-- Logs begin at Tue 2022-10-11 06:03:10 UTC, end at Tue 2022-10-11 07:28:56 UTC. -- Oct 11 06:33:11.407381 dv-cinder-854954-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 11 06:33:11.418359 dv-cinder-854954-3-iscsi devstack@n-api.service[110216]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 11 06:33:11.419643 dv-cinder-854954-3-iscsi devstack@n-api.service[110216]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 11 06:33:11 2022] *** Oct 11 06:33:11.419643 dv-cinder-854954-3-iscsi devstack@n-api.service[110216]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 11 06:33:11.419643 dv-cinder-854954-3-iscsi devstack@n-api.service[110216]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 11 06:33:11.419643 dv-cinder-854954-3-iscsi devstack@n-api.service[110216]: nodename: dv-cinder-854954-3-iscsi Oct 11 06:33:11.419643 dv-cinder-854954-3-iscsi devstack@n-api.service[110216]: machine: x86_64 Oct 11 06:33:11.419643 dv-cinder-854954-3-iscsi devstack@n-api.service[110216]: clock source: unix Oct 11 06:33:11.419643 dv-cinder-854954-3-iscsi devstack@n-api.service[110216]: pcre jit disabled Oct 11 06:33:11.419643 dv-cinder-854954-3-iscsi devstack@n-api.service[110216]: detected number of CPU cores: 4 Oct 11 06:33:11.419643 dv-cinder-854954-3-iscsi devstack@n-api.service[110216]: current working directory: / Oct 11 06:33:11.419643 dv-cinder-854954-3-iscsi devstack@n-api.service[110216]: detected binary path: /usr/bin/uwsgi-core Oct 11 06:33:11.419643 dv-cinder-854954-3-iscsi devstack@n-api.service[110216]: your processes number limit is 47680 Oct 11 06:33:11.419643 dv-cinder-854954-3-iscsi devstack@n-api.service[110216]: your memory page size is 4096 bytes Oct 11 06:33:11.419643 dv-cinder-854954-3-iscsi devstack@n-api.service[110216]: detected max file descriptor number: 2048 Oct 11 06:33:11.419643 dv-cinder-854954-3-iscsi devstack@n-api.service[110216]: lock engine: pthread robust mutexes Oct 11 06:33:11.419643 dv-cinder-854954-3-iscsi devstack@n-api.service[110216]: thunder lock: enabled Oct 11 06:33:11.419643 dv-cinder-854954-3-iscsi devstack@n-api.service[110216]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 11 06:33:11.419643 dv-cinder-854954-3-iscsi devstack@n-api.service[110216]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 11 06:33:11.458905 dv-cinder-854954-3-iscsi devstack@n-api.service[110216]: Python main interpreter initialized at 0x557b422979c0 Oct 11 06:33:11.458905 dv-cinder-854954-3-iscsi devstack@n-api.service[110216]: python threads support enabled Oct 11 06:33:11.458905 dv-cinder-854954-3-iscsi devstack@n-api.service[110216]: your server socket listen backlog is limited to 100 connections Oct 11 06:33:11.458905 dv-cinder-854954-3-iscsi devstack@n-api.service[110216]: your mercy for graceful operations on workers is 90 seconds Oct 11 06:33:11.459222 dv-cinder-854954-3-iscsi devstack@n-api.service[110216]: mapped 403077 bytes (393 KB) for 2 cores Oct 11 06:33:11.459321 dv-cinder-854954-3-iscsi devstack@n-api.service[110216]: *** Operational MODE: preforking *** Oct 11 06:33:11.459611 dv-cinder-854954-3-iscsi devstack@n-api.service[110216]: *** uWSGI is running in multiple interpreter mode *** Oct 11 06:33:11.459611 dv-cinder-854954-3-iscsi devstack@n-api.service[110216]: spawned uWSGI master process (pid: 110216) Oct 11 06:33:11.459806 dv-cinder-854954-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 11 06:33:11.462361 dv-cinder-854954-3-iscsi devstack@n-api.service[110216]: spawned uWSGI worker 1 (pid: 110217, cores: 1) Oct 11 06:33:11.462361 dv-cinder-854954-3-iscsi devstack@n-api.service[110216]: spawned uWSGI worker 2 (pid: 110218, cores: 1) Oct 11 06:33:11.462361 dv-cinder-854954-3-iscsi devstack@n-api.service[110216]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 11 06:33:12.113836 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 11 06:33:12.114440 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 11 06:33:13.190547 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 06:33:13.190547 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: from cryptography.utils import int_from_bytes Oct 11 06:33:13.191169 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 06:33:13.191169 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: from cryptography.utils import int_from_bytes Oct 11 06:33:13.191608 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 06:33:13.191608 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: from cryptography.utils import int_from_bytes Oct 11 06:33:13.192017 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 06:33:13.192017 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: from cryptography.utils import int_from_bytes Oct 11 06:33:15.652323 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 11 06:33:15.652968 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 11 06:33:15.653311 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 11 06:33:15.653396 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 11 06:33:15.653475 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 11 06:33:15.653561 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 11 06:33:15.653656 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 11 06:33:15.653736 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 11 06:33:15.653811 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 11 06:33:15.653893 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 11 06:33:15.654035 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.654275 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.654385 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.654588 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.654687 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.654904 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.654988 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.655218 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.655303 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.655570 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.655658 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.655881 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.656007 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.656199 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.656305 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.656517 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.656613 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.656770 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.656855 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.657083 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.657164 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.657394 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.657477 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854954-3-iscsi {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.657736 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.657826 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854954-3-iscsi {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.658019 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.658126 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.658324 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.658413 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.658631 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.658722 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.658931 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.659030 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.659234 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.659329 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.659562 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.659662 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.659867 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.660061 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.660374 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.660567 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.660680 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.660781 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.660968 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.661077 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.661289 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.661430 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.661604 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.662200 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.662442 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.662528 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.662752 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.662879 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.663070 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.663153 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.663377 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.663492 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.663727 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.663868 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.664032 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.664130 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854954-3-iscsi {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.664427 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.664515 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854954-3-iscsi {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.664737 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.664833 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.665041 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.665122 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.665348 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.665438 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.665742 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.665841 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.666047 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.666172 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.666352 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.666445 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.666671 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.666766 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.666973 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.667068 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.667282 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.667440 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.667631 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.667725 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.667946 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.668044 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.668264 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.668358 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.668563 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.668654 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.668861 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.668956 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.669164 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.669247 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.669468 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.669550 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.669774 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.669874 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.670066 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.670152 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.670314 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.670415 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.670599 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.670684 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.670902 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.670988 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.671220 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.671304 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.671556 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.671663 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.671805 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.671890 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.672052 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.672137 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.672344 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.672429 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.672659 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.672753 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.672965 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.673048 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.673267 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.673358 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.673568 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.673651 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.673869 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.673960 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.674171 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.674253 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.674470 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.674554 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.674769 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.674933 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.675068 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.675152 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.675372 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.675483 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.675704 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.675805 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.676016 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.676098 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.676317 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.676407 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.676623 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.676775 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.676939 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.677024 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.677247 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.677341 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.678093 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.678205 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.678399 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.678492 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.678735 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.678818 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.679038 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.679130 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.679341 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.679512 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.679682 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.679816 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.679986 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.680071 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.680288 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.680372 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.680596 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.680713 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.680901 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.681001 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.681218 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.681313 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.681516 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.681609 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.681762 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.681857 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.682058 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.682151 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.682354 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.682455 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.682659 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.682754 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.682960 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.683052 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.683262 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.683365 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.683587 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.683682 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.683885 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.683979 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.684183 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.684286 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.684483 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.684585 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.684785 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.684880 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.685084 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.685185 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.685383 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.685475 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.685682 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.685781 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.685978 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.686079 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.686278 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.686369 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.686577 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.686678 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.686877 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.686971 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.687177 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.687268 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.687514 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.687607 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.687818 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.687912 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.688120 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.688212 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.688419 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.688511 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.688718 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.688825 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.689020 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.689106 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.689320 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.689403 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.689622 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.689719 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.689925 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.690020 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.690227 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.690317 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.690527 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.690632 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.690830 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.690921 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.691130 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.691214 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.691445 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.691531 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.691757 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.691839 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.692053 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.692137 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.692355 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.692440 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.692656 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.692738 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.692975 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.693063 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.693279 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.693364 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.693579 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.693663 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.693880 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.693971 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.694179 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.694262 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.694477 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.694559 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.694774 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.694866 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.695073 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.695156 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.695365 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.695467 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.695688 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.695781 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.696003 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.696087 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.696306 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.696389 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.696608 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.696700 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.696908 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.696990 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.697210 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.697295 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.697525 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:33:15.697617 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.697851 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.697933 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.698178 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.698423 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.698517 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.698583 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.698811 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.698902 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.699138 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.699228 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.699471 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.699559 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.699781 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.699866 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.700091 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.700199 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.700400 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.700485 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.700705 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.700829 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.701013 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.701110 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.701317 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.701400 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.701628 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.701712 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.701938 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.702039 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.702248 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.702337 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.702566 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.702650 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.702879 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.702970 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.703192 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.703275 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.703520 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.703619 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.703831 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.703923 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.704147 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.704237 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.704463 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.704558 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.704770 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.704865 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.705076 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.705162 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.705413 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.705497 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.705730 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.705892 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.706052 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.706144 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.706367 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.706461 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.706678 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.706770 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.706985 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.707125 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.707292 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.707377 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.707637 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.707723 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.707953 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.708036 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.708263 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.708346 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.708594 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.708719 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.708909 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.708994 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.709219 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.709302 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.709525 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.709610 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.709832 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.709916 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.710145 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.710270 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.710451 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.710547 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.710756 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.710987 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.711076 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.711164 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.711382 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.711496 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.711718 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.711819 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.712030 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.712137 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.712340 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.712434 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.712648 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.712741 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.712953 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.713054 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.713260 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.713352 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.713565 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.713658 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.713867 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.713961 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.714168 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.714261 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.714474 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.714574 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.714763 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.714855 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.715059 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.715142 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.715359 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.715474 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.715712 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.715804 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.716015 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.716128 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.716326 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.716409 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.716628 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.716711 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.716934 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.717019 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.717239 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.717338 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.717544 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.717635 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.717843 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.717926 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.718143 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.718241 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.718450 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.718534 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.718750 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.718845 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.719049 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.719141 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.719360 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.719475 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.719688 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.719774 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.719989 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.720081 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.720297 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.720380 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.720600 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.720685 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.720939 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.721033 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.721208 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.721290 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.721515 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.721606 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.721821 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.721905 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.722129 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.722281 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.722421 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.722566 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.722737 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.722869 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.723042 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.723174 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.723345 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.723498 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.723710 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.723852 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.724013 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.724146 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.724852 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.725059 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.725193 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.725332 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.725463 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.725594 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.725756 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.725904 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.726062 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.726205 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.726345 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.726484 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.726646 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.726783 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.726946 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.727078 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.727246 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.727372 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.727567 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.727705 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.727867 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.727999 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.728169 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.728300 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.728474 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.728613 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.728775 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.728906 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.729074 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.729158 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.729384 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.729476 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.729684 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.729776 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.729982 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.730065 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.730293 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.730424 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.730576 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.730659 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.730908 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.730992 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.731211 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.731305 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.731571 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.731659 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.731888 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.731988 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.732207 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.732296 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.732511 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.732594 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.732821 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.732913 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.733126 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.733209 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.733429 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.733512 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.733734 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.733829 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.734039 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.734131 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.734341 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.734424 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.734645 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.734737 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.734949 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.735031 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.735253 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.735335 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.735582 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.735680 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.735888 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.735972 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.736197 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.736281 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.736495 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.736579 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.736799 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.736889 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.737111 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.737203 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.737446 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.737536 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.737756 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.737841 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.738071 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.738153 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.738375 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.738459 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.738684 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.738767 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.738989 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.739073 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.739294 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.739378 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.739621 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.739705 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.740494 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.740604 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.740814 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.740902 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.741119 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.741219 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.741435 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.741541 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.741740 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.741825 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.742051 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.742134 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.742352 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.742444 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.742666 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.742758 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.742966 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.743051 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.743268 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.743360 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.743625 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.743712 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.743953 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.744037 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.744258 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.744362 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.744568 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.744653 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.744879 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.744973 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.745184 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.745276 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.745490 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.745574 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.745796 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.745878 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.746097 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.746190 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.746397 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.746481 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.746699 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.746785 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.747006 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.747092 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.747309 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.747392 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.747640 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.747727 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.747940 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.748025 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.748238 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.748322 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.748549 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.748641 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.748852 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.748935 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.749153 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.749254 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.749453 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.749545 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.749762 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.749849 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.750068 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.750152 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.750373 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.750465 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.750693 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.750778 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.750992 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.751075 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.751292 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.751386 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.751616 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.751703 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.751929 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.752013 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.752231 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.752316 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.752531 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.752624 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.752829 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.752912 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.753128 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.753222 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.753462 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.753545 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.753763 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.753855 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.754069 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.754155 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.754385 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.754470 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.754689 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.754772 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.755000 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.755086 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.755308 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.755394 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.755660 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.755765 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.755969 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.756052 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.756276 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.756368 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.756585 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.756679 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.756891 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.756982 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.757196 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.757288 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.757500 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.757593 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.757804 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.757887 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.758109 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.758192 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.758415 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.758507 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.758722 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.758805 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.759025 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.759170 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.759328 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.759445 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.759652 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.759735 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.759958 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.760042 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.760274 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.760516 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.760832 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.760924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.761145 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.761229 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.761461 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.761547 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.761775 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.761860 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.762099 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.762192 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.762423 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.762519 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.762744 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.762835 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.763055 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.763140 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.763356 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.763461 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.763685 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.763771 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.763985 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.764068 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.764285 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.764369 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.764586 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.764677 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.764883 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.764966 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.765183 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.765267 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.765481 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.765565 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.765781 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.765864 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.766078 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.766170 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.766376 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.766459 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.766673 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.766763 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.766971 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.767064 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.767272 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.767355 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.767594 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.767681 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.767899 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.767995 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.768199 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.768282 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.768498 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.768581 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.768819 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.768912 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.769121 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.769206 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.769418 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.769501 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.769715 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.769799 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.770012 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.770094 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.770341 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.770423 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.770641 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.770731 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.770978 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.771093 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.771328 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.771432 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.771652 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.771737 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.771954 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.772038 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.772273 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.772365 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.772572 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.772694 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.772872 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.772957 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.773168 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.773262 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.773470 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.773554 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.773770 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.773853 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.774068 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.774161 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.774364 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.774447 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.774665 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.774756 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.774968 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.775070 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.775268 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.775351 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.775587 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.775676 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.775887 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.775980 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.776183 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.776266 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.776482 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.776564 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.777043 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.777128 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.777344 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.777428 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.777642 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.777733 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.778343 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.778450 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.778450 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.778601 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.778679 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.778755 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.778840 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.778919 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.779106 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.779193 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.779434 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.779538 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.779732 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.779819 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.780030 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.780123 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.780329 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.780431 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.780627 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.780711 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.780929 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.781017 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.781228 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.781323 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.781525 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.781609 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.781838 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.781921 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.782137 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.782231 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.782435 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.782518 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.782736 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.782821 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.783031 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.783123 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.783329 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.783444 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.783654 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.783738 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.783962 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.784056 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.784269 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.784353 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.784568 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.784654 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.784872 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.784957 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.785168 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.785252 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.785467 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.785552 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.785762 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.785847 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.786060 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.786144 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.786356 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.786439 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.786653 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.787281 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.787494 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.787582 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.787798 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.787891 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.788096 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.788179 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.788395 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.788478 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.788704 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.788801 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.789009 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.789092 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.789307 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.789392 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.789606 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.789709 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.789902 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.789985 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.790230 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.790313 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.790531 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.790623 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.790870 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.790954 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.791179 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.791271 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.791522 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.791609 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.791831 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.791973 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.792137 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.792221 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.792443 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.792527 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.792744 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.792837 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.793045 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.793136 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.793349 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.793433 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.793652 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.793735 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.793950 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.794033 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.794248 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.794332 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.794554 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.794638 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.794857 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.794940 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.795162 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.795255 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.795493 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.795581 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.795815 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.795912 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.796133 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.796216 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.796434 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.796520 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.796738 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.796830 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.797043 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.797126 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.797347 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.797432 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.797651 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.797743 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.797955 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.798039 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.798261 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.798343 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.798565 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.798656 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.798871 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.798954 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.799177 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.799261 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.799511 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.799609 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.799813 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.799897 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.800113 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.800196 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.800417 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.800501 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.800716 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.800800 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.801014 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.801099 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.801328 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.801420 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.801626 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.801711 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.801925 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.802060 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.802222 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.802357 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.803059 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.803153 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.803358 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.803503 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.803686 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.803802 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.804105 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.804226 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.804409 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.804502 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.804710 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.804795 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.805011 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.805094 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.805315 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.805409 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.805618 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.805708 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.805925 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.806008 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.806225 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.806359 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.806524 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.806642 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.806935 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.807079 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.807235 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.807316 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.807563 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.807662 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.807869 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.807954 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.808169 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.808255 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.808476 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.808569 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.808781 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.808864 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.809092 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.809176 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.809392 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.809474 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.809689 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.809772 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.809987 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.810070 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.810293 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.810382 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.810596 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.810697 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.810912 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.810997 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.811303 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.811386 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.811630 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.811725 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.811933 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.812041 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.812342 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.812427 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.812647 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.812739 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.812952 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.813048 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.813270 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.813362 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.813585 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.813668 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.813885 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.813977 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.814195 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.814285 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.814511 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.814612 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.814809 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.814907 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.815127 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.815210 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.815451 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.815539 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.815762 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.815854 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.816060 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.816182 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.816359 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.816444 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.816679 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.816765 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.816982 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.817066 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.817292 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.817374 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.817609 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.817696 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.818028 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.818120 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.818335 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.818420 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.818640 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.818725 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.818961 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.819047 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.819260 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.819352 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.819584 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.819683 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.819890 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.819984 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.820191 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.820288 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.820489 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.820580 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.820790 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.820875 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.821094 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.821188 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.821402 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.821486 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.821707 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.821791 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.822013 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.822105 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.822311 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.822397 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.822610 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.822700 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.822913 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.822999 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.823216 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.823307 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.823551 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.823637 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.823862 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.823946 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.824173 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.824257 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.824486 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.824570 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.824788 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.824884 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.825096 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.825179 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.825400 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.825483 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.825700 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.825798 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.826000 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.826083 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.826299 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.826392 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.826597 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.826690 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.826927 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.827011 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.827229 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.827320 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.827573 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.827660 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.827900 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.827986 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.828207 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.828300 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.828521 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.828605 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.828843 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.828927 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.829162 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.829253 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.829466 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.829551 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.829777 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.829913 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.830092 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.830179 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.830390 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.830473 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.830690 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.830775 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.830994 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.831079 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.831290 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.831373 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.831615 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.831703 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.831916 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.832003 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.832216 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.832335 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.832515 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.832608 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.832812 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.832896 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.833112 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.833196 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.833412 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.833513 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.833748 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.833888 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.834050 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.834134 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.834359 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.834451 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.834660 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.834746 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.834961 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.835052 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.835256 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.835348 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.835579 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.835665 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.835906 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.835991 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.836212 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.836297 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.836520 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.836603 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.836831 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.836915 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.837143 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.837227 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.837454 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.837537 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.837763 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.837853 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.838073 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.838157 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.838380 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.838464 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.838689 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.838782 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.838999 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.839083 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.839303 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.839387 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.839637 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.839723 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.839948 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.840035 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.840259 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.840351 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.840595 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.840768 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.841093 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.841183 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.841406 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.841499 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.841716 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.841819 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.842026 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.842118 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.842334 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.842468 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.842644 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.842736 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.842949 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.843033 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.843257 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.843343 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.843588 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.843681 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.843895 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.843980 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.844203 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.844288 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.844523 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.844615 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.844841 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.844925 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.845167 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.845253 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.845478 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.845563 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.845790 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.845876 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.846100 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.846259 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.846408 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.846500 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.846720 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.846805 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.847053 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.847150 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.847357 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.847491 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.847689 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.847773 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.847999 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.848091 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.848310 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.848401 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.848615 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.848700 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.848920 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.849004 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.849744 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.849838 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.850053 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.850137 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.850361 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.850446 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.850664 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.850748 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.850970 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.851066 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.851275 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.851358 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.851610 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.851732 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.851933 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.852070 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.852248 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.852333 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.852557 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.852642 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.852867 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.852959 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.853175 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.853259 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.853484 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.853689 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.853997 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.854082 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.854309 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.854392 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.854635 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.854730 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.854953 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.855039 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.855263 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.855348 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.855600 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.855688 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.855918 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.856003 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.856218 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.856302 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.856521 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.856614 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.856829 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.856914 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.857135 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.857220 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.857437 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.857530 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.857736 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.857821 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.858051 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.858134 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.858352 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.858445 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.858651 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.858748 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.858962 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.859046 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.859268 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.859520 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.859821 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.859907 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.860168 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.860286 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.860481 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.860578 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.860801 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.860896 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.861115 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.861210 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.861419 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.861514 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.861723 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.861830 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.862057 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.862152 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.862334 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.862428 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.862638 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.862733 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.862944 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.863028 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.863247 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.863335 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.863573 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.863678 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.863874 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.863970 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.864179 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.864264 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.864481 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.864566 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.864783 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.864915 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.865635 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.865720 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.865962 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.866047 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.866268 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.866367 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.866572 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.866657 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.866873 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.866964 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.867178 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.867272 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.867500 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.867589 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.867803 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.867887 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.868106 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.868191 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.868407 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.868491 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.868710 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.868794 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.869008 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.869093 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.869312 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.869396 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.869618 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.869702 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.869919 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.870004 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.870229 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.870314 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.870561 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.870644 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.870865 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.870951 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.871165 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.871249 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.871513 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.871616 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.871816 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.871958 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.872119 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.872204 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.872431 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.872530 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.872741 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.872831 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.873047 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.873142 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.873355 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.873449 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.873661 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.873787 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.873995 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.874079 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.874305 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.874523 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.874834 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.874920 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.875158 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.875249 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.875499 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.875588 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.875829 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.875914 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.876134 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.876218 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.876438 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.876533 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.876738 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.876822 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.877041 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.877125 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.877353 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.877438 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.877659 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.877743 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.877963 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.878046 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.878268 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.878352 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.878571 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.878655 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.878876 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.878968 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.879179 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.879262 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.879504 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.879591 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.879811 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.879905 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.880115 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.880199 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.880433 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.880521 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.880771 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.880865 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.881079 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.881163 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.881385 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.881469 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.881690 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.881781 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.882001 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.882094 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.882327 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.882411 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.882640 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.882725 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.882953 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.883040 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.883264 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.883348 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.883593 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.883680 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.883902 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.883997 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.884209 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.884304 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.884513 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.884605 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.884820 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.884905 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.885133 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.885227 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.885442 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.885533 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.885746 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.885831 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.886052 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.886397 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.886704 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.886790 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.887070 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.887167 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.887339 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.887475 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.887674 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.887760 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.887993 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.888079 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.888313 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.888401 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.888622 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.888708 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.888938 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.889022 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.889244 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.889338 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.889557 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.889641 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.889887 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.889981 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.890212 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.890297 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.890534 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.890620 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.890836 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.890931 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.891139 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.891224 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.891459 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.891548 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.891768 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.891864 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.892077 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.892163 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.892385 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.892469 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.892687 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.892781 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.892987 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.893081 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.893286 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.893370 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.893585 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.893670 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.893884 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.893968 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.894180 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.894263 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.894481 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.894567 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.894784 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.894868 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.895086 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.895171 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.895389 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.895489 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.895712 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.895797 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.896015 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.896127 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.896344 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.896430 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.896643 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.896731 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.896941 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.897034 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.897238 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.897357 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.897540 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.897628 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.897839 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.897934 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.898140 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.898231 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.898437 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.898521 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.898738 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.898830 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.899067 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.899152 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.899381 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.899484 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.899724 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.899825 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.900035 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.900120 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.900343 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.900426 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.900651 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.900735 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.900962 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.901045 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.901278 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.901362 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.901834 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.901934 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.902150 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.902235 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.902458 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.902542 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.902776 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.902861 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.903086 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.903169 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.903393 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.903515 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.903728 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.903812 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.904033 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.904289 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.904383 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.904473 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.904637 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.904722 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.904961 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.905047 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.905266 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.905429 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.905581 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.905668 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.905891 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.905984 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.906248 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.906382 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.906521 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.906645 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.906828 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.906926 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.907135 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.907220 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.907557 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.907647 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.907773 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.907872 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.908083 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.908169 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.908386 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.908470 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.908691 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.908790 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.908998 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.909083 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.909301 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.909385 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.909607 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.909699 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.909915 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.910000 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.910228 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.910311 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.910546 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.910639 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.910864 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.910958 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.911169 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.911262 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.911500 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.911600 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.912373 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.912473 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.912701 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.912788 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.913013 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.913097 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.913345 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.913429 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.913669 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.913760 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.913980 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.914072 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.914290 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.914473 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.914612 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.914700 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.914817 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 11 06:33:15.914905 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:33:15.915112 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 11 06:33:16.066309 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO dbcounter [None req-38eb17b4-d126-4d2a-bb5f-a082b8763e94 None None] Registered counter for database nova_api Oct 11 06:33:16.066751 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO dbcounter [None req-1d425604-6efb-4e53-b7f0-878d11fffbad None None] Registered counter for database nova_api Oct 11 06:33:16.086947 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG oslo_db.sqlalchemy.engines [None req-1d425604-6efb-4e53-b7f0-878d11fffbad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110218) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 06:33:16.089870 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG oslo_db.sqlalchemy.engines [None req-38eb17b4-d126-4d2a-bb5f-a082b8763e94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110217) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 06:33:16.093812 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG dbcounter [-] [110218] Writer thread running {{(pid=110218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 06:33:16.096347 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG dbcounter [-] [110217] Writer thread running {{(pid=110217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 06:33:16.150407 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.context [None req-1d425604-6efb-4e53-b7f0-878d11fffbad None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e62ab37f-4106-4036-9988-c6129f938802(cell1) {{(pid=110218) load_cells /opt/stack/nova/nova/context.py:464}} Oct 11 06:33:16.152545 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.context [None req-38eb17b4-d126-4d2a-bb5f-a082b8763e94 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e62ab37f-4106-4036-9988-c6129f938802(cell1) {{(pid=110217) load_cells /opt/stack/nova/nova/context.py:464}} Oct 11 06:33:16.154542 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG oslo_concurrency.lockutils [None req-1d425604-6efb-4e53-b7f0-878d11fffbad None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:33:16.155013 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG oslo_concurrency.lockutils [None req-1d425604-6efb-4e53-b7f0-878d11fffbad None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:33:16.156442 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG oslo_concurrency.lockutils [None req-38eb17b4-d126-4d2a-bb5f-a082b8763e94 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:33:16.156613 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG oslo_concurrency.lockutils [None req-1d425604-6efb-4e53-b7f0-878d11fffbad None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:33:16.156856 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG oslo_concurrency.lockutils [None req-38eb17b4-d126-4d2a-bb5f-a082b8763e94 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:33:16.157334 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG oslo_concurrency.lockutils [None req-1d425604-6efb-4e53-b7f0-878d11fffbad None None] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:33:16.157788 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG oslo_concurrency.lockutils [None req-1d425604-6efb-4e53-b7f0-878d11fffbad None None] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:33:16.158469 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG oslo_concurrency.lockutils [None req-38eb17b4-d126-4d2a-bb5f-a082b8763e94 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:33:16.159183 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG oslo_concurrency.lockutils [None req-38eb17b4-d126-4d2a-bb5f-a082b8763e94 None None] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:33:16.159642 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG oslo_concurrency.lockutils [None req-38eb17b4-d126-4d2a-bb5f-a082b8763e94 None None] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:33:16.159782 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG oslo_concurrency.lockutils [None req-1d425604-6efb-4e53-b7f0-878d11fffbad None None] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:33:16.161595 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG oslo_concurrency.lockutils [None req-38eb17b4-d126-4d2a-bb5f-a082b8763e94 None None] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:33:16.161787 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO dbcounter [None req-1d425604-6efb-4e53-b7f0-878d11fffbad None None] Registered counter for database nova_cell0 Oct 11 06:33:16.164196 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO dbcounter [None req-38eb17b4-d126-4d2a-bb5f-a082b8763e94 None None] Registered counter for database nova_cell0 Oct 11 06:33:16.166264 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO dbcounter [None req-1d425604-6efb-4e53-b7f0-878d11fffbad None None] Registered counter for database nova_cell1 Oct 11 06:33:16.168192 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO dbcounter [None req-38eb17b4-d126-4d2a-bb5f-a082b8763e94 None None] Registered counter for database nova_cell1 Oct 11 06:33:16.174002 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG oslo_db.sqlalchemy.engines [None req-1d425604-6efb-4e53-b7f0-878d11fffbad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110218) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 06:33:16.176902 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG oslo_db.sqlalchemy.engines [None req-1d425604-6efb-4e53-b7f0-878d11fffbad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110218) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 06:33:16.179859 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG oslo_db.sqlalchemy.engines [None req-38eb17b4-d126-4d2a-bb5f-a082b8763e94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110217) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 06:33:16.180668 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG oslo_db.sqlalchemy.engines [None req-38eb17b4-d126-4d2a-bb5f-a082b8763e94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110217) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 06:33:16.184797 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG dbcounter [-] [110218] Writer thread running {{(pid=110218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 06:33:16.187580 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG dbcounter [-] [110217] Writer thread running {{(pid=110217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 06:33:16.188040 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG dbcounter [-] [110218] Writer thread running {{(pid=110218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 06:33:16.189052 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG dbcounter [-] [110217] Writer thread running {{(pid=110217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 06:33:16.332524 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO dbcounter [None req-1d425604-6efb-4e53-b7f0-878d11fffbad None None] Registered counter for database nova_cell0 Oct 11 06:33:16.334234 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO dbcounter [None req-38eb17b4-d126-4d2a-bb5f-a082b8763e94 None None] Registered counter for database nova_cell0 Oct 11 06:33:16.341835 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG oslo_db.sqlalchemy.engines [None req-1d425604-6efb-4e53-b7f0-878d11fffbad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110218) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 06:33:16.345345 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG oslo_db.sqlalchemy.engines [None req-38eb17b4-d126-4d2a-bb5f-a082b8763e94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110217) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 06:33:16.346579 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG dbcounter [-] [110218] Writer thread running {{(pid=110218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 06:33:16.350132 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG dbcounter [-] [110217] Writer thread running {{(pid=110217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 06:33:16.679814 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: WARNING keystonemiddleware.auth_token [None req-38eb17b4-d126-4d2a-bb5f-a082b8763e94 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 06:33:16.684454 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: WARNING keystonemiddleware.auth_token [None req-1d425604-6efb-4e53-b7f0-878d11fffbad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 06:33:16.687039 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: WARNING keystonemiddleware.auth_token [None req-38eb17b4-d126-4d2a-bb5f-a082b8763e94 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 06:33:16.691649 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: WARNING keystonemiddleware.auth_token [None req-1d425604-6efb-4e53-b7f0-878d11fffbad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 06:33:17.024380 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: WARNING keystonemiddleware.auth_token [None req-38eb17b4-d126-4d2a-bb5f-a082b8763e94 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 06:33:17.030481 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: WARNING keystonemiddleware.auth_token [None req-38eb17b4-d126-4d2a-bb5f-a082b8763e94 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 06:33:17.031912 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: WARNING keystonemiddleware.auth_token [None req-1d425604-6efb-4e53-b7f0-878d11fffbad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 06:33:17.035738 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557b422979c0 pid: 110217 (default app) Oct 11 06:33:17.037782 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: WARNING keystonemiddleware.auth_token [None req-1d425604-6efb-4e53-b7f0-878d11fffbad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 06:33:17.037912 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-38eb17b4-d126-4d2a-bb5f-a082b8763e94 None None] Calling method '>' {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:33:17.039092 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-38eb17b4-d126-4d2a-bb5f-a082b8763e94 None None] 10.222.0.39 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001832 Oct 11 06:33:17.039521 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 788 bytes} [Tue Oct 11 06:33:17 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:33:17.043726 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557b422979c0 pid: 110218 (default app) Oct 11 06:34:37.898908 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-38eb17b4-d126-4d2a-bb5f-a082b8763e94 None None] Calling method '>' {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:34:37.899933 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-38eb17b4-d126-4d2a-bb5f-a082b8763e94 None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Oct 11 06:34:37.900473 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 2/2] 10.222.0.39 () {54 vars in 931 bytes} [Tue Oct 11 06:34:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:34:37.916819 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG dbcounter [-] [110218] Writing DB stats nova_api:SELECT=3 {{(pid=110218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:37.917992 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG dbcounter [-] [110218] Writing DB stats nova_cell0:SELECT=3 {{(pid=110218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:37.918886 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG dbcounter [-] [110218] Writing DB stats nova_cell1:SELECT=3 {{(pid=110218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:37.919957 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG dbcounter [-] [110218] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:38.798137 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-14a5a835-b4a4-4362-96cb-5d849c537d00 admin admin] Calling method '>' {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:34:38.830812 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-14a5a835-b4a4-4362-96cb-5d849c537d00 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.922242 Oct 11 06:34:38.831703 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 1/3] 10.222.0.39 () {60 vars in 1292 bytes} [Tue Oct 11 06:34:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:34:41.410326 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-38eb17b4-d126-4d2a-bb5f-a082b8763e94 None None] Calling method '>' {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:34:41.412882 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-38eb17b4-d126-4d2a-bb5f-a082b8763e94 None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.005964 Oct 11 06:34:41.416676 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 3/4] 10.222.0.39 () {54 vars in 931 bytes} [Tue Oct 11 06:34:41 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:34:41.852963 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-dcd326f8-c63d-4037-8ae6-1bd0a781b8cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 256, "vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "swap": 0, "id": "c1"}} {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:34:41.901518 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-dcd326f8-c63d-4037-8ae6-1bd0a781b8cc admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.481310 Oct 11 06:34:41.902252 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 2/5] 10.222.0.39 () {64 vars in 1283 bytes} [Tue Oct 11 06:34:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:34:41.916354 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG dbcounter [-] [110217] Writing DB stats nova_api:SELECT=3 {{(pid=110217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:41.917174 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG dbcounter [-] [110217] Writing DB stats nova_cell0:SELECT=3 {{(pid=110217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:41.921135 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG dbcounter [-] [110217] Writing DB stats nova_cell1:SELECT=3 {{(pid=110217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:41.921845 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG dbcounter [-] [110217] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:42.125624 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-11252b52-41d9-4d09-a025-149690a25537 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:34:42.196127 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-11252b52-41d9-4d09-a025-149690a25537 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284917 Oct 11 06:34:42.196710 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 4/6] 10.222.0.39 () {64 vars in 1336 bytes} [Tue Oct 11 06:34:41 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:34:44.812880 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-dcd326f8-c63d-4037-8ae6-1bd0a781b8cc admin admin] Calling method '>' {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:34:44.813821 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-dcd326f8-c63d-4037-8ae6-1bd0a781b8cc admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Oct 11 06:34:44.814494 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 3/7] 10.222.0.39 () {54 vars in 931 bytes} [Tue Oct 11 06:34:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:34:45.462115 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-7ab62d79-ffff-417e-bb68-bfc887ad3c94 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "ram": 512, "disk": 5, "id": "d1", "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:34:45.502438 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-7ab62d79-ffff-417e-bb68-bfc887ad3c94 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.681841 Oct 11 06:34:45.503560 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 5/8] 10.222.0.39 () {64 vars in 1283 bytes} [Tue Oct 11 06:34:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:34:45.515484 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-beaa59ce-4c85-4e7f-ae45-4f17975af322 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:34:45.556205 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-beaa59ce-4c85-4e7f-ae45-4f17975af322 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044490 Oct 11 06:34:45.556881 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 4/9] 10.222.0.39 () {64 vars in 1336 bytes} [Tue Oct 11 06:34:45 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:34:48.124929 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-7ab62d79-ffff-417e-bb68-bfc887ad3c94 admin admin] Calling method '>' {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:34:48.125936 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-7ab62d79-ffff-417e-bb68-bfc887ad3c94 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Oct 11 06:34:48.126340 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 6/10] 10.222.0.39 () {54 vars in 931 bytes} [Tue Oct 11 06:34:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:34:48.548475 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-12d86aeb-bc91-4374-8cb3-a16e20ad090e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds1G", "vcpus": 1, "disk": 10, "ram": 1024, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:34:48.570257 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-12d86aeb-bc91-4374-8cb3-a16e20ad090e admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.437602 Oct 11 06:34:48.570803 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 5/11] 10.222.0.39 () {64 vars in 1283 bytes} [Tue Oct 11 06:34:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 06:34:48.582799 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-780413e8-5bef-43e7-820a-604ab1ee5fdf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:34:48.611156 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-780413e8-5bef-43e7-820a-604ab1ee5fdf admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031900 Oct 11 06:34:48.611805 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 7/12] 10.222.0.39 () {64 vars in 1336 bytes} [Tue Oct 11 06:34:48 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:34:51.220071 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-12d86aeb-bc91-4374-8cb3-a16e20ad090e admin admin] Calling method '>' {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:34:51.220992 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-12d86aeb-bc91-4374-8cb3-a16e20ad090e admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 11 06:34:51.221385 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 6/13] 10.222.0.39 () {54 vars in 931 bytes} [Tue Oct 11 06:34:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:34:51.637075 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-c1ef61b2-77d6-49f0-a4c0-79e7f5fb7606 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "os-flavor-access:is_public": true, "id": "d3", "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 10, "vcpus": 2}} {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:34:51.658150 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-c1ef61b2-77d6-49f0-a4c0-79e7f5fb7606 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.430836 Oct 11 06:34:51.658908 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 8/14] 10.222.0.39 () {64 vars in 1283 bytes} [Tue Oct 11 06:34:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:34:51.671008 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-2fba2242-7323-4a55-9494-d5c7cf6caeda admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:34:51.696801 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-2fba2242-7323-4a55-9494-d5c7cf6caeda admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029386 Oct 11 06:34:51.702807 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 7/15] 10.222.0.39 () {64 vars in 1336 bytes} [Tue Oct 11 06:34:51 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:34:54.350486 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-c1ef61b2-77d6-49f0-a4c0-79e7f5fb7606 admin admin] Calling method '>' {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:34:54.351534 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-c1ef61b2-77d6-49f0-a4c0-79e7f5fb7606 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Oct 11 06:34:54.351935 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 9/16] 10.222.0.39 () {54 vars in 931 bytes} [Tue Oct 11 06:34:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:34:54.759644 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-fc2370e7-3e94-4a94-b413-9bf16cfb5f19 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "disk": 20, "swap": 0, "vcpus": 4, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d4"}} {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:34:54.778189 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-fc2370e7-3e94-4a94-b413-9bf16cfb5f19 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.419344 Oct 11 06:34:54.778737 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 8/17] 10.222.0.39 () {64 vars in 1283 bytes} [Tue Oct 11 06:34:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:34:54.790978 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-731d084f-8714-4d4e-9392-e706b95995a4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:34:54.816079 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-731d084f-8714-4d4e-9392-e706b95995a4 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028745 Oct 11 06:34:54.816644 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 10/18] 10.222.0.39 () {64 vars in 1336 bytes} [Tue Oct 11 06:34:54 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:34:57.379459 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-fc2370e7-3e94-4a94-b413-9bf16cfb5f19 admin admin] Calling method '>' {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:34:57.382075 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-fc2370e7-3e94-4a94-b413-9bf16cfb5f19 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002703 Oct 11 06:34:57.382827 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 9/19] 10.222.0.39 () {54 vars in 931 bytes} [Tue Oct 11 06:34:57 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:34:57.812230 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-d834db9f-3655-480d-bb9d-c087a8406fb6 admin admin] Calling method '>' {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:34:57.836784 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-d834db9f-3655-480d-bb9d-c087a8406fb6 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.446998 Oct 11 06:34:57.837330 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 11/20] 10.222.0.39 () {60 vars in 1292 bytes} [Tue Oct 11 06:34:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:35:00.427920 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-fc2370e7-3e94-4a94-b413-9bf16cfb5f19 admin admin] Calling method '>' {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:35:00.428930 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-fc2370e7-3e94-4a94-b413-9bf16cfb5f19 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Oct 11 06:35:00.429365 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 10/21] 10.222.0.39 () {54 vars in 931 bytes} [Tue Oct 11 06:35:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:35:00.841772 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-e2d43f69-c88d-42a5-b405-cc7f5c63cfe3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "vcpus": 1, "swap": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "disk": 1, "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:35:00.862857 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-e2d43f69-c88d-42a5-b405-cc7f5c63cfe3 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.426776 Oct 11 06:35:00.863397 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 12/22] 10.222.0.39 () {64 vars in 1283 bytes} [Tue Oct 11 06:35:00 2022] POST /compute/v2.1/flavors => generated 402 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 06:35:00.875890 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-f73b818e-2c2c-4fb9-b633-53f108d5901a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:35:00.902611 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-f73b818e-2c2c-4fb9-b633-53f108d5901a admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030959 Oct 11 06:35:00.903181 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 11/23] 10.222.0.39 () {64 vars in 1333 bytes} [Tue Oct 11 06:35:00 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:35:03.491223 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-e2d43f69-c88d-42a5-b405-cc7f5c63cfe3 admin admin] Calling method '>' {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:35:03.492241 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-e2d43f69-c88d-42a5-b405-cc7f5c63cfe3 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Oct 11 06:35:03.492629 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 13/24] 10.222.0.39 () {54 vars in 931 bytes} [Tue Oct 11 06:35:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:35:03.894955 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-2c3e9b93-871f-4027-a428-6cc48a36c72b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048, "id": "2", "name": "m1.small"}} {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:35:03.914219 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-2c3e9b93-871f-4027-a428-6cc48a36c72b admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.415302 Oct 11 06:35:03.914989 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 12/25] 10.222.0.39 () {64 vars in 1283 bytes} [Tue Oct 11 06:35:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 06:35:03.926836 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-88f72ad8-4a41-44b3-9d34-93d424e15ff3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:35:03.949731 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-88f72ad8-4a41-44b3-9d34-93d424e15ff3 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026663 Oct 11 06:35:03.950794 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 14/26] 10.222.0.39 () {64 vars in 1333 bytes} [Tue Oct 11 06:35:03 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:35:06.568805 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-2c3e9b93-871f-4027-a428-6cc48a36c72b admin admin] Calling method '>' {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:35:06.570440 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-2c3e9b93-871f-4027-a428-6cc48a36c72b admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002105 Oct 11 06:35:06.571027 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 13/27] 10.222.0.39 () {54 vars in 931 bytes} [Tue Oct 11 06:35:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:35:07.013738 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-5833c2b6-ae97-4a30-a731-7621fc3a5d1c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "rxtx_factor": 1.0, "disk": 40, "ram": 4096, "name": "m1.medium", "os-flavor-access:is_public": true, "id": "3", "swap": 0}} {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:35:07.038556 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-5833c2b6-ae97-4a30-a731-7621fc3a5d1c admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.461468 Oct 11 06:35:07.039263 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 15/28] 10.222.0.39 () {64 vars in 1283 bytes} [Tue Oct 11 06:35:06 2022] POST /compute/v2.1/flavors => generated 406 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:35:07.050943 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-e569c167-7094-40fa-9e57-29b66529df83 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:35:07.081511 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-e569c167-7094-40fa-9e57-29b66529df83 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034177 Oct 11 06:35:07.082195 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 14/29] 10.222.0.39 () {64 vars in 1333 bytes} [Tue Oct 11 06:35:07 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:35:09.706620 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-5833c2b6-ae97-4a30-a731-7621fc3a5d1c admin admin] Calling method '>' {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:35:09.707575 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-5833c2b6-ae97-4a30-a731-7621fc3a5d1c admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Oct 11 06:35:09.712216 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 16/30] 10.222.0.39 () {54 vars in 931 bytes} [Tue Oct 11 06:35:09 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:35:10.143170 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-95230450-fa96-4cec-8a19-fa381ed85ab8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "rxtx_factor": 1.0, "ram": 8192, "name": "m1.large", "id": "4", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:35:10.154904 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG dbcounter [-] [110218] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:10.257405 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-95230450-fa96-4cec-8a19-fa381ed85ab8 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.539223 Oct 11 06:35:10.257405 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 15/31] 10.222.0.39 () {64 vars in 1283 bytes} [Tue Oct 11 06:35:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 06:35:10.266498 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-ac542e9f-ab88-4334-97c6-40e0afa1bcc3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:35:10.291300 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-ac542e9f-ab88-4334-97c6-40e0afa1bcc3 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028834 Oct 11 06:35:10.291891 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 17/32] 10.222.0.39 () {64 vars in 1333 bytes} [Tue Oct 11 06:35:10 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:35:12.909696 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-95230450-fa96-4cec-8a19-fa381ed85ab8 admin admin] Calling method '>' {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:35:12.910628 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-95230450-fa96-4cec-8a19-fa381ed85ab8 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Oct 11 06:35:12.911034 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 16/33] 10.222.0.39 () {54 vars in 931 bytes} [Tue Oct 11 06:35:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:35:13.350024 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-b17bd5da-f92b-445c-ac43-0d1d5add16e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "disk": 160, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "rxtx_factor": 1.0, "id": "5", "os-flavor-access:is_public": true, "name": "m1.xlarge"}} {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:35:13.364292 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG dbcounter [-] [110217] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=110217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:13.375975 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-b17bd5da-f92b-445c-ac43-0d1d5add16e8 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.458723 Oct 11 06:35:13.377081 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 18/34] 10.222.0.39 () {64 vars in 1283 bytes} [Tue Oct 11 06:35:12 2022] POST /compute/v2.1/flavors => generated 408 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:35:13.391802 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-b5f5d386-2884-4cc1-8b55-9b682d5aa7b1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:35:13.422716 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-b5f5d386-2884-4cc1-8b55-9b682d5aa7b1 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037560 Oct 11 06:35:13.423296 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 17/35] 10.222.0.39 () {64 vars in 1333 bytes} [Tue Oct 11 06:35:13 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:35:30.492440 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-b17bd5da-f92b-445c-ac43-0d1d5add16e8 admin admin] Calling method '>' {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:35:30.493438 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-b17bd5da-f92b-445c-ac43-0d1d5add16e8 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Oct 11 06:35:30.493902 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 19/36] 10.222.0.39 () {54 vars in 931 bytes} [Tue Oct 11 06:35:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:35:30.505023 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG dbcounter [-] [110218] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=110218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:30.879213 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-01bdb1fb-6251-4a6c-bdaa-42a18a18e941 admin admin] Calling method '>' {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:35:30.897366 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-01bdb1fb-6251-4a6c-bdaa-42a18a18e941 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.396784 Oct 11 06:35:30.897956 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 18/37] 10.222.0.39 () {60 vars in 1292 bytes} [Tue Oct 11 06:35:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:35:32.186844 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-b17bd5da-f92b-445c-ac43-0d1d5add16e8 admin admin] Calling method '>' {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:35:32.187901 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-b17bd5da-f92b-445c-ac43-0d1d5add16e8 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Oct 11 06:35:32.188289 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 20/38] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Oct 11 06:35:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:35:32.699845 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-ecd42d1f-c078-4757-ad10-cb2b690daf3e admin admin] Calling method '>' {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:35:32.705315 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.wsgi [None req-ecd42d1f-c078-4757-ad10-cb2b690daf3e admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 11 06:35:32.708691 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-ecd42d1f-c078-4757-ad10-cb2b690daf3e admin admin] Request method failure captured: Oct 11 06:35:32.708691 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 11 06:35:32.708691 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: Accept: application/json Oct 11 06:35:32.708691 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: Accept-Encoding: gzip, deflate Oct 11 06:35:32.708691 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: Connection: keep-alive Oct 11 06:35:32.708691 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: Content-Length: 0 Oct 11 06:35:32.708691 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: Host: 10.222.0.39 Oct 11 06:35:32.708691 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: Openstack-Api-Version: compute 2.92 Oct 11 06:35:32.708691 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: Openstack-System-Scope: None Oct 11 06:35:32.708691 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: User-Agent: python-novaclient Oct 11 06:35:32.708691 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Auth-Token: gAAAAABjRQ60OOsopmpvjXr_KgaeDZalokZjOQiZynPV_EGU2E9xRveFsg_V6UuSRGloaybdqdxgRttcYwKj42m8A2U2bw6wlBLu8gqhWwAQyJR99UM9sLh2KazQuSai_kADaKZ9xFqIeH6ghVy_snF9KnDlm7EuM5HsxcOhdY70YZYyWrNVBQg Oct 11 06:35:32.708691 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Domain-Id: None Oct 11 06:35:32.708691 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Domain-Name: None Oct 11 06:35:32.708691 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Identity-Status: Confirmed Oct 11 06:35:32.708691 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Is-Admin-Project: True Oct 11 06:35:32.708691 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 06:35:32.708691 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Project-Domain-Id: default Oct 11 06:35:32.708691 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Project-Domain-Name: Default Oct 11 06:35:32.708691 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Project-Id: 4b69df7fd16f47b18a624f52e5487b78 Oct 11 06:35:32.708691 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Project-Name: admin Oct 11 06:35:32.708691 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Role: reader,member,admin Oct 11 06:35:32.708691 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Roles: reader,member,admin Oct 11 06:35:32.710301 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4b69df7fd16f47b18a624f52e5487b78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b69df7fd16f47b18a624f52e5487b78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b69df7fd16f47b18a624f52e5487b78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4b69df7fd16f47b18a624f52e5487b78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 06:35:32.710301 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Tenant: admin Oct 11 06:35:32.710301 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Tenant-Id: 4b69df7fd16f47b18a624f52e5487b78 Oct 11 06:35:32.710301 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Tenant-Name: admin Oct 11 06:35:32.710301 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-User: admin Oct 11 06:35:32.710301 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-User-Domain-Id: default Oct 11 06:35:32.710301 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-User-Domain-Name: Default Oct 11 06:35:32.710301 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-User-Id: cdd55bd4e43346b29310a317dad7a19b Oct 11 06:35:32.710301 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-User-Name: admin Oct 11 06:35:32.710301 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: method: > Oct 11 06:35:32.710301 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: exception: Flavor 42 could not be found. Oct 11 06:35:32.710301 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: action_args: {'id': '42'} Oct 11 06:35:32.710301 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 06:35:32.710301 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:35:32.711314 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 06:35:32.711314 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 06:35:32.711314 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 06:35:32.711314 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 06:35:32.711314 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 06:35:32.711314 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 06:35:32.711314 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 06:35:32.711314 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 06:35:32.711314 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 06:35:32.711314 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 06:35:32.711314 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 06:35:32.711314 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 06:35:32.711314 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 11 06:35:32.711314 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi Oct 11 06:35:32.711314 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:35:32.711314 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi Oct 11 06:35:32.711314 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:35:32.711314 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:35:32.711314 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:35:32.712783 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 06:35:32.712783 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 06:35:32.712783 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 06:35:32.712783 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 06:35:32.712783 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 06:35:32.712783 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 06:35:32.712783 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 11 06:35:32.712783 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi Oct 11 06:35:32.712783 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:35:32.712783 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi Oct 11 06:35:32.712783 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:35:32.712783 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:35:32.712783 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:35:32.712783 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 06:35:32.712783 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 06:35:32.712783 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 11 06:35:32.712783 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi Oct 11 06:35:32.712783 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-ecd42d1f-c078-4757-ad10-cb2b690daf3e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 06:35:32.714539 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-ecd42d1f-c078-4757-ad10-cb2b690daf3e admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.387488 Oct 11 06:35:32.714539 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 19/39] 10.222.0.39 () {60 vars in 1190 bytes} [Tue Oct 11 06:35:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 11 06:35:32.720528 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-b58b4112-9b7f-4bde-945b-53c7d84d836b admin admin] Calling method '>' {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:35:32.744163 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-b58b4112-9b7f-4bde-945b-53c7d84d836b admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027175 Oct 11 06:35:32.744734 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 21/40] 10.222.0.39 () {60 vars in 1210 bytes} [Tue Oct 11 06:35:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:35:32.755237 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-7f8d03b5-3068-4270-bfac-0c48ef454a14 admin admin] Calling method '>' {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:35:32.778078 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-7f8d03b5-3068-4270-bfac-0c48ef454a14 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027171 Oct 11 06:35:32.778630 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 20/41] 10.222.0.39 () {60 vars in 1210 bytes} [Tue Oct 11 06:35:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:35:32.788024 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-c801c859-225d-405c-bb36-bf574b843592 admin admin] Calling method '>' {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:35:32.793942 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.wsgi [None req-c801c859-225d-405c-bb36-bf574b843592 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 11 06:35:32.797207 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-c801c859-225d-405c-bb36-bf574b843592 admin admin] Request method failure captured: Oct 11 06:35:32.797207 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 11 06:35:32.797207 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: Accept: application/json Oct 11 06:35:32.797207 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: Accept-Encoding: gzip, deflate Oct 11 06:35:32.797207 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: Connection: keep-alive Oct 11 06:35:32.797207 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: Content-Length: 0 Oct 11 06:35:32.797207 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: Host: 10.222.0.39 Oct 11 06:35:32.797207 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: Openstack-Api-Version: compute 2.92 Oct 11 06:35:32.797207 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: Openstack-System-Scope: None Oct 11 06:35:32.797207 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: User-Agent: python-novaclient Oct 11 06:35:32.797207 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Auth-Token: gAAAAABjRQ60OOsopmpvjXr_KgaeDZalokZjOQiZynPV_EGU2E9xRveFsg_V6UuSRGloaybdqdxgRttcYwKj42m8A2U2bw6wlBLu8gqhWwAQyJR99UM9sLh2KazQuSai_kADaKZ9xFqIeH6ghVy_snF9KnDlm7EuM5HsxcOhdY70YZYyWrNVBQg Oct 11 06:35:32.797207 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Domain-Id: None Oct 11 06:35:32.797207 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Domain-Name: None Oct 11 06:35:32.797207 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Identity-Status: Confirmed Oct 11 06:35:32.797207 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Is-Admin-Project: True Oct 11 06:35:32.797207 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 06:35:32.797207 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Project-Domain-Id: default Oct 11 06:35:32.797207 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Project-Domain-Name: Default Oct 11 06:35:32.797207 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Project-Id: 4b69df7fd16f47b18a624f52e5487b78 Oct 11 06:35:32.797207 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Project-Name: admin Oct 11 06:35:32.797207 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Role: reader,member,admin Oct 11 06:35:32.797207 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Roles: reader,member,admin Oct 11 06:35:32.798518 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4b69df7fd16f47b18a624f52e5487b78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b69df7fd16f47b18a624f52e5487b78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b69df7fd16f47b18a624f52e5487b78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4b69df7fd16f47b18a624f52e5487b78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 06:35:32.798518 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Tenant: admin Oct 11 06:35:32.798518 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Tenant-Id: 4b69df7fd16f47b18a624f52e5487b78 Oct 11 06:35:32.798518 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Tenant-Name: admin Oct 11 06:35:32.798518 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-User: admin Oct 11 06:35:32.798518 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-User-Domain-Id: default Oct 11 06:35:32.798518 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-User-Domain-Name: Default Oct 11 06:35:32.798518 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-User-Id: cdd55bd4e43346b29310a317dad7a19b Oct 11 06:35:32.798518 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-User-Name: admin Oct 11 06:35:32.798518 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: method: > Oct 11 06:35:32.798518 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: exception: Flavor 42 could not be found. Oct 11 06:35:32.798518 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: action_args: {'id': '42'} Oct 11 06:35:32.798518 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 06:35:32.798518 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:35:32.799538 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 06:35:32.799538 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 06:35:32.799538 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 06:35:32.799538 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 06:35:32.799538 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 06:35:32.799538 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 06:35:32.799538 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 06:35:32.799538 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 06:35:32.799538 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 06:35:32.799538 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 06:35:32.799538 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 06:35:32.799538 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 06:35:32.799538 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 11 06:35:32.799538 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi Oct 11 06:35:32.799538 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:35:32.799538 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi Oct 11 06:35:32.799538 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:35:32.799538 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:35:32.799538 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:35:32.800924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 06:35:32.800924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 06:35:32.800924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 06:35:32.800924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 06:35:32.800924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 06:35:32.800924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 06:35:32.800924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 11 06:35:32.800924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi Oct 11 06:35:32.800924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:35:32.800924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi Oct 11 06:35:32.800924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:35:32.800924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:35:32.800924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:35:32.800924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 06:35:32.800924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 06:35:32.800924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 11 06:35:32.800924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi Oct 11 06:35:32.800924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-c801c859-225d-405c-bb36-bf574b843592 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 06:35:32.802245 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-c801c859-225d-405c-bb36-bf574b843592 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014084 Oct 11 06:35:32.802245 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 22/42] 10.222.0.39 () {60 vars in 1190 bytes} [Tue Oct 11 06:35:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 11 06:35:34.005140 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-7f8d03b5-3068-4270-bfac-0c48ef454a14 admin admin] Calling method '>' {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:35:34.006150 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-7f8d03b5-3068-4270-bfac-0c48ef454a14 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Oct 11 06:35:34.006551 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 21/43] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Oct 11 06:35:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:35:34.524323 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-fc3dfbbe-a6e7-492c-af6b-a6544ae8937e admin admin] Calling method '>' {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:35:34.529299 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.wsgi [None req-fc3dfbbe-a6e7-492c-af6b-a6544ae8937e admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 11 06:35:34.530801 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-fc3dfbbe-a6e7-492c-af6b-a6544ae8937e admin admin] Request method failure captured: Oct 11 06:35:34.530801 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 11 06:35:34.530801 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: Accept: application/json Oct 11 06:35:34.530801 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: Accept-Encoding: gzip, deflate Oct 11 06:35:34.530801 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: Connection: keep-alive Oct 11 06:35:34.530801 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: Content-Length: 0 Oct 11 06:35:34.530801 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: Host: 10.222.0.39 Oct 11 06:35:34.530801 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: Openstack-Api-Version: compute 2.92 Oct 11 06:35:34.530801 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: Openstack-System-Scope: None Oct 11 06:35:34.530801 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: User-Agent: python-novaclient Oct 11 06:35:34.530801 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Auth-Token: gAAAAABjRQ61eG2P_WmWt8aT_uG67-r8Vk98D_h_dbU9CA_E5ODsSUokI3FZXdSctbii6Bt3ZHwtj2PLJyF18ApC3IAD4Q8nOsJrF5ir0uEzvcwHOlL0W0es28UGzfdm1Ecq8Lo9KBauh_fQ_wT7ufBjlMys1ZiFcE-2oNpar1939AWWM9zgruA Oct 11 06:35:34.530801 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Domain-Id: None Oct 11 06:35:34.530801 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Domain-Name: None Oct 11 06:35:34.530801 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Identity-Status: Confirmed Oct 11 06:35:34.530801 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Is-Admin-Project: True Oct 11 06:35:34.530801 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 06:35:34.530801 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Project-Domain-Id: default Oct 11 06:35:34.530801 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Project-Domain-Name: Default Oct 11 06:35:34.530801 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Project-Id: 4b69df7fd16f47b18a624f52e5487b78 Oct 11 06:35:34.530801 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Project-Name: admin Oct 11 06:35:34.530801 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Role: reader,member,admin Oct 11 06:35:34.530801 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Roles: reader,member,admin Oct 11 06:35:34.532170 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4b69df7fd16f47b18a624f52e5487b78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b69df7fd16f47b18a624f52e5487b78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b69df7fd16f47b18a624f52e5487b78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4b69df7fd16f47b18a624f52e5487b78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 06:35:34.532170 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Tenant: admin Oct 11 06:35:34.532170 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Tenant-Id: 4b69df7fd16f47b18a624f52e5487b78 Oct 11 06:35:34.532170 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Tenant-Name: admin Oct 11 06:35:34.532170 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-User: admin Oct 11 06:35:34.532170 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-User-Domain-Id: default Oct 11 06:35:34.532170 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-User-Domain-Name: Default Oct 11 06:35:34.532170 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-User-Id: cdd55bd4e43346b29310a317dad7a19b Oct 11 06:35:34.532170 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-User-Name: admin Oct 11 06:35:34.532170 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: method: > Oct 11 06:35:34.532170 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: exception: Flavor 84 could not be found. Oct 11 06:35:34.532170 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: action_args: {'id': '84'} Oct 11 06:35:34.532170 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 06:35:34.532170 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:35:34.532924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 06:35:34.532924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 06:35:34.532924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 06:35:34.532924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 06:35:34.532924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 06:35:34.532924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 06:35:34.532924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 06:35:34.532924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 06:35:34.532924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 06:35:34.532924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 06:35:34.532924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 06:35:34.532924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 06:35:34.532924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 11 06:35:34.532924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi Oct 11 06:35:34.532924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:35:34.532924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi Oct 11 06:35:34.532924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:35:34.532924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:35:34.532924 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:35:34.534241 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 06:35:34.534241 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 06:35:34.534241 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 06:35:34.534241 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 06:35:34.534241 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 06:35:34.534241 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 06:35:34.534241 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 11 06:35:34.534241 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi Oct 11 06:35:34.534241 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:35:34.534241 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi Oct 11 06:35:34.534241 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:35:34.534241 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:35:34.534241 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:35:34.534241 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 06:35:34.534241 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 06:35:34.534241 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 11 06:35:34.534241 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi Oct 11 06:35:34.534241 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-fc3dfbbe-a6e7-492c-af6b-a6544ae8937e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 06:35:34.535446 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-fc3dfbbe-a6e7-492c-af6b-a6544ae8937e admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.387521 Oct 11 06:35:34.535446 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 23/44] 10.222.0.39 () {60 vars in 1190 bytes} [Tue Oct 11 06:35:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 11 06:35:34.542486 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-ab4239f9-8b15-4901-96d5-46ee40833f52 admin admin] Calling method '>' {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:35:34.557726 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-ab4239f9-8b15-4901-96d5-46ee40833f52 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018785 Oct 11 06:35:34.558252 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 22/45] 10.222.0.39 () {60 vars in 1210 bytes} [Tue Oct 11 06:35:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:35:34.567356 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-4a81d7f6-168d-4436-a1dc-efabfa1872f0 admin admin] Calling method '>' {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:35:34.582362 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-4a81d7f6-168d-4436-a1dc-efabfa1872f0 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018357 Oct 11 06:35:34.582887 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 24/46] 10.222.0.39 () {60 vars in 1210 bytes} [Tue Oct 11 06:35:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:35:34.591868 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-42bda760-7bf9-458a-9439-824416c419aa admin admin] Calling method '>' {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:35:34.596779 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.wsgi [None req-42bda760-7bf9-458a-9439-824416c419aa admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 11 06:35:34.598284 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-42bda760-7bf9-458a-9439-824416c419aa admin admin] Request method failure captured: Oct 11 06:35:34.598284 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 11 06:35:34.598284 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: Accept: application/json Oct 11 06:35:34.598284 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: Accept-Encoding: gzip, deflate Oct 11 06:35:34.598284 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: Connection: keep-alive Oct 11 06:35:34.598284 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: Content-Length: 0 Oct 11 06:35:34.598284 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: Host: 10.222.0.39 Oct 11 06:35:34.598284 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: Openstack-Api-Version: compute 2.92 Oct 11 06:35:34.598284 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: Openstack-System-Scope: None Oct 11 06:35:34.598284 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: User-Agent: python-novaclient Oct 11 06:35:34.598284 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Auth-Token: gAAAAABjRQ61eG2P_WmWt8aT_uG67-r8Vk98D_h_dbU9CA_E5ODsSUokI3FZXdSctbii6Bt3ZHwtj2PLJyF18ApC3IAD4Q8nOsJrF5ir0uEzvcwHOlL0W0es28UGzfdm1Ecq8Lo9KBauh_fQ_wT7ufBjlMys1ZiFcE-2oNpar1939AWWM9zgruA Oct 11 06:35:34.598284 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Domain-Id: None Oct 11 06:35:34.598284 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Domain-Name: None Oct 11 06:35:34.598284 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Identity-Status: Confirmed Oct 11 06:35:34.598284 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Is-Admin-Project: True Oct 11 06:35:34.598284 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 06:35:34.598284 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Project-Domain-Id: default Oct 11 06:35:34.598284 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Project-Domain-Name: Default Oct 11 06:35:34.598284 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Project-Id: 4b69df7fd16f47b18a624f52e5487b78 Oct 11 06:35:34.598284 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Project-Name: admin Oct 11 06:35:34.598284 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Role: reader,member,admin Oct 11 06:35:34.598284 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Roles: reader,member,admin Oct 11 06:35:34.599768 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4b69df7fd16f47b18a624f52e5487b78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b69df7fd16f47b18a624f52e5487b78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b69df7fd16f47b18a624f52e5487b78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4b69df7fd16f47b18a624f52e5487b78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 06:35:34.599768 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Tenant: admin Oct 11 06:35:34.599768 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Tenant-Id: 4b69df7fd16f47b18a624f52e5487b78 Oct 11 06:35:34.599768 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Tenant-Name: admin Oct 11 06:35:34.599768 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-User: admin Oct 11 06:35:34.599768 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-User-Domain-Id: default Oct 11 06:35:34.599768 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-User-Domain-Name: Default Oct 11 06:35:34.599768 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-User-Id: cdd55bd4e43346b29310a317dad7a19b Oct 11 06:35:34.599768 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-User-Name: admin Oct 11 06:35:34.599768 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: method: > Oct 11 06:35:34.599768 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: exception: Flavor 84 could not be found. Oct 11 06:35:34.599768 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: action_args: {'id': '84'} Oct 11 06:35:34.599768 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 06:35:34.599768 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:35:34.600637 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 06:35:34.600637 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 06:35:34.600637 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 06:35:34.600637 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 06:35:34.600637 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 06:35:34.600637 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 06:35:34.600637 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 06:35:34.600637 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 06:35:34.600637 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 06:35:34.600637 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 06:35:34.600637 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 06:35:34.600637 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 06:35:34.600637 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 11 06:35:34.600637 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi Oct 11 06:35:34.600637 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:35:34.600637 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi Oct 11 06:35:34.600637 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:35:34.600637 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:35:34.600637 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:35:34.601981 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 06:35:34.601981 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 06:35:34.601981 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 06:35:34.601981 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 06:35:34.601981 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 06:35:34.601981 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 06:35:34.601981 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 11 06:35:34.601981 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi Oct 11 06:35:34.601981 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:35:34.601981 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi Oct 11 06:35:34.601981 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:35:34.601981 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:35:34.601981 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:35:34.601981 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 06:35:34.601981 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 06:35:34.601981 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 11 06:35:34.601981 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi Oct 11 06:35:34.601981 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-42bda760-7bf9-458a-9439-824416c419aa admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 06:35:34.603218 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-42bda760-7bf9-458a-9439-824416c419aa admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011281 Oct 11 06:35:34.603218 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 23/47] 10.222.0.39 () {60 vars in 1190 bytes} [Tue Oct 11 06:35:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 11 06:35:35.805720 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-4a81d7f6-168d-4436-a1dc-efabfa1872f0 admin admin] Calling method '>' {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:35:35.806711 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-4a81d7f6-168d-4436-a1dc-efabfa1872f0 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Oct 11 06:35:35.807131 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 25/48] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Oct 11 06:35:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:35:36.326466 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-3e3261b2-a4ff-46a7-8073-c3c7e204c4bd admin admin] Calling method '>' {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:35:36.332374 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.wsgi [None req-3e3261b2-a4ff-46a7-8073-c3c7e204c4bd admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 11 06:35:36.333855 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-3e3261b2-a4ff-46a7-8073-c3c7e204c4bd admin admin] Request method failure captured: Oct 11 06:35:36.333855 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 11 06:35:36.333855 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: Accept: application/json Oct 11 06:35:36.333855 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: Accept-Encoding: gzip, deflate Oct 11 06:35:36.333855 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: Connection: keep-alive Oct 11 06:35:36.333855 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: Content-Length: 0 Oct 11 06:35:36.333855 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: Host: 10.222.0.39 Oct 11 06:35:36.333855 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: Openstack-Api-Version: compute 2.92 Oct 11 06:35:36.333855 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: Openstack-System-Scope: None Oct 11 06:35:36.333855 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: User-Agent: python-novaclient Oct 11 06:35:36.333855 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Auth-Token: gAAAAABjRQ63T8gjEqgKZtxJqsI6HpboJ4D6Ni71tPGaG6r_dhRtyZ0QP-sLU7FUFWFS_hTqdNgMPR8mcyGevDRq9jX8Cmg9iORIEhwrbNceXXto2d67q19nKb8qDESM8V9JBwhD9Gb_ed_KJ2EIBK2cnikoryTqqRnAWgD-tk9PJmykg0GW8sQ Oct 11 06:35:36.333855 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Domain-Id: None Oct 11 06:35:36.333855 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Domain-Name: None Oct 11 06:35:36.333855 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Identity-Status: Confirmed Oct 11 06:35:36.333855 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Is-Admin-Project: True Oct 11 06:35:36.333855 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 06:35:36.333855 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Project-Domain-Id: default Oct 11 06:35:36.333855 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Project-Domain-Name: Default Oct 11 06:35:36.333855 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Project-Id: 4b69df7fd16f47b18a624f52e5487b78 Oct 11 06:35:36.333855 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Project-Name: admin Oct 11 06:35:36.333855 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Role: reader,member,admin Oct 11 06:35:36.333855 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Roles: reader,member,admin Oct 11 06:35:36.335409 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4b69df7fd16f47b18a624f52e5487b78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b69df7fd16f47b18a624f52e5487b78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b69df7fd16f47b18a624f52e5487b78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4b69df7fd16f47b18a624f52e5487b78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 06:35:36.335409 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Tenant: admin Oct 11 06:35:36.335409 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Tenant-Id: 4b69df7fd16f47b18a624f52e5487b78 Oct 11 06:35:36.335409 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-Tenant-Name: admin Oct 11 06:35:36.335409 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-User: admin Oct 11 06:35:36.335409 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-User-Domain-Id: default Oct 11 06:35:36.335409 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-User-Domain-Name: Default Oct 11 06:35:36.335409 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-User-Id: cdd55bd4e43346b29310a317dad7a19b Oct 11 06:35:36.335409 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: X-User-Name: admin Oct 11 06:35:36.335409 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: method: > Oct 11 06:35:36.335409 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: exception: Flavor 451 could not be found. Oct 11 06:35:36.335409 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: action_args: {'id': '451'} Oct 11 06:35:36.335409 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 06:35:36.335409 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:35:36.336352 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 06:35:36.336352 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 06:35:36.336352 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 06:35:36.336352 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 06:35:36.336352 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 06:35:36.336352 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 06:35:36.336352 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 06:35:36.336352 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 06:35:36.336352 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 06:35:36.336352 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 06:35:36.336352 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 06:35:36.336352 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 06:35:36.336352 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 11 06:35:36.336352 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi Oct 11 06:35:36.336352 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:35:36.336352 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi Oct 11 06:35:36.336352 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:35:36.336352 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:35:36.336352 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:35:36.337436 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 06:35:36.337436 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 06:35:36.337436 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 06:35:36.337436 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 06:35:36.337436 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 06:35:36.337436 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 06:35:36.337436 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 11 06:35:36.337436 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi Oct 11 06:35:36.337436 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:35:36.337436 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi Oct 11 06:35:36.337436 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:35:36.337436 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:35:36.337436 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:35:36.337436 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 06:35:36.337436 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 06:35:36.337436 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 11 06:35:36.337436 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: ERROR nova.api.openstack.wsgi Oct 11 06:35:36.337436 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-3e3261b2-a4ff-46a7-8073-c3c7e204c4bd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 06:35:36.338497 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-3e3261b2-a4ff-46a7-8073-c3c7e204c4bd admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.387958 Oct 11 06:35:36.338497 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 24/49] 10.222.0.39 () {60 vars in 1193 bytes} [Tue Oct 11 06:35:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 11 06:35:36.345370 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-af7c6410-d3a1-428d-af6c-3e40658eafd9 admin admin] Calling method '>' {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:35:36.360726 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-af7c6410-d3a1-428d-af6c-3e40658eafd9 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018872 Oct 11 06:35:36.361247 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 26/50] 10.222.0.39 () {60 vars in 1210 bytes} [Tue Oct 11 06:35:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:35:36.370158 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-581836d3-f64b-4e0c-acae-eca254d90db0 admin admin] Calling method '>' {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:35:36.384988 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-581836d3-f64b-4e0c-acae-eca254d90db0 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018253 Oct 11 06:35:36.385507 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 25/51] 10.222.0.39 () {60 vars in 1210 bytes} [Tue Oct 11 06:35:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:35:36.394636 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-4a03f778-9a6b-4ea4-9340-64f9a4b9c6c3 admin admin] Calling method '>' {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:35:36.399830 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.wsgi [None req-4a03f778-9a6b-4ea4-9340-64f9a4b9c6c3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 11 06:35:36.401356 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-4a03f778-9a6b-4ea4-9340-64f9a4b9c6c3 admin admin] Request method failure captured: Oct 11 06:35:36.401356 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 11 06:35:36.401356 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: Accept: application/json Oct 11 06:35:36.401356 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: Accept-Encoding: gzip, deflate Oct 11 06:35:36.401356 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: Connection: keep-alive Oct 11 06:35:36.401356 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: Content-Length: 0 Oct 11 06:35:36.401356 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: Host: 10.222.0.39 Oct 11 06:35:36.401356 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: Openstack-Api-Version: compute 2.92 Oct 11 06:35:36.401356 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: Openstack-System-Scope: None Oct 11 06:35:36.401356 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: User-Agent: python-novaclient Oct 11 06:35:36.401356 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Auth-Token: gAAAAABjRQ63T8gjEqgKZtxJqsI6HpboJ4D6Ni71tPGaG6r_dhRtyZ0QP-sLU7FUFWFS_hTqdNgMPR8mcyGevDRq9jX8Cmg9iORIEhwrbNceXXto2d67q19nKb8qDESM8V9JBwhD9Gb_ed_KJ2EIBK2cnikoryTqqRnAWgD-tk9PJmykg0GW8sQ Oct 11 06:35:36.401356 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Domain-Id: None Oct 11 06:35:36.401356 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Domain-Name: None Oct 11 06:35:36.401356 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Identity-Status: Confirmed Oct 11 06:35:36.401356 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Is-Admin-Project: True Oct 11 06:35:36.401356 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 06:35:36.401356 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Project-Domain-Id: default Oct 11 06:35:36.401356 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Project-Domain-Name: Default Oct 11 06:35:36.401356 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Project-Id: 4b69df7fd16f47b18a624f52e5487b78 Oct 11 06:35:36.401356 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Project-Name: admin Oct 11 06:35:36.401356 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Role: reader,member,admin Oct 11 06:35:36.401356 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Roles: reader,member,admin Oct 11 06:35:36.403336 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4b69df7fd16f47b18a624f52e5487b78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b69df7fd16f47b18a624f52e5487b78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b69df7fd16f47b18a624f52e5487b78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4b69df7fd16f47b18a624f52e5487b78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 06:35:36.403336 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Tenant: admin Oct 11 06:35:36.403336 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Tenant-Id: 4b69df7fd16f47b18a624f52e5487b78 Oct 11 06:35:36.403336 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-Tenant-Name: admin Oct 11 06:35:36.403336 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-User: admin Oct 11 06:35:36.403336 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-User-Domain-Id: default Oct 11 06:35:36.403336 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-User-Domain-Name: Default Oct 11 06:35:36.403336 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-User-Id: cdd55bd4e43346b29310a317dad7a19b Oct 11 06:35:36.403336 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: X-User-Name: admin Oct 11 06:35:36.403336 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: method: > Oct 11 06:35:36.403336 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: exception: Flavor 451 could not be found. Oct 11 06:35:36.403336 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: action_args: {'id': '451'} Oct 11 06:35:36.403336 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 06:35:36.403336 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:35:36.405250 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 06:35:36.405250 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 06:35:36.405250 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 06:35:36.405250 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 06:35:36.405250 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 06:35:36.405250 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 06:35:36.405250 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 06:35:36.405250 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 06:35:36.405250 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 06:35:36.405250 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 06:35:36.405250 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 06:35:36.405250 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 06:35:36.405250 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 11 06:35:36.405250 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi Oct 11 06:35:36.405250 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:35:36.405250 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi Oct 11 06:35:36.405250 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:35:36.405250 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:35:36.405250 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:35:36.406487 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 06:35:36.406487 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 06:35:36.406487 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 06:35:36.406487 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 06:35:36.406487 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 06:35:36.406487 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 06:35:36.406487 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 11 06:35:36.406487 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi Oct 11 06:35:36.406487 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:35:36.406487 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi Oct 11 06:35:36.406487 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:35:36.406487 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:35:36.406487 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:35:36.406487 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 06:35:36.406487 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 06:35:36.406487 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 11 06:35:36.406487 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: ERROR nova.api.openstack.wsgi Oct 11 06:35:36.406487 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-4a03f778-9a6b-4ea4-9340-64f9a4b9c6c3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 06:35:36.407510 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-4a03f778-9a6b-4ea4-9340-64f9a4b9c6c3 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012070 Oct 11 06:35:36.407510 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 27/52] 10.222.0.39 () {60 vars in 1193 bytes} [Tue Oct 11 06:35:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 11 06:35:37.605315 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-581836d3-f64b-4e0c-acae-eca254d90db0 admin admin] Calling method '>' {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:35:37.606311 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-581836d3-f64b-4e0c-acae-eca254d90db0 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001943 Oct 11 06:35:37.606695 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 26/53] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Oct 11 06:35:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:35:38.124128 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-70a8df43-95ab-48e4-be9e-b8a6fde8d194 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:35:38.143028 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-70a8df43-95ab-48e4-be9e-b8a6fde8d194 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.399026 Oct 11 06:35:38.143610 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 28/54] 10.222.0.39 () {64 vars in 1235 bytes} [Tue Oct 11 06:35:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:35:39.352989 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-581836d3-f64b-4e0c-acae-eca254d90db0 admin admin] Calling method '>' {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:35:39.354018 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-581836d3-f64b-4e0c-acae-eca254d90db0 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Oct 11 06:35:39.354411 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 27/55] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Oct 11 06:35:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:35:39.869811 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-c656055c-39c5-40d5-a15f-7a9c518ad979 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:35:39.888465 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-c656055c-39c5-40d5-a15f-7a9c518ad979 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.395865 Oct 11 06:35:39.888995 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 29/56] 10.222.0.39 () {64 vars in 1235 bytes} [Tue Oct 11 06:35:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 06:35:41.097760 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-581836d3-f64b-4e0c-acae-eca254d90db0 admin admin] Calling method '>' {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:35:41.098808 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-581836d3-f64b-4e0c-acae-eca254d90db0 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Oct 11 06:35:41.099204 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 28/57] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Oct 11 06:35:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:35:41.616274 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-73cc0ea2-9a67-4275-af1b-a3bd9620a64a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:35:41.634382 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-73cc0ea2-9a67-4275-af1b-a3bd9620a64a admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.394464 Oct 11 06:35:41.634905 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 30/58] 10.222.0.39 () {64 vars in 1235 bytes} [Tue Oct 11 06:35:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:35:42.832926 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-581836d3-f64b-4e0c-acae-eca254d90db0 admin admin] Calling method '>' {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:35:42.834026 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-581836d3-f64b-4e0c-acae-eca254d90db0 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001587 Oct 11 06:35:42.834465 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 29/59] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Oct 11 06:35:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:35:43.348046 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-2df44b8c-f9d3-4f51-800f-85bc6b070a47 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:35:43.366460 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-2df44b8c-f9d3-4f51-800f-85bc6b070a47 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.395465 Oct 11 06:35:43.366996 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 31/60] 10.222.0.39 () {64 vars in 1235 bytes} [Tue Oct 11 06:35:42 2022] POST /compute/v2.1/flavors => generated 409 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:35:44.573525 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-581836d3-f64b-4e0c-acae-eca254d90db0 admin admin] Calling method '>' {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:35:44.574525 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-581836d3-f64b-4e0c-acae-eca254d90db0 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002042 Oct 11 06:35:44.574907 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 30/61] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Oct 11 06:35:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:35:45.087759 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-ebda7516-4477-4360-84d5-13646ba45de9 admin admin] Calling method '>' {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:35:45.108165 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-ebda7516-4477-4360-84d5-13646ba45de9 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.395942 Oct 11 06:35:45.108699 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 32/62] 10.222.0.39 () {60 vars in 1202 bytes} [Tue Oct 11 06:35:44 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:36:41.177892 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-581836d3-f64b-4e0c-acae-eca254d90db0 admin admin] Calling method '>' {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:36:41.179048 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-581836d3-f64b-4e0c-acae-eca254d90db0 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Oct 11 06:36:41.179480 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 31/63] 10.222.0.39 () {54 vars in 931 bytes} [Tue Oct 11 06:36:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:36:41.190627 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG dbcounter [-] [110217] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=110217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:36:41.564056 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-2e6e18cc-c593-42dc-8655-c2f179126fa7 admin admin] Calling method '>' {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:36:41.584715 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-2e6e18cc-c593-42dc-8655-c2f179126fa7 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.398582 Oct 11 06:36:41.585252 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 33/64] 10.222.0.39 () {60 vars in 1292 bytes} [Tue Oct 11 06:36:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:36:41.606018 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG dbcounter [-] [110218] Writing DB stats nova_api:SELECT=14 {{(pid=110218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:36:41.609707 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-d8d4e9d3-86bc-402b-997e-1a489b897a08 admin admin] Calling method '>' {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:36:41.616942 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-d8d4e9d3-86bc-402b-997e-1a489b897a08 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012430 Oct 11 06:36:41.617461 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 32/65] 10.222.0.39 () {60 vars in 1283 bytes} [Tue Oct 11 06:36:41 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:36:41.629307 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-41035ca2-2598-44a2-8a0b-23862f0a777d admin admin] Calling method '>' {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:36:41.636976 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-41035ca2-2598-44a2-8a0b-23862f0a777d admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011150 Oct 11 06:36:41.637475 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 34/66] 10.222.0.39 () {60 vars in 1286 bytes} [Tue Oct 11 06:36:41 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:36:41.648769 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-292e55d5-0c6b-4752-bea5-23ceac799d47 admin admin] Calling method '>' {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:36:41.655762 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-292e55d5-0c6b-4752-bea5-23ceac799d47 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010651 Oct 11 06:36:41.656268 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 33/67] 10.222.0.39 () {60 vars in 1286 bytes} [Tue Oct 11 06:36:41 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:36:41.667267 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-81f47723-9793-4c80-ade5-31f71b9ab3be admin admin] Calling method '>' {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:36:41.674265 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-81f47723-9793-4c80-ade5-31f71b9ab3be admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010463 Oct 11 06:36:41.674764 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 35/68] 10.222.0.39 () {60 vars in 1283 bytes} [Tue Oct 11 06:36:41 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:39:41.751754 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-292e55d5-0c6b-4752-bea5-23ceac799d47 admin admin] Calling method '>' {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:39:41.752788 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-292e55d5-0c6b-4752-bea5-23ceac799d47 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Oct 11 06:39:41.753203 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 34/69] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Oct 11 06:39:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:39:41.893057 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG dbcounter [-] [110217] Writing DB stats nova_api:SELECT=6 {{(pid=110217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:39:42.050983 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-17c40336-a1e4-4b1f-9d64-dc0bcc0f3a50 admin admin] Calling method '>' {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:39:42.055748 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG oslo_concurrency.lockutils [None req-17c40336-a1e4-4b1f-9d64-dc0bcc0f3a50 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:39:42.056246 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG oslo_concurrency.lockutils [None req-17c40336-a1e4-4b1f-9d64-dc0bcc0f3a50 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:39:42.056668 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG oslo_concurrency.lockutils [None req-17c40336-a1e4-4b1f-9d64-dc0bcc0f3a50 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:39:42.057370 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG oslo_concurrency.lockutils [None req-17c40336-a1e4-4b1f-9d64-dc0bcc0f3a50 admin admin] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:39:42.057810 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG oslo_concurrency.lockutils [None req-17c40336-a1e4-4b1f-9d64-dc0bcc0f3a50 admin admin] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:39:42.058219 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG oslo_concurrency.lockutils [None req-17c40336-a1e4-4b1f-9d64-dc0bcc0f3a50 admin admin] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:39:42.089486 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-17c40336-a1e4-4b1f-9d64-dc0bcc0f3a50 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.197631 Oct 11 06:39:42.090025 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 36/70] 10.222.0.39 () {60 vars in 1193 bytes} [Tue Oct 11 06:39:41 2022] GET /compute/v2.1/os-services => generated 791 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:39:43.167756 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-292e55d5-0c6b-4752-bea5-23ceac799d47 admin admin] Calling method '>' {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:39:43.168784 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-292e55d5-0c6b-4752-bea5-23ceac799d47 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Oct 11 06:39:43.169171 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 35/71] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Oct 11 06:39:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:39:43.357849 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-5385dd75-3b18-40c3-80d7-df1e89335005 admin admin] Calling method '>' {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:39:43.361336 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG oslo_concurrency.lockutils [None req-5385dd75-3b18-40c3-80d7-df1e89335005 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:39:43.361810 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG oslo_concurrency.lockutils [None req-5385dd75-3b18-40c3-80d7-df1e89335005 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:39:43.362234 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG oslo_concurrency.lockutils [None req-5385dd75-3b18-40c3-80d7-df1e89335005 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:39:43.362941 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG oslo_concurrency.lockutils [None req-5385dd75-3b18-40c3-80d7-df1e89335005 admin admin] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:39:43.363383 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG oslo_concurrency.lockutils [None req-5385dd75-3b18-40c3-80d7-df1e89335005 admin admin] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:39:43.363817 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG oslo_concurrency.lockutils [None req-5385dd75-3b18-40c3-80d7-df1e89335005 admin admin] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:39:43.383528 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-5385dd75-3b18-40c3-80d7-df1e89335005 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.075975 Oct 11 06:39:43.383996 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 37/72] 10.222.0.39 () {60 vars in 1193 bytes} [Tue Oct 11 06:39:43 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:39:54.863111 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-292e55d5-0c6b-4752-bea5-23ceac799d47 admin admin] Calling method '>' {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:39:54.864151 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-292e55d5-0c6b-4752-bea5-23ceac799d47 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Oct 11 06:39:54.864536 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 36/73] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Oct 11 06:39:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:39:55.007031 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG dbcounter [-] [110217] Writing DB stats nova_cell0:SELECT=4 {{(pid=110217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:39:55.007793 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG dbcounter [-] [110217] Writing DB stats nova_cell1:SELECT=4 {{(pid=110217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:39:55.008409 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG dbcounter [-] [110217] Writing DB stats nova_api:SELECT=8 {{(pid=110217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:39:55.055872 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-99f4aba9-0a52-4b32-90da-f440c64baccc admin admin] Calling method '>' {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:39:55.059277 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG oslo_concurrency.lockutils [None req-99f4aba9-0a52-4b32-90da-f440c64baccc admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:39:55.059773 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG oslo_concurrency.lockutils [None req-99f4aba9-0a52-4b32-90da-f440c64baccc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:39:55.060200 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG oslo_concurrency.lockutils [None req-99f4aba9-0a52-4b32-90da-f440c64baccc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:39:55.060903 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG oslo_concurrency.lockutils [None req-99f4aba9-0a52-4b32-90da-f440c64baccc admin admin] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:39:55.061346 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG oslo_concurrency.lockutils [None req-99f4aba9-0a52-4b32-90da-f440c64baccc admin admin] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:39:55.061756 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG oslo_concurrency.lockutils [None req-99f4aba9-0a52-4b32-90da-f440c64baccc admin admin] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:39:55.086729 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-99f4aba9-0a52-4b32-90da-f440c64baccc admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.084021 Oct 11 06:39:55.087199 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 38/74] 10.222.0.39 () {60 vars in 1193 bytes} [Tue Oct 11 06:39:55 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:39:56.163812 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG nova.api.openstack.wsgi [None req-292e55d5-0c6b-4752-bea5-23ceac799d47 admin admin] Calling method '>' {{(pid=110218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:39:56.164815 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: INFO nova.api.openstack.requestlog [None req-292e55d5-0c6b-4752-bea5-23ceac799d47 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Oct 11 06:39:56.165210 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: [pid: 110218|app: 0|req: 37/75] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Oct 11 06:39:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:39:56.356076 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG nova.api.openstack.wsgi [None req-4f795831-4037-498e-9d65-e01089f95175 admin admin] Calling method '>' {{(pid=110217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:39:56.359385 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG oslo_concurrency.lockutils [None req-4f795831-4037-498e-9d65-e01089f95175 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:39:56.359905 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG oslo_concurrency.lockutils [None req-4f795831-4037-498e-9d65-e01089f95175 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:39:56.360322 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG oslo_concurrency.lockutils [None req-4f795831-4037-498e-9d65-e01089f95175 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:39:56.361022 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG oslo_concurrency.lockutils [None req-4f795831-4037-498e-9d65-e01089f95175 admin admin] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:39:56.361458 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG oslo_concurrency.lockutils [None req-4f795831-4037-498e-9d65-e01089f95175 admin admin] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:39:56.361865 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: DEBUG oslo_concurrency.lockutils [None req-4f795831-4037-498e-9d65-e01089f95175 admin admin] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:39:56.382851 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: INFO nova.api.openstack.requestlog [None req-4f795831-4037-498e-9d65-e01089f95175 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.077942 Oct 11 06:39:56.383327 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: [pid: 110217|app: 0|req: 39/76] 10.222.0.39 () {60 vars in 1193 bytes} [Tue Oct 11 06:39:56 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:40:52.307013 dv-cinder-854954-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 11 06:40:52.307566 dv-cinder-854954-3-iscsi devstack@n-api.service[110216]: Tue Oct 11 06:40:52 2022 - graceful shutdown triggered... Oct 11 06:40:52.308003 dv-cinder-854954-3-iscsi devstack@n-api.service[110217]: Gracefully killing worker 1 (pid: 110217)... Oct 11 06:40:52.308737 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: Gracefully killing worker 2 (pid: 110218)... Oct 11 06:40:52.434996 dv-cinder-854954-3-iscsi devstack@n-api.service[110218]: DEBUG dbcounter [-] [110218] Writing DB stats nova_api:SELECT=4 {{(pid=110218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:40:53.308321 dv-cinder-854954-3-iscsi devstack@n-api.service[110216]: worker 1 buried after 1 seconds Oct 11 06:40:53.308871 dv-cinder-854954-3-iscsi devstack@n-api.service[110216]: worker 2 buried after 1 seconds Oct 11 06:40:53.308871 dv-cinder-854954-3-iscsi devstack@n-api.service[110216]: goodbye to uWSGI. Oct 11 06:40:53.309836 dv-cinder-854954-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 11 06:40:53.310383 dv-cinder-854954-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 11 06:40:53.313216 dv-cinder-854954-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 11 06:40:53.322412 dv-cinder-854954-3-iscsi devstack@n-api.service[125250]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 11 06:40:53.325038 dv-cinder-854954-3-iscsi devstack@n-api.service[125250]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 11 06:40:53 2022] *** Oct 11 06:40:53.325186 dv-cinder-854954-3-iscsi devstack@n-api.service[125250]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 11 06:40:53.325319 dv-cinder-854954-3-iscsi devstack@n-api.service[125250]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 11 06:40:53.325440 dv-cinder-854954-3-iscsi devstack@n-api.service[125250]: nodename: dv-cinder-854954-3-iscsi Oct 11 06:40:53.325549 dv-cinder-854954-3-iscsi devstack@n-api.service[125250]: machine: x86_64 Oct 11 06:40:53.325658 dv-cinder-854954-3-iscsi devstack@n-api.service[125250]: clock source: unix Oct 11 06:40:53.325764 dv-cinder-854954-3-iscsi devstack@n-api.service[125250]: pcre jit disabled Oct 11 06:40:53.325884 dv-cinder-854954-3-iscsi devstack@n-api.service[125250]: detected number of CPU cores: 4 Oct 11 06:40:53.325998 dv-cinder-854954-3-iscsi devstack@n-api.service[125250]: current working directory: / Oct 11 06:40:53.326113 dv-cinder-854954-3-iscsi devstack@n-api.service[125250]: detected binary path: /usr/bin/uwsgi-core Oct 11 06:40:53.326219 dv-cinder-854954-3-iscsi devstack@n-api.service[125250]: your processes number limit is 47680 Oct 11 06:40:53.326329 dv-cinder-854954-3-iscsi devstack@n-api.service[125250]: your memory page size is 4096 bytes Oct 11 06:40:53.326438 dv-cinder-854954-3-iscsi devstack@n-api.service[125250]: detected max file descriptor number: 2048 Oct 11 06:40:53.326561 dv-cinder-854954-3-iscsi devstack@n-api.service[125250]: lock engine: pthread robust mutexes Oct 11 06:40:53.326766 dv-cinder-854954-3-iscsi devstack@n-api.service[125250]: thunder lock: enabled Oct 11 06:40:53.326918 dv-cinder-854954-3-iscsi devstack@n-api.service[125250]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 11 06:40:53.327011 dv-cinder-854954-3-iscsi devstack@n-api.service[125250]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 11 06:40:53.367165 dv-cinder-854954-3-iscsi devstack@n-api.service[125250]: Python main interpreter initialized at 0x563bfac3c9c0 Oct 11 06:40:53.367165 dv-cinder-854954-3-iscsi devstack@n-api.service[125250]: python threads support enabled Oct 11 06:40:53.367165 dv-cinder-854954-3-iscsi devstack@n-api.service[125250]: your server socket listen backlog is limited to 100 connections Oct 11 06:40:53.367165 dv-cinder-854954-3-iscsi devstack@n-api.service[125250]: your mercy for graceful operations on workers is 90 seconds Oct 11 06:40:53.367600 dv-cinder-854954-3-iscsi devstack@n-api.service[125250]: mapped 403077 bytes (393 KB) for 2 cores Oct 11 06:40:53.367722 dv-cinder-854954-3-iscsi devstack@n-api.service[125250]: *** Operational MODE: preforking *** Oct 11 06:40:53.367985 dv-cinder-854954-3-iscsi devstack@n-api.service[125250]: *** uWSGI is running in multiple interpreter mode *** Oct 11 06:40:53.367985 dv-cinder-854954-3-iscsi devstack@n-api.service[125250]: spawned uWSGI master process (pid: 125250) Oct 11 06:40:53.368362 dv-cinder-854954-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 11 06:40:53.368798 dv-cinder-854954-3-iscsi devstack@n-api.service[125250]: spawned uWSGI worker 1 (pid: 125266, cores: 1) Oct 11 06:40:53.369151 dv-cinder-854954-3-iscsi devstack@n-api.service[125250]: spawned uWSGI worker 2 (pid: 125267, cores: 1) Oct 11 06:40:53.369309 dv-cinder-854954-3-iscsi devstack@n-api.service[125250]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 11 06:40:54.032433 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 11 06:40:54.042107 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 11 06:40:55.186684 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 06:40:55.186684 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: from cryptography.utils import int_from_bytes Oct 11 06:40:55.187343 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 06:40:55.187343 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: from cryptography.utils import int_from_bytes Oct 11 06:40:55.203537 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 06:40:55.203537 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: from cryptography.utils import int_from_bytes Oct 11 06:40:55.204106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 06:40:55.204106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: from cryptography.utils import int_from_bytes Oct 11 06:40:57.585531 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 11 06:40:57.586108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 11 06:40:57.586426 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 11 06:40:57.586617 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 11 06:40:57.586862 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 11 06:40:57.587252 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.587649 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.588410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.588410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.588654 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.588915 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.589245 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.589563 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.589890 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.590153 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.590470 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.590962 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854954-3-iscsi {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.591288 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.591630 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.591947 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.592268 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.592575 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.592899 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.593218 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.593723 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.595138 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.595138 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.595138 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.595138 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.595525 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.595740 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.596049 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.596363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.596675 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.596995 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.597396 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854954-3-iscsi {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.597721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.598031 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.598344 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.598765 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.599072 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.599381 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.599738 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.600067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.600370 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.600685 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.601002 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.601321 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.601641 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.601940 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.602250 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.602562 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.602879 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.603745 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.604052 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.604311 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.604621 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.604940 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.605261 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.605586 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.605839 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.606106 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.606413 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.606515 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 11 06:40:57.606955 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.607041 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 11 06:40:57.607126 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.607327 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 11 06:40:57.607469 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.607638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.607740 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 11 06:40:57.607942 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 11 06:40:57.608035 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.608248 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.608360 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.608554 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.608643 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.608859 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.608948 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.609165 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.609260 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.609674 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.609841 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.610036 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.610189 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.610338 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.610490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.610632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.610774 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.610923 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.611083 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.611083 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.611391 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.611391 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.611744 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.611896 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.612038 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854954-3-iscsi {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.612194 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.612343 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.612494 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.612643 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.612792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.612958 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.613118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.613269 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.613418 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.613567 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.613708 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.613855 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.614012 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.614165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.614314 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.614473 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.614644 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.614830 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.615025 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.615182 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.615335 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.615505 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.615690 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.615853 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.616034 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.616196 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.616364 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.616510 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.616666 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.616826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.617336 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.617491 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.617643 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.617805 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.617983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.618145 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.618529 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.618748 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.618748 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.619751 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854954-3-iscsi {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.619898 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.620094 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.620262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.620408 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.620557 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.620710 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.620853 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.621004 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.621147 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.621296 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.621446 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.621598 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.621741 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.621889 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.622032 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.622184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.622339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.622484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.622626 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.622775 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.622924 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.623076 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.623233 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.623382 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.623605 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.623758 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.623901 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.624054 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.624205 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.624355 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.624498 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.624649 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.624798 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.624949 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.625099 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.625247 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.625390 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.625549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.625698 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.625912 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.626082 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.626233 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.626389 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.626540 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.626683 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.627872 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.628048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.628212 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.628392 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.628735 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.628896 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.629040 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.629196 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.629421 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.629748 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.629900 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.630052 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.630239 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.630394 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.630555 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.630699 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.630853 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.631004 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.631153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.631353 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.631541 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.631686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.631829 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.631981 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.632131 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.632279 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.632430 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.632572 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.632714 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.632863 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.633005 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.633160 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.633321 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.633478 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.633630 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.633773 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.633924 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.634083 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.634234 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.634383 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.634532 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.634700 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.634877 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.635035 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.635179 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.635332 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.635518 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.635665 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.635816 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.635980 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.636132 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.636280 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.636423 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.636572 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.636723 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.636874 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.637023 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.637183 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.637497 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.637735 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.637897 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.638048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.638200 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.638343 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.638493 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.638663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.639003 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.639154 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.639304 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.639475 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.639660 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.639961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.640130 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.640317 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.640469 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.640620 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.640770 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.640926 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.641078 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.641231 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.641383 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.641533 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.641693 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.641870 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.642014 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.642163 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.642306 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.642454 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.642603 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.642603 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.642903 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.643054 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.643196 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.643345 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.643525 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.643690 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.643843 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.643996 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.644714 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.644878 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.645029 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.645173 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.645314 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.645523 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.645675 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.645818 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.646219 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.646366 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.646509 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.646667 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.646824 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.646968 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.647159 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.647307 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.647682 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.647977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.648163 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.648319 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.648471 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.648636 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.648788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.649173 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.649329 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.649488 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.649647 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.649793 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.650689 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.650842 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.650993 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.651147 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.651297 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.651471 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.651641 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.651793 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.651943 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.652093 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.652248 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.652391 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.652532 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.652681 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.652826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.652968 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.653118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.653261 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.653415 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.653568 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.653719 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.653872 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.654028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.654172 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.654314 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.654463 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.654613 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.654756 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.655158 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.655312 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.655471 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.655630 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.655790 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.655943 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.656093 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.656236 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.656377 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.656528 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.656682 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.656833 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.656985 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.657127 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:40:57.657270 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.657412 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.657564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.658150 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.658312 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.658464 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.658607 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.658756 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.658905 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.659531 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.659702 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.659864 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.660009 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.660153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.660309 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.660484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.660834 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.660985 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.661137 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.661289 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.661446 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.661591 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.661733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.661875 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.662017 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.662159 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.662316 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.662316 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.662613 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.662763 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.662906 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.663057 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.663212 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.663377 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.663552 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.663696 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.663846 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.663997 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.664139 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.664281 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.664434 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.664576 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.664725 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.664878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.665029 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.665171 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.665319 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.665469 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.666257 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.666418 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.666569 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.666712 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.666853 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.667006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.667157 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.667300 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.667557 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.667707 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.667861 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.668012 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.668272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.668434 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.668587 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.668731 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.668881 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.669024 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.669186 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.669330 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.669637 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.669794 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.669946 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.670088 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.670240 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.670383 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.670383 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.670669 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.671018 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.671186 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.671457 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.671628 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.671791 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.671947 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.672097 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.672254 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.672411 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.672560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.672708 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.672864 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.673019 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.673182 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.673331 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.673501 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.673651 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.673800 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.673955 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.674114 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.674271 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.674427 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.674575 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.674731 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.674881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.675039 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.675195 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.675351 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.675621 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.675772 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.675939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.676134 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.676295 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.676443 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.676590 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.676738 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.676899 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.677057 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.677205 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.677361 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.677517 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.677677 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.677839 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.677990 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.678138 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.678286 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.678542 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.678708 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.678869 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.679027 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.679214 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.679365 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.679688 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.679891 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.680057 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.680241 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.680395 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.680552 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.680708 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.680872 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.681224 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.681383 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.681532 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.681688 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.681838 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.682000 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.682159 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.682330 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.682480 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.682664 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.682832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.682996 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.683153 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.683303 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.683513 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.683677 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.683836 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.683992 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.684141 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.684309 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.684459 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.684608 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.684765 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.684921 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.685078 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.685235 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.685392 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.685550 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.685709 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.685866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.686016 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.686164 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.686334 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.686493 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.686719 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.686878 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.687035 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.687192 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.687341 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.687527 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.687679 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.687851 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.688011 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.688160 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.688309 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.688477 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.688627 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.688782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.688931 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.689079 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.689226 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.689453 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.689611 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.689918 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.690081 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.690239 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.690388 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.690546 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.690714 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.690864 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.691012 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.691358 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.691564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.691681 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.691780 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.691874 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.691968 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.692052 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.692144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.692235 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.692317 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.692398 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.692487 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.692568 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.692663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.692663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.692821 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.692911 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.693000 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.693088 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.693183 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.693273 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.693361 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.693449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.693529 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.693598 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.693686 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.693768 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.693856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.693937 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.694017 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.694116 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.694199 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.694288 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.694370 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.694459 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.694540 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.694630 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.694713 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.694793 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.694873 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.694961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.695042 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.695131 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.695221 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.695302 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.695394 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.695509 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.695592 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.695676 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.695747 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.695822 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.695892 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.695959 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.696041 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.696118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.696194 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.696263 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.696338 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.696407 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.696407 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.696540 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.696608 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.696708 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.696794 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.696867 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.696944 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.697015 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.697082 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.697157 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.697157 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.697322 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.697408 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.697479 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.697547 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.697614 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.697681 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.697758 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.697829 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.697897 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.697973 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.697973 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.698122 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.698192 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.698267 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.698336 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.698403 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.698482 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.698572 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.698676 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.698760 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.698852 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.698932 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.699004 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.699079 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.699149 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.699217 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.699299 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.699386 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.699386 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.699562 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.699637 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.699714 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.699784 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.699861 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.699938 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.700008 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.700083 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.700152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.700227 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.700304 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.700375 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.700443 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.700510 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.700600 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.700683 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.700760 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.700836 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.700912 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.700989 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.701059 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.701137 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.701214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.701291 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.701368 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.701437 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.701511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.701809 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.702733 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.702830 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.702934 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.703030 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.703116 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.703214 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.703300 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.703383 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.703566 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.703653 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.703798 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.703886 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.703969 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.704060 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.704152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.704236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.704332 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.704425 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.704509 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.704744 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.704838 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.705050 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.705155 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.705356 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.705524 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.705659 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.705751 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.705965 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.706064 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.706272 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.706362 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.706576 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.706675 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.706885 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.706977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.707193 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.707285 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.707527 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.707623 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.707838 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.707944 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.708142 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.708242 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.708460 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.708551 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.708765 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.708955 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.709088 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.709215 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.709378 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.709510 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.709668 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.709861 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.710143 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.710276 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.710403 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.710610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.710750 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.710886 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.711014 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.711142 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.711308 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.711589 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.711732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.711902 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.712041 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.712303 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.712926 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.713070 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.713200 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.713327 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.713465 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.713596 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.713724 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.713865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.714001 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.714129 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.714257 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.714384 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.714539 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.714765 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.714898 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.715025 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.715153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.715289 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.715447 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.715591 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.715723 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.715852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.716032 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.716174 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.716368 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.716514 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.716705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.716925 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.717056 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.717183 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.717310 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.717437 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.717610 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.717752 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.717915 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.718048 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.718218 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.718357 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.718519 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.718663 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.718818 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.718956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.719119 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.719251 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.719576 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.719735 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.719735 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.720009 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.720255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.720397 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.720536 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.720665 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.720793 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.720921 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.721049 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.721176 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.721316 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.721452 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.721697 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.721831 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.721968 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.722106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.722258 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.722466 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.722606 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.722742 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.722742 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.722983 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.723121 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.723257 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.723386 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.723542 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.723672 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.723809 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.723971 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.724112 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.724282 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.724427 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.724604 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.724744 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.724911 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.725051 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.725230 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.725363 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.725541 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.725681 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.725856 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.725988 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.726199 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.726410 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.726554 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.726684 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.726819 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.726955 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.727092 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.727222 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.727363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.727524 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.727836 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.727976 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.728651 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.728799 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.728930 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.729058 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.729185 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.729313 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.729467 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.729629 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.729825 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.729957 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.730094 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.730238 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.730446 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.730588 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.730719 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.730847 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.730982 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.731111 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.731275 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.731472 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.732292 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.732457 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.732679 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.732822 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.732961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.733091 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.733227 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.733365 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.733365 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.733653 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.733653 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.733934 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.734070 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.734207 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.734207 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.734449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.734588 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.734724 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.734860 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.734995 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.735124 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.735252 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.735389 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.735561 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.735693 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.735839 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.735974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.736111 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.736247 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.736376 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.736504 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.736639 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.736775 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.736911 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.737049 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.737186 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.737322 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.737457 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.737585 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.737723 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.737858 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.737987 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.738123 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.738251 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.738387 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.738524 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.738653 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.738782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.738917 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.739045 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.739180 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.739314 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.739459 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.739659 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.739815 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.740011 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.740157 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.740287 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.740438 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.740634 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.740773 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.740903 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.741044 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.741174 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.741302 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.741430 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.741566 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.741737 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.742047 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.742268 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.742489 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.742489 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.742852 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.742852 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.743120 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.743261 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.743390 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.743604 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.743746 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.743892 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.744025 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.744195 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.744328 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.744457 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.744594 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.744732 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.744862 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.744991 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.745128 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.745258 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.745386 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.745586 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.745717 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.745845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.745979 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.746116 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.746267 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.746404 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.746532 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.746668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.746796 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.746973 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.747114 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.747292 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.747451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.747627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.747767 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.747936 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.748077 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.748263 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.748407 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.748580 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.748719 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.748895 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.749105 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.749243 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.749375 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.749531 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.749688 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.749859 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.750007 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.750210 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.750345 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.750482 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.750627 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.750840 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.750982 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.751112 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.751241 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.751371 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.751544 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.751712 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.751881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.752019 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.752159 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.752338 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.752486 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.752701 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.752858 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.753074 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.753213 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.753342 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.753484 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.753620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.753749 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.753881 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.754009 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.754170 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.754311 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.754484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.754624 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.754804 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.754942 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.755110 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.755287 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.755467 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.755599 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.755727 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.755864 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.756037 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.756170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.756357 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.756497 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.756662 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.756805 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.756985 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.757117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.757294 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.757426 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.757627 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.757774 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.757911 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.758061 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.758192 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.758332 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.758524 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.758671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.758831 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.758972 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.759159 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.759312 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.759543 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.759700 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.759874 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.760014 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.760252 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.760395 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.760522 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.760652 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.760866 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.761014 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.761143 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.761272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.761441 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.761583 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.761757 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.761942 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.762076 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.762205 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.762375 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.762510 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.762662 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.762868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.763011 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.763248 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.763248 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.763549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.763680 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.763820 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.763960 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.764098 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.764228 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.764369 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.764500 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.764635 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.764771 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.764908 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.765046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.765328 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.765471 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.765635 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.765771 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.765948 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.766080 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.766256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.766387 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.766563 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.766705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.766870 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.767005 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.767174 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.767308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.767532 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.767677 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.767851 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.767984 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.768178 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.768317 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.768490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.768631 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.768810 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.768939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.769129 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.769240 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.769438 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.769566 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.769749 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.769890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.770064 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.770196 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.770379 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.770500 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.770696 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.770810 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.771011 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.771119 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.771320 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.771447 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.771660 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.771761 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.771974 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.772081 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.772293 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.772394 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.772675 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.772823 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.772986 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.773152 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.773303 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.773467 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.773617 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.773768 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.773930 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.774078 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.774257 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.774398 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.775523 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.775622 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.775716 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.775814 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.775906 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.775990 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.776080 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.776164 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.776310 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.776412 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.776623 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.776722 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.776949 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.777041 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.777264 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.777357 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.777595 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.777687 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.777915 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.778007 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.778244 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.778338 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.778570 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.778672 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.778881 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.778981 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.779208 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.779307 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.779546 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.779641 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.779861 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.780296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.780472 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.780710 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.780710 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.781031 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.781031 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.781399 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.781553 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.781729 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.781879 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.782066 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.782218 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.782384 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.782529 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.782673 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.782818 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.782980 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.783215 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.783382 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.783628 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.783797 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.783944 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.784088 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.784245 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.784403 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.784547 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.784691 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.784833 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.784977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.785128 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.785273 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.785415 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.785558 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.785701 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.785852 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.785852 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.786209 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.786365 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.786517 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.786661 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.786813 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.786982 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.787129 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.787278 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.787469 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.787621 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.787776 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.787921 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.788076 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.788221 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.788382 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.788527 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.788689 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.788848 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.788993 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.789137 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.789279 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.789431 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.789598 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.789755 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.789908 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.790052 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.790207 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.790360 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.790558 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.791264 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.791367 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.791491 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.791586 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.791679 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.791764 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.791871 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.791984 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.792078 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.792301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.792402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.792621 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.792721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.792940 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.793033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.793259 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.793362 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.793574 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.793663 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.793889 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.794061 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.794223 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.794375 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.794543 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.794701 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.794853 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.794996 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.795148 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.795292 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.795461 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.795646 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.795796 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.795979 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.796141 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.796293 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.796456 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.796602 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.796744 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.796899 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.797042 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.797185 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.797340 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.797486 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.797629 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.797780 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.797937 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.798080 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.798222 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.798376 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.798527 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.798687 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.798832 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.798975 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.799117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.799268 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.799432 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.799597 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.799749 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.799893 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.800036 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.800203 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.800359 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.800503 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.800654 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.800806 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.800958 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.801124 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.801300 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.801462 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.801616 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.801776 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.801932 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.802121 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.802307 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.802455 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.802604 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.802748 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.802899 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.803051 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.803195 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.803461 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.803616 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.803777 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.804007 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.804171 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.804327 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.804471 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.804614 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.804756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.804908 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.805066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.805211 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.805354 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.805497 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.805641 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.805793 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.805938 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.806114 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.806275 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.806426 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.806570 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.806726 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.806877 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.807021 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.807165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.807314 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.807503 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.807668 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.807814 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.807957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.808111 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.808255 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.808405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.808556 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.808700 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.808880 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.809039 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.809191 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.809348 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.809516 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.809673 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.809842 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.809999 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.810162 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.810328 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.810473 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.810624 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.810768 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.810910 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.811053 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.811210 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.811362 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.811544 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.811698 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.811848 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.812009 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.812154 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.812339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.812496 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.812648 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.812792 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.812943 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.813094 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.813239 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.813406 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.813623 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.813779 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.813938 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.814196 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.814354 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.814515 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.814740 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.814904 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.815055 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.815207 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.815352 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.815548 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.815693 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.815854 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.816007 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.816007 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.816299 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.816451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.816603 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.816603 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.816898 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.817044 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.817188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.817337 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.817489 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.817642 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.817787 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.817929 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.818089 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.818243 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.818396 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.818541 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.818684 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.818827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.818970 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.819114 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.819269 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.819455 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.819607 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.819758 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.819912 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.820064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.820223 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.820371 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.820520 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.820672 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.820815 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.820971 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.821127 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.821280 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.821436 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.821582 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.821747 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.821986 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.822133 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.822284 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.822475 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.822631 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.822777 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.822934 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.823078 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.823229 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.823373 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.823542 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.823774 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.823941 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.824106 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.824274 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.824426 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.824578 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.824729 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.824876 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.825025 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.825169 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.825311 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.825460 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.825615 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.825760 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.825904 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.826061 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.826212 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.826363 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.826515 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.826666 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.826810 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.826961 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.827104 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.827254 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.827405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.827405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.827720 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.827971 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.828122 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.828278 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.828278 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.828556 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.828700 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.828859 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.829006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.829162 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.829307 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.829458 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.829609 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.829752 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.829905 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.830058 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.830209 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.830355 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.830729 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.830890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.831037 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.831195 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.831339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.831519 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.831681 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.831833 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.831985 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.832150 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.832294 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.832437 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.832626 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.832769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.832926 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.833076 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.833221 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.833363 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.833512 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.833663 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.833902 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.834071 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.834219 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.834369 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.834514 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.834670 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.834822 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.834966 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.835116 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.835269 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.835443 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.835644 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.835806 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.835952 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.836114 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.836259 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.836411 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.836565 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.836724 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.836877 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.837020 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.837163 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.837821 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.837973 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.838117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.838261 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.838423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.838567 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.838718 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.838871 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.839022 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.839173 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.839323 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.839505 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.839703 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.839851 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.839995 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.840182 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.840347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.840539 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.840683 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.840826 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.840976 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.841127 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.841278 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.841431 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.841574 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.841718 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.841869 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.842020 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.842164 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.842325 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.842469 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.842661 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.842810 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.842953 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.843103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.843261 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.843406 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.843577 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.843721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.843893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.844120 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.844280 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.844425 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.844576 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.844728 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.844880 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.845038 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.845191 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.845335 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.845485 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.845667 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.845667 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 11 06:40:57.845955 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.845955 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.845955 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.845955 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.846520 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.846520 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.846808 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.846949 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.847261 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.847593 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.847902 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.848215 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.848521 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.848829 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.849138 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.849446 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.849751 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.850057 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.850368 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.850675 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.850984 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.851292 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.851623 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.851931 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.852268 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.852601 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.852921 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.853809 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.854132 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.854460 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.854775 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.855101 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.855473 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.855772 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.856085 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.856424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.856740 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.857055 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.857377 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.857692 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.858004 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.858318 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.858651 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.858981 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.859293 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.859656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.859977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.860301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.860620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.860935 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.861266 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.861579 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.861892 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.862204 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.862516 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.862827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.863145 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.863479 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.863795 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.864113 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.864428 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.864754 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.865083 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.865396 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.865721 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.866046 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.866393 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.866712 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.867057 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.867394 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.867735 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.868052 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.868359 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:40:57.868630 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 11 06:40:57.906828 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO dbcounter [None req-2423bbce-75b4-4687-9cb5-f5e7787f5aae None None] Registered counter for database nova_api Oct 11 06:40:57.926943 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_db.sqlalchemy.engines [None req-2423bbce-75b4-4687-9cb5-f5e7787f5aae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 06:40:57.930565 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO dbcounter [None req-ddeefd13-5c16-4e7d-952b-3acc3df827b9 None None] Registered counter for database nova_api Oct 11 06:40:57.934181 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writer thread running {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 06:40:57.951607 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_db.sqlalchemy.engines [None req-ddeefd13-5c16-4e7d-952b-3acc3df827b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 06:40:57.958385 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writer thread running {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 06:40:57.989061 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.context [None req-2423bbce-75b4-4687-9cb5-f5e7787f5aae None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e62ab37f-4106-4036-9988-c6129f938802(cell1) {{(pid=125266) load_cells /opt/stack/nova/nova/context.py:464}} Oct 11 06:40:57.993074 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2423bbce-75b4-4687-9cb5-f5e7787f5aae None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:40:57.994065 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2423bbce-75b4-4687-9cb5-f5e7787f5aae None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:40:57.995689 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2423bbce-75b4-4687-9cb5-f5e7787f5aae None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:40:57.996422 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2423bbce-75b4-4687-9cb5-f5e7787f5aae None None] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:40:57.996866 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2423bbce-75b4-4687-9cb5-f5e7787f5aae None None] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:40:57.998854 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2423bbce-75b4-4687-9cb5-f5e7787f5aae None None] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:40:58.000859 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO dbcounter [None req-2423bbce-75b4-4687-9cb5-f5e7787f5aae None None] Registered counter for database nova_cell0 Oct 11 06:40:58.004869 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO dbcounter [None req-2423bbce-75b4-4687-9cb5-f5e7787f5aae None None] Registered counter for database nova_cell1 Oct 11 06:40:58.012563 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_db.sqlalchemy.engines [None req-2423bbce-75b4-4687-9cb5-f5e7787f5aae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 06:40:58.014236 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.context [None req-ddeefd13-5c16-4e7d-952b-3acc3df827b9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e62ab37f-4106-4036-9988-c6129f938802(cell1) {{(pid=125267) load_cells /opt/stack/nova/nova/context.py:464}} Oct 11 06:40:58.014356 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_db.sqlalchemy.engines [None req-2423bbce-75b4-4687-9cb5-f5e7787f5aae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 06:40:58.018294 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ddeefd13-5c16-4e7d-952b-3acc3df827b9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:40:58.018768 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ddeefd13-5c16-4e7d-952b-3acc3df827b9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:40:58.020080 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writer thread running {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 06:40:58.020360 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ddeefd13-5c16-4e7d-952b-3acc3df827b9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:40:58.021100 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ddeefd13-5c16-4e7d-952b-3acc3df827b9 None None] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:40:58.021545 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ddeefd13-5c16-4e7d-952b-3acc3df827b9 None None] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:40:58.023558 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ddeefd13-5c16-4e7d-952b-3acc3df827b9 None None] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:40:58.025592 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO dbcounter [None req-ddeefd13-5c16-4e7d-952b-3acc3df827b9 None None] Registered counter for database nova_cell0 Oct 11 06:40:58.029620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO dbcounter [None req-ddeefd13-5c16-4e7d-952b-3acc3df827b9 None None] Registered counter for database nova_cell1 Oct 11 06:40:58.036982 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_db.sqlalchemy.engines [None req-ddeefd13-5c16-4e7d-952b-3acc3df827b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 06:40:58.039209 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_db.sqlalchemy.engines [None req-ddeefd13-5c16-4e7d-952b-3acc3df827b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 06:40:58.045502 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writer thread running {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 06:40:58.046805 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writer thread running {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 06:40:58.161055 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writer thread running {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 06:40:58.171957 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO dbcounter [None req-2423bbce-75b4-4687-9cb5-f5e7787f5aae None None] Registered counter for database nova_cell0 Oct 11 06:40:58.178563 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_db.sqlalchemy.engines [None req-2423bbce-75b4-4687-9cb5-f5e7787f5aae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 06:40:58.183712 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writer thread running {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 06:40:58.197522 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO dbcounter [None req-ddeefd13-5c16-4e7d-952b-3acc3df827b9 None None] Registered counter for database nova_cell0 Oct 11 06:40:58.204224 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_db.sqlalchemy.engines [None req-ddeefd13-5c16-4e7d-952b-3acc3df827b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 06:40:58.208661 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writer thread running {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 06:40:58.503012 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: WARNING keystonemiddleware.auth_token [None req-2423bbce-75b4-4687-9cb5-f5e7787f5aae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 06:40:58.509822 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: WARNING keystonemiddleware.auth_token [None req-2423bbce-75b4-4687-9cb5-f5e7787f5aae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 06:40:58.525914 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: WARNING keystonemiddleware.auth_token [None req-ddeefd13-5c16-4e7d-952b-3acc3df827b9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 06:40:58.533435 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: WARNING keystonemiddleware.auth_token [None req-ddeefd13-5c16-4e7d-952b-3acc3df827b9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 06:40:58.855026 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: WARNING keystonemiddleware.auth_token [None req-2423bbce-75b4-4687-9cb5-f5e7787f5aae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 06:40:58.861092 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: WARNING keystonemiddleware.auth_token [None req-2423bbce-75b4-4687-9cb5-f5e7787f5aae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 06:40:58.866374 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563bfac3c9c0 pid: 125266 (default app) Oct 11 06:40:58.876255 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: WARNING keystonemiddleware.auth_token [None req-ddeefd13-5c16-4e7d-952b-3acc3df827b9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 06:40:58.882315 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: WARNING keystonemiddleware.auth_token [None req-ddeefd13-5c16-4e7d-952b-3acc3df827b9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 06:40:58.887656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563bfac3c9c0 pid: 125267 (default app) Oct 11 06:41:33.063237 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=3 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:41:33.064310 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=3 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:41:33.065181 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=3 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:41:33.066072 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=3 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:41:34.121960 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-783ddfc5-c042-4e7a-9f39-5af7c8ddc053 tempest-VolumesGetTestJSON-1016101688 tempest-VolumesGetTestJSON-1016101688-project] Action: 'create', calling method: .version_select at 0x7f8e27cd94c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-291443817", "metadata": {"Type": "work"}}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:41:35.776940 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-783ddfc5-c042-4e7a-9f39-5af7c8ddc053 tempest-VolumesGetTestJSON-1016101688 tempest-VolumesGetTestJSON-1016101688-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.727976 Oct 11 06:41:35.787946 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1/1] 10.222.0.39 () {60 vars in 1156 bytes} [Tue Oct 11 06:41:33 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2740 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 11 06:41:35.798614 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=3 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:41:35.801143 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=3 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:41:35.806355 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=3 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:41:35.809211 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=3 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:41:36.088462 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-15b6548e-9985-4aff-8c47-fd988ca00463 tempest-VolumesTestJSON-2005999983 tempest-VolumesTestJSON-2005999983-project] Calling method '.version_select at 0x7f8e27bac3a0>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:41:36.253882 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-15b6548e-9985-4aff-8c47-fd988ca00463 tempest-VolumesTestJSON-2005999983 tempest-VolumesTestJSON-2005999983-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/bd913a79-5241-46e5-9d69-35dcbc9eaf21" status: 200 len: 350 microversion: 2.1 time: 0.169404 Oct 11 06:41:36.254442 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 2/2] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Oct 11 06:41:36 2022] GET /compute/v2.1/os-volumes/bd913a79-5241-46e5-9d69-35dcbc9eaf21 => generated 350 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:41:36.319639 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9855b453-0db3-43ac-9b4a-65e91dbb8d9f tempest-VolumesGetTestJSON-1016101688 tempest-VolumesGetTestJSON-1016101688-project] Calling method '.version_select at 0x7f8e27d23160>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:41:36.858658 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9855b453-0db3-43ac-9b4a-65e91dbb8d9f tempest-VolumesGetTestJSON-1016101688 tempest-VolumesGetTestJSON-1016101688-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/3b19dfbb-10c4-4545-a834-944f5fbf30dc" status: 200 len: 353 microversion: 2.1 time: 1.068264 Oct 11 06:41:36.860711 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1/3] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Oct 11 06:41:35 2022] GET /compute/v2.1/os-volumes/3b19dfbb-10c4-4545-a834-944f5fbf30dc => generated 353 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:41:36.878023 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-40ea1f1e-6564-4f5a-b239-a15bdb6fdd88 tempest-VolumesGetTestJSON-1016101688 tempest-VolumesGetTestJSON-1016101688-project] Calling method '.version_select at 0x7f8e27bacaf0>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:41:36.990194 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-40ea1f1e-6564-4f5a-b239-a15bdb6fdd88 tempest-VolumesGetTestJSON-1016101688 tempest-VolumesGetTestJSON-1016101688-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/3b19dfbb-10c4-4545-a834-944f5fbf30dc" status: 200 len: 353 microversion: 2.1 time: 0.116025 Oct 11 06:41:37.010737 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 3/4] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Oct 11 06:41:36 2022] GET /compute/v2.1/os-volumes/3b19dfbb-10c4-4545-a834-944f5fbf30dc => generated 353 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:41:37.010931 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-eb3af432-af7c-408b-a3b0-72b3a4964aeb tempest-VolumesGetTestJSON-1016101688 tempest-VolumesGetTestJSON-1016101688-project] Calling method '.version_select at 0x7f8e27beb3a0>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:41:37.137721 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-eb3af432-af7c-408b-a3b0-72b3a4964aeb tempest-VolumesGetTestJSON-1016101688 tempest-VolumesGetTestJSON-1016101688-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/3b19dfbb-10c4-4545-a834-944f5fbf30dc" status: 202 len: 0 microversion: 2.1 time: 0.131535 Oct 11 06:41:37.141790 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 2/5] 10.222.0.39 () {58 vars in 1248 bytes} [Tue Oct 11 06:41:37 2022] DELETE /compute/v2.1/os-volumes/3b19dfbb-10c4-4545-a834-944f5fbf30dc => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 06:41:37.147140 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b7959383-b1f7-4a13-9122-cba05c601c2a tempest-VolumesGetTestJSON-1016101688 tempest-VolumesGetTestJSON-1016101688-project] Calling method '.version_select at 0x7f8e27b451f0>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:41:37.260098 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b7959383-b1f7-4a13-9122-cba05c601c2a tempest-VolumesGetTestJSON-1016101688 tempest-VolumesGetTestJSON-1016101688-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/3b19dfbb-10c4-4545-a834-944f5fbf30dc" status: 200 len: 352 microversion: 2.1 time: 0.115755 Oct 11 06:41:37.260098 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 4/6] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Oct 11 06:41:37 2022] GET /compute/v2.1/os-volumes/3b19dfbb-10c4-4545-a834-944f5fbf30dc => generated 352 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:41:38.029151 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6566f739-a47b-46a9-b9e8-7ea485e5f70a tempest-VolumesTestJSON-2005999983 tempest-VolumesTestJSON-2005999983-project] Calling method '.version_select at 0x7f8e27beba60>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:41:38.106609 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6566f739-a47b-46a9-b9e8-7ea485e5f70a tempest-VolumesTestJSON-2005999983 tempest-VolumesTestJSON-2005999983-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/2532b6bd-7d00-4983-9b73-94bb2e8e51a5" status: 200 len: 350 microversion: 2.1 time: 0.082200 Oct 11 06:41:38.107537 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 3/7] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Oct 11 06:41:38 2022] GET /compute/v2.1/os-volumes/2532b6bd-7d00-4983-9b73-94bb2e8e51a5 => generated 350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:41:38.273916 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c0044b35-4e89-4bd7-bbe8-ea5dda52de0c tempest-VolumesGetTestJSON-1016101688 tempest-VolumesGetTestJSON-1016101688-project] Calling method '.version_select at 0x7f8e27bacc10>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:41:38.321755 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-c0044b35-4e89-4bd7-bbe8-ea5dda52de0c tempest-VolumesGetTestJSON-1016101688 tempest-VolumesGetTestJSON-1016101688-project] HTTP exception thrown: Volume 3b19dfbb-10c4-4545-a834-944f5fbf30dc could not be found. Oct 11 06:41:38.325852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c0044b35-4e89-4bd7-bbe8-ea5dda52de0c tempest-VolumesGetTestJSON-1016101688 tempest-VolumesGetTestJSON-1016101688-project] Request method failure captured: Oct 11 06:41:38.325852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: request: GET /compute/v2.1/os-volumes/3b19dfbb-10c4-4545-a834-944f5fbf30dc HTTP/1.1 Oct 11 06:41:38.325852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept: application/json Oct 11 06:41:38.325852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Oct 11 06:41:38.325852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Connection: close Oct 11 06:41:38.325852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Length: 0 Oct 11 06:41:38.325852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Type: application/json Oct 11 06:41:38.325852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Host: 10.222.0.39 Oct 11 06:41:38.325852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Oct 11 06:41:38.325852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.12 Oct 11 06:41:38.325852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABjRRAcV51e_m7nSmSeRaN0ac0-h6y34UTS8dn9K4WTr_UhxBkbHaQxMMAVqiLNcvk4Z2_AAcyjztQV7CAiBln8Hx2S6jVEQ7urYVGt_lx-6KwKcU_yfDd-cknMU2IZz9JrOW1JIY5JuxcdyxYQncvzDYsE2gYVOhUsp9flqHKNNe2U8VI Oct 11 06:41:38.325852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Oct 11 06:41:38.325852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Oct 11 06:41:38.325852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Oct 11 06:41:38.325852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Oct 11 06:41:38.325852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Oct 11 06:41:38.325852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Oct 11 06:41:38.325852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Id: 211c913f67af4c30899f4a7602ddaa5e Oct 11 06:41:38.325852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-VolumesGetTestJSON-1016101688 Oct 11 06:41:38.325852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Role: reader,member Oct 11 06:41:38.325852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Oct 11 06:41:38.327381 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_211c913f67af4c30899f4a7602ddaa5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/211c913f67af4c30899f4a7602ddaa5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/211c913f67af4c30899f4a7602ddaa5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/211c913f67af4c30899f4a7602ddaa5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 06:41:38.327381 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-VolumesGetTestJSON-1016101688 Oct 11 06:41:38.327381 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 211c913f67af4c30899f4a7602ddaa5e Oct 11 06:41:38.327381 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-VolumesGetTestJSON-1016101688 Oct 11 06:41:38.327381 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User: tempest-VolumesGetTestJSON-1016101688-project Oct 11 06:41:38.327381 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Oct 11 06:41:38.327381 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Oct 11 06:41:38.327381 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Id: 4bf1711f968a47179cfb0e6444203f7d Oct 11 06:41:38.327381 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-VolumesGetTestJSON-1016101688-project Oct 11 06:41:38.327381 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: method: Oct 11 06:41:38.327381 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: exception: Volume 3b19dfbb-10c4-4545-a834-944f5fbf30dc could not be found. Oct 11 06:41:38.327381 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: action_args: {'id': '3b19dfbb-10c4-4545-a834-944f5fbf30dc'} Oct 11 06:41:38.327381 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 06:41:38.328256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:41:38.328256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 06:41:38.328256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 06:41:38.328256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 06:41:38.328256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 06:41:38.328256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 06:41:38.328256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 06:41:38.328256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 06:41:38.328256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 06:41:38.328256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 06:41:38.328256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 06:41:38.328256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 06:41:38.328256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 06:41:38.328256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 06:41:38.328256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 06:41:38.328256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3b19dfbb-10c4-4545-a834-944f5fbf30dc could not be found. (HTTP 404) (Request-ID: req-9ced877b-3bdd-4f1e-bc0d-67d88a4bcfe3) Oct 11 06:41:38.328256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:38.328256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:41:38.328256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:38.329410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:41:38.329410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 11 06:41:38.329410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 11 06:41:38.329410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 06:41:38.329410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 06:41:38.329410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 06:41:38.329410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 06:41:38.329410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 06:41:38.329410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 06:41:38.329410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 06:41:38.329410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 06:41:38.329410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 06:41:38.329410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 06:41:38.329410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 06:41:38.329410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 06:41:38.329410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 06:41:38.329410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 06:41:38.329410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 06:41:38.329410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 06:41:38.333366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 06:41:38.333366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 06:41:38.333366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 06:41:38.333366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 06:41:38.333366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3b19dfbb-10c4-4545-a834-944f5fbf30dc could not be found. Oct 11 06:41:38.333366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:38.333366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:41:38.333366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:38.333366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:41:38.333366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:41:38.333366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:41:38.333366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 06:41:38.333366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 06:41:38.333366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 06:41:38.333366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 06:41:38.333366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 06:41:38.333366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 06:41:38.333366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 11 06:41:38.333366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 06:41:38.336410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3b19dfbb-10c4-4545-a834-944f5fbf30dc could not be found. Oct 11 06:41:38.336410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:38.336410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:41:38.336410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:38.336410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:41:38.336410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:41:38.336410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:41:38.336410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 06:41:38.336410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 06:41:38.336410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3b19dfbb-10c4-4545-a834-944f5fbf30dc could not be found. Oct 11 06:41:38.336410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:38.336410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c0044b35-4e89-4bd7-bbe8-ea5dda52de0c tempest-VolumesGetTestJSON-1016101688 tempest-VolumesGetTestJSON-1016101688-project] Returning 404 to user: Volume 3b19dfbb-10c4-4545-a834-944f5fbf30dc could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 06:41:38.336410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c0044b35-4e89-4bd7-bbe8-ea5dda52de0c tempest-VolumesGetTestJSON-1016101688 tempest-VolumesGetTestJSON-1016101688-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/3b19dfbb-10c4-4545-a834-944f5fbf30dc" status: 404 len: 109 microversion: 2.1 time: 0.057256 Oct 11 06:41:38.336410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 5/8] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Oct 11 06:41:38 2022] GET /compute/v2.1/os-volumes/3b19dfbb-10c4-4545-a834-944f5fbf30dc => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 06:41:39.761262 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0cd313a0-1744-4f5c-b924-2aa38a2655b8 tempest-VolumesTestJSON-2005999983 tempest-VolumesTestJSON-2005999983-project] Calling method '.version_select at 0x7f8e27bebaf0>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:41:39.865764 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0cd313a0-1744-4f5c-b924-2aa38a2655b8 tempest-VolumesTestJSON-2005999983 tempest-VolumesTestJSON-2005999983-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/1447c5b4-7b8f-4598-80f5-1c4a38e0a6f0" status: 200 len: 351 microversion: 2.1 time: 0.108875 Oct 11 06:41:39.866547 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 4/9] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Oct 11 06:41:39 2022] GET /compute/v2.1/os-volumes/1447c5b4-7b8f-4598-80f5-1c4a38e0a6f0 => generated 351 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:41:39.882294 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d797c7d0-316a-43f4-bdcc-a77371f0a29d tempest-VolumesTestJSON-2005999983 tempest-VolumesTestJSON-2005999983-project] Calling method '.version_select at 0x7f8e28507b80>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:41:40.008632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d797c7d0-316a-43f4-bdcc-a77371f0a29d tempest-VolumesTestJSON-2005999983 tempest-VolumesTestJSON-2005999983-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.132198 Oct 11 06:41:40.010336 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 6/10] 10.222.0.39 () {58 vars in 1134 bytes} [Tue Oct 11 06:41:39 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:41:40.025897 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-61623606-b813-4c65-8aa3-ee325c8906f8 tempest-VolumesTestJSON-2005999983 tempest-VolumesTestJSON-2005999983-project] Calling method '.version_select at 0x7f8e27beb550>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:41:40.166478 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-61623606-b813-4c65-8aa3-ee325c8906f8 tempest-VolumesTestJSON-2005999983 tempest-VolumesTestJSON-2005999983-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.145039 Oct 11 06:41:40.167355 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 5/11] 10.222.0.39 () {58 vars in 1149 bytes} [Tue Oct 11 06:41:40 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:41:40.182978 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ca897463-076c-47c2-b3fd-f08b760062b1 tempest-VolumesTestJSON-2005999983 tempest-VolumesTestJSON-2005999983-project] Calling method '.version_select at 0x7f8e27b41670>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:41:40.341092 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ca897463-076c-47c2-b3fd-f08b760062b1 tempest-VolumesTestJSON-2005999983 tempest-VolumesTestJSON-2005999983-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.163104 Oct 11 06:41:40.342061 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 7/12] 10.222.0.39 () {58 vars in 1134 bytes} [Tue Oct 11 06:41:40 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:41:40.358823 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-91321e14-ff99-48dd-8ea4-7ef208e8d521 tempest-VolumesTestJSON-2005999983 tempest-VolumesTestJSON-2005999983-project] Calling method '.version_select at 0x7f8e27beb9d0>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:41:40.499107 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-91321e14-ff99-48dd-8ea4-7ef208e8d521 tempest-VolumesTestJSON-2005999983 tempest-VolumesTestJSON-2005999983-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.145403 Oct 11 06:41:40.500597 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 6/13] 10.222.0.39 () {58 vars in 1167 bytes} [Tue Oct 11 06:41:40 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:41:40.516024 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cee3713c-f519-46c5-9b9e-37717b21e40e tempest-VolumesTestJSON-2005999983 tempest-VolumesTestJSON-2005999983-project] Calling method '.version_select at 0x7f8e27b439d0>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:41:40.721884 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cee3713c-f519-46c5-9b9e-37717b21e40e tempest-VolumesTestJSON-2005999983 tempest-VolumesTestJSON-2005999983-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.209954 Oct 11 06:41:40.722448 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 8/14] 10.222.0.39 () {58 vars in 1170 bytes} [Tue Oct 11 06:41:40 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:41:40.741663 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0cdd8560-3e75-4552-b43a-911543582465 tempest-VolumesTestJSON-2005999983 tempest-VolumesTestJSON-2005999983-project] Calling method '.version_select at 0x7f8e27b3f700>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:41:40.988022 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0cdd8560-3e75-4552-b43a-911543582465 tempest-VolumesTestJSON-2005999983 tempest-VolumesTestJSON-2005999983-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.252050 Oct 11 06:41:41.000515 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 7/15] 10.222.0.39 () {58 vars in 1155 bytes} [Tue Oct 11 06:41:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:41:41.005714 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a92cc18f-38a5-4b93-b53e-d5faf5ff8bde tempest-VolumesTestJSON-2005999983 tempest-VolumesTestJSON-2005999983-project] Calling method '.version_select at 0x7f8e27b43790>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:41:41.203609 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a92cc18f-38a5-4b93-b53e-d5faf5ff8bde tempest-VolumesTestJSON-2005999983 tempest-VolumesTestJSON-2005999983-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.202126 Oct 11 06:41:41.204182 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 9/16] 10.222.0.39 () {58 vars in 1188 bytes} [Tue Oct 11 06:41:40 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:41:41.219096 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cb2a5ed9-28af-4314-a199-6f0627feeccf tempest-VolumesTestJSON-2005999983 tempest-VolumesTestJSON-2005999983-project] Calling method '.version_select at 0x7f8e27b3f9d0>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:41:41.481820 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cb2a5ed9-28af-4314-a199-6f0627feeccf tempest-VolumesTestJSON-2005999983 tempest-VolumesTestJSON-2005999983-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.267614 Oct 11 06:41:41.482903 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 8/17] 10.222.0.39 () {58 vars in 1155 bytes} [Tue Oct 11 06:41:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:41:49.897253 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-757c915c-014c-49da-8a3f-6c1a2fcf34ee tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Action: 'create', calling method: .version_select at 0x7f8e27b414c0>, body: {"keypair": {"name": "tempest-keypair-1038104129", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCVJAKK4XyYicCN5QWnDVKsdye2oRVh15lsJtIpkL1jZ6DhPY9TqAhIAOBEZqJVkpGEP4hn8W+2LOiuMWa2Qnl/m2E/6+dwV18x79ohUAGQf0fpKBV4Fr1GZ3YLNQyOH/A=="}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:41:50.023944 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-757c915c-014c-49da-8a3f-6c1a2fcf34ee tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Getting quotas for project bf094dc7d5f1453ba9112d1a1d3f0d9c. Resources: {'key_pairs'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 06:41:50.041370 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-757c915c-014c-49da-8a3f-6c1a2fcf34ee tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Getting quotas for user 1c602e0f9e0e4e479a6a3c32febdb14b and project bf094dc7d5f1453ba9112d1a1d3f0d9c. Resources: {'key_pairs'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 06:41:50.164742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-757c915c-014c-49da-8a3f-6c1a2fcf34ee tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.968184 Oct 11 06:41:50.168160 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 10/18] 10.222.0.39 () {60 vars in 1159 bytes} [Tue Oct 11 06:41:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:41:52.673315 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-77eb52f3-b410-49e3-987f-e3531f27e000 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Action: 'create', calling method: .version_select at 0x7f8e28506a60>, body: {"keypair": {"name": "tempest-keypair-1818048256", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLX31u39hc7nVkz1ewWO+ttWGMqD3T+WHl1mV3k+3yJ/eGNEzqb65Nk4LU2BcTZG6tgDnX3fAJH/yd/86DZ0YJi/yLLGfY2Jid3Xatv2BJKcSF35GSSUbboc4AUsq5lWYw=="}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:41:52.849140 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-77eb52f3-b410-49e3-987f-e3531f27e000 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Getting quotas for project ec4a4c53c1c744688b3bf91e806286bf. Resources: {'key_pairs'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 06:41:52.882432 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-77eb52f3-b410-49e3-987f-e3531f27e000 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Getting quotas for user f95c1cd09e1042abbb5725f241ce147d and project ec4a4c53c1c744688b3bf91e806286bf. Resources: {'key_pairs'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 06:41:53.072012 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-77eb52f3-b410-49e3-987f-e3531f27e000 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.746545 Oct 11 06:41:53.075110 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 9/19] 10.222.0.39 () {62 vars in 1200 bytes} [Tue Oct 11 06:41:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 757 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 06:41:53.782601 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-75fae922-42c7-497c-9143-e1815f81b33a tempest-VolumesNegativeTest-529557693 tempest-VolumesNegativeTest-529557693-project] Action: 'create', calling method: .version_select at 0x7f8e27a82310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1548602654", "metadata": {"Type": "work"}}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:41:53.789939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-75fae922-42c7-497c-9143-e1815f81b33a tempest-VolumesNegativeTest-529557693 tempest-VolumesNegativeTest-529557693-project] Request method failure captured: Oct 11 06:41:53.789939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 11 06:41:53.789939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept: application/json Oct 11 06:41:53.789939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Oct 11 06:41:53.789939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Connection: close Oct 11 06:41:53.789939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Length: 122 Oct 11 06:41:53.789939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Type: application/json Oct 11 06:41:53.789939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Host: 10.222.0.39 Oct 11 06:41:53.789939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Oct 11 06:41:53.789939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.12 Oct 11 06:41:53.789939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABjRRAxttgg5xL11nzq2AcpFzz432vYMdrpWAVr4amO3gmRAJMqaL8Nn5HpgTSobicf76dXjJSKlZUci54lSXRRaAbKrhfAq79G4qljQyhF0AmfVknlZTWEvF_iwVAW7WrD6volev_96YYzXijhAq3bwtGVFdNVTKyDiFjo0IhCBj6_VxU Oct 11 06:41:53.789939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Oct 11 06:41:53.789939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Oct 11 06:41:53.789939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Oct 11 06:41:53.789939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Oct 11 06:41:53.789939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Oct 11 06:41:53.789939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Oct 11 06:41:53.789939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Id: ad85348d701e432ca0f8777fcc134bae Oct 11 06:41:53.789939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-VolumesNegativeTest-529557693 Oct 11 06:41:53.789939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Role: reader,member Oct 11 06:41:53.789939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Oct 11 06:41:53.790976 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ad85348d701e432ca0f8777fcc134bae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ad85348d701e432ca0f8777fcc134bae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ad85348d701e432ca0f8777fcc134bae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ad85348d701e432ca0f8777fcc134bae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 06:41:53.790976 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-VolumesNegativeTest-529557693 Oct 11 06:41:53.790976 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Id: ad85348d701e432ca0f8777fcc134bae Oct 11 06:41:53.790976 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-VolumesNegativeTest-529557693 Oct 11 06:41:53.790976 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User: tempest-VolumesNegativeTest-529557693-project Oct 11 06:41:53.790976 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Oct 11 06:41:53.790976 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Oct 11 06:41:53.790976 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Id: aa7f407234d64999afafe79145d9e36c Oct 11 06:41:53.790976 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-VolumesNegativeTest-529557693-project Oct 11 06:41:53.790976 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Oct 11 06:41:53.790976 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1548602654", "metadata": {"Type": "work"}}} Oct 11 06:41:53.790976 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: method: Oct 11 06:41:53.790976 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 11 06:41:53.791638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1548602654', 'metadata': {'Type': 'work'}}}} Oct 11 06:41:53.791638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 06:41:53.791638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:41:53.791638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 06:41:53.791638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 06:41:53.791638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 06:41:53.791638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise error Oct 11 06:41:53.791638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 11 06:41:53.791638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:53.791638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 11 06:41:53.791638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 11 06:41:53.791638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:53.791638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 11 06:41:53.791638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi '#$%' Oct 11 06:41:53.791638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:53.791638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:41:53.791638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:53.791638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:41:53.791638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:41:53.791638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:41:53.791638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 06:41:53.791638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 06:41:53.792669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 06:41:53.792669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 06:41:53.792669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 06:41:53.792669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 06:41:53.792669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 06:41:53.792669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 06:41:53.792669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 06:41:53.792669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 06:41:53.792669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 06:41:53.792669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 06:41:53.792669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 11 06:41:53.792669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:53.792669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:41:53.792669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:53.792669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:41:53.792669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:41:53.792669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:41:53.792669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 06:41:53.792669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 06:41:53.795755 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 11 06:41:53.795755 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:53.795755 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-75fae922-42c7-497c-9143-e1815f81b33a tempest-VolumesNegativeTest-529557693 tempest-VolumesNegativeTest-529557693-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 06:41:53.795755 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-75fae922-42c7-497c-9143-e1815f81b33a tempest-VolumesNegativeTest-529557693 tempest-VolumesNegativeTest-529557693-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.312524 Oct 11 06:41:53.807383 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 11/20] 10.222.0.39 () {60 vars in 1156 bytes} [Tue Oct 11 06:41:53 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 332 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 06:41:53.820214 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-492bea68-93bb-4622-a636-834b20772a85 tempest-VolumesNegativeTest-529557693 tempest-VolumesNegativeTest-529557693-project] Action: 'create', calling method: .version_select at 0x7f8e27a5a280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1010677478", "metadata": {"Type": "work"}}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:41:53.828103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-492bea68-93bb-4622-a636-834b20772a85 tempest-VolumesNegativeTest-529557693 tempest-VolumesNegativeTest-529557693-project] Request method failure captured: Oct 11 06:41:53.828103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 11 06:41:53.828103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept: application/json Oct 11 06:41:53.828103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Oct 11 06:41:53.828103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Connection: close Oct 11 06:41:53.828103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Length: 120 Oct 11 06:41:53.828103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Type: application/json Oct 11 06:41:53.828103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Host: 10.222.0.39 Oct 11 06:41:53.828103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Oct 11 06:41:53.828103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.12 Oct 11 06:41:53.828103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABjRRAxttgg5xL11nzq2AcpFzz432vYMdrpWAVr4amO3gmRAJMqaL8Nn5HpgTSobicf76dXjJSKlZUci54lSXRRaAbKrhfAq79G4qljQyhF0AmfVknlZTWEvF_iwVAW7WrD6volev_96YYzXijhAq3bwtGVFdNVTKyDiFjo0IhCBj6_VxU Oct 11 06:41:53.828103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Oct 11 06:41:53.828103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Oct 11 06:41:53.828103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Oct 11 06:41:53.828103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Oct 11 06:41:53.828103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Oct 11 06:41:53.828103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Oct 11 06:41:53.828103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Id: ad85348d701e432ca0f8777fcc134bae Oct 11 06:41:53.828103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-VolumesNegativeTest-529557693 Oct 11 06:41:53.828103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Role: reader,member Oct 11 06:41:53.828103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Oct 11 06:41:53.829164 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ad85348d701e432ca0f8777fcc134bae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ad85348d701e432ca0f8777fcc134bae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ad85348d701e432ca0f8777fcc134bae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ad85348d701e432ca0f8777fcc134bae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 06:41:53.829164 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-VolumesNegativeTest-529557693 Oct 11 06:41:53.829164 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Id: ad85348d701e432ca0f8777fcc134bae Oct 11 06:41:53.829164 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-VolumesNegativeTest-529557693 Oct 11 06:41:53.829164 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User: tempest-VolumesNegativeTest-529557693-project Oct 11 06:41:53.829164 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Oct 11 06:41:53.829164 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Oct 11 06:41:53.829164 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Id: aa7f407234d64999afafe79145d9e36c Oct 11 06:41:53.829164 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-VolumesNegativeTest-529557693-project Oct 11 06:41:53.829164 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Oct 11 06:41:53.829164 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1010677478", "metadata": {"Type": "work"}}} Oct 11 06:41:53.829164 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: method: Oct 11 06:41:53.829164 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 11 06:41:53.829751 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1010677478', 'metadata': {'Type': 'work'}}}} Oct 11 06:41:53.829751 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 06:41:53.829751 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:41:53.829751 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 06:41:53.829751 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 06:41:53.829751 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 06:41:53.829751 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise error Oct 11 06:41:53.829751 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 11 06:41:53.829751 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:53.829751 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 11 06:41:53.829751 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 11 06:41:53.829751 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:53.829751 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 11 06:41:53.829751 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi '0' Oct 11 06:41:53.829751 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:53.829751 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:41:53.829751 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:53.829751 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:41:53.829751 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:41:53.829751 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:41:53.829751 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 06:41:53.829751 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 06:41:53.830782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 06:41:53.830782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 06:41:53.830782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 06:41:53.830782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 06:41:53.830782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 06:41:53.830782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 06:41:53.830782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 06:41:53.830782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 06:41:53.830782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 06:41:53.830782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 06:41:53.830782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 11 06:41:53.830782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:53.830782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:41:53.830782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:53.830782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:41:53.830782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:41:53.830782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:41:53.830782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 06:41:53.830782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 06:41:53.831613 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 11 06:41:53.831613 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:53.831613 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-492bea68-93bb-4622-a636-834b20772a85 tempest-VolumesNegativeTest-529557693 tempest-VolumesNegativeTest-529557693-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 06:41:53.845982 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-492bea68-93bb-4622-a636-834b20772a85 tempest-VolumesNegativeTest-529557693 tempest-VolumesNegativeTest-529557693-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.020992 Oct 11 06:41:53.845982 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 12/21] 10.222.0.39 () {60 vars in 1156 bytes} [Tue Oct 11 06:41:53 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 06:41:53.871319 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-588219e5-5c56-456f-996c-a4220a98033c tempest-VolumesNegativeTest-529557693 tempest-VolumesNegativeTest-529557693-project] Action: 'create', calling method: .version_select at 0x7f8e27ab5160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2117482169", "metadata": {"Type": "work"}}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:41:53.872693 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cc88cb89-7593-46f6-8f44-b5255eb562a8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Action: 'create', calling method: .version_select at 0x7f8e27b1f160>, body: {"keypair": {"name": "tempest-keypair-981874670", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyNpg38m41IV7B4YtVBRmSwY1uVnKaV9mRLBulOA4mD4UP3hvbNM/7ivqeAgRBRZLyJyvzfCK2yfh06Fejutwhv0q326K8rNR4H7mpkobwpSKLQLbsNKEo2iPIija7Bgw=="}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:41:53.879108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-588219e5-5c56-456f-996c-a4220a98033c tempest-VolumesNegativeTest-529557693 tempest-VolumesNegativeTest-529557693-project] Request method failure captured: Oct 11 06:41:53.879108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 11 06:41:53.879108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept: application/json Oct 11 06:41:53.879108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Oct 11 06:41:53.879108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Connection: close Oct 11 06:41:53.879108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Length: 119 Oct 11 06:41:53.879108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Type: application/json Oct 11 06:41:53.879108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Host: 10.222.0.39 Oct 11 06:41:53.879108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Oct 11 06:41:53.879108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.12 Oct 11 06:41:53.879108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABjRRAxttgg5xL11nzq2AcpFzz432vYMdrpWAVr4amO3gmRAJMqaL8Nn5HpgTSobicf76dXjJSKlZUci54lSXRRaAbKrhfAq79G4qljQyhF0AmfVknlZTWEvF_iwVAW7WrD6volev_96YYzXijhAq3bwtGVFdNVTKyDiFjo0IhCBj6_VxU Oct 11 06:41:53.879108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Oct 11 06:41:53.879108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Oct 11 06:41:53.879108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Oct 11 06:41:53.879108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Oct 11 06:41:53.879108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Oct 11 06:41:53.879108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Oct 11 06:41:53.879108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Id: ad85348d701e432ca0f8777fcc134bae Oct 11 06:41:53.879108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-VolumesNegativeTest-529557693 Oct 11 06:41:53.879108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Role: reader,member Oct 11 06:41:53.879108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Oct 11 06:41:53.880145 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ad85348d701e432ca0f8777fcc134bae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ad85348d701e432ca0f8777fcc134bae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ad85348d701e432ca0f8777fcc134bae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ad85348d701e432ca0f8777fcc134bae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 06:41:53.880145 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-VolumesNegativeTest-529557693 Oct 11 06:41:53.880145 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Id: ad85348d701e432ca0f8777fcc134bae Oct 11 06:41:53.880145 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-VolumesNegativeTest-529557693 Oct 11 06:41:53.880145 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User: tempest-VolumesNegativeTest-529557693-project Oct 11 06:41:53.880145 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Oct 11 06:41:53.880145 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Oct 11 06:41:53.880145 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Id: aa7f407234d64999afafe79145d9e36c Oct 11 06:41:53.880145 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-VolumesNegativeTest-529557693-project Oct 11 06:41:53.880145 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Oct 11 06:41:53.880145 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2117482169", "metadata": {"Type": "work"}}} Oct 11 06:41:53.880145 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: method: Oct 11 06:41:53.880145 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 11 06:41:53.880742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2117482169', 'metadata': {'Type': 'work'}}}} Oct 11 06:41:53.880742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 06:41:53.880742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:41:53.880742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 06:41:53.880742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 06:41:53.880742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 06:41:53.880742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise error Oct 11 06:41:53.880742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 11 06:41:53.880742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:53.880742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 11 06:41:53.880742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 11 06:41:53.880742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:53.880742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 11 06:41:53.880742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi '' Oct 11 06:41:53.880742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:53.880742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:41:53.880742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:53.880742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:41:53.880742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:41:53.880742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:41:53.880742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 06:41:53.880742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 06:41:53.881732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 06:41:53.881732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 06:41:53.881732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 06:41:53.881732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 06:41:53.881732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 06:41:53.881732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 06:41:53.881732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 06:41:53.881732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 06:41:53.881732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 06:41:53.881732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 06:41:53.881732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 11 06:41:53.881732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:53.881732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:41:53.881732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:53.881732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:41:53.881732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:41:53.881732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:41:53.881732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 06:41:53.881732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 06:41:53.882596 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 11 06:41:53.882596 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:53.889834 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-588219e5-5c56-456f-996c-a4220a98033c tempest-VolumesNegativeTest-529557693 tempest-VolumesNegativeTest-529557693-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 06:41:53.890880 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-588219e5-5c56-456f-996c-a4220a98033c tempest-VolumesNegativeTest-529557693 tempest-VolumesNegativeTest-529557693-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.037009 Oct 11 06:41:53.901152 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 13/22] 10.222.0.39 () {60 vars in 1156 bytes} [Tue Oct 11 06:41:53 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 06:41:53.920650 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6eec7bea-8183-4c10-ad8e-b08463f1fda2 tempest-VolumesNegativeTest-529557693 tempest-VolumesNegativeTest-529557693-project] Calling method '.version_select at 0x7f8e27a65160>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:41:53.929081 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-cc88cb89-7593-46f6-8f44-b5255eb562a8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Getting quotas for project 5af47e2321de4d299ff3a7fb3d3d9e3c. Resources: {'key_pairs'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 06:41:53.939163 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-cc88cb89-7593-46f6-8f44-b5255eb562a8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Getting quotas for user 2e63c3f83f3d41018e6330f26ed7b8a0 and project 5af47e2321de4d299ff3a7fb3d3d9e3c. Resources: {'key_pairs'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 06:41:53.987505 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-6eec7bea-8183-4c10-ad8e-b08463f1fda2 tempest-VolumesNegativeTest-529557693 tempest-VolumesNegativeTest-529557693-project] HTTP exception thrown: Volume tempest-invalid-1870027427 could not be found. Oct 11 06:41:53.990117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6eec7bea-8183-4c10-ad8e-b08463f1fda2 tempest-VolumesNegativeTest-529557693 tempest-VolumesNegativeTest-529557693-project] Request method failure captured: Oct 11 06:41:53.990117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1870027427 HTTP/1.1 Oct 11 06:41:53.990117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept: application/json Oct 11 06:41:53.990117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Oct 11 06:41:53.990117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Connection: close Oct 11 06:41:53.990117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Length: 0 Oct 11 06:41:53.990117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Type: application/json Oct 11 06:41:53.990117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Host: 10.222.0.39 Oct 11 06:41:53.990117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Oct 11 06:41:53.990117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.12 Oct 11 06:41:53.990117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABjRRAxttgg5xL11nzq2AcpFzz432vYMdrpWAVr4amO3gmRAJMqaL8Nn5HpgTSobicf76dXjJSKlZUci54lSXRRaAbKrhfAq79G4qljQyhF0AmfVknlZTWEvF_iwVAW7WrD6volev_96YYzXijhAq3bwtGVFdNVTKyDiFjo0IhCBj6_VxU Oct 11 06:41:53.990117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Oct 11 06:41:53.990117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Oct 11 06:41:53.990117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Oct 11 06:41:53.990117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Oct 11 06:41:53.990117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Oct 11 06:41:53.990117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Oct 11 06:41:53.990117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Id: ad85348d701e432ca0f8777fcc134bae Oct 11 06:41:53.990117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-VolumesNegativeTest-529557693 Oct 11 06:41:53.990117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Role: reader,member Oct 11 06:41:53.990117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Oct 11 06:41:53.991298 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ad85348d701e432ca0f8777fcc134bae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ad85348d701e432ca0f8777fcc134bae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ad85348d701e432ca0f8777fcc134bae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ad85348d701e432ca0f8777fcc134bae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 06:41:53.991298 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-VolumesNegativeTest-529557693 Oct 11 06:41:53.991298 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Id: ad85348d701e432ca0f8777fcc134bae Oct 11 06:41:53.991298 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-VolumesNegativeTest-529557693 Oct 11 06:41:53.991298 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User: tempest-VolumesNegativeTest-529557693-project Oct 11 06:41:53.991298 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Oct 11 06:41:53.991298 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Oct 11 06:41:53.991298 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Id: aa7f407234d64999afafe79145d9e36c Oct 11 06:41:53.991298 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-VolumesNegativeTest-529557693-project Oct 11 06:41:53.991298 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: method: Oct 11 06:41:53.991298 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: exception: Volume tempest-invalid-1870027427 could not be found. Oct 11 06:41:53.991298 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: action_args: {'id': 'tempest-invalid-1870027427'} Oct 11 06:41:53.991298 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 06:41:53.992118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:41:53.992118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 06:41:53.992118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 06:41:53.992118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 06:41:53.992118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 06:41:53.992118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 06:41:53.992118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 06:41:53.992118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 06:41:53.992118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 06:41:53.992118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 06:41:53.992118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 06:41:53.992118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 06:41:53.992118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 06:41:53.992118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 06:41:53.992118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 06:41:53.992118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1870027427 could not be found. (HTTP 404) (Request-ID: req-487c1bef-ba0e-4518-886b-83a0dbd0bfde) Oct 11 06:41:53.992118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:53.992118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:41:53.992118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:53.993188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:41:53.993188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 11 06:41:53.993188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 11 06:41:53.993188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 06:41:53.993188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 06:41:53.993188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 06:41:53.993188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 06:41:53.993188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 06:41:53.993188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 06:41:53.993188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 06:41:53.993188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 06:41:53.993188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 06:41:53.993188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 06:41:53.993188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 06:41:53.993188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 06:41:53.993188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 06:41:53.993188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 06:41:53.993188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 06:41:53.993188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 06:41:53.995140 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 06:41:53.995140 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 06:41:53.995140 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 06:41:53.995140 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 06:41:53.995140 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1870027427 could not be found. Oct 11 06:41:53.995140 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:53.995140 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:41:53.995140 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:53.995140 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:41:53.995140 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:41:53.995140 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:41:53.995140 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 06:41:53.995140 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 06:41:53.995140 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 06:41:53.995140 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 06:41:53.995140 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 06:41:53.995140 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 06:41:53.995140 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 11 06:41:53.995140 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 06:41:53.995140 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1870027427 could not be found. Oct 11 06:41:53.997254 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:53.997254 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:41:53.997254 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:53.997254 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:41:53.997254 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:41:53.997254 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:41:53.997254 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 06:41:53.997254 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 06:41:53.997254 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1870027427 could not be found. Oct 11 06:41:53.997254 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:53.997254 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6eec7bea-8183-4c10-ad8e-b08463f1fda2 tempest-VolumesNegativeTest-529557693 tempest-VolumesNegativeTest-529557693-project] Returning 404 to user: Volume tempest-invalid-1870027427 could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 06:41:53.997254 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6eec7bea-8183-4c10-ad8e-b08463f1fda2 tempest-VolumesNegativeTest-529557693 tempest-VolumesNegativeTest-529557693-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1870027427" status: 404 len: 99 microversion: 2.1 time: 0.089748 Oct 11 06:41:53.997254 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 14/23] 10.222.0.39 () {58 vars in 1218 bytes} [Tue Oct 11 06:41:53 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1870027427 => generated 99 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 06:41:54.002793 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cc88cb89-7593-46f6-8f44-b5255eb562a8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.246292 Oct 11 06:41:54.013006 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 10/24] 10.222.0.39 () {60 vars in 1159 bytes} [Tue Oct 11 06:41:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:41:54.013311 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ece989eb-b10f-4ee3-b2c5-43f444b08555 tempest-VolumesNegativeTest-529557693 tempest-VolumesNegativeTest-529557693-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012114 Oct 11 06:41:54.021670 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-16706d70-b967-41e4-bf6e-c51609203b02 tempest-VolumesNegativeTest-529557693 tempest-VolumesNegativeTest-529557693-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004244 Oct 11 06:41:54.022286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 15/25] 10.222.0.39 () {58 vars in 1140 bytes} [Tue Oct 11 06:41:53 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 11 06:41:54.026416 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 11/26] 10.222.0.39 () {58 vars in 1137 bytes} [Tue Oct 11 06:41:54 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 11 06:41:54.033435 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-93fe32dd-b54a-42a0-a95a-65d14a4c5203 tempest-VolumesNegativeTest-529557693 tempest-VolumesNegativeTest-529557693-project] Calling method '.version_select at 0x7f8e27cd94c0>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:41:54.082663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-93fe32dd-b54a-42a0-a95a-65d14a4c5203 tempest-VolumesNegativeTest-529557693 tempest-VolumesNegativeTest-529557693-project] HTTP exception thrown: Volume 97d759da-a4c9-460f-9873-eed991bd773e could not be found. Oct 11 06:41:54.084918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-93fe32dd-b54a-42a0-a95a-65d14a4c5203 tempest-VolumesNegativeTest-529557693 tempest-VolumesNegativeTest-529557693-project] Request method failure captured: Oct 11 06:41:54.084918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: request: DELETE /compute/v2.1/os-volumes/97d759da-a4c9-460f-9873-eed991bd773e HTTP/1.1 Oct 11 06:41:54.084918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept: application/json Oct 11 06:41:54.084918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Oct 11 06:41:54.084918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Connection: close Oct 11 06:41:54.084918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Length: 0 Oct 11 06:41:54.084918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Type: application/json Oct 11 06:41:54.084918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Host: 10.222.0.39 Oct 11 06:41:54.084918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Oct 11 06:41:54.084918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.12 Oct 11 06:41:54.084918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABjRRAxttgg5xL11nzq2AcpFzz432vYMdrpWAVr4amO3gmRAJMqaL8Nn5HpgTSobicf76dXjJSKlZUci54lSXRRaAbKrhfAq79G4qljQyhF0AmfVknlZTWEvF_iwVAW7WrD6volev_96YYzXijhAq3bwtGVFdNVTKyDiFjo0IhCBj6_VxU Oct 11 06:41:54.084918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Oct 11 06:41:54.084918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Oct 11 06:41:54.084918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Oct 11 06:41:54.084918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Oct 11 06:41:54.084918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Oct 11 06:41:54.084918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Oct 11 06:41:54.084918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Id: ad85348d701e432ca0f8777fcc134bae Oct 11 06:41:54.084918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-VolumesNegativeTest-529557693 Oct 11 06:41:54.084918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Role: reader,member Oct 11 06:41:54.084918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Oct 11 06:41:54.086507 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ad85348d701e432ca0f8777fcc134bae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ad85348d701e432ca0f8777fcc134bae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ad85348d701e432ca0f8777fcc134bae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ad85348d701e432ca0f8777fcc134bae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 06:41:54.086507 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-VolumesNegativeTest-529557693 Oct 11 06:41:54.086507 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Id: ad85348d701e432ca0f8777fcc134bae Oct 11 06:41:54.086507 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-VolumesNegativeTest-529557693 Oct 11 06:41:54.086507 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User: tempest-VolumesNegativeTest-529557693-project Oct 11 06:41:54.086507 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Oct 11 06:41:54.086507 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Oct 11 06:41:54.086507 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Id: aa7f407234d64999afafe79145d9e36c Oct 11 06:41:54.086507 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-VolumesNegativeTest-529557693-project Oct 11 06:41:54.086507 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: method: Oct 11 06:41:54.086507 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: exception: Volume 97d759da-a4c9-460f-9873-eed991bd773e could not be found. Oct 11 06:41:54.086507 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: action_args: {'id': '97d759da-a4c9-460f-9873-eed991bd773e'} Oct 11 06:41:54.086507 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 06:41:54.087107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:41:54.087107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 06:41:54.087107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 06:41:54.087107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 06:41:54.087107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 06:41:54.087107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 06:41:54.087107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 06:41:54.087107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 06:41:54.087107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 06:41:54.087107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 06:41:54.087107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 06:41:54.087107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 06:41:54.087107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 06:41:54.087107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 06:41:54.087107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 06:41:54.087107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 97d759da-a4c9-460f-9873-eed991bd773e could not be found. (HTTP 404) (Request-ID: req-09970b5e-6a4b-407a-819b-dbbe005b6559) Oct 11 06:41:54.087107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:54.087107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:41:54.087107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:54.088632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:41:54.088632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 11 06:41:54.088632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 11 06:41:54.088632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 06:41:54.088632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 06:41:54.088632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 06:41:54.088632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 06:41:54.088632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 06:41:54.088632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 06:41:54.088632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 06:41:54.088632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 06:41:54.088632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 06:41:54.088632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 06:41:54.088632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 06:41:54.088632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 06:41:54.088632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 06:41:54.088632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 06:41:54.088632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 06:41:54.088632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 06:41:54.089449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 06:41:54.089449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 06:41:54.089449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 06:41:54.089449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 06:41:54.089449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 97d759da-a4c9-460f-9873-eed991bd773e could not be found. Oct 11 06:41:54.089449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:54.089449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:41:54.089449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:54.089449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:41:54.089449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:41:54.089449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:41:54.089449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 06:41:54.089449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 06:41:54.089449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 06:41:54.089449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 06:41:54.089449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 06:41:54.089449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 06:41:54.089449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 11 06:41:54.089449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 06:41:54.090273 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 97d759da-a4c9-460f-9873-eed991bd773e could not be found. Oct 11 06:41:54.090273 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:54.090273 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:41:54.090273 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:54.090273 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:41:54.090273 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:41:54.090273 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:41:54.090273 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 06:41:54.090273 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 06:41:54.090273 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 97d759da-a4c9-460f-9873-eed991bd773e could not be found. Oct 11 06:41:54.090273 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:41:54.090273 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-93fe32dd-b54a-42a0-a95a-65d14a4c5203 tempest-VolumesNegativeTest-529557693 tempest-VolumesNegativeTest-529557693-project] Returning 404 to user: Volume 97d759da-a4c9-460f-9873-eed991bd773e could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 06:41:54.090273 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-93fe32dd-b54a-42a0-a95a-65d14a4c5203 tempest-VolumesNegativeTest-529557693 tempest-VolumesNegativeTest-529557693-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/97d759da-a4c9-460f-9873-eed991bd773e" status: 404 len: 109 microversion: 2.1 time: 0.057827 Oct 11 06:41:54.090273 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 16/27] 10.222.0.39 () {58 vars in 1248 bytes} [Tue Oct 11 06:41:54 2022] DELETE /compute/v2.1/os-volumes/97d759da-a4c9-460f-9873-eed991bd773e => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 06:41:54.097422 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b7f2da82-1f91-4e8b-aebc-d8bad73f16f4 tempest-VolumesNegativeTest-529557693 tempest-VolumesNegativeTest-529557693-project] Calling method '.version_select at 0x7f8e27acf790>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:41:54.168404 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-b7f2da82-1f91-4e8b-aebc-d8bad73f16f4 tempest-VolumesNegativeTest-529557693 tempest-VolumesNegativeTest-529557693-project] HTTP exception thrown: Volume 7cb6cde1-9015-4233-8f35-4cd354c96a71 could not be found. Oct 11 06:41:54.172544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b7f2da82-1f91-4e8b-aebc-d8bad73f16f4 tempest-VolumesNegativeTest-529557693 tempest-VolumesNegativeTest-529557693-project] Request method failure captured: Oct 11 06:41:54.172544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: request: GET /compute/v2.1/os-volumes/7cb6cde1-9015-4233-8f35-4cd354c96a71 HTTP/1.1 Oct 11 06:41:54.172544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept: application/json Oct 11 06:41:54.172544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Oct 11 06:41:54.172544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Connection: close Oct 11 06:41:54.172544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Length: 0 Oct 11 06:41:54.172544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Type: application/json Oct 11 06:41:54.172544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Host: 10.222.0.39 Oct 11 06:41:54.172544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Oct 11 06:41:54.172544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.12 Oct 11 06:41:54.172544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABjRRAxttgg5xL11nzq2AcpFzz432vYMdrpWAVr4amO3gmRAJMqaL8Nn5HpgTSobicf76dXjJSKlZUci54lSXRRaAbKrhfAq79G4qljQyhF0AmfVknlZTWEvF_iwVAW7WrD6volev_96YYzXijhAq3bwtGVFdNVTKyDiFjo0IhCBj6_VxU Oct 11 06:41:54.172544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Oct 11 06:41:54.172544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Oct 11 06:41:54.172544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Oct 11 06:41:54.172544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Oct 11 06:41:54.172544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Oct 11 06:41:54.172544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Oct 11 06:41:54.172544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Id: ad85348d701e432ca0f8777fcc134bae Oct 11 06:41:54.172544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-VolumesNegativeTest-529557693 Oct 11 06:41:54.172544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Role: reader,member Oct 11 06:41:54.172544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Oct 11 06:41:54.173679 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ad85348d701e432ca0f8777fcc134bae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ad85348d701e432ca0f8777fcc134bae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ad85348d701e432ca0f8777fcc134bae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ad85348d701e432ca0f8777fcc134bae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 06:41:54.173679 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-VolumesNegativeTest-529557693 Oct 11 06:41:54.173679 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Id: ad85348d701e432ca0f8777fcc134bae Oct 11 06:41:54.173679 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-VolumesNegativeTest-529557693 Oct 11 06:41:54.173679 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User: tempest-VolumesNegativeTest-529557693-project Oct 11 06:41:54.173679 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Oct 11 06:41:54.173679 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Oct 11 06:41:54.173679 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Id: aa7f407234d64999afafe79145d9e36c Oct 11 06:41:54.173679 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-VolumesNegativeTest-529557693-project Oct 11 06:41:54.173679 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: method: Oct 11 06:41:54.173679 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: exception: Volume 7cb6cde1-9015-4233-8f35-4cd354c96a71 could not be found. Oct 11 06:41:54.173679 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: action_args: {'id': '7cb6cde1-9015-4233-8f35-4cd354c96a71'} Oct 11 06:41:54.173679 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 06:41:54.174302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:41:54.174302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 06:41:54.174302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 06:41:54.174302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 06:41:54.174302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 06:41:54.174302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 06:41:54.174302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 06:41:54.174302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 06:41:54.174302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 06:41:54.174302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 06:41:54.174302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 06:41:54.174302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 06:41:54.174302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 06:41:54.174302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 06:41:54.174302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 06:41:54.174302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7cb6cde1-9015-4233-8f35-4cd354c96a71 could not be found. (HTTP 404) (Request-ID: req-e0540a5f-3429-4d34-9887-5d14031adb04) Oct 11 06:41:54.174302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 06:41:54.174302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:41:54.174302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 06:41:54.175184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:41:54.175184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 11 06:41:54.175184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 11 06:41:54.175184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 06:41:54.175184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 06:41:54.175184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 06:41:54.175184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 06:41:54.175184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 06:41:54.175184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 06:41:54.175184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 06:41:54.175184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 06:41:54.175184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 06:41:54.175184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 06:41:54.175184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 06:41:54.175184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 06:41:54.175184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 06:41:54.175184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 06:41:54.175184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 06:41:54.175184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 06:41:54.177030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 06:41:54.177030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 06:41:54.177030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 06:41:54.177030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 06:41:54.177030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7cb6cde1-9015-4233-8f35-4cd354c96a71 could not be found. Oct 11 06:41:54.177030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 06:41:54.177030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:41:54.177030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 06:41:54.177030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:41:54.177030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:41:54.177030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:41:54.177030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 06:41:54.177030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 06:41:54.177030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 06:41:54.177030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 06:41:54.177030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 06:41:54.177030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 06:41:54.177030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 11 06:41:54.177030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 06:41:54.179610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7cb6cde1-9015-4233-8f35-4cd354c96a71 could not be found. Oct 11 06:41:54.179610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 06:41:54.179610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:41:54.179610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 06:41:54.179610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:41:54.179610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:41:54.179610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:41:54.179610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 06:41:54.179610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 06:41:54.179610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7cb6cde1-9015-4233-8f35-4cd354c96a71 could not be found. Oct 11 06:41:54.179610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 06:41:54.179610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b7f2da82-1f91-4e8b-aebc-d8bad73f16f4 tempest-VolumesNegativeTest-529557693 tempest-VolumesNegativeTest-529557693-project] Returning 404 to user: Volume 7cb6cde1-9015-4233-8f35-4cd354c96a71 could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 06:41:54.179610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b7f2da82-1f91-4e8b-aebc-d8bad73f16f4 tempest-VolumesNegativeTest-529557693 tempest-VolumesNegativeTest-529557693-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/7cb6cde1-9015-4233-8f35-4cd354c96a71" status: 404 len: 109 microversion: 2.1 time: 0.081120 Oct 11 06:41:54.179610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 12/28] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Oct 11 06:41:54 2022] GET /compute/v2.1/os-volumes/7cb6cde1-9015-4233-8f35-4cd354c96a71 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 06:41:56.680449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-242d0721-dcff-4e54-9040-a5f768fbb225 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1345010008", "imageRef": "2303551c-410e-4a2b-8eeb-dea686876901", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:41:56.910259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.network.neutron [None req-242d0721-dcff-4e54-9040-a5f768fbb225 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] validate_networks() for [('82722ee9-dbe3-45c3-9852-16d75ee6066b', None, None, None, None, None)] {{(pid=125266) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 06:41:59.046698 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8a981f5c-912e-4070-b2e3-f996c9ca7f65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-761852742", "imageRef": "2303551c-410e-4a2b-8eeb-dea686876901", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e96a53a6-e96c-406d-9212-fd1b88f3fd49"}], "security_groups": [{"name": "tempest-securitygroup--35618913"}], "key_name": "tempest-keypair-1038104129", "user_data": "}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:41:59.561386 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.network.neutron [None req-8a981f5c-912e-4070-b2e3-f996c9ca7f65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] validate_networks() for [('e96a53a6-e96c-406d-9212-fd1b88f3fd49', None, None, None, None, None)] {{(pid=125267) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 06:42:00.007875 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-242d0721-dcff-4e54-9040-a5f768fbb225 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Flavor limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 06:42:00.008404 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-242d0721-dcff-4e54-9040-a5f768fbb225 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Image limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 06:42:00.008763 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-242d0721-dcff-4e54-9040-a5f768fbb225 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Flavor pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 06:42:00.010347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-242d0721-dcff-4e54-9040-a5f768fbb225 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Image pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 06:42:00.010347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-242d0721-dcff-4e54-9040-a5f768fbb225 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 06:42:00.023634 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-242d0721-dcff-4e54-9040-a5f768fbb225 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:00.024258 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-242d0721-dcff-4e54-9040-a5f768fbb225 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:00.027056 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-242d0721-dcff-4e54-9040-a5f768fbb225 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:00.028060 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-242d0721-dcff-4e54-9040-a5f768fbb225 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:00.028677 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-242d0721-dcff-4e54-9040-a5f768fbb225 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:00.029277 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-242d0721-dcff-4e54-9040-a5f768fbb225 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:00.070128 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-242d0721-dcff-4e54-9040-a5f768fbb225 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Getting quotas for project 0e4e977dc2e84b08a4fbaf7fd2fac42f. Resources: {'cores', 'ram', 'instances'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 06:42:00.075080 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-242d0721-dcff-4e54-9040-a5f768fbb225 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Getting quotas for user 3d57230baeb24e8a8a511a0c6417077e and project 0e4e977dc2e84b08a4fbaf7fd2fac42f. Resources: {'cores', 'ram', 'instances'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 06:42:00.100545 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-242d0721-dcff-4e54-9040-a5f768fbb225 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Going to run 1 instances... {{(pid=125266) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 06:42:00.112328 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-242d0721-dcff-4e54-9040-a5f768fbb225 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2303551c-410e-4a2b-8eeb-dea686876901',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 06:42:00.248286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-242d0721-dcff-4e54-9040-a5f768fbb225 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.750810 Oct 11 06:42:00.248961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 17/29] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Oct 11 06:41:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 3752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 06:42:00.264769 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-38823419-11d0-4518-8593-b0d3c0304022 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-104336435", "imageRef": "2303551c-410e-4a2b-8eeb-dea686876901", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3b290ad2-90c3-4ca5-88a3-9d0ec13dbcae"}], "security_groups": [{"name": "tempest-securitygroup--946552439"}], "key_name": "tempest-keypair-1818048256", "user_data": "}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:42:00.582624 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.network.neutron [None req-38823419-11d0-4518-8593-b0d3c0304022 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] validate_networks() for [('3b290ad2-90c3-4ca5-88a3-9d0ec13dbcae', None, None, None, None, None)] {{(pid=125266) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 06:42:01.303273 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-38823419-11d0-4518-8593-b0d3c0304022 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Flavor limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 06:42:01.303922 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-38823419-11d0-4518-8593-b0d3c0304022 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Image limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 06:42:01.304740 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-38823419-11d0-4518-8593-b0d3c0304022 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Flavor pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 06:42:01.305182 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-38823419-11d0-4518-8593-b0d3c0304022 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Image pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 06:42:01.305661 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-38823419-11d0-4518-8593-b0d3c0304022 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 06:42:01.318967 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-38823419-11d0-4518-8593-b0d3c0304022 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:01.322142 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-38823419-11d0-4518-8593-b0d3c0304022 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:01.322644 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-38823419-11d0-4518-8593-b0d3c0304022 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:01.330107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-38823419-11d0-4518-8593-b0d3c0304022 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:01.331442 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-38823419-11d0-4518-8593-b0d3c0304022 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:01.333049 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-38823419-11d0-4518-8593-b0d3c0304022 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:01.392432 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-38823419-11d0-4518-8593-b0d3c0304022 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Getting quotas for project ec4a4c53c1c744688b3bf91e806286bf. Resources: {'cores', 'ram', 'instances'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 06:42:01.398945 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-38823419-11d0-4518-8593-b0d3c0304022 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Getting quotas for user f95c1cd09e1042abbb5725f241ce147d and project ec4a4c53c1c744688b3bf91e806286bf. Resources: {'cores', 'ram', 'instances'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 06:42:01.426528 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-38823419-11d0-4518-8593-b0d3c0304022 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Going to run 1 instances... {{(pid=125266) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 06:42:01.433906 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-38823419-11d0-4518-8593-b0d3c0304022 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2303551c-410e-4a2b-8eeb-dea686876901',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 06:42:01.531196 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-38823419-11d0-4518-8593-b0d3c0304022 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.280745 Oct 11 06:42:01.534787 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 18/30] 10.222.0.39 () {62 vars in 1188 bytes} [Tue Oct 11 06:42:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 1285 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 06:42:01.546785 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-690f3dc3-0bef-425e-a3c0-5238dc0f53b3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:01.547353 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-690f3dc3-0bef-425e-a3c0-5238dc0f53b3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:01.655448 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-8a981f5c-912e-4070-b2e3-f996c9ca7f65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Flavor limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 06:42:01.656490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-8a981f5c-912e-4070-b2e3-f996c9ca7f65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Image limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 06:42:01.656966 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-8a981f5c-912e-4070-b2e3-f996c9ca7f65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Flavor pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 06:42:01.657375 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-8a981f5c-912e-4070-b2e3-f996c9ca7f65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Image pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 06:42:01.657783 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-8a981f5c-912e-4070-b2e3-f996c9ca7f65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 06:42:01.668235 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8a981f5c-912e-4070-b2e3-f996c9ca7f65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:01.681151 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8a981f5c-912e-4070-b2e3-f996c9ca7f65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:01.681811 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8a981f5c-912e-4070-b2e3-f996c9ca7f65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:01.682794 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8a981f5c-912e-4070-b2e3-f996c9ca7f65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:01.683444 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8a981f5c-912e-4070-b2e3-f996c9ca7f65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:01.686579 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8a981f5c-912e-4070-b2e3-f996c9ca7f65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:01.709157 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-690f3dc3-0bef-425e-a3c0-5238dc0f53b3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:01.734710 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-690f3dc3-0bef-425e-a3c0-5238dc0f53b3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1222 microversion: 2.1 time: 0.198710 Oct 11 06:42:01.736975 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 19/31] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:01 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1222 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:01.744694 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f62871e2-5406-43d9-87da-1e6d717d0bdb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-191490214", "imageRef": "2303551c-410e-4a2b-8eeb-dea686876901", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21c482a1-7bc7-4511-a714-740a34b4b762"}], "security_groups": [{"name": "tempest-securitygroup--1011333399"}], "key_name": "tempest-keypair-981874670", "user_data": "}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:42:01.766360 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-8a981f5c-912e-4070-b2e3-f996c9ca7f65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Getting quotas for project bf094dc7d5f1453ba9112d1a1d3f0d9c. Resources: {'cores', 'ram', 'instances'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 06:42:01.771648 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-8a981f5c-912e-4070-b2e3-f996c9ca7f65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Getting quotas for user 1c602e0f9e0e4e479a6a3c32febdb14b and project bf094dc7d5f1453ba9112d1a1d3f0d9c. Resources: {'cores', 'ram', 'instances'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 06:42:01.786299 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8a981f5c-912e-4070-b2e3-f996c9ca7f65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Going to run 1 instances... {{(pid=125267) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 06:42:01.790187 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8a981f5c-912e-4070-b2e3-f996c9ca7f65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2303551c-410e-4a2b-8eeb-dea686876901',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 06:42:01.961747 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8a981f5c-912e-4070-b2e3-f996c9ca7f65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.923513 Oct 11 06:42:01.975833 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 13/32] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Oct 11 06:41:59 2022] POST /compute/v2.1/servers => generated 400 bytes in 2938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 06:42:02.014368 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.network.neutron [None req-f62871e2-5406-43d9-87da-1e6d717d0bdb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] validate_networks() for [('21c482a1-7bc7-4511-a714-740a34b4b762', None, None, None, None, None)] {{(pid=125266) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 06:42:02.229721 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-91cea3fd-8584-47e6-880f-c254f8b4db80 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1200846816", "imageRef": "2303551c-410e-4a2b-8eeb-dea686876901", "flavorRef": "452", "networks": [{"uuid": "00363809-cf1a-446a-acb0-b2e9db60549c"}]}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:42:02.365783 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.network.neutron [None req-91cea3fd-8584-47e6-880f-c254f8b4db80 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] validate_networks() for [('00363809-cf1a-446a-acb0-b2e9db60549c', None, None, None, None, None)] {{(pid=125267) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 06:42:02.974725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-f62871e2-5406-43d9-87da-1e6d717d0bdb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Flavor limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 06:42:02.976987 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-f62871e2-5406-43d9-87da-1e6d717d0bdb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Image limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 06:42:02.977625 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-f62871e2-5406-43d9-87da-1e6d717d0bdb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Flavor pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 06:42:02.978191 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-f62871e2-5406-43d9-87da-1e6d717d0bdb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Image pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 06:42:02.978788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-f62871e2-5406-43d9-87da-1e6d717d0bdb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 06:42:03.004387 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f62871e2-5406-43d9-87da-1e6d717d0bdb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:03.005636 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f62871e2-5406-43d9-87da-1e6d717d0bdb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:03.013492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f62871e2-5406-43d9-87da-1e6d717d0bdb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:03.014542 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f62871e2-5406-43d9-87da-1e6d717d0bdb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:03.016469 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f62871e2-5406-43d9-87da-1e6d717d0bdb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:03.017066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f62871e2-5406-43d9-87da-1e6d717d0bdb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:03.080033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-f62871e2-5406-43d9-87da-1e6d717d0bdb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Getting quotas for project 5af47e2321de4d299ff3a7fb3d3d9e3c. Resources: {'cores', 'ram', 'instances'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 06:42:03.094153 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-f62871e2-5406-43d9-87da-1e6d717d0bdb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Getting quotas for user 2e63c3f83f3d41018e6330f26ed7b8a0 and project 5af47e2321de4d299ff3a7fb3d3d9e3c. Resources: {'cores', 'ram', 'instances'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 06:42:03.137794 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f62871e2-5406-43d9-87da-1e6d717d0bdb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Going to run 1 instances... {{(pid=125266) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 06:42:03.140036 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f62871e2-5406-43d9-87da-1e6d717d0bdb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2303551c-410e-4a2b-8eeb-dea686876901',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 06:42:03.197998 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-91cea3fd-8584-47e6-880f-c254f8b4db80 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Flavor limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 06:42:03.199907 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-91cea3fd-8584-47e6-880f-c254f8b4db80 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Image limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 06:42:03.200611 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-91cea3fd-8584-47e6-880f-c254f8b4db80 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Flavor pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 06:42:03.201691 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-91cea3fd-8584-47e6-880f-c254f8b4db80 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Image pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 06:42:03.202319 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-91cea3fd-8584-47e6-880f-c254f8b4db80 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 06:42:03.222138 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-91cea3fd-8584-47e6-880f-c254f8b4db80 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:03.225107 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-91cea3fd-8584-47e6-880f-c254f8b4db80 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:03.226648 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-91cea3fd-8584-47e6-880f-c254f8b4db80 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:03.227675 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-91cea3fd-8584-47e6-880f-c254f8b4db80 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:03.228250 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-91cea3fd-8584-47e6-880f-c254f8b4db80 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:03.228675 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-91cea3fd-8584-47e6-880f-c254f8b4db80 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:03.247981 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-91cea3fd-8584-47e6-880f-c254f8b4db80 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Getting quotas for project 048f1b5e89c8417695e7916b444e2778. Resources: {'cores', 'ram', 'instances'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 06:42:03.253526 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-91cea3fd-8584-47e6-880f-c254f8b4db80 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Getting quotas for user e97edc31dd834fd8811ad1bb25f1168b and project 048f1b5e89c8417695e7916b444e2778. Resources: {'cores', 'ram', 'instances'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 06:42:03.268512 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-91cea3fd-8584-47e6-880f-c254f8b4db80 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Going to run 1 instances... {{(pid=125267) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 06:42:03.270700 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-91cea3fd-8584-47e6-880f-c254f8b4db80 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2303551c-410e-4a2b-8eeb-dea686876901',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 06:42:03.353178 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-91cea3fd-8584-47e6-880f-c254f8b4db80 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.372651 Oct 11 06:42:03.353616 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 14/33] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Oct 11 06:42:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1376 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 06:42:03.379259 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ff0303c4-7859-4736-abbf-31ca13c534cd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:03.383932 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ff0303c4-7859-4736-abbf-31ca13c534cd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:03.413460 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f62871e2-5406-43d9-87da-1e6d717d0bdb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.633223 Oct 11 06:42:03.417692 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 20/34] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Oct 11 06:42:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 1680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 06:42:03.435350 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff0303c4-7859-4736-abbf-31ca13c534cd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:03.436951 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff0303c4-7859-4736-abbf-31ca13c534cd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:03.439060 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff0303c4-7859-4736-abbf-31ca13c534cd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:03.441196 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff0303c4-7859-4736-abbf-31ca13c534cd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:03.442707 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff0303c4-7859-4736-abbf-31ca13c534cd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:03.446497 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff0303c4-7859-4736-abbf-31ca13c534cd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:03.467665 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-749438bf-f76a-4bcf-80f3-188bc56d8a44 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:03.467665 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-749438bf-f76a-4bcf-80f3-188bc56d8a44 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:03.493660 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-749438bf-f76a-4bcf-80f3-188bc56d8a44 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:03.494694 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-749438bf-f76a-4bcf-80f3-188bc56d8a44 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:03.495403 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-749438bf-f76a-4bcf-80f3-188bc56d8a44 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:03.497406 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-749438bf-f76a-4bcf-80f3-188bc56d8a44 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:03.498664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-749438bf-f76a-4bcf-80f3-188bc56d8a44 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:03.500547 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-749438bf-f76a-4bcf-80f3-188bc56d8a44 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:04.064316 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-749438bf-f76a-4bcf-80f3-188bc56d8a44 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:04.090135 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-749438bf-f76a-4bcf-80f3-188bc56d8a44 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1233 microversion: 2.1 time: 0.668468 Oct 11 06:42:04.104337 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 21/35] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:03 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1233 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:04.127254 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d61e3c04-6295-4bd6-9124-512aee3d206e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1075468515", "imageRef": "2303551c-410e-4a2b-8eeb-dea686876901", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:42:04.174050 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ff0303c4-7859-4736-abbf-31ca13c534cd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:04.226773 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ff0303c4-7859-4736-abbf-31ca13c534cd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:04.228322 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ff0303c4-7859-4736-abbf-31ca13c534cd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:04.229522 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ff0303c4-7859-4736-abbf-31ca13c534cd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1277 microversion: 2.20 time: 0.874122 Oct 11 06:42:04.263742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.network.neutron [None req-d61e3c04-6295-4bd6-9124-512aee3d206e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] validate_networks() for [('82722ee9-dbe3-45c3-9852-16d75ee6066b', None, None, None, None, None)] {{(pid=125266) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 06:42:04.264377 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 15/36] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:42:03 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1277 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:42:04.317383 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-584aa07e-139b-4fd4-8e3a-445075b9d3a7 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:04.318035 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-584aa07e-139b-4fd4-8e3a-445075b9d3a7 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:04.550185 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-584aa07e-139b-4fd4-8e3a-445075b9d3a7 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:04.588677 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-584aa07e-139b-4fd4-8e3a-445075b9d3a7 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1215 microversion: 2.1 time: 0.310990 Oct 11 06:42:04.590775 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 16/37] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:04 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1215 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:04.614808 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-218014d3-76f8-401a-9c17-c4c17100f2f8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:04.621510 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-218014d3-76f8-401a-9c17-c4c17100f2f8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:05.015899 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-218014d3-76f8-401a-9c17-c4c17100f2f8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:05.027050 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-218014d3-76f8-401a-9c17-c4c17100f2f8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1240 microversion: 2.1 time: 0.433539 Oct 11 06:42:05.049206 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 17/38] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:04 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1240 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:05.127584 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c562c091-5f19-4d02-a576-495b91ce5551 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:05.128661 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c562c091-5f19-4d02-a576-495b91ce5551 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:05.144380 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c562c091-5f19-4d02-a576-495b91ce5551 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:05.148374 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c562c091-5f19-4d02-a576-495b91ce5551 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:05.150077 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c562c091-5f19-4d02-a576-495b91ce5551 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:05.155761 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c562c091-5f19-4d02-a576-495b91ce5551 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:05.157087 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c562c091-5f19-4d02-a576-495b91ce5551 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:05.157844 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c562c091-5f19-4d02-a576-495b91ce5551 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:05.340602 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c562c091-5f19-4d02-a576-495b91ce5551 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:05.355505 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c562c091-5f19-4d02-a576-495b91ce5551 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1289 microversion: 2.1 time: 0.233092 Oct 11 06:42:05.369090 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 18/39] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:05 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1289 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:05.379931 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8d39298e-79b8-4176-9254-f77300634c79 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:05.381598 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8d39298e-79b8-4176-9254-f77300634c79 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:05.390039 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d39298e-79b8-4176-9254-f77300634c79 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:05.390800 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d39298e-79b8-4176-9254-f77300634c79 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:05.395594 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d39298e-79b8-4176-9254-f77300634c79 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:05.396387 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d39298e-79b8-4176-9254-f77300634c79 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:05.396950 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d39298e-79b8-4176-9254-f77300634c79 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:05.397478 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d39298e-79b8-4176-9254-f77300634c79 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:05.560726 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8d39298e-79b8-4176-9254-f77300634c79 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:05.592630 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8d39298e-79b8-4176-9254-f77300634c79 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:05.608266 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8d39298e-79b8-4176-9254-f77300634c79 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:05.612383 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8d39298e-79b8-4176-9254-f77300634c79 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1277 microversion: 2.20 time: 0.242043 Oct 11 06:42:05.617408 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 19/40] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:42:05 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1277 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:42:05.630002 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-15102d08-a5aa-4687-825d-f5ca27855096 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:05.630870 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-15102d08-a5aa-4687-825d-f5ca27855096 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:05.665235 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15102d08-a5aa-4687-825d-f5ca27855096 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:05.668040 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15102d08-a5aa-4687-825d-f5ca27855096 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:05.668647 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15102d08-a5aa-4687-825d-f5ca27855096 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:05.669527 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15102d08-a5aa-4687-825d-f5ca27855096 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:05.670675 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15102d08-a5aa-4687-825d-f5ca27855096 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:05.672016 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15102d08-a5aa-4687-825d-f5ca27855096 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:05.919482 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-d61e3c04-6295-4bd6-9124-512aee3d206e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Flavor limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 06:42:05.919994 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-d61e3c04-6295-4bd6-9124-512aee3d206e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Image limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 06:42:05.920390 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-d61e3c04-6295-4bd6-9124-512aee3d206e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Flavor pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 06:42:05.920813 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-d61e3c04-6295-4bd6-9124-512aee3d206e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Image pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 06:42:05.921213 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-d61e3c04-6295-4bd6-9124-512aee3d206e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 06:42:05.953061 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d61e3c04-6295-4bd6-9124-512aee3d206e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:05.953638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d61e3c04-6295-4bd6-9124-512aee3d206e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:05.954091 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d61e3c04-6295-4bd6-9124-512aee3d206e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:05.954904 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d61e3c04-6295-4bd6-9124-512aee3d206e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:05.955359 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d61e3c04-6295-4bd6-9124-512aee3d206e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:05.955813 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d61e3c04-6295-4bd6-9124-512aee3d206e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:05.962911 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-15102d08-a5aa-4687-825d-f5ca27855096 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:05.971758 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-15102d08-a5aa-4687-825d-f5ca27855096 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1211 microversion: 2.1 time: 0.352477 Oct 11 06:42:05.976403 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 20/41] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:05 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1211 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:06.024909 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-d61e3c04-6295-4bd6-9124-512aee3d206e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Getting quotas for project 0e4e977dc2e84b08a4fbaf7fd2fac42f. Resources: {'cores', 'ram', 'instances'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 06:42:06.043814 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-d61e3c04-6295-4bd6-9124-512aee3d206e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Getting quotas for user 3d57230baeb24e8a8a511a0c6417077e and project 0e4e977dc2e84b08a4fbaf7fd2fac42f. Resources: {'cores', 'ram', 'instances'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 06:42:06.057473 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f931e842-d0ec-4d32-87d5-f76a6435faa4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:06.058533 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f931e842-d0ec-4d32-87d5-f76a6435faa4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:06.097423 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f931e842-d0ec-4d32-87d5-f76a6435faa4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:06.100896 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f931e842-d0ec-4d32-87d5-f76a6435faa4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:06.104686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d61e3c04-6295-4bd6-9124-512aee3d206e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Going to run 1 instances... {{(pid=125266) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 06:42:06.105043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f931e842-d0ec-4d32-87d5-f76a6435faa4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:06.107975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f931e842-d0ec-4d32-87d5-f76a6435faa4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:06.113086 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f931e842-d0ec-4d32-87d5-f76a6435faa4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:06.115576 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f931e842-d0ec-4d32-87d5-f76a6435faa4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:06.120936 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d61e3c04-6295-4bd6-9124-512aee3d206e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2303551c-410e-4a2b-8eeb-dea686876901',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 06:42:06.335226 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d61e3c04-6295-4bd6-9124-512aee3d206e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.227471 Oct 11 06:42:06.339336 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 22/42] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Oct 11 06:42:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 2234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 06:42:06.350294 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ab9a34bb-9a15-405a-98ea-c30dae9c24b7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:06.355301 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ab9a34bb-9a15-405a-98ea-c30dae9c24b7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:06.436318 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f931e842-d0ec-4d32-87d5-f76a6435faa4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:06.446589 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f931e842-d0ec-4d32-87d5-f76a6435faa4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1236 microversion: 2.1 time: 0.394071 Oct 11 06:42:06.447182 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 21/43] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:06 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1236 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:06.464001 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cb7b3dde-ae68-4ad9-895e-30c19176392d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:06.476924 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cb7b3dde-ae68-4ad9-895e-30c19176392d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:06.497145 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb7b3dde-ae68-4ad9-895e-30c19176392d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:06.497711 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb7b3dde-ae68-4ad9-895e-30c19176392d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:06.498069 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb7b3dde-ae68-4ad9-895e-30c19176392d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:06.498546 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ab9a34bb-9a15-405a-98ea-c30dae9c24b7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:06.498784 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb7b3dde-ae68-4ad9-895e-30c19176392d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:06.507105 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb7b3dde-ae68-4ad9-895e-30c19176392d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:06.507597 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb7b3dde-ae68-4ad9-895e-30c19176392d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:06.510660 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ab9a34bb-9a15-405a-98ea-c30dae9c24b7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1222 microversion: 2.1 time: 0.164274 Oct 11 06:42:06.526918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 23/44] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:06 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1222 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:06.648708 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-41d7e9af-013d-4768-8fd8-94e53dabd9ed tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:06.649359 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-41d7e9af-013d-4768-8fd8-94e53dabd9ed tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:06.661863 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-41d7e9af-013d-4768-8fd8-94e53dabd9ed tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:06.665248 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-41d7e9af-013d-4768-8fd8-94e53dabd9ed tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:06.666487 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-41d7e9af-013d-4768-8fd8-94e53dabd9ed tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:06.669032 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-41d7e9af-013d-4768-8fd8-94e53dabd9ed tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:06.669810 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-41d7e9af-013d-4768-8fd8-94e53dabd9ed tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:06.672410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-41d7e9af-013d-4768-8fd8-94e53dabd9ed tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:06.859372 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-41d7e9af-013d-4768-8fd8-94e53dabd9ed tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:06.869861 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-41d7e9af-013d-4768-8fd8-94e53dabd9ed tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:06.876949 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-41d7e9af-013d-4768-8fd8-94e53dabd9ed tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:06.880397 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-41d7e9af-013d-4768-8fd8-94e53dabd9ed tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1333 microversion: 2.20 time: 0.238271 Oct 11 06:42:06.884394 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 24/45] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:42:06 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1333 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:42:07.000738 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-124503fa-6d9f-4182-80c2-398c05415f23 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:07.001368 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-124503fa-6d9f-4182-80c2-398c05415f23 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:07.021201 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-124503fa-6d9f-4182-80c2-398c05415f23 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:07.021708 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-124503fa-6d9f-4182-80c2-398c05415f23 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:07.022150 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-124503fa-6d9f-4182-80c2-398c05415f23 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:07.022898 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-124503fa-6d9f-4182-80c2-398c05415f23 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:07.031816 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-124503fa-6d9f-4182-80c2-398c05415f23 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:07.032360 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-124503fa-6d9f-4182-80c2-398c05415f23 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:07.185710 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cb7b3dde-ae68-4ad9-895e-30c19176392d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:07.189804 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-124503fa-6d9f-4182-80c2-398c05415f23 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:07.199237 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cb7b3dde-ae68-4ad9-895e-30c19176392d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1295 microversion: 2.1 time: 0.749663 Oct 11 06:42:07.206588 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-124503fa-6d9f-4182-80c2-398c05415f23 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1211 microversion: 2.1 time: 0.209748 Oct 11 06:42:07.222970 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 22/46] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:06 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1295 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:07.223303 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 25/47] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:06 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1211 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:07.470371 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9190c63f-180e-4b96-bcca-d99143f9f513 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:07.470997 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9190c63f-180e-4b96-bcca-d99143f9f513 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:07.481973 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9190c63f-180e-4b96-bcca-d99143f9f513 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:07.488087 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9190c63f-180e-4b96-bcca-d99143f9f513 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:07.488568 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9190c63f-180e-4b96-bcca-d99143f9f513 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:07.489343 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9190c63f-180e-4b96-bcca-d99143f9f513 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:07.489855 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9190c63f-180e-4b96-bcca-d99143f9f513 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:07.490252 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9190c63f-180e-4b96-bcca-d99143f9f513 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:07.550251 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-54e6662e-9934-430d-a116-becb5f011c5a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:07.550890 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-54e6662e-9934-430d-a116-becb5f011c5a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:07.560585 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54e6662e-9934-430d-a116-becb5f011c5a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:07.561339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54e6662e-9934-430d-a116-becb5f011c5a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:07.571703 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54e6662e-9934-430d-a116-becb5f011c5a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:07.572483 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54e6662e-9934-430d-a116-becb5f011c5a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:07.572960 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54e6662e-9934-430d-a116-becb5f011c5a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:07.573390 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54e6662e-9934-430d-a116-becb5f011c5a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:07.656876 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9190c63f-180e-4b96-bcca-d99143f9f513 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:07.665327 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9190c63f-180e-4b96-bcca-d99143f9f513 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1236 microversion: 2.1 time: 0.198959 Oct 11 06:42:07.681284 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 23/48] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:07 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1236 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:07.684226 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-54e6662e-9934-430d-a116-becb5f011c5a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:07.693056 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-54e6662e-9934-430d-a116-becb5f011c5a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1226 microversion: 2.1 time: 0.146765 Oct 11 06:42:07.694401 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 26/49] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:07 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1226 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:42:07.911093 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-40ddf6da-044c-4282-aa32-804950b242f0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:07.915333 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-40ddf6da-044c-4282-aa32-804950b242f0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:07.923822 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-40ddf6da-044c-4282-aa32-804950b242f0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:07.924616 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-40ddf6da-044c-4282-aa32-804950b242f0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:07.925932 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-40ddf6da-044c-4282-aa32-804950b242f0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:07.927122 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-40ddf6da-044c-4282-aa32-804950b242f0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:07.928059 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-40ddf6da-044c-4282-aa32-804950b242f0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:07.928689 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-40ddf6da-044c-4282-aa32-804950b242f0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:08.031074 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-40ddf6da-044c-4282-aa32-804950b242f0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:08.049057 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-40ddf6da-044c-4282-aa32-804950b242f0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:08.053588 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-40ddf6da-044c-4282-aa32-804950b242f0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:08.054796 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-40ddf6da-044c-4282-aa32-804950b242f0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1333 microversion: 2.20 time: 0.149539 Oct 11 06:42:08.058907 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 24/50] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:42:07 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1333 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:42:08.232508 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7e2698e0-5fe0-4d2b-ae3d-076986048a09 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:08.233114 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7e2698e0-5fe0-4d2b-ae3d-076986048a09 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:08.239308 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e2698e0-5fe0-4d2b-ae3d-076986048a09 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:08.242164 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e2698e0-5fe0-4d2b-ae3d-076986048a09 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:08.242806 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e2698e0-5fe0-4d2b-ae3d-076986048a09 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:08.243769 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e2698e0-5fe0-4d2b-ae3d-076986048a09 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:08.244420 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e2698e0-5fe0-4d2b-ae3d-076986048a09 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:08.245060 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e2698e0-5fe0-4d2b-ae3d-076986048a09 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:08.246536 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8bfda9b6-70ae-4371-99f0-7bce6430c58d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:08.247158 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8bfda9b6-70ae-4371-99f0-7bce6430c58d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:08.260016 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8bfda9b6-70ae-4371-99f0-7bce6430c58d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:08.261141 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8bfda9b6-70ae-4371-99f0-7bce6430c58d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:08.261630 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8bfda9b6-70ae-4371-99f0-7bce6430c58d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:08.262377 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8bfda9b6-70ae-4371-99f0-7bce6430c58d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:08.262843 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8bfda9b6-70ae-4371-99f0-7bce6430c58d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:08.263300 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8bfda9b6-70ae-4371-99f0-7bce6430c58d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:08.327240 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7e2698e0-5fe0-4d2b-ae3d-076986048a09 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:08.335603 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7e2698e0-5fe0-4d2b-ae3d-076986048a09 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1211 microversion: 2.1 time: 0.106876 Oct 11 06:42:08.348553 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 27/51] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:08 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1211 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:08.370392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8bfda9b6-70ae-4371-99f0-7bce6430c58d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:08.379133 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8bfda9b6-70ae-4371-99f0-7bce6430c58d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1295 microversion: 2.1 time: 0.136343 Oct 11 06:42:08.379739 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 25/52] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:08 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1295 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:42:08.691789 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a4db229c-d315-49dd-a563-6b94a1a56e2f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:08.692840 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a4db229c-d315-49dd-a563-6b94a1a56e2f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:08.696210 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:08.700658 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a4db229c-d315-49dd-a563-6b94a1a56e2f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:08.701619 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a4db229c-d315-49dd-a563-6b94a1a56e2f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:08.702309 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a4db229c-d315-49dd-a563-6b94a1a56e2f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:08.703186 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a4db229c-d315-49dd-a563-6b94a1a56e2f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:08.703948 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a4db229c-d315-49dd-a563-6b94a1a56e2f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:08.704506 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a4db229c-d315-49dd-a563-6b94a1a56e2f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:08.718248 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-857f151a-ec20-4697-8c08-f31ff12bf26b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:08.718959 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-857f151a-ec20-4697-8c08-f31ff12bf26b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:08.725015 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-857f151a-ec20-4697-8c08-f31ff12bf26b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:08.725503 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-857f151a-ec20-4697-8c08-f31ff12bf26b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:08.726478 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-857f151a-ec20-4697-8c08-f31ff12bf26b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:08.727187 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-857f151a-ec20-4697-8c08-f31ff12bf26b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:08.727661 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-857f151a-ec20-4697-8c08-f31ff12bf26b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:08.728357 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-857f151a-ec20-4697-8c08-f31ff12bf26b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:08.790832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a4db229c-d315-49dd-a563-6b94a1a56e2f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:08.798441 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a4db229c-d315-49dd-a563-6b94a1a56e2f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1236 microversion: 2.1 time: 0.111273 Oct 11 06:42:08.812232 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-857f151a-ec20-4697-8c08-f31ff12bf26b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:08.812827 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 28/53] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:08 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1236 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:08.816207 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-857f151a-ec20-4697-8c08-f31ff12bf26b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1226 microversion: 2.1 time: 0.101538 Oct 11 06:42:08.818994 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 26/54] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:08 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:42:09.080499 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-46882ebe-7c45-4eb4-bddb-2089f057cf51 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:09.081873 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-46882ebe-7c45-4eb4-bddb-2089f057cf51 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:09.087271 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-46882ebe-7c45-4eb4-bddb-2089f057cf51 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:09.088164 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-46882ebe-7c45-4eb4-bddb-2089f057cf51 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:09.088607 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-46882ebe-7c45-4eb4-bddb-2089f057cf51 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:09.089476 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-46882ebe-7c45-4eb4-bddb-2089f057cf51 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:09.089931 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-46882ebe-7c45-4eb4-bddb-2089f057cf51 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:09.090355 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-46882ebe-7c45-4eb4-bddb-2089f057cf51 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:09.182999 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-46882ebe-7c45-4eb4-bddb-2089f057cf51 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:09.197925 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-46882ebe-7c45-4eb4-bddb-2089f057cf51 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:09.200135 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-46882ebe-7c45-4eb4-bddb-2089f057cf51 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:09.204752 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-46882ebe-7c45-4eb4-bddb-2089f057cf51 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1333 microversion: 2.20 time: 0.128275 Oct 11 06:42:09.236892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 29/55] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:42:09 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1333 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:42:09.360780 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d2ddab0f-2d06-429b-aa4a-88fc95827e90 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:09.361403 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d2ddab0f-2d06-429b-aa4a-88fc95827e90 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:09.371679 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d2ddab0f-2d06-429b-aa4a-88fc95827e90 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:09.372445 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d2ddab0f-2d06-429b-aa4a-88fc95827e90 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:09.372892 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d2ddab0f-2d06-429b-aa4a-88fc95827e90 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:09.373616 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d2ddab0f-2d06-429b-aa4a-88fc95827e90 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:09.376114 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d2ddab0f-2d06-429b-aa4a-88fc95827e90 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:09.376552 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d2ddab0f-2d06-429b-aa4a-88fc95827e90 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:09.412919 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b14a67f9-a357-4d03-807f-c6596dc22a49 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:09.413986 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b14a67f9-a357-4d03-807f-c6596dc22a49 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:09.426468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b14a67f9-a357-4d03-807f-c6596dc22a49 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:09.427953 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b14a67f9-a357-4d03-807f-c6596dc22a49 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:09.432810 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b14a67f9-a357-4d03-807f-c6596dc22a49 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:09.435039 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b14a67f9-a357-4d03-807f-c6596dc22a49 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:09.436557 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b14a67f9-a357-4d03-807f-c6596dc22a49 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:09.438932 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b14a67f9-a357-4d03-807f-c6596dc22a49 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:09.536351 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d2ddab0f-2d06-429b-aa4a-88fc95827e90 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:09.548762 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d2ddab0f-2d06-429b-aa4a-88fc95827e90 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1211 microversion: 2.1 time: 0.192399 Oct 11 06:42:09.549897 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 27/56] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:09 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1211 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:09.636681 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b14a67f9-a357-4d03-807f-c6596dc22a49 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:09.649307 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b14a67f9-a357-4d03-807f-c6596dc22a49 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1295 microversion: 2.1 time: 0.249542 Oct 11 06:42:09.670808 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 30/57] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:09 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1295 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:09.828636 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-73ed0e85-2617-493d-b9fc-abbde5cfd825 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:09.829382 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-73ed0e85-2617-493d-b9fc-abbde5cfd825 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:09.842377 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-27af3712-d1db-4798-82ee-8695b76ae108 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:09.843831 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-27af3712-d1db-4798-82ee-8695b76ae108 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:09.849720 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-73ed0e85-2617-493d-b9fc-abbde5cfd825 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:09.851024 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-73ed0e85-2617-493d-b9fc-abbde5cfd825 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:09.851760 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-73ed0e85-2617-493d-b9fc-abbde5cfd825 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:09.854030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-73ed0e85-2617-493d-b9fc-abbde5cfd825 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:09.859980 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-73ed0e85-2617-493d-b9fc-abbde5cfd825 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:09.862110 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-27af3712-d1db-4798-82ee-8695b76ae108 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:09.862957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-73ed0e85-2617-493d-b9fc-abbde5cfd825 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:09.865759 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-27af3712-d1db-4798-82ee-8695b76ae108 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:09.869912 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-27af3712-d1db-4798-82ee-8695b76ae108 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:09.871082 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-27af3712-d1db-4798-82ee-8695b76ae108 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:09.874508 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-27af3712-d1db-4798-82ee-8695b76ae108 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:09.879524 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-27af3712-d1db-4798-82ee-8695b76ae108 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:10.055217 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-73ed0e85-2617-493d-b9fc-abbde5cfd825 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:10.064643 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-73ed0e85-2617-493d-b9fc-abbde5cfd825 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1236 microversion: 2.1 time: 0.244335 Oct 11 06:42:10.079495 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 28/58] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:09 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1236 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:10.092673 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-27af3712-d1db-4798-82ee-8695b76ae108 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:10.111924 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-27af3712-d1db-4798-82ee-8695b76ae108 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1226 microversion: 2.1 time: 0.269148 Oct 11 06:42:10.113410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 31/59] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:09 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1226 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:42:10.236053 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e0af074e-1475-4055-9d60-21c23e728265 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:10.237113 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e0af074e-1475-4055-9d60-21c23e728265 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:10.251876 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e0af074e-1475-4055-9d60-21c23e728265 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:10.253047 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e0af074e-1475-4055-9d60-21c23e728265 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:10.253685 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e0af074e-1475-4055-9d60-21c23e728265 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:10.254617 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e0af074e-1475-4055-9d60-21c23e728265 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:10.255303 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e0af074e-1475-4055-9d60-21c23e728265 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:10.256089 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e0af074e-1475-4055-9d60-21c23e728265 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:10.378721 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e0af074e-1475-4055-9d60-21c23e728265 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:10.394974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e0af074e-1475-4055-9d60-21c23e728265 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:10.397170 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e0af074e-1475-4055-9d60-21c23e728265 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:10.399347 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e0af074e-1475-4055-9d60-21c23e728265 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1333 microversion: 2.20 time: 0.168365 Oct 11 06:42:10.444257 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 29/60] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:42:10 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1333 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:42:10.576411 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-56ed8770-fcea-4d50-8f27-0dd423c9b22d tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:10.577019 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-56ed8770-fcea-4d50-8f27-0dd423c9b22d tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:10.592931 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-56ed8770-fcea-4d50-8f27-0dd423c9b22d tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:10.593619 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-56ed8770-fcea-4d50-8f27-0dd423c9b22d tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:10.594241 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-56ed8770-fcea-4d50-8f27-0dd423c9b22d tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:10.595127 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-56ed8770-fcea-4d50-8f27-0dd423c9b22d tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:10.595787 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-56ed8770-fcea-4d50-8f27-0dd423c9b22d tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:10.596387 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-56ed8770-fcea-4d50-8f27-0dd423c9b22d tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:10.679261 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e01390c0-358f-43f1-911a-d7e0ec3b0cdb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:10.680207 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e01390c0-358f-43f1-911a-d7e0ec3b0cdb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:10.692415 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e01390c0-358f-43f1-911a-d7e0ec3b0cdb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:10.693177 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e01390c0-358f-43f1-911a-d7e0ec3b0cdb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:10.693859 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e01390c0-358f-43f1-911a-d7e0ec3b0cdb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:10.699685 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e01390c0-358f-43f1-911a-d7e0ec3b0cdb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:10.702216 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e01390c0-358f-43f1-911a-d7e0ec3b0cdb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:10.703001 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e01390c0-358f-43f1-911a-d7e0ec3b0cdb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:10.746785 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-56ed8770-fcea-4d50-8f27-0dd423c9b22d tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:10.754458 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-56ed8770-fcea-4d50-8f27-0dd423c9b22d tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1211 microversion: 2.1 time: 0.183452 Oct 11 06:42:10.763770 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 32/61] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:10 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1211 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:10.793675 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e01390c0-358f-43f1-911a-d7e0ec3b0cdb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:10.816337 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e01390c0-358f-43f1-911a-d7e0ec3b0cdb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1295 microversion: 2.1 time: 0.137668 Oct 11 06:42:10.831451 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 30/62] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:10 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1295 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:11.092457 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-20200792-8a71-4733-8f9b-ea79a345c59f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:11.093070 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-20200792-8a71-4733-8f9b-ea79a345c59f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:11.105156 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20200792-8a71-4733-8f9b-ea79a345c59f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:11.105641 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20200792-8a71-4733-8f9b-ea79a345c59f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:11.106710 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20200792-8a71-4733-8f9b-ea79a345c59f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:11.107457 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20200792-8a71-4733-8f9b-ea79a345c59f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:11.107913 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20200792-8a71-4733-8f9b-ea79a345c59f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:11.108499 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20200792-8a71-4733-8f9b-ea79a345c59f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:11.139104 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-80b5fb7d-f31f-4bb8-84c5-1e1ebfb99354 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:11.140280 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-80b5fb7d-f31f-4bb8-84c5-1e1ebfb99354 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:11.149399 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-80b5fb7d-f31f-4bb8-84c5-1e1ebfb99354 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:11.152482 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-80b5fb7d-f31f-4bb8-84c5-1e1ebfb99354 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:11.156916 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-80b5fb7d-f31f-4bb8-84c5-1e1ebfb99354 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:11.158161 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-80b5fb7d-f31f-4bb8-84c5-1e1ebfb99354 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:11.158931 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-80b5fb7d-f31f-4bb8-84c5-1e1ebfb99354 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:11.159659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-80b5fb7d-f31f-4bb8-84c5-1e1ebfb99354 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:11.253674 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-80b5fb7d-f31f-4bb8-84c5-1e1ebfb99354 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:11.264900 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-80b5fb7d-f31f-4bb8-84c5-1e1ebfb99354 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1226 microversion: 2.1 time: 0.128269 Oct 11 06:42:11.265496 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 31/63] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:11 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1226 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:11.267020 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-20200792-8a71-4733-8f9b-ea79a345c59f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:11.289253 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-20200792-8a71-4733-8f9b-ea79a345c59f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1236 microversion: 2.1 time: 0.187352 Oct 11 06:42:11.290341 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 33/64] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:11 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1236 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:11.431703 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f8d4f776-b180-4c53-b8fe-53e2d9481448 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:11.432707 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f8d4f776-b180-4c53-b8fe-53e2d9481448 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:11.439284 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f8d4f776-b180-4c53-b8fe-53e2d9481448 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:11.439956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f8d4f776-b180-4c53-b8fe-53e2d9481448 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:11.444360 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f8d4f776-b180-4c53-b8fe-53e2d9481448 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:11.445907 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f8d4f776-b180-4c53-b8fe-53e2d9481448 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:11.446433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f8d4f776-b180-4c53-b8fe-53e2d9481448 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:11.446941 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f8d4f776-b180-4c53-b8fe-53e2d9481448 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:11.573925 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f8d4f776-b180-4c53-b8fe-53e2d9481448 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:11.578749 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:11.585210 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f8d4f776-b180-4c53-b8fe-53e2d9481448 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:11.587299 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f8d4f776-b180-4c53-b8fe-53e2d9481448 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:11.588712 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f8d4f776-b180-4c53-b8fe-53e2d9481448 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1333 microversion: 2.20 time: 0.162259 Oct 11 06:42:11.589923 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 32/65] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:42:11 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1333 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:42:11.778070 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fb0983a8-db4a-438f-a57d-1aabe8cc15f8 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:11.779306 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fb0983a8-db4a-438f-a57d-1aabe8cc15f8 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:11.792260 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fb0983a8-db4a-438f-a57d-1aabe8cc15f8 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:11.793363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fb0983a8-db4a-438f-a57d-1aabe8cc15f8 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:11.794142 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fb0983a8-db4a-438f-a57d-1aabe8cc15f8 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:11.795750 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fb0983a8-db4a-438f-a57d-1aabe8cc15f8 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:11.797516 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fb0983a8-db4a-438f-a57d-1aabe8cc15f8 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:11.798573 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fb0983a8-db4a-438f-a57d-1aabe8cc15f8 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:11.856583 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-834d6f1a-80d3-4754-98f4-843b2a837880 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:11.857382 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-834d6f1a-80d3-4754-98f4-843b2a837880 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:11.865299 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:11.871748 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-834d6f1a-80d3-4754-98f4-843b2a837880 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:11.872323 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-834d6f1a-80d3-4754-98f4-843b2a837880 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:11.872999 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-834d6f1a-80d3-4754-98f4-843b2a837880 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:11.873899 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-834d6f1a-80d3-4754-98f4-843b2a837880 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:11.874446 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-834d6f1a-80d3-4754-98f4-843b2a837880 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:11.874870 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-834d6f1a-80d3-4754-98f4-843b2a837880 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:11.969240 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fb0983a8-db4a-438f-a57d-1aabe8cc15f8 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:11.990538 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fb0983a8-db4a-438f-a57d-1aabe8cc15f8 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1211 microversion: 2.1 time: 0.216140 Oct 11 06:42:11.991766 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 34/66] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:11 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1211 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:12.016062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-834d6f1a-80d3-4754-98f4-843b2a837880 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:12.037692 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-834d6f1a-80d3-4754-98f4-843b2a837880 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1295 microversion: 2.1 time: 0.190103 Oct 11 06:42:12.041092 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 33/67] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:11 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1295 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:12.292952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9f7f2898-6172-4800-b1d0-7978a74d9557 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:12.293568 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9f7f2898-6172-4800-b1d0-7978a74d9557 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:12.299922 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9f7f2898-6172-4800-b1d0-7978a74d9557 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:12.301045 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9f7f2898-6172-4800-b1d0-7978a74d9557 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:12.301965 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9f7f2898-6172-4800-b1d0-7978a74d9557 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:12.302891 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9f7f2898-6172-4800-b1d0-7978a74d9557 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:12.304668 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9f7f2898-6172-4800-b1d0-7978a74d9557 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:12.305916 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9f7f2898-6172-4800-b1d0-7978a74d9557 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:12.321962 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6ca6ce46-133b-4572-adde-2d9ebc29b671 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:12.321962 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6ca6ce46-133b-4572-adde-2d9ebc29b671 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:12.327342 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ca6ce46-133b-4572-adde-2d9ebc29b671 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:12.328025 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ca6ce46-133b-4572-adde-2d9ebc29b671 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:12.328454 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ca6ce46-133b-4572-adde-2d9ebc29b671 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:12.329152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ca6ce46-133b-4572-adde-2d9ebc29b671 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:12.329819 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ca6ce46-133b-4572-adde-2d9ebc29b671 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:12.330351 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ca6ce46-133b-4572-adde-2d9ebc29b671 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:12.403042 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9f7f2898-6172-4800-b1d0-7978a74d9557 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:12.417347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9f7f2898-6172-4800-b1d0-7978a74d9557 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1226 microversion: 2.1 time: 0.128082 Oct 11 06:42:12.418347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 35/68] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:12 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1226 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:12.438661 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6ca6ce46-133b-4572-adde-2d9ebc29b671 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:12.450015 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6ca6ce46-133b-4572-adde-2d9ebc29b671 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1236 microversion: 2.1 time: 0.133402 Oct 11 06:42:12.464245 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 34/69] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:12 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1236 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:12.619123 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-22d69f82-379e-4b2b-a090-f6b4c66d808d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:12.620155 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-22d69f82-379e-4b2b-a090-f6b4c66d808d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:12.628201 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-22d69f82-379e-4b2b-a090-f6b4c66d808d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:12.628922 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-22d69f82-379e-4b2b-a090-f6b4c66d808d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:12.629447 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-22d69f82-379e-4b2b-a090-f6b4c66d808d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:12.630240 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-22d69f82-379e-4b2b-a090-f6b4c66d808d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:12.630782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-22d69f82-379e-4b2b-a090-f6b4c66d808d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:12.631340 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-22d69f82-379e-4b2b-a090-f6b4c66d808d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:12.695882 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-22d69f82-379e-4b2b-a090-f6b4c66d808d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:12.704007 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-22d69f82-379e-4b2b-a090-f6b4c66d808d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:12.705434 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-22d69f82-379e-4b2b-a090-f6b4c66d808d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:12.706523 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-22d69f82-379e-4b2b-a090-f6b4c66d808d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1333 microversion: 2.20 time: 0.093634 Oct 11 06:42:12.722394 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 36/70] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:42:12 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1333 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:42:13.014259 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c94a1de2-7852-47a1-b90e-fbbacbd02709 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:13.015732 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c94a1de2-7852-47a1-b90e-fbbacbd02709 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:13.023199 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c94a1de2-7852-47a1-b90e-fbbacbd02709 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:13.024090 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c94a1de2-7852-47a1-b90e-fbbacbd02709 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:13.024697 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c94a1de2-7852-47a1-b90e-fbbacbd02709 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:13.025587 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c94a1de2-7852-47a1-b90e-fbbacbd02709 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:13.026194 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c94a1de2-7852-47a1-b90e-fbbacbd02709 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:13.026785 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c94a1de2-7852-47a1-b90e-fbbacbd02709 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:13.061984 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-be558279-dcf2-4199-be45-fcb019cb5a9d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:13.064475 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-be558279-dcf2-4199-be45-fcb019cb5a9d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:13.093845 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-be558279-dcf2-4199-be45-fcb019cb5a9d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:13.095522 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-be558279-dcf2-4199-be45-fcb019cb5a9d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:13.117723 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-be558279-dcf2-4199-be45-fcb019cb5a9d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:13.118730 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-be558279-dcf2-4199-be45-fcb019cb5a9d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:13.120691 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-be558279-dcf2-4199-be45-fcb019cb5a9d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:13.122142 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-be558279-dcf2-4199-be45-fcb019cb5a9d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:13.236870 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=4 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:13.242208 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c94a1de2-7852-47a1-b90e-fbbacbd02709 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:13.268278 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c94a1de2-7852-47a1-b90e-fbbacbd02709 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1211 microversion: 2.1 time: 0.254845 Oct 11 06:42:13.268895 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 35/71] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:13 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1211 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:13.294680 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-be558279-dcf2-4199-be45-fcb019cb5a9d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:13.304313 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-be558279-dcf2-4199-be45-fcb019cb5a9d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1295 microversion: 2.1 time: 0.246750 Oct 11 06:42:13.306934 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 37/72] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:13 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1295 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:42:13.442801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b37a1ec2-0ba9-431a-9c2b-1e8709aecc5d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:13.443431 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b37a1ec2-0ba9-431a-9c2b-1e8709aecc5d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:13.461152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b37a1ec2-0ba9-431a-9c2b-1e8709aecc5d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:13.462158 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b37a1ec2-0ba9-431a-9c2b-1e8709aecc5d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:13.465079 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b37a1ec2-0ba9-431a-9c2b-1e8709aecc5d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:13.465985 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b37a1ec2-0ba9-431a-9c2b-1e8709aecc5d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:13.466580 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b37a1ec2-0ba9-431a-9c2b-1e8709aecc5d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:13.467015 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b37a1ec2-0ba9-431a-9c2b-1e8709aecc5d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:13.475757 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e4c4ed53-0f1e-4269-8a0d-8b9c474ee10a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:13.476690 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e4c4ed53-0f1e-4269-8a0d-8b9c474ee10a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:13.488597 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e4c4ed53-0f1e-4269-8a0d-8b9c474ee10a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:13.489680 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e4c4ed53-0f1e-4269-8a0d-8b9c474ee10a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:13.490428 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e4c4ed53-0f1e-4269-8a0d-8b9c474ee10a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:13.492033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e4c4ed53-0f1e-4269-8a0d-8b9c474ee10a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:13.492492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e4c4ed53-0f1e-4269-8a0d-8b9c474ee10a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:13.492980 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e4c4ed53-0f1e-4269-8a0d-8b9c474ee10a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:13.499605 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:13.560311 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b37a1ec2-0ba9-431a-9c2b-1e8709aecc5d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:13.568904 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b37a1ec2-0ba9-431a-9c2b-1e8709aecc5d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1226 microversion: 2.1 time: 0.130378 Oct 11 06:42:13.570413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 36/73] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:13 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1226 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:13.639977 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e4c4ed53-0f1e-4269-8a0d-8b9c474ee10a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:13.651559 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e4c4ed53-0f1e-4269-8a0d-8b9c474ee10a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1236 microversion: 2.1 time: 0.179382 Oct 11 06:42:13.653451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 38/74] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:13 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1236 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:13.732394 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6404e528-fabd-423c-9b1f-5fc93ff69ff6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:13.733002 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6404e528-fabd-423c-9b1f-5fc93ff69ff6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:13.740861 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6404e528-fabd-423c-9b1f-5fc93ff69ff6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:13.741390 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6404e528-fabd-423c-9b1f-5fc93ff69ff6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:13.746376 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6404e528-fabd-423c-9b1f-5fc93ff69ff6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:13.747151 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6404e528-fabd-423c-9b1f-5fc93ff69ff6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:13.747756 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6404e528-fabd-423c-9b1f-5fc93ff69ff6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:13.748188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6404e528-fabd-423c-9b1f-5fc93ff69ff6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:13.853142 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6404e528-fabd-423c-9b1f-5fc93ff69ff6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:13.865166 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6404e528-fabd-423c-9b1f-5fc93ff69ff6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:13.867932 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6404e528-fabd-423c-9b1f-5fc93ff69ff6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:13.869371 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6404e528-fabd-423c-9b1f-5fc93ff69ff6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1333 microversion: 2.20 time: 0.140870 Oct 11 06:42:13.870038 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 37/75] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:42:13 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1333 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:42:14.294235 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d1d50d28-50aa-45fe-a774-fdb435929791 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:14.294971 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d1d50d28-50aa-45fe-a774-fdb435929791 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:14.306333 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d1d50d28-50aa-45fe-a774-fdb435929791 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:14.307286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d1d50d28-50aa-45fe-a774-fdb435929791 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:14.309056 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d1d50d28-50aa-45fe-a774-fdb435929791 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:14.310003 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d1d50d28-50aa-45fe-a774-fdb435929791 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:14.315721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d1d50d28-50aa-45fe-a774-fdb435929791 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:14.316281 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d1d50d28-50aa-45fe-a774-fdb435929791 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:14.331647 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f332ea7a-5b70-4e8f-994d-a93f03283c0a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:14.332259 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f332ea7a-5b70-4e8f-994d-a93f03283c0a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:14.346372 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f332ea7a-5b70-4e8f-994d-a93f03283c0a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:14.346798 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f332ea7a-5b70-4e8f-994d-a93f03283c0a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:14.347607 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f332ea7a-5b70-4e8f-994d-a93f03283c0a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:14.348954 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f332ea7a-5b70-4e8f-994d-a93f03283c0a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:14.349547 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f332ea7a-5b70-4e8f-994d-a93f03283c0a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:14.350112 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f332ea7a-5b70-4e8f-994d-a93f03283c0a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:14.473531 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d1d50d28-50aa-45fe-a774-fdb435929791 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:14.484617 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f332ea7a-5b70-4e8f-994d-a93f03283c0a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:14.489786 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d1d50d28-50aa-45fe-a774-fdb435929791 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1211 microversion: 2.1 time: 0.200660 Oct 11 06:42:14.499515 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 39/76] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:14 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1211 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:14.499676 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f332ea7a-5b70-4e8f-994d-a93f03283c0a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1295 microversion: 2.1 time: 0.168924 Oct 11 06:42:14.499676 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 38/77] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:14 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1295 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:14.593448 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-67e83b7d-4dd3-4151-8816-67b0c18c3678 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:14.594339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-67e83b7d-4dd3-4151-8816-67b0c18c3678 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:14.605553 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67e83b7d-4dd3-4151-8816-67b0c18c3678 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:14.606336 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67e83b7d-4dd3-4151-8816-67b0c18c3678 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:14.610886 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67e83b7d-4dd3-4151-8816-67b0c18c3678 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:14.611988 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67e83b7d-4dd3-4151-8816-67b0c18c3678 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:14.612558 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67e83b7d-4dd3-4151-8816-67b0c18c3678 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:14.613200 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67e83b7d-4dd3-4151-8816-67b0c18c3678 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:14.677375 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c1226838-e8f7-4a2b-9a4c-9025a762155f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:14.678116 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c1226838-e8f7-4a2b-9a4c-9025a762155f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:14.686648 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1226838-e8f7-4a2b-9a4c-9025a762155f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:14.687488 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1226838-e8f7-4a2b-9a4c-9025a762155f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:14.688156 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1226838-e8f7-4a2b-9a4c-9025a762155f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:14.688958 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1226838-e8f7-4a2b-9a4c-9025a762155f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:14.689608 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1226838-e8f7-4a2b-9a4c-9025a762155f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:14.690242 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1226838-e8f7-4a2b-9a4c-9025a762155f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:14.696884 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-67e83b7d-4dd3-4151-8816-67b0c18c3678 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:14.707400 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-67e83b7d-4dd3-4151-8816-67b0c18c3678 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1226 microversion: 2.1 time: 0.117623 Oct 11 06:42:14.718133 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 40/78] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:14 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1226 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:14.777025 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c1226838-e8f7-4a2b-9a4c-9025a762155f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:14.786556 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c1226838-e8f7-4a2b-9a4c-9025a762155f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1236 microversion: 2.1 time: 0.112881 Oct 11 06:42:14.787120 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 39/79] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:14 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1236 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:42:14.894961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ba324800-345b-4d29-8857-253b73d95273 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:14.896526 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ba324800-345b-4d29-8857-253b73d95273 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:14.904379 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ba324800-345b-4d29-8857-253b73d95273 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:14.905559 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ba324800-345b-4d29-8857-253b73d95273 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:14.906308 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ba324800-345b-4d29-8857-253b73d95273 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:14.907402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ba324800-345b-4d29-8857-253b73d95273 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:14.907989 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ba324800-345b-4d29-8857-253b73d95273 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:14.908560 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ba324800-345b-4d29-8857-253b73d95273 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:14.983846 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ba324800-345b-4d29-8857-253b73d95273 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:14.993577 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ba324800-345b-4d29-8857-253b73d95273 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:14.997948 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ba324800-345b-4d29-8857-253b73d95273 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:14.999395 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ba324800-345b-4d29-8857-253b73d95273 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1333 microversion: 2.20 time: 0.109085 Oct 11 06:42:15.012066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 41/80] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:42:14 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1333 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:42:15.516189 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-def69a9f-ed54-4974-ab7a-7e465cf7b7ca tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:15.516786 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f30a36c4-9651-49c4-a5a8-a3f55fee3be8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:15.517167 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f30a36c4-9651-49c4-a5a8-a3f55fee3be8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:15.517910 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-def69a9f-ed54-4974-ab7a-7e465cf7b7ca tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:15.519830 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=24 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:15.523972 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f30a36c4-9651-49c4-a5a8-a3f55fee3be8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:15.524624 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f30a36c4-9651-49c4-a5a8-a3f55fee3be8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:15.525208 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f30a36c4-9651-49c4-a5a8-a3f55fee3be8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:15.526056 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f30a36c4-9651-49c4-a5a8-a3f55fee3be8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:15.526180 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-def69a9f-ed54-4974-ab7a-7e465cf7b7ca tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:15.526503 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f30a36c4-9651-49c4-a5a8-a3f55fee3be8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:15.526607 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-def69a9f-ed54-4974-ab7a-7e465cf7b7ca tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:15.526914 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f30a36c4-9651-49c4-a5a8-a3f55fee3be8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:15.527029 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-def69a9f-ed54-4974-ab7a-7e465cf7b7ca tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:15.527672 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-def69a9f-ed54-4974-ab7a-7e465cf7b7ca tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:15.528116 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-def69a9f-ed54-4974-ab7a-7e465cf7b7ca tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:15.528541 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-def69a9f-ed54-4974-ab7a-7e465cf7b7ca tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:15.615171 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f30a36c4-9651-49c4-a5a8-a3f55fee3be8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:15.625898 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f30a36c4-9651-49c4-a5a8-a3f55fee3be8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1295 microversion: 2.1 time: 0.113322 Oct 11 06:42:15.626476 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 42/81] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:15 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1295 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:15.641491 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-def69a9f-ed54-4974-ab7a-7e465cf7b7ca tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:15.656381 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-def69a9f-ed54-4974-ab7a-7e465cf7b7ca tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1211 microversion: 2.1 time: 0.143874 Oct 11 06:42:15.657416 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 40/82] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:15 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1211 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:15.735628 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4a5d6416-e26f-4acb-9e6b-a2d95173c18d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:15.736568 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4a5d6416-e26f-4acb-9e6b-a2d95173c18d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:15.744560 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4a5d6416-e26f-4acb-9e6b-a2d95173c18d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:15.745064 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4a5d6416-e26f-4acb-9e6b-a2d95173c18d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:15.745684 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4a5d6416-e26f-4acb-9e6b-a2d95173c18d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:15.746388 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4a5d6416-e26f-4acb-9e6b-a2d95173c18d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:15.746832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4a5d6416-e26f-4acb-9e6b-a2d95173c18d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:15.747244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4a5d6416-e26f-4acb-9e6b-a2d95173c18d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:15.814323 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7165cdf0-06d7-4276-b955-4e69424f64e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:15.815290 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7165cdf0-06d7-4276-b955-4e69424f64e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:15.826950 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7165cdf0-06d7-4276-b955-4e69424f64e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:15.827803 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7165cdf0-06d7-4276-b955-4e69424f64e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:15.828596 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7165cdf0-06d7-4276-b955-4e69424f64e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:15.829869 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7165cdf0-06d7-4276-b955-4e69424f64e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:15.855834 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7165cdf0-06d7-4276-b955-4e69424f64e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:15.856267 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7165cdf0-06d7-4276-b955-4e69424f64e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:15.861955 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4a5d6416-e26f-4acb-9e6b-a2d95173c18d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:15.870831 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4a5d6416-e26f-4acb-9e6b-a2d95173c18d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1226 microversion: 2.1 time: 0.141081 Oct 11 06:42:15.871628 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 43/83] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:15 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1226 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:15.943222 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7165cdf0-06d7-4276-b955-4e69424f64e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:15.953833 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7165cdf0-06d7-4276-b955-4e69424f64e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1236 microversion: 2.1 time: 0.144150 Oct 11 06:42:15.954707 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 41/84] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:15 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1236 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:42:16.028971 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d9953c49-e0f2-4150-b490-5b41bf85b06c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:16.029498 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d9953c49-e0f2-4150-b490-5b41bf85b06c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:16.031696 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=8 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:16.037286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d9953c49-e0f2-4150-b490-5b41bf85b06c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:16.037803 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d9953c49-e0f2-4150-b490-5b41bf85b06c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:16.038771 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d9953c49-e0f2-4150-b490-5b41bf85b06c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:16.039493 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d9953c49-e0f2-4150-b490-5b41bf85b06c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:16.039946 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d9953c49-e0f2-4150-b490-5b41bf85b06c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:16.040369 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d9953c49-e0f2-4150-b490-5b41bf85b06c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:16.099905 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d9953c49-e0f2-4150-b490-5b41bf85b06c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:16.108682 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d9953c49-e0f2-4150-b490-5b41bf85b06c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:16.110153 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d9953c49-e0f2-4150-b490-5b41bf85b06c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:16.111262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d9953c49-e0f2-4150-b490-5b41bf85b06c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1333 microversion: 2.20 time: 0.086437 Oct 11 06:42:16.111850 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 44/85] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:42:16 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1333 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:42:16.648659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3672afb9-5dc1-4d96-bb76-6b9df7a877b4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:16.649261 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3672afb9-5dc1-4d96-bb76-6b9df7a877b4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:16.655393 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3672afb9-5dc1-4d96-bb76-6b9df7a877b4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:16.655917 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3672afb9-5dc1-4d96-bb76-6b9df7a877b4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:16.656325 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3672afb9-5dc1-4d96-bb76-6b9df7a877b4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:16.657008 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3672afb9-5dc1-4d96-bb76-6b9df7a877b4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:16.657589 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3672afb9-5dc1-4d96-bb76-6b9df7a877b4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:16.658011 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3672afb9-5dc1-4d96-bb76-6b9df7a877b4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:16.687054 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ef947083-49ed-4c4c-9f26-217dc9283b0d tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:16.688300 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ef947083-49ed-4c4c-9f26-217dc9283b0d tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:16.694254 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=32 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:16.696519 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef947083-49ed-4c4c-9f26-217dc9283b0d tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:16.697003 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef947083-49ed-4c4c-9f26-217dc9283b0d tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:16.697433 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef947083-49ed-4c4c-9f26-217dc9283b0d tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:16.698123 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef947083-49ed-4c4c-9f26-217dc9283b0d tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:16.698569 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef947083-49ed-4c4c-9f26-217dc9283b0d tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:16.698982 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef947083-49ed-4c4c-9f26-217dc9283b0d tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:16.752133 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3672afb9-5dc1-4d96-bb76-6b9df7a877b4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:16.759931 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3672afb9-5dc1-4d96-bb76-6b9df7a877b4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1295 microversion: 2.1 time: 0.115400 Oct 11 06:42:16.760492 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 42/86] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:16 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1295 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:16.763404 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ef947083-49ed-4c4c-9f26-217dc9283b0d tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:16.771382 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ef947083-49ed-4c4c-9f26-217dc9283b0d tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1211 microversion: 2.1 time: 0.096560 Oct 11 06:42:16.771952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 45/87] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:16 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1211 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:16.893936 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1c299865-07fb-4930-82f4-4148ae4ab8ea tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:16.894488 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1c299865-07fb-4930-82f4-4148ae4ab8ea tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:16.901066 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c299865-07fb-4930-82f4-4148ae4ab8ea tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:16.901535 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c299865-07fb-4930-82f4-4148ae4ab8ea tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:16.901961 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c299865-07fb-4930-82f4-4148ae4ab8ea tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:16.902643 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c299865-07fb-4930-82f4-4148ae4ab8ea tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:16.903090 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c299865-07fb-4930-82f4-4148ae4ab8ea tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:16.903540 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c299865-07fb-4930-82f4-4148ae4ab8ea tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:16.967070 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1c299865-07fb-4930-82f4-4148ae4ab8ea tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:16.979131 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1c299865-07fb-4930-82f4-4148ae4ab8ea tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1226 microversion: 2.1 time: 0.088997 Oct 11 06:42:16.980091 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 43/88] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:16 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:16.987651 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4f9f1a4c-a830-44c7-a3b0-1791da1c31fb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:16.988338 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4f9f1a4c-a830-44c7-a3b0-1791da1c31fb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:16.998159 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f9f1a4c-a830-44c7-a3b0-1791da1c31fb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:16.998643 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f9f1a4c-a830-44c7-a3b0-1791da1c31fb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:16.999341 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f9f1a4c-a830-44c7-a3b0-1791da1c31fb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:17.000449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f9f1a4c-a830-44c7-a3b0-1791da1c31fb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:17.001191 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f9f1a4c-a830-44c7-a3b0-1791da1c31fb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:17.001845 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f9f1a4c-a830-44c7-a3b0-1791da1c31fb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:17.090492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4f9f1a4c-a830-44c7-a3b0-1791da1c31fb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:17.105494 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4f9f1a4c-a830-44c7-a3b0-1791da1c31fb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1236 microversion: 2.1 time: 0.129548 Oct 11 06:42:17.120216 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 46/89] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:16 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1236 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:17.140109 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0e345009-1e8f-43fe-a7a9-37c33b37a7f6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:17.141264 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0e345009-1e8f-43fe-a7a9-37c33b37a7f6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:17.149005 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0e345009-1e8f-43fe-a7a9-37c33b37a7f6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:17.149714 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0e345009-1e8f-43fe-a7a9-37c33b37a7f6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:17.150261 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0e345009-1e8f-43fe-a7a9-37c33b37a7f6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:17.151361 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0e345009-1e8f-43fe-a7a9-37c33b37a7f6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:17.151850 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0e345009-1e8f-43fe-a7a9-37c33b37a7f6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:17.152266 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0e345009-1e8f-43fe-a7a9-37c33b37a7f6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:17.233714 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0e345009-1e8f-43fe-a7a9-37c33b37a7f6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:17.252397 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0e345009-1e8f-43fe-a7a9-37c33b37a7f6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:17.254051 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0e345009-1e8f-43fe-a7a9-37c33b37a7f6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:17.255196 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0e345009-1e8f-43fe-a7a9-37c33b37a7f6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1333 microversion: 2.20 time: 0.120320 Oct 11 06:42:17.255803 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 44/90] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:42:17 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1333 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:42:17.782800 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0087adb0-f401-4eff-a87b-f3cb35ae6879 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:17.783452 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0087adb0-f401-4eff-a87b-f3cb35ae6879 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:17.790166 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0087adb0-f401-4eff-a87b-f3cb35ae6879 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:17.790634 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0087adb0-f401-4eff-a87b-f3cb35ae6879 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:17.791366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0087adb0-f401-4eff-a87b-f3cb35ae6879 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:17.792152 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0087adb0-f401-4eff-a87b-f3cb35ae6879 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:17.792591 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0087adb0-f401-4eff-a87b-f3cb35ae6879 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:17.793069 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0087adb0-f401-4eff-a87b-f3cb35ae6879 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:17.796394 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f41130a8-298f-48ca-adbf-c3848c9e0c1e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:17.797126 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f41130a8-298f-48ca-adbf-c3848c9e0c1e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:17.803013 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f41130a8-298f-48ca-adbf-c3848c9e0c1e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:17.803547 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f41130a8-298f-48ca-adbf-c3848c9e0c1e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:17.804031 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f41130a8-298f-48ca-adbf-c3848c9e0c1e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:17.804719 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f41130a8-298f-48ca-adbf-c3848c9e0c1e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:17.805165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f41130a8-298f-48ca-adbf-c3848c9e0c1e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:17.805579 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f41130a8-298f-48ca-adbf-c3848c9e0c1e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:17.858321 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0087adb0-f401-4eff-a87b-f3cb35ae6879 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:17.866019 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f41130a8-298f-48ca-adbf-c3848c9e0c1e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:17.866969 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0087adb0-f401-4eff-a87b-f3cb35ae6879 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1295 microversion: 2.1 time: 0.088644 Oct 11 06:42:17.867595 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 47/91] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:17 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1295 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:17.874550 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f41130a8-298f-48ca-adbf-c3848c9e0c1e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1211 microversion: 2.1 time: 0.082405 Oct 11 06:42:17.875132 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 45/92] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:17 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1211 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:42:18.002716 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-04203c38-23c2-4725-a381-309ecb3a0807 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:18.003323 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-04203c38-23c2-4725-a381-309ecb3a0807 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:18.010262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04203c38-23c2-4725-a381-309ecb3a0807 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:18.010742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04203c38-23c2-4725-a381-309ecb3a0807 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:18.011172 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04203c38-23c2-4725-a381-309ecb3a0807 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:18.011893 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04203c38-23c2-4725-a381-309ecb3a0807 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:18.012356 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04203c38-23c2-4725-a381-309ecb3a0807 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:18.012776 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04203c38-23c2-4725-a381-309ecb3a0807 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:18.073158 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-04203c38-23c2-4725-a381-309ecb3a0807 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:18.083139 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-04203c38-23c2-4725-a381-309ecb3a0807 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1226 microversion: 2.1 time: 0.084167 Oct 11 06:42:18.084060 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 48/93] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:17 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:18.128746 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4b332e78-c0d6-4885-9d43-7b9091c245f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:18.129372 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4b332e78-c0d6-4885-9d43-7b9091c245f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:18.142152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b332e78-c0d6-4885-9d43-7b9091c245f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:18.142877 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b332e78-c0d6-4885-9d43-7b9091c245f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:18.143308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b332e78-c0d6-4885-9d43-7b9091c245f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:18.144228 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b332e78-c0d6-4885-9d43-7b9091c245f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:18.144566 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b332e78-c0d6-4885-9d43-7b9091c245f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:18.146188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b332e78-c0d6-4885-9d43-7b9091c245f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:18.287169 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2185328c-0edb-4f26-8254-e7b834e0827e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:18.289007 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2185328c-0edb-4f26-8254-e7b834e0827e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:18.296829 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4b332e78-c0d6-4885-9d43-7b9091c245f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:18.307380 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4b332e78-c0d6-4885-9d43-7b9091c245f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1236 microversion: 2.1 time: 0.182461 Oct 11 06:42:18.310677 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 46/94] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:18 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1236 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:18.312195 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2185328c-0edb-4f26-8254-e7b834e0827e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:18.314116 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2185328c-0edb-4f26-8254-e7b834e0827e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:18.315945 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2185328c-0edb-4f26-8254-e7b834e0827e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:18.316861 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2185328c-0edb-4f26-8254-e7b834e0827e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:18.319017 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2185328c-0edb-4f26-8254-e7b834e0827e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:18.319824 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2185328c-0edb-4f26-8254-e7b834e0827e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:18.475292 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2185328c-0edb-4f26-8254-e7b834e0827e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:18.485387 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2185328c-0edb-4f26-8254-e7b834e0827e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:18.496516 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2185328c-0edb-4f26-8254-e7b834e0827e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:18.497806 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2185328c-0edb-4f26-8254-e7b834e0827e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1341 microversion: 2.20 time: 0.221899 Oct 11 06:42:18.498950 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 49/95] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:42:18 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1341 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:42:18.889058 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7bea3b1e-8c22-4d20-96ac-43134db9a307 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:18.890202 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7bea3b1e-8c22-4d20-96ac-43134db9a307 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:18.899132 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-416db4ae-ec20-440e-a4cb-04d6c379afda tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:18.899791 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-416db4ae-ec20-440e-a4cb-04d6c379afda tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:18.901491 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7bea3b1e-8c22-4d20-96ac-43134db9a307 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:18.902278 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7bea3b1e-8c22-4d20-96ac-43134db9a307 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:18.902857 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7bea3b1e-8c22-4d20-96ac-43134db9a307 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:18.903777 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7bea3b1e-8c22-4d20-96ac-43134db9a307 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:18.906304 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7bea3b1e-8c22-4d20-96ac-43134db9a307 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:18.907529 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7bea3b1e-8c22-4d20-96ac-43134db9a307 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:18.910561 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-416db4ae-ec20-440e-a4cb-04d6c379afda tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:18.911051 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-416db4ae-ec20-440e-a4cb-04d6c379afda tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:18.911511 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-416db4ae-ec20-440e-a4cb-04d6c379afda tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:18.913039 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-416db4ae-ec20-440e-a4cb-04d6c379afda tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:18.913497 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-416db4ae-ec20-440e-a4cb-04d6c379afda tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:18.915648 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-416db4ae-ec20-440e-a4cb-04d6c379afda tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:19.106025 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-416db4ae-ec20-440e-a4cb-04d6c379afda tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:19.119351 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-416db4ae-ec20-440e-a4cb-04d6c379afda tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1267 microversion: 2.1 time: 0.223607 Oct 11 06:42:19.120301 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 50/96] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:18 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1267 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:42:19.131503 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ff2e6427-0b4d-4a4d-b609-d8c34a5a76c3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:19.134081 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ff2e6427-0b4d-4a4d-b609-d8c34a5a76c3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:19.151549 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff2e6427-0b4d-4a4d-b609-d8c34a5a76c3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:19.152918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff2e6427-0b4d-4a4d-b609-d8c34a5a76c3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:19.153914 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff2e6427-0b4d-4a4d-b609-d8c34a5a76c3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:19.156472 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff2e6427-0b4d-4a4d-b609-d8c34a5a76c3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:19.157093 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff2e6427-0b4d-4a4d-b609-d8c34a5a76c3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:19.159867 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff2e6427-0b4d-4a4d-b609-d8c34a5a76c3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:19.365139 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ff2e6427-0b4d-4a4d-b609-d8c34a5a76c3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:19.376548 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ff2e6427-0b4d-4a4d-b609-d8c34a5a76c3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1218 microversion: 2.1 time: 0.253661 Oct 11 06:42:19.395514 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 51/97] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:19 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1218 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:19.406640 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7faf3e49-6352-42db-b6d2-e45d84e081cb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:19.407444 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7faf3e49-6352-42db-b6d2-e45d84e081cb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:19.425397 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7faf3e49-6352-42db-b6d2-e45d84e081cb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:19.425893 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7faf3e49-6352-42db-b6d2-e45d84e081cb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:19.426309 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7faf3e49-6352-42db-b6d2-e45d84e081cb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:19.426999 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7faf3e49-6352-42db-b6d2-e45d84e081cb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:19.427640 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7faf3e49-6352-42db-b6d2-e45d84e081cb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:19.428378 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7faf3e49-6352-42db-b6d2-e45d84e081cb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:19.542736 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7faf3e49-6352-42db-b6d2-e45d84e081cb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:19.558594 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7faf3e49-6352-42db-b6d2-e45d84e081cb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1292 microversion: 2.1 time: 0.161395 Oct 11 06:42:19.560275 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 52/98] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:19 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1292 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:19.566481 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f03040ef-626a-4f9b-90e3-ebb9bfb59757 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:19.568964 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f03040ef-626a-4f9b-90e3-ebb9bfb59757 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:19.583250 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f03040ef-626a-4f9b-90e3-ebb9bfb59757 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:19.586242 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f03040ef-626a-4f9b-90e3-ebb9bfb59757 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:19.598125 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f03040ef-626a-4f9b-90e3-ebb9bfb59757 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:19.600184 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f03040ef-626a-4f9b-90e3-ebb9bfb59757 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:19.601462 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f03040ef-626a-4f9b-90e3-ebb9bfb59757 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:19.602185 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f03040ef-626a-4f9b-90e3-ebb9bfb59757 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:19.684393 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7bea3b1e-8c22-4d20-96ac-43134db9a307 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:19.692285 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7bea3b1e-8c22-4d20-96ac-43134db9a307 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1361 microversion: 2.1 time: 0.806905 Oct 11 06:42:19.692853 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 47/99] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:18 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1361 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:19.744786 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f03040ef-626a-4f9b-90e3-ebb9bfb59757 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:19.765962 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f03040ef-626a-4f9b-90e3-ebb9bfb59757 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:19.767346 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f03040ef-626a-4f9b-90e3-ebb9bfb59757 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:19.768636 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f03040ef-626a-4f9b-90e3-ebb9bfb59757 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1339 microversion: 2.20 time: 0.207089 Oct 11 06:42:19.769032 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 53/100] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:42:19 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1339 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:42:20.151867 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3e795631-e275-48a8-adc5-e483c8d77fdc tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:20.153254 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3e795631-e275-48a8-adc5-e483c8d77fdc tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:20.159841 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e795631-e275-48a8-adc5-e483c8d77fdc tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:20.160532 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e795631-e275-48a8-adc5-e483c8d77fdc tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:20.161122 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e795631-e275-48a8-adc5-e483c8d77fdc tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:20.161970 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e795631-e275-48a8-adc5-e483c8d77fdc tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:20.162559 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e795631-e275-48a8-adc5-e483c8d77fdc tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:20.163706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e795631-e275-48a8-adc5-e483c8d77fdc tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:20.288790 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3e795631-e275-48a8-adc5-e483c8d77fdc tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:20.300320 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3e795631-e275-48a8-adc5-e483c8d77fdc tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1273 microversion: 2.1 time: 0.161003 Oct 11 06:42:20.308691 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 48/101] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:20 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1273 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:20.402838 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-edaa0779-4b00-4c5f-b9de-436aec0e6ba6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:20.404067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-edaa0779-4b00-4c5f-b9de-436aec0e6ba6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:20.414259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-edaa0779-4b00-4c5f-b9de-436aec0e6ba6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:20.417585 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-edaa0779-4b00-4c5f-b9de-436aec0e6ba6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:20.418256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-edaa0779-4b00-4c5f-b9de-436aec0e6ba6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:20.421318 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-edaa0779-4b00-4c5f-b9de-436aec0e6ba6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:20.421945 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-edaa0779-4b00-4c5f-b9de-436aec0e6ba6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:20.422553 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-edaa0779-4b00-4c5f-b9de-436aec0e6ba6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:20.592011 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e4b08375-26e4-4074-b69f-1103198ae99a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:20.592726 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e4b08375-26e4-4074-b69f-1103198ae99a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:20.601698 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e4b08375-26e4-4074-b69f-1103198ae99a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:20.602400 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e4b08375-26e4-4074-b69f-1103198ae99a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:20.602588 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e4b08375-26e4-4074-b69f-1103198ae99a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:20.603208 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e4b08375-26e4-4074-b69f-1103198ae99a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:20.603647 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-edaa0779-4b00-4c5f-b9de-436aec0e6ba6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:20.603789 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e4b08375-26e4-4074-b69f-1103198ae99a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:20.604086 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e4b08375-26e4-4074-b69f-1103198ae99a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:20.608086 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:20.613491 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-edaa0779-4b00-4c5f-b9de-436aec0e6ba6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1218 microversion: 2.1 time: 0.214639 Oct 11 06:42:20.624559 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 54/102] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:20 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1218 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:20.643586 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:20.778427 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-641fb17e-6bd3-4be5-8a6b-5f9953b3daad req-4121bf6f-c695-4adf-b92d-6ccc7e9a94ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03687593-229b-46bf-b79a-f09a1db51ac2", "tag": "9782d4cc-0e17-4e19-8fc0-23bc73899c9a"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:42:20.807294 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e4b08375-26e4-4074-b69f-1103198ae99a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:20.821346 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e4b08375-26e4-4074-b69f-1103198ae99a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1292 microversion: 2.1 time: 0.237952 Oct 11 06:42:20.822388 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 49/103] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:20 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1292 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:42:20.826592 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-641fb17e-6bd3-4be5-8a6b-5f9953b3daad req-4121bf6f-c695-4adf-b92d-6ccc7e9a94ea service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:20.827256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-641fb17e-6bd3-4be5-8a6b-5f9953b3daad req-4121bf6f-c695-4adf-b92d-6ccc7e9a94ea service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:20.831502 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-641fb17e-6bd3-4be5-8a6b-5f9953b3daad req-4121bf6f-c695-4adf-b92d-6ccc7e9a94ea service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:20.832783 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-74d6ef13-891f-4897-b511-f2854e3ea8a2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:20.833494 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-74d6ef13-891f-4897-b511-f2854e3ea8a2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:20.861607 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-74d6ef13-891f-4897-b511-f2854e3ea8a2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:20.862378 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-74d6ef13-891f-4897-b511-f2854e3ea8a2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:20.863887 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-74d6ef13-891f-4897-b511-f2854e3ea8a2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:20.865873 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-74d6ef13-891f-4897-b511-f2854e3ea8a2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:20.867937 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-74d6ef13-891f-4897-b511-f2854e3ea8a2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:20.870780 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-74d6ef13-891f-4897-b511-f2854e3ea8a2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:20.888157 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-641fb17e-6bd3-4be5-8a6b-5f9953b3daad req-4121bf6f-c695-4adf-b92d-6ccc7e9a94ea service nova] Creating event network-changed:9782d4cc-0e17-4e19-8fc0-23bc73899c9a for instance 03687593-229b-46bf-b79a-f09a1db51ac2 on hv-cinder-85495 Oct 11 06:42:20.888818 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-641fb17e-6bd3-4be5-8a6b-5f9953b3daad req-4121bf6f-c695-4adf-b92d-6ccc7e9a94ea service nova] Acquiring lock "compute-rpcapi-router" {{(pid=125266) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 06:42:20.891521 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-641fb17e-6bd3-4be5-8a6b-5f9953b3daad req-4121bf6f-c695-4adf-b92d-6ccc7e9a94ea service nova] Acquired lock "compute-rpcapi-router" {{(pid=125266) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 06:42:20.892866 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1de01843-c542-4e9f-9f30-7a51326e1bc6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:20.893495 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1de01843-c542-4e9f-9f30-7a51326e1bc6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:20.894102 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1de01843-c542-4e9f-9f30-7a51326e1bc6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:20.894843 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1de01843-c542-4e9f-9f30-7a51326e1bc6 None None] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:20.895293 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1de01843-c542-4e9f-9f30-7a51326e1bc6 None None] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:20.899841 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1de01843-c542-4e9f-9f30-7a51326e1bc6 None None] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:20.922894 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.compute.rpcapi [None req-1de01843-c542-4e9f-9f30-7a51326e1bc6 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 11 06:42:20.924205 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1de01843-c542-4e9f-9f30-7a51326e1bc6 None None] Releasing lock "compute-rpcapi-router" {{(pid=125266) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 06:42:20.951818 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1de01843-c542-4e9f-9f30-7a51326e1bc6 None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.302845 Oct 11 06:42:20.953093 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 55/104] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:42:20.965802 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5301548e-8b97-496f-898f-2bce64982c17 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:20.966630 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5301548e-8b97-496f-898f-2bce64982c17 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:20.983168 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5301548e-8b97-496f-898f-2bce64982c17 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:20.983717 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5301548e-8b97-496f-898f-2bce64982c17 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:20.984153 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5301548e-8b97-496f-898f-2bce64982c17 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:20.984867 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5301548e-8b97-496f-898f-2bce64982c17 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:20.985318 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5301548e-8b97-496f-898f-2bce64982c17 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:20.985965 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5301548e-8b97-496f-898f-2bce64982c17 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:21.245042 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-74d6ef13-891f-4897-b511-f2854e3ea8a2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:21.253769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-74d6ef13-891f-4897-b511-f2854e3ea8a2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1361 microversion: 2.1 time: 0.429985 Oct 11 06:42:21.255111 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 50/105] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:20 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1361 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:21.300259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5301548e-8b97-496f-898f-2bce64982c17 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:21.310585 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5301548e-8b97-496f-898f-2bce64982c17 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:21.316610 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5301548e-8b97-496f-898f-2bce64982c17 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:21.317756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5301548e-8b97-496f-898f-2bce64982c17 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1406 microversion: 2.20 time: 0.363284 Oct 11 06:42:21.318312 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 56/106] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:42:20 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1406 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:42:21.328167 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-04dc2a63-4c47-4195-a87d-05e363e7312f tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:21.328851 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-04dc2a63-4c47-4195-a87d-05e363e7312f tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:21.336594 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-04dc2a63-4c47-4195-a87d-05e363e7312f tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:21.337077 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-04dc2a63-4c47-4195-a87d-05e363e7312f tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:21.337501 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-04dc2a63-4c47-4195-a87d-05e363e7312f tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:21.338191 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-04dc2a63-4c47-4195-a87d-05e363e7312f tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:21.338631 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-04dc2a63-4c47-4195-a87d-05e363e7312f tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:21.339043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-04dc2a63-4c47-4195-a87d-05e363e7312f tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:21.421259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-f69f892e-a0c6-486d-a742-c981fc187785 req-8856902a-3e13-4ddb-b693-a1f4577b64b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c76b29e-08a3-4b53-9b36-82980a19493d", "tag": "b4d1c36d-2115-4009-915e-804111b3a836"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:42:21.431726 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-f69f892e-a0c6-486d-a742-c981fc187785 req-8856902a-3e13-4ddb-b693-a1f4577b64b5 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:21.432269 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-f69f892e-a0c6-486d-a742-c981fc187785 req-8856902a-3e13-4ddb-b693-a1f4577b64b5 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:21.432889 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-f69f892e-a0c6-486d-a742-c981fc187785 req-8856902a-3e13-4ddb-b693-a1f4577b64b5 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:21.446451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-f69f892e-a0c6-486d-a742-c981fc187785 req-8856902a-3e13-4ddb-b693-a1f4577b64b5 service nova] Creating event network-changed:b4d1c36d-2115-4009-915e-804111b3a836 for instance 9c76b29e-08a3-4b53-9b36-82980a19493d on hv-cinder-85495 Oct 11 06:42:21.452055 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-f69f892e-a0c6-486d-a742-c981fc187785 req-8856902a-3e13-4ddb-b693-a1f4577b64b5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091639 Oct 11 06:42:21.452750 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 57/107] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:42:21.487216 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-04dc2a63-4c47-4195-a87d-05e363e7312f tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:21.494728 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-04dc2a63-4c47-4195-a87d-05e363e7312f tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1315 microversion: 2.1 time: 0.172868 Oct 11 06:42:21.495259 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 51/108] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:21 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:42:21.650676 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9d21cca5-8471-4b92-9aa8-d7167f3dcfe2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:21.651311 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9d21cca5-8471-4b92-9aa8-d7167f3dcfe2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:21.657747 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9d21cca5-8471-4b92-9aa8-d7167f3dcfe2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:21.658219 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9d21cca5-8471-4b92-9aa8-d7167f3dcfe2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:21.658642 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9d21cca5-8471-4b92-9aa8-d7167f3dcfe2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:21.659314 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9d21cca5-8471-4b92-9aa8-d7167f3dcfe2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:21.659783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9d21cca5-8471-4b92-9aa8-d7167f3dcfe2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:21.660195 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9d21cca5-8471-4b92-9aa8-d7167f3dcfe2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:21.720255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9d21cca5-8471-4b92-9aa8-d7167f3dcfe2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:21.727603 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9d21cca5-8471-4b92-9aa8-d7167f3dcfe2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1218 microversion: 2.1 time: 0.081812 Oct 11 06:42:21.728151 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 58/109] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:21 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:21.845377 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a6ce7fac-d87e-40bb-aa4e-f2ca605fe437 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:21.845985 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a6ce7fac-d87e-40bb-aa4e-f2ca605fe437 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:21.852032 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6ce7fac-d87e-40bb-aa4e-f2ca605fe437 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:21.852512 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6ce7fac-d87e-40bb-aa4e-f2ca605fe437 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:21.852942 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6ce7fac-d87e-40bb-aa4e-f2ca605fe437 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:21.853629 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6ce7fac-d87e-40bb-aa4e-f2ca605fe437 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:21.854076 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6ce7fac-d87e-40bb-aa4e-f2ca605fe437 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:21.854497 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6ce7fac-d87e-40bb-aa4e-f2ca605fe437 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:21.913417 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a6ce7fac-d87e-40bb-aa4e-f2ca605fe437 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:21.920888 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a6ce7fac-d87e-40bb-aa4e-f2ca605fe437 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1292 microversion: 2.1 time: 0.079303 Oct 11 06:42:21.921443 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 52/110] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:21 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1292 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:22.280499 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d70feedd-a867-4b56-806d-14e3310c2be4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:22.281024 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d70feedd-a867-4b56-806d-14e3310c2be4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:22.286857 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d70feedd-a867-4b56-806d-14e3310c2be4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:22.287324 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d70feedd-a867-4b56-806d-14e3310c2be4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:22.288272 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d70feedd-a867-4b56-806d-14e3310c2be4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:22.288939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d70feedd-a867-4b56-806d-14e3310c2be4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:22.289373 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d70feedd-a867-4b56-806d-14e3310c2be4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:22.289779 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d70feedd-a867-4b56-806d-14e3310c2be4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:22.343801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1282f6ed-f7eb-471f-bae0-3507a052d704 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:22.346366 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1282f6ed-f7eb-471f-bae0-3507a052d704 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:22.353308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1282f6ed-f7eb-471f-bae0-3507a052d704 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:22.353877 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1282f6ed-f7eb-471f-bae0-3507a052d704 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:22.354381 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1282f6ed-f7eb-471f-bae0-3507a052d704 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:22.355299 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1282f6ed-f7eb-471f-bae0-3507a052d704 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:22.355848 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1282f6ed-f7eb-471f-bae0-3507a052d704 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:22.356339 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1282f6ed-f7eb-471f-bae0-3507a052d704 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:22.460654 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d70feedd-a867-4b56-806d-14e3310c2be4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:22.471328 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d70feedd-a867-4b56-806d-14e3310c2be4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1361 microversion: 2.1 time: 0.194829 Oct 11 06:42:22.471931 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 59/111] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:22 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1361 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:22.518620 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e7aacb34-63fe-47e4-920d-5fac8ce8bc4a tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:22.519980 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e7aacb34-63fe-47e4-920d-5fac8ce8bc4a tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:22.521430 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1282f6ed-f7eb-471f-bae0-3507a052d704 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:22.527842 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7aacb34-63fe-47e4-920d-5fac8ce8bc4a tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:22.528523 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7aacb34-63fe-47e4-920d-5fac8ce8bc4a tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:22.529130 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7aacb34-63fe-47e4-920d-5fac8ce8bc4a tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:22.530399 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7aacb34-63fe-47e4-920d-5fac8ce8bc4a tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:22.531073 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7aacb34-63fe-47e4-920d-5fac8ce8bc4a tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:22.531700 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7aacb34-63fe-47e4-920d-5fac8ce8bc4a tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:22.534834 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1282f6ed-f7eb-471f-bae0-3507a052d704 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:22.537162 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1282f6ed-f7eb-471f-bae0-3507a052d704 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:22.539913 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1282f6ed-f7eb-471f-bae0-3507a052d704 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1406 microversion: 2.20 time: 0.200121 Oct 11 06:42:22.542801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 53/112] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:42:22 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:42:22.750056 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-74ebbeb4-b6d8-4cac-a2c5-94ed93150a12 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:22.750911 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-74ebbeb4-b6d8-4cac-a2c5-94ed93150a12 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:22.751870 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e7aacb34-63fe-47e4-920d-5fac8ce8bc4a tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:22.760854 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-74ebbeb4-b6d8-4cac-a2c5-94ed93150a12 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:22.765030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-74ebbeb4-b6d8-4cac-a2c5-94ed93150a12 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:22.765748 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-74ebbeb4-b6d8-4cac-a2c5-94ed93150a12 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:22.766726 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-74ebbeb4-b6d8-4cac-a2c5-94ed93150a12 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:22.767362 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-74ebbeb4-b6d8-4cac-a2c5-94ed93150a12 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:22.769113 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-74ebbeb4-b6d8-4cac-a2c5-94ed93150a12 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:22.773689 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e7aacb34-63fe-47e4-920d-5fac8ce8bc4a tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1315 microversion: 2.1 time: 0.259432 Oct 11 06:42:22.777053 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 60/113] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:22 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:42:22.945731 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0fb8680a-d3d2-4f4b-b8fa-478842bf46fa tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:22.946481 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0fb8680a-d3d2-4f4b-b8fa-478842bf46fa tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:22.955752 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0fb8680a-d3d2-4f4b-b8fa-478842bf46fa tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:22.956396 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0fb8680a-d3d2-4f4b-b8fa-478842bf46fa tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:22.957097 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0fb8680a-d3d2-4f4b-b8fa-478842bf46fa tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:22.958133 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0fb8680a-d3d2-4f4b-b8fa-478842bf46fa tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:22.958845 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0fb8680a-d3d2-4f4b-b8fa-478842bf46fa tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:22.959776 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0fb8680a-d3d2-4f4b-b8fa-478842bf46fa tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:23.164197 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0fb8680a-d3d2-4f4b-b8fa-478842bf46fa tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:23.175046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0fb8680a-d3d2-4f4b-b8fa-478842bf46fa tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1300 microversion: 2.1 time: 0.233776 Oct 11 06:42:23.181276 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 61/114] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:22 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1300 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:42:23.227890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-74ebbeb4-b6d8-4cac-a2c5-94ed93150a12 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:23.252079 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-74ebbeb4-b6d8-4cac-a2c5-94ed93150a12 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1218 microversion: 2.1 time: 0.505498 Oct 11 06:42:23.271238 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 54/115] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:22 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1218 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:42:23.504476 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7796e6c9-3ae7-487c-be7c-2ae017379ca5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:23.506715 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7796e6c9-3ae7-487c-be7c-2ae017379ca5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:23.520737 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7796e6c9-3ae7-487c-be7c-2ae017379ca5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:23.521737 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7796e6c9-3ae7-487c-be7c-2ae017379ca5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:23.522901 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7796e6c9-3ae7-487c-be7c-2ae017379ca5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:23.526414 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7796e6c9-3ae7-487c-be7c-2ae017379ca5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:23.527119 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7796e6c9-3ae7-487c-be7c-2ae017379ca5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:23.527732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7796e6c9-3ae7-487c-be7c-2ae017379ca5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:23.566569 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-54f9f8cb-7f7f-45b7-8bef-98ddcd95ad4d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:23.568079 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-54f9f8cb-7f7f-45b7-8bef-98ddcd95ad4d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:23.579410 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-54f9f8cb-7f7f-45b7-8bef-98ddcd95ad4d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:23.584463 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-54f9f8cb-7f7f-45b7-8bef-98ddcd95ad4d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:23.585699 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-54f9f8cb-7f7f-45b7-8bef-98ddcd95ad4d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:23.587178 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-54f9f8cb-7f7f-45b7-8bef-98ddcd95ad4d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:23.587778 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-54f9f8cb-7f7f-45b7-8bef-98ddcd95ad4d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:23.588575 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-54f9f8cb-7f7f-45b7-8bef-98ddcd95ad4d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:23.959735 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-54f9f8cb-7f7f-45b7-8bef-98ddcd95ad4d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:23.975046 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-54f9f8cb-7f7f-45b7-8bef-98ddcd95ad4d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:23.994023 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-54f9f8cb-7f7f-45b7-8bef-98ddcd95ad4d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:24.004951 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-54f9f8cb-7f7f-45b7-8bef-98ddcd95ad4d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1406 microversion: 2.20 time: 0.437064 Oct 11 06:42:24.007326 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 55/116] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:42:23 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1406 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:42:24.044666 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-664c88af-1c1c-4647-9eca-7b7fc4c316f5 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:24.049090 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-664c88af-1c1c-4647-9eca-7b7fc4c316f5 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:24.058768 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-664c88af-1c1c-4647-9eca-7b7fc4c316f5 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:24.065325 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-664c88af-1c1c-4647-9eca-7b7fc4c316f5 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:24.067891 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-664c88af-1c1c-4647-9eca-7b7fc4c316f5 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:24.080074 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-664c88af-1c1c-4647-9eca-7b7fc4c316f5 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:24.081858 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-664c88af-1c1c-4647-9eca-7b7fc4c316f5 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:24.082368 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-664c88af-1c1c-4647-9eca-7b7fc4c316f5 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:24.167600 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7796e6c9-3ae7-487c-be7c-2ae017379ca5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:24.177099 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7796e6c9-3ae7-487c-be7c-2ae017379ca5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1361 microversion: 2.1 time: 0.682679 Oct 11 06:42:24.208397 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 62/117] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:23 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1361 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:24.214452 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-978d2a82-04d2-4a88-a079-7270f411b3e4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:24.215944 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-978d2a82-04d2-4a88-a079-7270f411b3e4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:24.226740 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-978d2a82-04d2-4a88-a079-7270f411b3e4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:24.227811 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-978d2a82-04d2-4a88-a079-7270f411b3e4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:24.230537 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-978d2a82-04d2-4a88-a079-7270f411b3e4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:24.232085 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-978d2a82-04d2-4a88-a079-7270f411b3e4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:24.232938 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-978d2a82-04d2-4a88-a079-7270f411b3e4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:24.233564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-978d2a82-04d2-4a88-a079-7270f411b3e4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:24.372096 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-978d2a82-04d2-4a88-a079-7270f411b3e4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:24.379557 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-978d2a82-04d2-4a88-a079-7270f411b3e4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1298 microversion: 2.1 time: 0.169846 Oct 11 06:42:24.380397 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 63/118] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:24 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1298 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:24.385719 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ad5609d8-4a8b-40f6-88d6-f043ebb127f6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:24.386600 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ad5609d8-4a8b-40f6-88d6-f043ebb127f6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:24.392568 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ad5609d8-4a8b-40f6-88d6-f043ebb127f6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:24.393271 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ad5609d8-4a8b-40f6-88d6-f043ebb127f6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:24.393939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ad5609d8-4a8b-40f6-88d6-f043ebb127f6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:24.394828 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ad5609d8-4a8b-40f6-88d6-f043ebb127f6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:24.395526 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ad5609d8-4a8b-40f6-88d6-f043ebb127f6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:24.396147 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ad5609d8-4a8b-40f6-88d6-f043ebb127f6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:24.568151 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-664c88af-1c1c-4647-9eca-7b7fc4c316f5 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:24.582913 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-664c88af-1c1c-4647-9eca-7b7fc4c316f5 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1315 microversion: 2.1 time: 0.571745 Oct 11 06:42:24.596412 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 56/119] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:24 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1315 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:24.697895 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ad5609d8-4a8b-40f6-88d6-f043ebb127f6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:24.715513 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ad5609d8-4a8b-40f6-88d6-f043ebb127f6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1280 microversion: 2.1 time: 0.332576 Oct 11 06:42:24.716394 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 64/120] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:24 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1280 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:24.756493 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-c85e3377-f706-49f5-a0b7-364e75f034eb req-fa8c12e9-147c-4b43-b8ac-601197e703a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43d48211-8dab-4abd-8c95-e850b83382ff", "tag": "f963366d-bbf2-4aff-84d1-f61c69977089"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:42:24.801390 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-c85e3377-f706-49f5-a0b7-364e75f034eb req-fa8c12e9-147c-4b43-b8ac-601197e703a1 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:24.804927 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-c85e3377-f706-49f5-a0b7-364e75f034eb req-fa8c12e9-147c-4b43-b8ac-601197e703a1 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:24.808226 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-c85e3377-f706-49f5-a0b7-364e75f034eb req-fa8c12e9-147c-4b43-b8ac-601197e703a1 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:24.847348 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-c85e3377-f706-49f5-a0b7-364e75f034eb req-fa8c12e9-147c-4b43-b8ac-601197e703a1 service nova] Creating event network-changed:f963366d-bbf2-4aff-84d1-f61c69977089 for instance 43d48211-8dab-4abd-8c95-e850b83382ff on hv-cinder-85495 Oct 11 06:42:24.848198 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-c85e3377-f706-49f5-a0b7-364e75f034eb req-fa8c12e9-147c-4b43-b8ac-601197e703a1 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=125267) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 06:42:24.848808 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-c85e3377-f706-49f5-a0b7-364e75f034eb req-fa8c12e9-147c-4b43-b8ac-601197e703a1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=125267) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 06:42:24.850982 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-468a6e17-e05e-4271-9f13-b3cc3eb25503 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:24.851792 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-468a6e17-e05e-4271-9f13-b3cc3eb25503 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:24.852413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-468a6e17-e05e-4271-9f13-b3cc3eb25503 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:24.853625 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-468a6e17-e05e-4271-9f13-b3cc3eb25503 None None] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:24.854331 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-468a6e17-e05e-4271-9f13-b3cc3eb25503 None None] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:24.855110 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-468a6e17-e05e-4271-9f13-b3cc3eb25503 None None] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:24.866653 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.compute.rpcapi [None req-468a6e17-e05e-4271-9f13-b3cc3eb25503 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 11 06:42:24.867922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-468a6e17-e05e-4271-9f13-b3cc3eb25503 None None] Releasing lock "compute-rpcapi-router" {{(pid=125267) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 06:42:24.895959 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-468a6e17-e05e-4271-9f13-b3cc3eb25503 None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146528 Oct 11 06:42:24.897981 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 57/121] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:42:25.036049 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-606563c0-fcbc-4f70-8e01-fc0c61a205ca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:25.042099 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-606563c0-fcbc-4f70-8e01-fc0c61a205ca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:25.067508 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-606563c0-fcbc-4f70-8e01-fc0c61a205ca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:25.079324 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-606563c0-fcbc-4f70-8e01-fc0c61a205ca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:25.080475 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-606563c0-fcbc-4f70-8e01-fc0c61a205ca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:25.082409 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-606563c0-fcbc-4f70-8e01-fc0c61a205ca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:25.083814 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-606563c0-fcbc-4f70-8e01-fc0c61a205ca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:25.084564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-606563c0-fcbc-4f70-8e01-fc0c61a205ca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:25.118476 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-ca4b681d-7343-410f-8258-468ec64cdbf4 req-362a341b-28f1-408e-bc98-f4f015e48bcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07799819-eaa3-484d-bbcf-2c3c97ea26f3", "tag": "5513024a-3af1-4db9-810a-0131e7119a57"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:42:25.179579 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-ca4b681d-7343-410f-8258-468ec64cdbf4 req-362a341b-28f1-408e-bc98-f4f015e48bcc service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:25.181995 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-ca4b681d-7343-410f-8258-468ec64cdbf4 req-362a341b-28f1-408e-bc98-f4f015e48bcc service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:25.183576 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-ca4b681d-7343-410f-8258-468ec64cdbf4 req-362a341b-28f1-408e-bc98-f4f015e48bcc service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:25.224022 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-ca4b681d-7343-410f-8258-468ec64cdbf4 req-362a341b-28f1-408e-bc98-f4f015e48bcc service nova] Creating event network-changed:5513024a-3af1-4db9-810a-0131e7119a57 for instance 07799819-eaa3-484d-bbcf-2c3c97ea26f3 on hv-cinder-85495 Oct 11 06:42:25.238077 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-ca4b681d-7343-410f-8258-468ec64cdbf4 req-362a341b-28f1-408e-bc98-f4f015e48bcc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134279 Oct 11 06:42:25.239537 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 58/122] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:42:25.245813 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-560ca73a-4f90-4ec4-b51e-35f3fba7e00b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:25.246942 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-560ca73a-4f90-4ec4-b51e-35f3fba7e00b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:25.264756 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-560ca73a-4f90-4ec4-b51e-35f3fba7e00b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:25.266307 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-560ca73a-4f90-4ec4-b51e-35f3fba7e00b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:25.266899 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-560ca73a-4f90-4ec4-b51e-35f3fba7e00b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:25.268590 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-560ca73a-4f90-4ec4-b51e-35f3fba7e00b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:25.270533 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-560ca73a-4f90-4ec4-b51e-35f3fba7e00b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:25.274150 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-560ca73a-4f90-4ec4-b51e-35f3fba7e00b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:25.674123 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-560ca73a-4f90-4ec4-b51e-35f3fba7e00b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:25.683875 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-560ca73a-4f90-4ec4-b51e-35f3fba7e00b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1361 microversion: 2.1 time: 0.442867 Oct 11 06:42:25.684449 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 59/123] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:25 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1361 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:25.691368 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4b3f0315-24ad-47c8-ab8f-c24d1e5d5828 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:25.692430 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4b3f0315-24ad-47c8-ab8f-c24d1e5d5828 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:25.700019 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b3f0315-24ad-47c8-ab8f-c24d1e5d5828 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:25.700679 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b3f0315-24ad-47c8-ab8f-c24d1e5d5828 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:25.701449 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b3f0315-24ad-47c8-ab8f-c24d1e5d5828 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:25.702504 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b3f0315-24ad-47c8-ab8f-c24d1e5d5828 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:25.703119 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b3f0315-24ad-47c8-ab8f-c24d1e5d5828 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:25.703644 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b3f0315-24ad-47c8-ab8f-c24d1e5d5828 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:25.777457 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4b3f0315-24ad-47c8-ab8f-c24d1e5d5828 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:25.789027 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4b3f0315-24ad-47c8-ab8f-c24d1e5d5828 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1298 microversion: 2.1 time: 0.103388 Oct 11 06:42:25.789911 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 60/124] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:25 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1298 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:25.794988 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bec7751e-c25d-44d8-99a2-209062a3d71e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:25.796269 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bec7751e-c25d-44d8-99a2-209062a3d71e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:25.805833 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bec7751e-c25d-44d8-99a2-209062a3d71e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:25.806629 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bec7751e-c25d-44d8-99a2-209062a3d71e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:25.807313 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bec7751e-c25d-44d8-99a2-209062a3d71e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:25.808607 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bec7751e-c25d-44d8-99a2-209062a3d71e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:25.809052 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bec7751e-c25d-44d8-99a2-209062a3d71e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:25.809562 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bec7751e-c25d-44d8-99a2-209062a3d71e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:25.817283 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-606563c0-fcbc-4f70-8e01-fc0c61a205ca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:25.829744 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-606563c0-fcbc-4f70-8e01-fc0c61a205ca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:25.831230 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-606563c0-fcbc-4f70-8e01-fc0c61a205ca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:25.832468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-606563c0-fcbc-4f70-8e01-fc0c61a205ca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1406 microversion: 2.20 time: 0.801965 Oct 11 06:42:25.843477 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 65/125] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:42:25 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1406 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:42:25.856798 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c4999481-c60a-41fe-9a0c-6f3df0d34298 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:25.857677 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c4999481-c60a-41fe-9a0c-6f3df0d34298 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:25.864136 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c4999481-c60a-41fe-9a0c-6f3df0d34298 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:25.864852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c4999481-c60a-41fe-9a0c-6f3df0d34298 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:25.865277 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c4999481-c60a-41fe-9a0c-6f3df0d34298 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:25.866575 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c4999481-c60a-41fe-9a0c-6f3df0d34298 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:25.867176 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c4999481-c60a-41fe-9a0c-6f3df0d34298 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:25.867627 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c4999481-c60a-41fe-9a0c-6f3df0d34298 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:26.076934 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-bec7751e-c25d-44d8-99a2-209062a3d71e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:26.085748 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bec7751e-c25d-44d8-99a2-209062a3d71e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1315 microversion: 2.1 time: 0.294588 Oct 11 06:42:26.086317 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 61/126] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:25 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:26.284635 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c4999481-c60a-41fe-9a0c-6f3df0d34298 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:26.303182 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c4999481-c60a-41fe-9a0c-6f3df0d34298 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1322 microversion: 2.1 time: 0.449974 Oct 11 06:42:26.318546 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 66/127] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:25 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1322 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:26.709699 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f0733589-5d8e-43f9-a340-b3134e41a6b4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:26.710617 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f0733589-5d8e-43f9-a340-b3134e41a6b4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:26.724623 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f0733589-5d8e-43f9-a340-b3134e41a6b4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:26.726280 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f0733589-5d8e-43f9-a340-b3134e41a6b4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:26.726726 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f0733589-5d8e-43f9-a340-b3134e41a6b4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:26.729577 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f0733589-5d8e-43f9-a340-b3134e41a6b4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:26.730498 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f0733589-5d8e-43f9-a340-b3134e41a6b4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:26.731853 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f0733589-5d8e-43f9-a340-b3134e41a6b4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:26.816234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9d3ad646-0372-4e92-80f1-ef5b9fa34973 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:26.817001 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9d3ad646-0372-4e92-80f1-ef5b9fa34973 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:26.829622 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9d3ad646-0372-4e92-80f1-ef5b9fa34973 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:26.831081 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9d3ad646-0372-4e92-80f1-ef5b9fa34973 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:26.833803 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9d3ad646-0372-4e92-80f1-ef5b9fa34973 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:26.845262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9d3ad646-0372-4e92-80f1-ef5b9fa34973 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:26.845749 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9d3ad646-0372-4e92-80f1-ef5b9fa34973 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:26.848618 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9d3ad646-0372-4e92-80f1-ef5b9fa34973 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:27.218358 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f0733589-5d8e-43f9-a340-b3134e41a6b4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:27.229299 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f0733589-5d8e-43f9-a340-b3134e41a6b4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1361 microversion: 2.1 time: 0.523263 Oct 11 06:42:27.239844 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 62/128] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:26 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1361 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:27.249846 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-fc8a365b-9e30-4d13-839d-0dc264b357be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:27.252536 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-fc8a365b-9e30-4d13-839d-0dc264b357be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:27.265888 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc8a365b-9e30-4d13-839d-0dc264b357be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:27.266608 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc8a365b-9e30-4d13-839d-0dc264b357be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:27.267259 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc8a365b-9e30-4d13-839d-0dc264b357be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:27.269257 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc8a365b-9e30-4d13-839d-0dc264b357be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:27.272094 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc8a365b-9e30-4d13-839d-0dc264b357be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:27.272763 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc8a365b-9e30-4d13-839d-0dc264b357be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:27.339962 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9d3ad646-0372-4e92-80f1-ef5b9fa34973 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:27.358705 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9d3ad646-0372-4e92-80f1-ef5b9fa34973 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1366 microversion: 2.1 time: 0.547104 Oct 11 06:42:27.376594 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 67/129] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:26 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1366 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:42:27.387724 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-890c22cd-233e-4a27-ada3-a4ac3f824dde tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:27.389284 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-890c22cd-233e-4a27-ada3-a4ac3f824dde tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:27.402129 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-890c22cd-233e-4a27-ada3-a4ac3f824dde tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:27.402953 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-890c22cd-233e-4a27-ada3-a4ac3f824dde tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:27.403610 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-890c22cd-233e-4a27-ada3-a4ac3f824dde tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:27.404521 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-890c22cd-233e-4a27-ada3-a4ac3f824dde tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:27.405381 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-890c22cd-233e-4a27-ada3-a4ac3f824dde tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:27.406013 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-890c22cd-233e-4a27-ada3-a4ac3f824dde tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:27.616989 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-fc8a365b-9e30-4d13-839d-0dc264b357be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:27.630658 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-fc8a365b-9e30-4d13-839d-0dc264b357be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:27.632505 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-890c22cd-233e-4a27-ada3-a4ac3f824dde tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:27.633476 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-fc8a365b-9e30-4d13-839d-0dc264b357be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:27.634789 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-fc8a365b-9e30-4d13-839d-0dc264b357be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1406 microversion: 2.20 time: 0.395570 Oct 11 06:42:27.635580 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 63/130] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:42:27 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1406 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:42:27.646915 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-890c22cd-233e-4a27-ada3-a4ac3f824dde tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1315 microversion: 2.1 time: 0.268656 Oct 11 06:42:27.649727 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 68/131] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:27 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:27.660602 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6b181769-5d12-47dc-a248-d7e509a33ee0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:27.661203 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6b181769-5d12-47dc-a248-d7e509a33ee0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:27.667459 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6b181769-5d12-47dc-a248-d7e509a33ee0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:27.668167 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6b181769-5d12-47dc-a248-d7e509a33ee0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:27.668754 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6b181769-5d12-47dc-a248-d7e509a33ee0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:27.670206 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6b181769-5d12-47dc-a248-d7e509a33ee0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:27.670817 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6b181769-5d12-47dc-a248-d7e509a33ee0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:27.671241 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6b181769-5d12-47dc-a248-d7e509a33ee0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:27.924493 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6b181769-5d12-47dc-a248-d7e509a33ee0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:27.937120 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6b181769-5d12-47dc-a248-d7e509a33ee0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1322 microversion: 2.1 time: 0.282892 Oct 11 06:42:27.937973 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 64/132] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:27 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1322 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:27.946920 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-3b2b305f-fbbd-49c6-9e93-8830d56d671b req-49aa9989-8bfb-4821-bd67-9cc9160d0bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2ce136a-30ab-4986-931e-5af38b37875e", "tag": "3280a926-f599-464d-a89c-2446cca4d1a4"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:42:27.971340 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-3b2b305f-fbbd-49c6-9e93-8830d56d671b req-49aa9989-8bfb-4821-bd67-9cc9160d0bf3 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:27.972202 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-3b2b305f-fbbd-49c6-9e93-8830d56d671b req-49aa9989-8bfb-4821-bd67-9cc9160d0bf3 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:27.972869 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-3b2b305f-fbbd-49c6-9e93-8830d56d671b req-49aa9989-8bfb-4821-bd67-9cc9160d0bf3 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:27.988657 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-3b2b305f-fbbd-49c6-9e93-8830d56d671b req-49aa9989-8bfb-4821-bd67-9cc9160d0bf3 service nova] Creating event network-changed:3280a926-f599-464d-a89c-2446cca4d1a4 for instance a2ce136a-30ab-4986-931e-5af38b37875e on hv-cinder-85495 Oct 11 06:42:28.004059 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-3b2b305f-fbbd-49c6-9e93-8830d56d671b req-49aa9989-8bfb-4821-bd67-9cc9160d0bf3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052340 Oct 11 06:42:28.005386 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 69/133] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:42:28.196230 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-e2a0690e-2651-4af5-9fcd-1b4f22553952 req-34ba6d13-f601-4e88-ac5d-3361ae3d333a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63ee206c-410a-4d60-89ab-e6d6319e64b6", "tag": "f00aa092-378a-4b0d-9b6e-c605b2ca8c2c"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:42:28.214444 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-e2a0690e-2651-4af5-9fcd-1b4f22553952 req-34ba6d13-f601-4e88-ac5d-3361ae3d333a service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:28.220390 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-e2a0690e-2651-4af5-9fcd-1b4f22553952 req-34ba6d13-f601-4e88-ac5d-3361ae3d333a service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:28.221128 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-e2a0690e-2651-4af5-9fcd-1b4f22553952 req-34ba6d13-f601-4e88-ac5d-3361ae3d333a service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:28.242463 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-e2a0690e-2651-4af5-9fcd-1b4f22553952 req-34ba6d13-f601-4e88-ac5d-3361ae3d333a service nova] Creating event network-changed:f00aa092-378a-4b0d-9b6e-c605b2ca8c2c for instance 63ee206c-410a-4d60-89ab-e6d6319e64b6 on hv-cinder-85495 Oct 11 06:42:28.255368 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0394fc90-7445-43c4-8511-bfa73b5a5365 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:28.256147 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0394fc90-7445-43c4-8511-bfa73b5a5365 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:28.267836 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-e2a0690e-2651-4af5-9fcd-1b4f22553952 req-34ba6d13-f601-4e88-ac5d-3361ae3d333a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075953 Oct 11 06:42:28.269795 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0394fc90-7445-43c4-8511-bfa73b5a5365 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:28.270946 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 65/134] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:42:28.271793 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0394fc90-7445-43c4-8511-bfa73b5a5365 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:28.273093 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0394fc90-7445-43c4-8511-bfa73b5a5365 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:28.274257 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0394fc90-7445-43c4-8511-bfa73b5a5365 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:28.274889 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0394fc90-7445-43c4-8511-bfa73b5a5365 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:28.275309 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0394fc90-7445-43c4-8511-bfa73b5a5365 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:28.390050 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d535a6e0-5672-4dfa-952c-5cc9d256a9a9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:28.390774 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d535a6e0-5672-4dfa-952c-5cc9d256a9a9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:28.397837 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d535a6e0-5672-4dfa-952c-5cc9d256a9a9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:28.398318 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d535a6e0-5672-4dfa-952c-5cc9d256a9a9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:28.398764 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d535a6e0-5672-4dfa-952c-5cc9d256a9a9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:28.399622 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d535a6e0-5672-4dfa-952c-5cc9d256a9a9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:28.400066 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d535a6e0-5672-4dfa-952c-5cc9d256a9a9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:28.400483 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d535a6e0-5672-4dfa-952c-5cc9d256a9a9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:28.581708 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0394fc90-7445-43c4-8511-bfa73b5a5365 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:28.592096 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0394fc90-7445-43c4-8511-bfa73b5a5365 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1361 microversion: 2.1 time: 0.341550 Oct 11 06:42:28.593174 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 70/135] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:28 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1361 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:28.670321 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-14b5971d-ba9a-4ddf-8c6e-a2f496619b62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:28.672597 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-14b5971d-ba9a-4ddf-8c6e-a2f496619b62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:28.685469 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-14b5971d-ba9a-4ddf-8c6e-a2f496619b62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:28.688442 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-14b5971d-ba9a-4ddf-8c6e-a2f496619b62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:28.690610 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-14b5971d-ba9a-4ddf-8c6e-a2f496619b62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:28.692101 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-14b5971d-ba9a-4ddf-8c6e-a2f496619b62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:28.692799 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-14b5971d-ba9a-4ddf-8c6e-a2f496619b62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:28.693431 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-14b5971d-ba9a-4ddf-8c6e-a2f496619b62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:28.731085 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d535a6e0-5672-4dfa-952c-5cc9d256a9a9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:28.744880 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d535a6e0-5672-4dfa-952c-5cc9d256a9a9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1366 microversion: 2.1 time: 0.359406 Oct 11 06:42:28.745760 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 66/136] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:28 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1366 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:28.753192 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-14caef59-f256-4f8f-a28c-7dd794e2990a tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:28.754086 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-14caef59-f256-4f8f-a28c-7dd794e2990a tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:28.763577 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14caef59-f256-4f8f-a28c-7dd794e2990a tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:28.764338 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14caef59-f256-4f8f-a28c-7dd794e2990a tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:28.764912 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14caef59-f256-4f8f-a28c-7dd794e2990a tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:28.766591 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14caef59-f256-4f8f-a28c-7dd794e2990a tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:28.767632 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14caef59-f256-4f8f-a28c-7dd794e2990a tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:28.768297 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14caef59-f256-4f8f-a28c-7dd794e2990a tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:28.895530 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-14b5971d-ba9a-4ddf-8c6e-a2f496619b62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:28.905955 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-14b5971d-ba9a-4ddf-8c6e-a2f496619b62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:28.907794 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-14b5971d-ba9a-4ddf-8c6e-a2f496619b62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:28.909241 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-14b5971d-ba9a-4ddf-8c6e-a2f496619b62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1406 microversion: 2.20 time: 0.247391 Oct 11 06:42:28.910014 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 71/137] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:42:28 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1406 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:42:28.965725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8996c8d2-7293-4f33-93c1-6bf3c8606789 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:28.966436 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8996c8d2-7293-4f33-93c1-6bf3c8606789 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:28.976875 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8996c8d2-7293-4f33-93c1-6bf3c8606789 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:28.979676 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8996c8d2-7293-4f33-93c1-6bf3c8606789 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:28.980287 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8996c8d2-7293-4f33-93c1-6bf3c8606789 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:28.981173 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8996c8d2-7293-4f33-93c1-6bf3c8606789 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:28.983634 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8996c8d2-7293-4f33-93c1-6bf3c8606789 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:28.985868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8996c8d2-7293-4f33-93c1-6bf3c8606789 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:29.047518 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-14caef59-f256-4f8f-a28c-7dd794e2990a tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:29.051774 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:29.060314 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-14caef59-f256-4f8f-a28c-7dd794e2990a tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1315 microversion: 2.1 time: 0.312662 Oct 11 06:42:29.061848 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 67/138] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:28 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:29.238648 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-71805e84-46ec-4aa4-81b6-ead1c0ad2e51 req-a0b6078f-6087-4bac-a145-8f7a5988f3bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c76b29e-08a3-4b53-9b36-82980a19493d", "name": "network-vif-plugged", "status": "completed", "tag": "b4d1c36d-2115-4009-915e-804111b3a836"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:42:29.250638 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-71805e84-46ec-4aa4-81b6-ead1c0ad2e51 req-a0b6078f-6087-4bac-a145-8f7a5988f3bd service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:29.251347 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-71805e84-46ec-4aa4-81b6-ead1c0ad2e51 req-a0b6078f-6087-4bac-a145-8f7a5988f3bd service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:29.251947 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-71805e84-46ec-4aa4-81b6-ead1c0ad2e51 req-a0b6078f-6087-4bac-a145-8f7a5988f3bd service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:29.263288 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8996c8d2-7293-4f33-93c1-6bf3c8606789 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:29.265168 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-71805e84-46ec-4aa4-81b6-ead1c0ad2e51 req-a0b6078f-6087-4bac-a145-8f7a5988f3bd service nova] Creating event network-vif-plugged:b4d1c36d-2115-4009-915e-804111b3a836 for instance 9c76b29e-08a3-4b53-9b36-82980a19493d on hv-cinder-85495 Oct 11 06:42:29.270868 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-71805e84-46ec-4aa4-81b6-ead1c0ad2e51 req-a0b6078f-6087-4bac-a145-8f7a5988f3bd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201936 Oct 11 06:42:29.271676 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 68/139] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:42:29.273747 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8996c8d2-7293-4f33-93c1-6bf3c8606789 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1322 microversion: 2.1 time: 0.312761 Oct 11 06:42:29.274572 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 72/140] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:28 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1322 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:42:29.615708 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-607b49ab-6d93-4a89-ae68-852f71a95764 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:29.616737 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-607b49ab-6d93-4a89-ae68-852f71a95764 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:29.624078 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-607b49ab-6d93-4a89-ae68-852f71a95764 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:29.624686 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-607b49ab-6d93-4a89-ae68-852f71a95764 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:29.625180 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-607b49ab-6d93-4a89-ae68-852f71a95764 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:29.626075 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-607b49ab-6d93-4a89-ae68-852f71a95764 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:29.626531 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-607b49ab-6d93-4a89-ae68-852f71a95764 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:29.626956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-607b49ab-6d93-4a89-ae68-852f71a95764 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:29.775120 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d0248edd-ff94-40b6-b6a5-f294598f6870 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:29.775998 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d0248edd-ff94-40b6-b6a5-f294598f6870 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:29.784519 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-607b49ab-6d93-4a89-ae68-852f71a95764 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:29.791074 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0248edd-ff94-40b6-b6a5-f294598f6870 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:29.793597 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0248edd-ff94-40b6-b6a5-f294598f6870 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:29.794059 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0248edd-ff94-40b6-b6a5-f294598f6870 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:29.794927 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0248edd-ff94-40b6-b6a5-f294598f6870 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:29.795383 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0248edd-ff94-40b6-b6a5-f294598f6870 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:29.797725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0248edd-ff94-40b6-b6a5-f294598f6870 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:29.802223 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:29.803317 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-607b49ab-6d93-4a89-ae68-852f71a95764 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1361 microversion: 2.1 time: 0.192476 Oct 11 06:42:29.804448 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 69/141] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:29 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1361 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:29.941360 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1536e66c-d1b7-412e-8383-f8b1b2fa51cf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:29.942247 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1536e66c-d1b7-412e-8383-f8b1b2fa51cf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:29.952090 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d0248edd-ff94-40b6-b6a5-f294598f6870 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:29.961411 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d0248edd-ff94-40b6-b6a5-f294598f6870 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1366 microversion: 2.1 time: 0.193282 Oct 11 06:42:29.962543 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 73/142] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:29 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:29.966701 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1536e66c-d1b7-412e-8383-f8b1b2fa51cf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:29.967325 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1536e66c-d1b7-412e-8383-f8b1b2fa51cf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:29.967963 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1536e66c-d1b7-412e-8383-f8b1b2fa51cf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:29.968936 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1536e66c-d1b7-412e-8383-f8b1b2fa51cf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:29.969585 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1536e66c-d1b7-412e-8383-f8b1b2fa51cf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:29.970483 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1536e66c-d1b7-412e-8383-f8b1b2fa51cf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:30.087439 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6fcb5b3f-5a76-4212-b874-5e04e24e77a2 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:30.088700 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6fcb5b3f-5a76-4212-b874-5e04e24e77a2 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:30.098974 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fcb5b3f-5a76-4212-b874-5e04e24e77a2 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:30.102043 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fcb5b3f-5a76-4212-b874-5e04e24e77a2 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:30.102664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fcb5b3f-5a76-4212-b874-5e04e24e77a2 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:30.104301 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fcb5b3f-5a76-4212-b874-5e04e24e77a2 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:30.108627 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fcb5b3f-5a76-4212-b874-5e04e24e77a2 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:30.109245 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fcb5b3f-5a76-4212-b874-5e04e24e77a2 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:30.530561 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1536e66c-d1b7-412e-8383-f8b1b2fa51cf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:30.539039 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1536e66c-d1b7-412e-8383-f8b1b2fa51cf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:30.540517 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1536e66c-d1b7-412e-8383-f8b1b2fa51cf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:30.541950 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1536e66c-d1b7-412e-8383-f8b1b2fa51cf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1406 microversion: 2.20 time: 0.605374 Oct 11 06:42:30.558466 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 70/143] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:42:29 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1406 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:42:30.574714 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5352a876-d24b-4315-98c2-988c4b35e99c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:30.578619 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5352a876-d24b-4315-98c2-988c4b35e99c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:30.596146 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5352a876-d24b-4315-98c2-988c4b35e99c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:30.596709 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5352a876-d24b-4315-98c2-988c4b35e99c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:30.597157 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5352a876-d24b-4315-98c2-988c4b35e99c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:30.597895 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5352a876-d24b-4315-98c2-988c4b35e99c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:30.598434 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5352a876-d24b-4315-98c2-988c4b35e99c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:30.598761 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5352a876-d24b-4315-98c2-988c4b35e99c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:30.922230 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:31.040029 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6fcb5b3f-5a76-4212-b874-5e04e24e77a2 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:31.049544 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6fcb5b3f-5a76-4212-b874-5e04e24e77a2 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1315 microversion: 2.1 time: 0.966179 Oct 11 06:42:31.050120 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 74/144] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:30 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1315 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:42:31.067038 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-de6946d4-1b6d-4309-8076-16df92527b9d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:31.067732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-de6946d4-1b6d-4309-8076-16df92527b9d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:31.077605 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-de6946d4-1b6d-4309-8076-16df92527b9d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:31.080415 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-de6946d4-1b6d-4309-8076-16df92527b9d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:31.081590 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-de6946d4-1b6d-4309-8076-16df92527b9d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:31.084366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-de6946d4-1b6d-4309-8076-16df92527b9d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:31.086193 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-de6946d4-1b6d-4309-8076-16df92527b9d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:31.086761 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-de6946d4-1b6d-4309-8076-16df92527b9d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:31.131314 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5352a876-d24b-4315-98c2-988c4b35e99c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:31.139445 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5352a876-d24b-4315-98c2-988c4b35e99c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1322 microversion: 2.1 time: 0.579621 Oct 11 06:42:31.140023 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 71/145] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:30 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1322 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:31.145650 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-de6564ec-5bca-43c6-8a8b-975f6b73ff35 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:31.146424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-de6564ec-5bca-43c6-8a8b-975f6b73ff35 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:31.161565 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-de6564ec-5bca-43c6-8a8b-975f6b73ff35 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:31.162991 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-de6564ec-5bca-43c6-8a8b-975f6b73ff35 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:31.163661 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-de6564ec-5bca-43c6-8a8b-975f6b73ff35 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:31.164537 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-de6564ec-5bca-43c6-8a8b-975f6b73ff35 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:31.165807 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-de6564ec-5bca-43c6-8a8b-975f6b73ff35 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:31.166807 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-de6564ec-5bca-43c6-8a8b-975f6b73ff35 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:31.342700 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-de6564ec-5bca-43c6-8a8b-975f6b73ff35 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:31.346398 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-de6946d4-1b6d-4309-8076-16df92527b9d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:31.353537 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-de6564ec-5bca-43c6-8a8b-975f6b73ff35 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1366 microversion: 2.1 time: 0.211395 Oct 11 06:42:31.354888 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 72/146] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:31 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:31.357373 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-de6946d4-1b6d-4309-8076-16df92527b9d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1361 microversion: 2.1 time: 0.306259 Oct 11 06:42:31.360952 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-18ddcfe5-7324-4859-9d45-df917eb7f8f5 req-b781e95c-e8ec-4eba-8913-d7fba04850b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03687593-229b-46bf-b79a-f09a1db51ac2", "name": "network-vif-plugged", "status": "completed", "tag": "9782d4cc-0e17-4e19-8fc0-23bc73899c9a"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:42:31.371817 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 75/147] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:31 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1361 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:31.374348 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-18ddcfe5-7324-4859-9d45-df917eb7f8f5 req-b781e95c-e8ec-4eba-8913-d7fba04850b8 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:31.374725 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-18ddcfe5-7324-4859-9d45-df917eb7f8f5 req-b781e95c-e8ec-4eba-8913-d7fba04850b8 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:31.375248 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-18ddcfe5-7324-4859-9d45-df917eb7f8f5 req-b781e95c-e8ec-4eba-8913-d7fba04850b8 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:31.388936 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-18ddcfe5-7324-4859-9d45-df917eb7f8f5 req-b781e95c-e8ec-4eba-8913-d7fba04850b8 service nova] Creating event network-vif-plugged:9782d4cc-0e17-4e19-8fc0-23bc73899c9a for instance 03687593-229b-46bf-b79a-f09a1db51ac2 on hv-cinder-85495 Oct 11 06:42:31.394578 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-18ddcfe5-7324-4859-9d45-df917eb7f8f5 req-b781e95c-e8ec-4eba-8913-d7fba04850b8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038155 Oct 11 06:42:31.395388 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 73/148] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:42:31.587665 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fe348a31-2478-427c-b345-faf329ac7c34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:31.588408 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fe348a31-2478-427c-b345-faf329ac7c34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:31.596008 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fe348a31-2478-427c-b345-faf329ac7c34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:31.596786 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fe348a31-2478-427c-b345-faf329ac7c34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:31.597209 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fe348a31-2478-427c-b345-faf329ac7c34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:31.598074 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fe348a31-2478-427c-b345-faf329ac7c34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:31.598522 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fe348a31-2478-427c-b345-faf329ac7c34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:31.598941 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fe348a31-2478-427c-b345-faf329ac7c34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:31.739990 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fe348a31-2478-427c-b345-faf329ac7c34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:31.750828 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fe348a31-2478-427c-b345-faf329ac7c34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:31.752593 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fe348a31-2478-427c-b345-faf329ac7c34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:31.753779 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fe348a31-2478-427c-b345-faf329ac7c34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1406 microversion: 2.20 time: 0.171911 Oct 11 06:42:31.754402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 76/149] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:42:31 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:42:32.077677 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8b61661b-e6f8-414f-8a87-24b6a8a3a82b tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:32.078551 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8b61661b-e6f8-414f-8a87-24b6a8a3a82b tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:32.085977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8b61661b-e6f8-414f-8a87-24b6a8a3a82b tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:32.086813 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8b61661b-e6f8-414f-8a87-24b6a8a3a82b tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:32.087304 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8b61661b-e6f8-414f-8a87-24b6a8a3a82b tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:32.088220 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8b61661b-e6f8-414f-8a87-24b6a8a3a82b tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:32.088677 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8b61661b-e6f8-414f-8a87-24b6a8a3a82b tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:32.089221 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8b61661b-e6f8-414f-8a87-24b6a8a3a82b tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:32.162103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4ec94d8d-63c8-4dcd-8e57-d483bb45dbb7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:32.163626 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4ec94d8d-63c8-4dcd-8e57-d483bb45dbb7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:32.169782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ec94d8d-63c8-4dcd-8e57-d483bb45dbb7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:32.170547 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ec94d8d-63c8-4dcd-8e57-d483bb45dbb7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:32.171181 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ec94d8d-63c8-4dcd-8e57-d483bb45dbb7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:32.172221 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ec94d8d-63c8-4dcd-8e57-d483bb45dbb7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:32.172888 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ec94d8d-63c8-4dcd-8e57-d483bb45dbb7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:32.173505 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ec94d8d-63c8-4dcd-8e57-d483bb45dbb7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:32.405712 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4ec94d8d-63c8-4dcd-8e57-d483bb45dbb7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:32.418807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4ec94d8d-63c8-4dcd-8e57-d483bb45dbb7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1322 microversion: 2.1 time: 0.260548 Oct 11 06:42:32.421180 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 77/150] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:32 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:42:32.427942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cdfb5e66-2e3c-41a1-bbb5-52d338b42758 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:32.428502 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cdfb5e66-2e3c-41a1-bbb5-52d338b42758 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:32.443432 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:32.445483 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cdfb5e66-2e3c-41a1-bbb5-52d338b42758 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:32.445970 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cdfb5e66-2e3c-41a1-bbb5-52d338b42758 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:32.446409 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cdfb5e66-2e3c-41a1-bbb5-52d338b42758 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:32.447087 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cdfb5e66-2e3c-41a1-bbb5-52d338b42758 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:32.447548 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cdfb5e66-2e3c-41a1-bbb5-52d338b42758 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:32.448134 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cdfb5e66-2e3c-41a1-bbb5-52d338b42758 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:32.454593 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8b61661b-e6f8-414f-8a87-24b6a8a3a82b tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:32.468478 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8b61661b-e6f8-414f-8a87-24b6a8a3a82b tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1315 microversion: 2.1 time: 0.395059 Oct 11 06:42:32.469484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 74/151] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:32 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:32.490508 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-fdd03df0-513b-4d78-a45c-2230284c2320 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:32.494734 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-fdd03df0-513b-4d78-a45c-2230284c2320 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:32.509462 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fdd03df0-513b-4d78-a45c-2230284c2320 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:32.510206 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fdd03df0-513b-4d78-a45c-2230284c2320 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:32.512133 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fdd03df0-513b-4d78-a45c-2230284c2320 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:32.513786 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fdd03df0-513b-4d78-a45c-2230284c2320 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:32.515577 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fdd03df0-513b-4d78-a45c-2230284c2320 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:32.518381 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fdd03df0-513b-4d78-a45c-2230284c2320 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:32.876865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-fdd03df0-513b-4d78-a45c-2230284c2320 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:32.884755 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-fdd03df0-513b-4d78-a45c-2230284c2320 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1361 microversion: 2.1 time: 0.399726 Oct 11 06:42:32.885660 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 75/152] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:32 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1361 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:32.895819 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cdfb5e66-2e3c-41a1-bbb5-52d338b42758 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:32.895819 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cdfb5e66-2e3c-41a1-bbb5-52d338b42758 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1366 microversion: 2.1 time: 0.470592 Oct 11 06:42:32.897976 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 78/153] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:32 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1366 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:32.916074 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-144627ca-9157-4e85-b06f-78d1d50fc5e8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:32.916793 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-144627ca-9157-4e85-b06f-78d1d50fc5e8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:32.924244 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-144627ca-9157-4e85-b06f-78d1d50fc5e8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:32.925122 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-144627ca-9157-4e85-b06f-78d1d50fc5e8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:32.925675 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-144627ca-9157-4e85-b06f-78d1d50fc5e8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:32.926804 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-144627ca-9157-4e85-b06f-78d1d50fc5e8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:32.927596 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-144627ca-9157-4e85-b06f-78d1d50fc5e8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:32.928568 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-144627ca-9157-4e85-b06f-78d1d50fc5e8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:33.179625 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-144627ca-9157-4e85-b06f-78d1d50fc5e8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:33.197791 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-144627ca-9157-4e85-b06f-78d1d50fc5e8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:33.199358 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-144627ca-9157-4e85-b06f-78d1d50fc5e8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:33.200595 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-144627ca-9157-4e85-b06f-78d1d50fc5e8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1406 microversion: 2.20 time: 0.302458 Oct 11 06:42:33.201562 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 76/154] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:42:32 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1406 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:42:33.447121 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-31d1070f-b1b3-43cf-93ea-5e1df925fac2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:33.447769 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-31d1070f-b1b3-43cf-93ea-5e1df925fac2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:33.455708 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-31d1070f-b1b3-43cf-93ea-5e1df925fac2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:33.456502 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-31d1070f-b1b3-43cf-93ea-5e1df925fac2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:33.457189 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-31d1070f-b1b3-43cf-93ea-5e1df925fac2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:33.460127 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-31d1070f-b1b3-43cf-93ea-5e1df925fac2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:33.460882 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-31d1070f-b1b3-43cf-93ea-5e1df925fac2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:33.462006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-31d1070f-b1b3-43cf-93ea-5e1df925fac2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:33.501387 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c135c98f-9472-430a-aacf-e56f2f4aa406 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:33.502011 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c135c98f-9472-430a-aacf-e56f2f4aa406 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:33.509568 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c135c98f-9472-430a-aacf-e56f2f4aa406 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:33.510051 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c135c98f-9472-430a-aacf-e56f2f4aa406 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:33.510488 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c135c98f-9472-430a-aacf-e56f2f4aa406 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:33.511186 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c135c98f-9472-430a-aacf-e56f2f4aa406 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:33.511671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c135c98f-9472-430a-aacf-e56f2f4aa406 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:33.532211 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c135c98f-9472-430a-aacf-e56f2f4aa406 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:33.806026 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c135c98f-9472-430a-aacf-e56f2f4aa406 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:33.815701 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c135c98f-9472-430a-aacf-e56f2f4aa406 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1315 microversion: 2.1 time: 0.320959 Oct 11 06:42:33.816434 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 77/155] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:33 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:33.883867 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-31d1070f-b1b3-43cf-93ea-5e1df925fac2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:33.891779 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-31d1070f-b1b3-43cf-93ea-5e1df925fac2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1322 microversion: 2.1 time: 0.449368 Oct 11 06:42:33.892352 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 79/156] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:33 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1322 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:33.912308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-eddcf5ce-b693-48d0-b883-d4fdfa06341d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:33.913591 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-eddcf5ce-b693-48d0-b883-d4fdfa06341d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:33.918558 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-95011140-e351-4f31-a89e-7c3f232dff7e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:33.919170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-95011140-e351-4f31-a89e-7c3f232dff7e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:33.920557 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eddcf5ce-b693-48d0-b883-d4fdfa06341d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:33.921257 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eddcf5ce-b693-48d0-b883-d4fdfa06341d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:33.921931 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eddcf5ce-b693-48d0-b883-d4fdfa06341d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:33.922781 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eddcf5ce-b693-48d0-b883-d4fdfa06341d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:33.923699 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eddcf5ce-b693-48d0-b883-d4fdfa06341d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:33.924332 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eddcf5ce-b693-48d0-b883-d4fdfa06341d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:33.925641 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-95011140-e351-4f31-a89e-7c3f232dff7e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:33.926124 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-95011140-e351-4f31-a89e-7c3f232dff7e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:33.926550 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-95011140-e351-4f31-a89e-7c3f232dff7e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:33.927239 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-95011140-e351-4f31-a89e-7c3f232dff7e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:33.927732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-95011140-e351-4f31-a89e-7c3f232dff7e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:33.928652 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-95011140-e351-4f31-a89e-7c3f232dff7e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:34.112499 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-eddcf5ce-b693-48d0-b883-d4fdfa06341d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:34.121410 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-eddcf5ce-b693-48d0-b883-d4fdfa06341d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1547 microversion: 2.1 time: 0.213907 Oct 11 06:42:34.135929 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-95011140-e351-4f31-a89e-7c3f232dff7e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:34.136206 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 78/157] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:33 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1547 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:34.145362 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-95011140-e351-4f31-a89e-7c3f232dff7e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1366 microversion: 2.1 time: 0.231489 Oct 11 06:42:34.146585 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 80/158] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:33 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:34.146939 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8d9a70df-b1c5-40e6-ac31-e8b690e56b0b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:34.147464 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8d9a70df-b1c5-40e6-ac31-e8b690e56b0b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:34.154518 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d9a70df-b1c5-40e6-ac31-e8b690e56b0b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:34.155273 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d9a70df-b1c5-40e6-ac31-e8b690e56b0b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:34.155733 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d9a70df-b1c5-40e6-ac31-e8b690e56b0b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:34.156446 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d9a70df-b1c5-40e6-ac31-e8b690e56b0b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:34.156898 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d9a70df-b1c5-40e6-ac31-e8b690e56b0b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:34.157335 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d9a70df-b1c5-40e6-ac31-e8b690e56b0b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:34.230349 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-46ed2930-d82c-44cd-9cfd-17139229ebfd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:34.231277 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-46ed2930-d82c-44cd-9cfd-17139229ebfd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:34.241049 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-46ed2930-d82c-44cd-9cfd-17139229ebfd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:34.241665 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-46ed2930-d82c-44cd-9cfd-17139229ebfd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:34.242163 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-46ed2930-d82c-44cd-9cfd-17139229ebfd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:34.243111 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-46ed2930-d82c-44cd-9cfd-17139229ebfd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:34.243647 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-46ed2930-d82c-44cd-9cfd-17139229ebfd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:34.244458 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-46ed2930-d82c-44cd-9cfd-17139229ebfd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:34.325488 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8d9a70df-b1c5-40e6-ac31-e8b690e56b0b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.184697 Oct 11 06:42:34.326085 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 79/159] 10.222.0.39 () {58 vars in 1275 bytes} [Tue Oct 11 06:42:34 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-interface => generated 284 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:42:34.411462 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-46ed2930-d82c-44cd-9cfd-17139229ebfd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:34.424231 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-46ed2930-d82c-44cd-9cfd-17139229ebfd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:34.426778 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-46ed2930-d82c-44cd-9cfd-17139229ebfd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:34.428555 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-46ed2930-d82c-44cd-9cfd-17139229ebfd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1406 microversion: 2.20 time: 0.202565 Oct 11 06:42:34.429294 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 81/160] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:42:34 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:42:34.840074 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-49fa53a9-e514-4e1a-8f73-ccbf69d2df3b tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:34.840930 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-49fa53a9-e514-4e1a-8f73-ccbf69d2df3b tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:34.848288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-49fa53a9-e514-4e1a-8f73-ccbf69d2df3b tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:34.849047 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-49fa53a9-e514-4e1a-8f73-ccbf69d2df3b tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:34.850266 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-49fa53a9-e514-4e1a-8f73-ccbf69d2df3b tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:34.851178 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-49fa53a9-e514-4e1a-8f73-ccbf69d2df3b tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:34.852048 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-49fa53a9-e514-4e1a-8f73-ccbf69d2df3b tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:34.852668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-49fa53a9-e514-4e1a-8f73-ccbf69d2df3b tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:34.872625 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=2 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:34.918157 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f4e29d75-3708-40da-9a12-852a4477592a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:34.919599 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f4e29d75-3708-40da-9a12-852a4477592a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:34.929963 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f4e29d75-3708-40da-9a12-852a4477592a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:34.931323 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f4e29d75-3708-40da-9a12-852a4477592a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:34.931935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f4e29d75-3708-40da-9a12-852a4477592a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:34.932786 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f4e29d75-3708-40da-9a12-852a4477592a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:34.933415 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f4e29d75-3708-40da-9a12-852a4477592a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:34.934428 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f4e29d75-3708-40da-9a12-852a4477592a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:35.111136 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f4e29d75-3708-40da-9a12-852a4477592a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:35.120940 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f4e29d75-3708-40da-9a12-852a4477592a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1322 microversion: 2.1 time: 0.207216 Oct 11 06:42:35.121776 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 82/161] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:34 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:42:35.171099 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1b4c320e-1ddc-4552-9baa-cfdd0e563865 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:35.171834 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1b4c320e-1ddc-4552-9baa-cfdd0e563865 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:35.178683 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b4c320e-1ddc-4552-9baa-cfdd0e563865 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:35.179238 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b4c320e-1ddc-4552-9baa-cfdd0e563865 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:35.179738 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b4c320e-1ddc-4552-9baa-cfdd0e563865 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:35.180851 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b4c320e-1ddc-4552-9baa-cfdd0e563865 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:35.181665 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b4c320e-1ddc-4552-9baa-cfdd0e563865 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:35.182433 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b4c320e-1ddc-4552-9baa-cfdd0e563865 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:35.354546 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1b4c320e-1ddc-4552-9baa-cfdd0e563865 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:35.366605 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1b4c320e-1ddc-4552-9baa-cfdd0e563865 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1366 microversion: 2.1 time: 0.200162 Oct 11 06:42:35.367249 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 83/162] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:35 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:42:35.377579 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-49fa53a9-e514-4e1a-8f73-ccbf69d2df3b tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:35.388558 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-49fa53a9-e514-4e1a-8f73-ccbf69d2df3b tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1315 microversion: 2.1 time: 0.552054 Oct 11 06:42:35.390500 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 80/163] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:34 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1315 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:35.455350 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-619a2135-f087-4bfb-96b7-ea5c262ec255 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:35.456829 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-619a2135-f087-4bfb-96b7-ea5c262ec255 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:35.464488 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-619a2135-f087-4bfb-96b7-ea5c262ec255 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:35.465142 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-619a2135-f087-4bfb-96b7-ea5c262ec255 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:35.465835 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-619a2135-f087-4bfb-96b7-ea5c262ec255 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:35.466685 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-619a2135-f087-4bfb-96b7-ea5c262ec255 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:35.467347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-619a2135-f087-4bfb-96b7-ea5c262ec255 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:35.467981 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-619a2135-f087-4bfb-96b7-ea5c262ec255 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:35.687329 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-619a2135-f087-4bfb-96b7-ea5c262ec255 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:35.697189 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-619a2135-f087-4bfb-96b7-ea5c262ec255 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:35.699099 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-619a2135-f087-4bfb-96b7-ea5c262ec255 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:35.700254 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-619a2135-f087-4bfb-96b7-ea5c262ec255 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1406 microversion: 2.20 time: 0.250188 Oct 11 06:42:35.700804 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 84/164] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:42:35 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:42:35.964045 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-9b2f2768-e799-4947-9aa4-f6d9af05dda7 req-4797b6c1-6279-4531-8464-c49da2ee3601 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c76b29e-08a3-4b53-9b36-82980a19493d", "tag": "b4d1c36d-2115-4009-915e-804111b3a836"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:42:35.976850 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-9b2f2768-e799-4947-9aa4-f6d9af05dda7 req-4797b6c1-6279-4531-8464-c49da2ee3601 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:35.977571 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-9b2f2768-e799-4947-9aa4-f6d9af05dda7 req-4797b6c1-6279-4531-8464-c49da2ee3601 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:35.978205 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-9b2f2768-e799-4947-9aa4-f6d9af05dda7 req-4797b6c1-6279-4531-8464-c49da2ee3601 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:35.991711 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-9b2f2768-e799-4947-9aa4-f6d9af05dda7 req-4797b6c1-6279-4531-8464-c49da2ee3601 service nova] Creating event network-changed:b4d1c36d-2115-4009-915e-804111b3a836 for instance 9c76b29e-08a3-4b53-9b36-82980a19493d on hv-cinder-85495 Oct 11 06:42:35.997776 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-9b2f2768-e799-4947-9aa4-f6d9af05dda7 req-4797b6c1-6279-4531-8464-c49da2ee3601 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037424 Oct 11 06:42:35.998492 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 81/165] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:42:36.151025 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d04a5b93-1d9b-4a49-a8a6-02b25d08531e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:36.153232 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d04a5b93-1d9b-4a49-a8a6-02b25d08531e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:36.163766 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d04a5b93-1d9b-4a49-a8a6-02b25d08531e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:36.164838 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d04a5b93-1d9b-4a49-a8a6-02b25d08531e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:36.166087 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d04a5b93-1d9b-4a49-a8a6-02b25d08531e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:36.167579 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d04a5b93-1d9b-4a49-a8a6-02b25d08531e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:36.168606 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d04a5b93-1d9b-4a49-a8a6-02b25d08531e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:36.169557 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d04a5b93-1d9b-4a49-a8a6-02b25d08531e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:36.348726 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d04a5b93-1d9b-4a49-a8a6-02b25d08531e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:36.360531 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d04a5b93-1d9b-4a49-a8a6-02b25d08531e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1322 microversion: 2.1 time: 0.217473 Oct 11 06:42:36.368591 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 85/166] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:36 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:36.390652 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9b7e6f7e-5c3a-440f-b493-36d480349322 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:36.392854 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9b7e6f7e-5c3a-440f-b493-36d480349322 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:36.399756 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9b7e6f7e-5c3a-440f-b493-36d480349322 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:36.400656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9b7e6f7e-5c3a-440f-b493-36d480349322 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:36.401421 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9b7e6f7e-5c3a-440f-b493-36d480349322 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:36.402367 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9b7e6f7e-5c3a-440f-b493-36d480349322 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:36.403049 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9b7e6f7e-5c3a-440f-b493-36d480349322 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:36.403736 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9b7e6f7e-5c3a-440f-b493-36d480349322 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:36.414480 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-48e140c4-2ea6-41eb-a0b3-80619b9d5f2e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:36.415488 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-48e140c4-2ea6-41eb-a0b3-80619b9d5f2e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:36.424983 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-48e140c4-2ea6-41eb-a0b3-80619b9d5f2e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:36.425480 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-48e140c4-2ea6-41eb-a0b3-80619b9d5f2e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:36.425919 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-48e140c4-2ea6-41eb-a0b3-80619b9d5f2e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:36.427035 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-48e140c4-2ea6-41eb-a0b3-80619b9d5f2e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:36.427528 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-48e140c4-2ea6-41eb-a0b3-80619b9d5f2e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:36.428070 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-48e140c4-2ea6-41eb-a0b3-80619b9d5f2e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:36.904020 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-48e140c4-2ea6-41eb-a0b3-80619b9d5f2e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:36.920680 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-48e140c4-2ea6-41eb-a0b3-80619b9d5f2e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1315 microversion: 2.1 time: 0.507598 Oct 11 06:42:36.938929 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 86/167] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:36 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1315 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:36.938929 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b2b4538f-c67c-4e22-8e61-8137225328a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:36.938929 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b2b4538f-c67c-4e22-8e61-8137225328a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:36.954574 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9b7e6f7e-5c3a-440f-b493-36d480349322 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:36.965036 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9b7e6f7e-5c3a-440f-b493-36d480349322 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1366 microversion: 2.1 time: 0.579315 Oct 11 06:42:36.968269 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b2b4538f-c67c-4e22-8e61-8137225328a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:36.968773 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b2b4538f-c67c-4e22-8e61-8137225328a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:36.969257 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 82/168] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:36 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1366 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:42:36.969365 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b2b4538f-c67c-4e22-8e61-8137225328a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:36.990022 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b2b4538f-c67c-4e22-8e61-8137225328a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:36.990550 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b2b4538f-c67c-4e22-8e61-8137225328a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:36.990985 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b2b4538f-c67c-4e22-8e61-8137225328a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:37.214545 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b2b4538f-c67c-4e22-8e61-8137225328a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:37.226157 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b2b4538f-c67c-4e22-8e61-8137225328a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:37.227815 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b2b4538f-c67c-4e22-8e61-8137225328a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:37.229093 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b2b4538f-c67c-4e22-8e61-8137225328a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1406 microversion: 2.20 time: 0.297432 Oct 11 06:42:37.233949 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 87/169] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:42:36 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1406 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:42:37.390515 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0b2835fe-b97c-4d4b-9121-3f74b72e641e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:37.391124 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0b2835fe-b97c-4d4b-9121-3f74b72e641e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:37.394161 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:37.398614 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b2835fe-b97c-4d4b-9121-3f74b72e641e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:37.399117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b2835fe-b97c-4d4b-9121-3f74b72e641e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:37.399601 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b2835fe-b97c-4d4b-9121-3f74b72e641e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:37.400315 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b2835fe-b97c-4d4b-9121-3f74b72e641e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:37.400771 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b2835fe-b97c-4d4b-9121-3f74b72e641e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:37.401260 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b2835fe-b97c-4d4b-9121-3f74b72e641e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:37.541646 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0b2835fe-b97c-4d4b-9121-3f74b72e641e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:37.549796 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0b2835fe-b97c-4d4b-9121-3f74b72e641e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1322 microversion: 2.1 time: 0.163072 Oct 11 06:42:37.550379 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 83/170] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:37 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:37.946094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a83237da-124b-4ff6-b0bc-6336c518dc7b tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:37.946702 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a83237da-124b-4ff6-b0bc-6336c518dc7b tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:37.953469 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a83237da-124b-4ff6-b0bc-6336c518dc7b tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:37.953961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a83237da-124b-4ff6-b0bc-6336c518dc7b tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:37.954399 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a83237da-124b-4ff6-b0bc-6336c518dc7b tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:37.955104 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a83237da-124b-4ff6-b0bc-6336c518dc7b tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:37.955593 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a83237da-124b-4ff6-b0bc-6336c518dc7b tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:37.956022 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a83237da-124b-4ff6-b0bc-6336c518dc7b tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:37.997463 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-65a5651d-2b68-4ac7-b97e-5d3dab06e8df tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:37.998495 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-65a5651d-2b68-4ac7-b97e-5d3dab06e8df tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:38.005236 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65a5651d-2b68-4ac7-b97e-5d3dab06e8df tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:38.005821 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65a5651d-2b68-4ac7-b97e-5d3dab06e8df tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:38.006463 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65a5651d-2b68-4ac7-b97e-5d3dab06e8df tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:38.007372 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65a5651d-2b68-4ac7-b97e-5d3dab06e8df tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:38.008034 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65a5651d-2b68-4ac7-b97e-5d3dab06e8df tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:38.008456 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65a5651d-2b68-4ac7-b97e-5d3dab06e8df tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:38.095157 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a83237da-124b-4ff6-b0bc-6336c518dc7b tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:38.103959 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a83237da-124b-4ff6-b0bc-6336c518dc7b tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1315 microversion: 2.1 time: 0.161426 Oct 11 06:42:38.105069 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 88/171] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:37 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:38.145380 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-65a5651d-2b68-4ac7-b97e-5d3dab06e8df tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:38.154017 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-65a5651d-2b68-4ac7-b97e-5d3dab06e8df tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1366 microversion: 2.1 time: 0.160507 Oct 11 06:42:38.154587 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 84/172] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:37 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:42:38.264683 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8d9cbf08-3fb3-4c6d-bab5-c4773f1c0567 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:38.265289 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8d9cbf08-3fb3-4c6d-bab5-c4773f1c0567 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:38.271082 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8d9cbf08-3fb3-4c6d-bab5-c4773f1c0567 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:38.272179 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8d9cbf08-3fb3-4c6d-bab5-c4773f1c0567 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:38.272608 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8d9cbf08-3fb3-4c6d-bab5-c4773f1c0567 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:38.273281 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8d9cbf08-3fb3-4c6d-bab5-c4773f1c0567 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:38.273727 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8d9cbf08-3fb3-4c6d-bab5-c4773f1c0567 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:38.274144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8d9cbf08-3fb3-4c6d-bab5-c4773f1c0567 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:38.398612 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8d9cbf08-3fb3-4c6d-bab5-c4773f1c0567 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:38.401954 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:38.407548 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8d9cbf08-3fb3-4c6d-bab5-c4773f1c0567 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:38.408973 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8d9cbf08-3fb3-4c6d-bab5-c4773f1c0567 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:38.410057 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8d9cbf08-3fb3-4c6d-bab5-c4773f1c0567 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1406 microversion: 2.20 time: 0.149245 Oct 11 06:42:38.410600 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 89/173] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:42:38 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:42:38.573293 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-469a1e79-4157-40f5-90bc-6d4f82eb7d6d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:38.573904 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-469a1e79-4157-40f5-90bc-6d4f82eb7d6d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:38.579805 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-469a1e79-4157-40f5-90bc-6d4f82eb7d6d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:38.580283 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-469a1e79-4157-40f5-90bc-6d4f82eb7d6d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:38.580713 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-469a1e79-4157-40f5-90bc-6d4f82eb7d6d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:38.581399 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-469a1e79-4157-40f5-90bc-6d4f82eb7d6d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:38.581850 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-469a1e79-4157-40f5-90bc-6d4f82eb7d6d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:38.582271 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-469a1e79-4157-40f5-90bc-6d4f82eb7d6d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:38.707216 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-469a1e79-4157-40f5-90bc-6d4f82eb7d6d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:38.715366 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-469a1e79-4157-40f5-90bc-6d4f82eb7d6d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1322 microversion: 2.1 time: 0.145913 Oct 11 06:42:38.715957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 85/174] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:38 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:39.128429 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6730a551-bc94-4706-a76b-50074b48e907 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:39.129739 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6730a551-bc94-4706-a76b-50074b48e907 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:39.138774 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6730a551-bc94-4706-a76b-50074b48e907 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:39.139659 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6730a551-bc94-4706-a76b-50074b48e907 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:39.140158 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6730a551-bc94-4706-a76b-50074b48e907 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:39.141103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6730a551-bc94-4706-a76b-50074b48e907 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:39.141617 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6730a551-bc94-4706-a76b-50074b48e907 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:39.142289 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6730a551-bc94-4706-a76b-50074b48e907 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:39.181285 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5f26ce90-917f-4635-a4a6-1f1750863776 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:39.182945 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5f26ce90-917f-4635-a4a6-1f1750863776 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:39.194836 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f26ce90-917f-4635-a4a6-1f1750863776 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:39.195596 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f26ce90-917f-4635-a4a6-1f1750863776 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:39.196571 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f26ce90-917f-4635-a4a6-1f1750863776 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:39.197511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f26ce90-917f-4635-a4a6-1f1750863776 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:39.199904 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f26ce90-917f-4635-a4a6-1f1750863776 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:39.202690 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f26ce90-917f-4635-a4a6-1f1750863776 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:39.320886 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6730a551-bc94-4706-a76b-50074b48e907 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:39.328443 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6730a551-bc94-4706-a76b-50074b48e907 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1315 microversion: 2.1 time: 0.205531 Oct 11 06:42:39.329113 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 90/175] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:39 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:39.349150 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5f26ce90-917f-4635-a4a6-1f1750863776 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:39.352588 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:39.357938 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5f26ce90-917f-4635-a4a6-1f1750863776 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1366 microversion: 2.1 time: 0.184492 Oct 11 06:42:39.358496 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 86/176] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:39 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:42:39.435352 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7d794f52-4eea-45d6-9a9d-b1be001dfe0e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:39.435969 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7d794f52-4eea-45d6-9a9d-b1be001dfe0e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:39.441868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d794f52-4eea-45d6-9a9d-b1be001dfe0e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:39.442350 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d794f52-4eea-45d6-9a9d-b1be001dfe0e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:39.442771 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d794f52-4eea-45d6-9a9d-b1be001dfe0e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:39.443968 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d794f52-4eea-45d6-9a9d-b1be001dfe0e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:39.444409 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d794f52-4eea-45d6-9a9d-b1be001dfe0e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:39.444824 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d794f52-4eea-45d6-9a9d-b1be001dfe0e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:39.735973 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7d794f52-4eea-45d6-9a9d-b1be001dfe0e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:39.738841 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-93aa3c8c-3ad8-4afd-bb53-9b0c7734a2f2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:39.739874 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-93aa3c8c-3ad8-4afd-bb53-9b0c7734a2f2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:39.745310 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7d794f52-4eea-45d6-9a9d-b1be001dfe0e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:39.746794 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93aa3c8c-3ad8-4afd-bb53-9b0c7734a2f2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:39.747161 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7d794f52-4eea-45d6-9a9d-b1be001dfe0e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:39.747290 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93aa3c8c-3ad8-4afd-bb53-9b0c7734a2f2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:39.747756 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93aa3c8c-3ad8-4afd-bb53-9b0c7734a2f2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:39.748340 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7d794f52-4eea-45d6-9a9d-b1be001dfe0e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1406 microversion: 2.20 time: 0.316886 Oct 11 06:42:39.748457 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93aa3c8c-3ad8-4afd-bb53-9b0c7734a2f2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:39.748912 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93aa3c8c-3ad8-4afd-bb53-9b0c7734a2f2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:39.759479 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 91/177] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:42:39 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1406 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:42:39.759920 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93aa3c8c-3ad8-4afd-bb53-9b0c7734a2f2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:39.875581 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-93aa3c8c-3ad8-4afd-bb53-9b0c7734a2f2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:39.883820 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-93aa3c8c-3ad8-4afd-bb53-9b0c7734a2f2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1322 microversion: 2.1 time: 0.149603 Oct 11 06:42:39.884379 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 87/178] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:39 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:42:40.351210 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-eb178c70-0b32-49b8-96d9-b08140b047c5 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:40.351857 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-eb178c70-0b32-49b8-96d9-b08140b047c5 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:40.360341 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eb178c70-0b32-49b8-96d9-b08140b047c5 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:40.361412 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eb178c70-0b32-49b8-96d9-b08140b047c5 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:40.362601 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eb178c70-0b32-49b8-96d9-b08140b047c5 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:40.363955 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eb178c70-0b32-49b8-96d9-b08140b047c5 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:40.364687 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eb178c70-0b32-49b8-96d9-b08140b047c5 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:40.365484 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eb178c70-0b32-49b8-96d9-b08140b047c5 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:40.382130 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3e4609b1-bf25-4e53-8f30-41dca16d617c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:40.382760 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3e4609b1-bf25-4e53-8f30-41dca16d617c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:40.392752 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e4609b1-bf25-4e53-8f30-41dca16d617c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:40.393240 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e4609b1-bf25-4e53-8f30-41dca16d617c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:40.394038 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e4609b1-bf25-4e53-8f30-41dca16d617c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:40.394803 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e4609b1-bf25-4e53-8f30-41dca16d617c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:40.395184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e4609b1-bf25-4e53-8f30-41dca16d617c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:40.395662 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e4609b1-bf25-4e53-8f30-41dca16d617c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:40.556776 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-eb178c70-0b32-49b8-96d9-b08140b047c5 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:40.580740 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-eb178c70-0b32-49b8-96d9-b08140b047c5 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1315 microversion: 2.1 time: 0.233131 Oct 11 06:42:40.595061 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 92/179] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:40 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:40.651546 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3e4609b1-bf25-4e53-8f30-41dca16d617c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:40.661648 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3e4609b1-bf25-4e53-8f30-41dca16d617c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1366 microversion: 2.1 time: 0.283555 Oct 11 06:42:40.663227 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 88/180] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:40 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:42:40.703095 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-5a767a0e-424d-4050-aa5a-b1c40f918713 req-68a97603-e4e2-44ae-8d5f-a1b47cfbf3a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43d48211-8dab-4abd-8c95-e850b83382ff", "name": "network-vif-plugged", "status": "completed", "tag": "f963366d-bbf2-4aff-84d1-f61c69977089"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:42:40.731949 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-5a767a0e-424d-4050-aa5a-b1c40f918713 req-68a97603-e4e2-44ae-8d5f-a1b47cfbf3a8 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:40.732601 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-5a767a0e-424d-4050-aa5a-b1c40f918713 req-68a97603-e4e2-44ae-8d5f-a1b47cfbf3a8 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:40.733190 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-5a767a0e-424d-4050-aa5a-b1c40f918713 req-68a97603-e4e2-44ae-8d5f-a1b47cfbf3a8 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:40.761724 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-5a767a0e-424d-4050-aa5a-b1c40f918713 req-68a97603-e4e2-44ae-8d5f-a1b47cfbf3a8 service nova] Creating event network-vif-plugged:f963366d-bbf2-4aff-84d1-f61c69977089 for instance 43d48211-8dab-4abd-8c95-e850b83382ff on hv-cinder-85495 Oct 11 06:42:40.775444 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c3625b30-6338-4d9f-a578-ce198986c2b0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:40.776064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c3625b30-6338-4d9f-a578-ce198986c2b0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:40.781966 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-5a767a0e-424d-4050-aa5a-b1c40f918713 req-68a97603-e4e2-44ae-8d5f-a1b47cfbf3a8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085726 Oct 11 06:42:40.797192 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 93/181] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:42:40.801164 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c3625b30-6338-4d9f-a578-ce198986c2b0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:40.801665 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c3625b30-6338-4d9f-a578-ce198986c2b0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:40.803707 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c3625b30-6338-4d9f-a578-ce198986c2b0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:40.805831 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c3625b30-6338-4d9f-a578-ce198986c2b0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:40.806285 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c3625b30-6338-4d9f-a578-ce198986c2b0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:40.806716 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c3625b30-6338-4d9f-a578-ce198986c2b0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:40.907079 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-45b0d2d0-b31a-4b0d-8289-d06cabee984a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:40.908335 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-45b0d2d0-b31a-4b0d-8289-d06cabee984a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:40.921141 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-45b0d2d0-b31a-4b0d-8289-d06cabee984a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:40.927798 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-45b0d2d0-b31a-4b0d-8289-d06cabee984a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:40.928676 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-45b0d2d0-b31a-4b0d-8289-d06cabee984a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:40.929577 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-45b0d2d0-b31a-4b0d-8289-d06cabee984a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:40.930171 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-45b0d2d0-b31a-4b0d-8289-d06cabee984a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:40.931020 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-45b0d2d0-b31a-4b0d-8289-d06cabee984a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:41.150772 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c3625b30-6338-4d9f-a578-ce198986c2b0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:41.168683 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c3625b30-6338-4d9f-a578-ce198986c2b0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:41.170177 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c3625b30-6338-4d9f-a578-ce198986c2b0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:41.171373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c3625b30-6338-4d9f-a578-ce198986c2b0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1406 microversion: 2.20 time: 0.400816 Oct 11 06:42:41.171956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 89/182] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:42:40 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1406 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:42:41.366424 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-45b0d2d0-b31a-4b0d-8289-d06cabee984a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:41.376505 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-45b0d2d0-b31a-4b0d-8289-d06cabee984a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1322 microversion: 2.1 time: 0.473485 Oct 11 06:42:41.378288 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 94/183] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:40 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1322 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:41.607178 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-958e75c5-ee13-478c-9734-be9482b5b5aa tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:41.607824 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-958e75c5-ee13-478c-9734-be9482b5b5aa tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:41.616184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-958e75c5-ee13-478c-9734-be9482b5b5aa tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:41.616884 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-958e75c5-ee13-478c-9734-be9482b5b5aa tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:41.617640 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-958e75c5-ee13-478c-9734-be9482b5b5aa tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:41.618622 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-958e75c5-ee13-478c-9734-be9482b5b5aa tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:41.619281 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-958e75c5-ee13-478c-9734-be9482b5b5aa tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:41.619946 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-958e75c5-ee13-478c-9734-be9482b5b5aa tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:41.694117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f1bdc688-e2be-4e33-8949-3ab37b25e5c6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:41.698677 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f1bdc688-e2be-4e33-8949-3ab37b25e5c6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:41.715863 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1bdc688-e2be-4e33-8949-3ab37b25e5c6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:41.716785 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1bdc688-e2be-4e33-8949-3ab37b25e5c6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:41.717455 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1bdc688-e2be-4e33-8949-3ab37b25e5c6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:41.719541 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1bdc688-e2be-4e33-8949-3ab37b25e5c6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:41.720561 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1bdc688-e2be-4e33-8949-3ab37b25e5c6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:41.721326 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1bdc688-e2be-4e33-8949-3ab37b25e5c6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:41.817744 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-958e75c5-ee13-478c-9734-be9482b5b5aa tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:41.837054 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-958e75c5-ee13-478c-9734-be9482b5b5aa tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1315 microversion: 2.1 time: 0.234092 Oct 11 06:42:41.859045 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 90/184] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:41 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:41.937802 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f1bdc688-e2be-4e33-8949-3ab37b25e5c6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:41.945891 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f1bdc688-e2be-4e33-8949-3ab37b25e5c6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1366 microversion: 2.1 time: 0.259928 Oct 11 06:42:41.946982 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 95/185] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:41 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:42.197714 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5a684b79-bba1-420c-bce9-57fb45ee5745 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:42.198320 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5a684b79-bba1-420c-bce9-57fb45ee5745 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:42.204338 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a684b79-bba1-420c-bce9-57fb45ee5745 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:42.204821 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a684b79-bba1-420c-bce9-57fb45ee5745 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:42.205252 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a684b79-bba1-420c-bce9-57fb45ee5745 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:42.205949 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a684b79-bba1-420c-bce9-57fb45ee5745 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:42.206426 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a684b79-bba1-420c-bce9-57fb45ee5745 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:42.207017 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a684b79-bba1-420c-bce9-57fb45ee5745 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:42.356043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5a684b79-bba1-420c-bce9-57fb45ee5745 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:42.364549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5a684b79-bba1-420c-bce9-57fb45ee5745 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:42.365917 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5a684b79-bba1-420c-bce9-57fb45ee5745 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:42.367001 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5a684b79-bba1-420c-bce9-57fb45ee5745 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1406 microversion: 2.20 time: 0.173596 Oct 11 06:42:42.367572 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 91/186] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:42:42 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:42:42.400484 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6f9a23de-9e40-41ba-9416-1022c846f518 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:42.401130 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6f9a23de-9e40-41ba-9416-1022c846f518 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:42.407177 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f9a23de-9e40-41ba-9416-1022c846f518 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:42.407690 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f9a23de-9e40-41ba-9416-1022c846f518 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:42.408116 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f9a23de-9e40-41ba-9416-1022c846f518 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:42.408798 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f9a23de-9e40-41ba-9416-1022c846f518 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:42.409472 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f9a23de-9e40-41ba-9416-1022c846f518 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:42.409649 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f9a23de-9e40-41ba-9416-1022c846f518 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:42.537045 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6f9a23de-9e40-41ba-9416-1022c846f518 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:42.546548 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6f9a23de-9e40-41ba-9416-1022c846f518 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1322 microversion: 2.1 time: 0.150317 Oct 11 06:42:42.547110 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 96/187] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:42 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:42.811440 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-4d75f1ff-5d5b-43de-b96d-6751090ccb44 req-40d442bf-c884-4f88-8224-a579383709cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07799819-eaa3-484d-bbcf-2c3c97ea26f3", "name": "network-vif-plugged", "status": "completed", "tag": "5513024a-3af1-4db9-810a-0131e7119a57"}, {"server_uuid": "a2ce136a-30ab-4986-931e-5af38b37875e", "name": "network-vif-plugged", "status": "completed", "tag": "3280a926-f599-464d-a89c-2446cca4d1a4"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:42:42.823760 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-4d75f1ff-5d5b-43de-b96d-6751090ccb44 req-40d442bf-c884-4f88-8224-a579383709cd service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:42.824428 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-4d75f1ff-5d5b-43de-b96d-6751090ccb44 req-40d442bf-c884-4f88-8224-a579383709cd service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:42.824823 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-4d75f1ff-5d5b-43de-b96d-6751090ccb44 req-40d442bf-c884-4f88-8224-a579383709cd service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:42.838511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-4d75f1ff-5d5b-43de-b96d-6751090ccb44 req-40d442bf-c884-4f88-8224-a579383709cd service nova] Creating event network-vif-plugged:5513024a-3af1-4db9-810a-0131e7119a57 for instance 07799819-eaa3-484d-bbcf-2c3c97ea26f3 on hv-cinder-85495 Oct 11 06:42:42.839005 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-4d75f1ff-5d5b-43de-b96d-6751090ccb44 req-40d442bf-c884-4f88-8224-a579383709cd service nova] Creating event network-vif-plugged:3280a926-f599-464d-a89c-2446cca4d1a4 for instance a2ce136a-30ab-4986-931e-5af38b37875e on hv-cinder-85495 Oct 11 06:42:42.849027 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-4d75f1ff-5d5b-43de-b96d-6751090ccb44 req-40d442bf-c884-4f88-8224-a579383709cd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041680 Oct 11 06:42:42.849664 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 92/188] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:42:42.866809 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1267dc34-47f5-4a40-a95d-d4de1e181bfd tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:42.867543 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1267dc34-47f5-4a40-a95d-d4de1e181bfd tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:42.873207 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1267dc34-47f5-4a40-a95d-d4de1e181bfd tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:42.873713 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1267dc34-47f5-4a40-a95d-d4de1e181bfd tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:42.874148 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1267dc34-47f5-4a40-a95d-d4de1e181bfd tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:42.874826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1267dc34-47f5-4a40-a95d-d4de1e181bfd tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:42.875262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1267dc34-47f5-4a40-a95d-d4de1e181bfd tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:42.875697 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1267dc34-47f5-4a40-a95d-d4de1e181bfd tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:42.973092 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-addd8605-a63d-4add-8fd6-69eb92d4fb54 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:42.973852 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-addd8605-a63d-4add-8fd6-69eb92d4fb54 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:42.981505 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-addd8605-a63d-4add-8fd6-69eb92d4fb54 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:42.982032 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-addd8605-a63d-4add-8fd6-69eb92d4fb54 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:42.982513 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-addd8605-a63d-4add-8fd6-69eb92d4fb54 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:42.983586 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-addd8605-a63d-4add-8fd6-69eb92d4fb54 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:42.984038 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-addd8605-a63d-4add-8fd6-69eb92d4fb54 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:42.984870 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-addd8605-a63d-4add-8fd6-69eb92d4fb54 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:43.023788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1267dc34-47f5-4a40-a95d-d4de1e181bfd tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:43.033805 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1267dc34-47f5-4a40-a95d-d4de1e181bfd tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1315 microversion: 2.1 time: 0.171228 Oct 11 06:42:43.034541 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 97/189] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:42 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:42:43.155956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-addd8605-a63d-4add-8fd6-69eb92d4fb54 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:43.166308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-addd8605-a63d-4add-8fd6-69eb92d4fb54 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1366 microversion: 2.1 time: 0.198580 Oct 11 06:42:43.166983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 93/190] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:42 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:43.395522 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c94da0b0-5953-4293-a061-0c3ba5829fc1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:43.397146 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c94da0b0-5953-4293-a061-0c3ba5829fc1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:43.428609 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c94da0b0-5953-4293-a061-0c3ba5829fc1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:43.429177 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c94da0b0-5953-4293-a061-0c3ba5829fc1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:43.429576 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c94da0b0-5953-4293-a061-0c3ba5829fc1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:43.430308 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c94da0b0-5953-4293-a061-0c3ba5829fc1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:43.430851 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c94da0b0-5953-4293-a061-0c3ba5829fc1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:43.431159 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c94da0b0-5953-4293-a061-0c3ba5829fc1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:43.572053 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-faa82ced-186a-4626-9527-e012533d1606 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:43.573117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-faa82ced-186a-4626-9527-e012533d1606 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:43.579945 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-faa82ced-186a-4626-9527-e012533d1606 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:43.580814 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-faa82ced-186a-4626-9527-e012533d1606 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:43.581363 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-faa82ced-186a-4626-9527-e012533d1606 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:43.582293 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-faa82ced-186a-4626-9527-e012533d1606 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:43.582866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-faa82ced-186a-4626-9527-e012533d1606 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:43.583439 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-faa82ced-186a-4626-9527-e012533d1606 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:43.743293 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-faa82ced-186a-4626-9527-e012533d1606 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:43.751313 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c94da0b0-5953-4293-a061-0c3ba5829fc1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:43.753269 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-faa82ced-186a-4626-9527-e012533d1606 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1322 microversion: 2.1 time: 0.183463 Oct 11 06:42:43.754284 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 94/191] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:43 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:43.760068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c94da0b0-5953-4293-a061-0c3ba5829fc1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:43.764484 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c94da0b0-5953-4293-a061-0c3ba5829fc1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:43.769769 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c94da0b0-5953-4293-a061-0c3ba5829fc1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1598 microversion: 2.20 time: 0.380297 Oct 11 06:42:43.771918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 98/192] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:42:43 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1598 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:42:43.798800 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c0ebfc65-f0a1-4100-bb78-d7eb7b4c444c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:43.799703 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c0ebfc65-f0a1-4100-bb78-d7eb7b4c444c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:43.808334 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c0ebfc65-f0a1-4100-bb78-d7eb7b4c444c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:43.808930 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c0ebfc65-f0a1-4100-bb78-d7eb7b4c444c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:43.809626 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c0ebfc65-f0a1-4100-bb78-d7eb7b4c444c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:43.810404 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c0ebfc65-f0a1-4100-bb78-d7eb7b4c444c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:43.810858 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c0ebfc65-f0a1-4100-bb78-d7eb7b4c444c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:43.811278 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c0ebfc65-f0a1-4100-bb78-d7eb7b4c444c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:43.902114 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c0ebfc65-f0a1-4100-bb78-d7eb7b4c444c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.108644 Oct 11 06:42:43.902882 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 95/193] 10.222.0.39 () {60 vars in 1316 bytes} [Tue Oct 11 06:42:43 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:42:44.061819 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-57408e69-db9e-4b1f-b616-41e53bdca7ec tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:44.062504 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-57408e69-db9e-4b1f-b616-41e53bdca7ec tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:44.069132 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-57408e69-db9e-4b1f-b616-41e53bdca7ec tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:44.069612 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-57408e69-db9e-4b1f-b616-41e53bdca7ec tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:44.070041 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-57408e69-db9e-4b1f-b616-41e53bdca7ec tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:44.070772 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-57408e69-db9e-4b1f-b616-41e53bdca7ec tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:44.071220 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-57408e69-db9e-4b1f-b616-41e53bdca7ec tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:44.071667 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-57408e69-db9e-4b1f-b616-41e53bdca7ec tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:44.190512 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-707849c7-7a66-4522-872f-1d33c8b477c8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:44.191119 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-707849c7-7a66-4522-872f-1d33c8b477c8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:44.197388 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-707849c7-7a66-4522-872f-1d33c8b477c8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:44.197903 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-707849c7-7a66-4522-872f-1d33c8b477c8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:44.198403 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-707849c7-7a66-4522-872f-1d33c8b477c8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:44.199226 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-707849c7-7a66-4522-872f-1d33c8b477c8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:44.199738 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-707849c7-7a66-4522-872f-1d33c8b477c8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:44.200184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-707849c7-7a66-4522-872f-1d33c8b477c8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:44.337645 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-707849c7-7a66-4522-872f-1d33c8b477c8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:44.347017 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-707849c7-7a66-4522-872f-1d33c8b477c8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1366 microversion: 2.1 time: 0.160619 Oct 11 06:42:44.347756 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 96/194] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:44 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:42:44.368535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-57408e69-db9e-4b1f-b616-41e53bdca7ec tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:44.377971 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-57408e69-db9e-4b1f-b616-41e53bdca7ec tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1315 microversion: 2.1 time: 0.319973 Oct 11 06:42:44.392546 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 99/195] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:44 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:44.783802 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bd87f9b1-f483-48f8-af1e-fbf9466e371c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:44.783802 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bd87f9b1-f483-48f8-af1e-fbf9466e371c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:44.801545 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bd87f9b1-f483-48f8-af1e-fbf9466e371c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:44.802039 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bd87f9b1-f483-48f8-af1e-fbf9466e371c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:44.802498 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bd87f9b1-f483-48f8-af1e-fbf9466e371c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:44.803214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bd87f9b1-f483-48f8-af1e-fbf9466e371c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:44.803693 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bd87f9b1-f483-48f8-af1e-fbf9466e371c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:44.804116 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bd87f9b1-f483-48f8-af1e-fbf9466e371c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:44.866270 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-3ccb91ca-b8a2-4b4f-84ff-ef8bf58606e4 req-dd35dd7b-de9a-49f3-87ab-35f4d92d3421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63ee206c-410a-4d60-89ab-e6d6319e64b6", "name": "network-vif-plugged", "status": "completed", "tag": "f00aa092-378a-4b0d-9b6e-c605b2ca8c2c"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:42:44.882559 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-3ccb91ca-b8a2-4b4f-84ff-ef8bf58606e4 req-dd35dd7b-de9a-49f3-87ab-35f4d92d3421 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:44.883029 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-3ccb91ca-b8a2-4b4f-84ff-ef8bf58606e4 req-dd35dd7b-de9a-49f3-87ab-35f4d92d3421 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:44.883481 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-3ccb91ca-b8a2-4b4f-84ff-ef8bf58606e4 req-dd35dd7b-de9a-49f3-87ab-35f4d92d3421 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:44.900861 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-3ccb91ca-b8a2-4b4f-84ff-ef8bf58606e4 req-dd35dd7b-de9a-49f3-87ab-35f4d92d3421 service nova] Creating event network-vif-plugged:f00aa092-378a-4b0d-9b6e-c605b2ca8c2c for instance 63ee206c-410a-4d60-89ab-e6d6319e64b6 on hv-cinder-85495 Oct 11 06:42:44.906561 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-3ccb91ca-b8a2-4b4f-84ff-ef8bf58606e4 req-dd35dd7b-de9a-49f3-87ab-35f4d92d3421 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044054 Oct 11 06:42:44.907165 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 100/196] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:42:45.008340 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-bd87f9b1-f483-48f8-af1e-fbf9466e371c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:45.016949 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bd87f9b1-f483-48f8-af1e-fbf9466e371c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1322 microversion: 2.1 time: 0.242103 Oct 11 06:42:45.017663 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 97/197] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:44 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:45.371972 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-58bc793e-4e8a-49c3-b9a5-8dc6cf55b32e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:45.372672 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-58bc793e-4e8a-49c3-b9a5-8dc6cf55b32e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:45.380805 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-58bc793e-4e8a-49c3-b9a5-8dc6cf55b32e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:45.381304 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-58bc793e-4e8a-49c3-b9a5-8dc6cf55b32e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:45.381933 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-58bc793e-4e8a-49c3-b9a5-8dc6cf55b32e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:45.383396 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-58bc793e-4e8a-49c3-b9a5-8dc6cf55b32e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:45.383876 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-58bc793e-4e8a-49c3-b9a5-8dc6cf55b32e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:45.385145 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-58bc793e-4e8a-49c3-b9a5-8dc6cf55b32e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:45.403167 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-05e13afa-0f14-4749-91c6-14bbd61773b9 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:45.404190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-05e13afa-0f14-4749-91c6-14bbd61773b9 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:45.412835 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-05e13afa-0f14-4749-91c6-14bbd61773b9 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:45.413680 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-05e13afa-0f14-4749-91c6-14bbd61773b9 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:45.414394 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-05e13afa-0f14-4749-91c6-14bbd61773b9 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:45.418698 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-05e13afa-0f14-4749-91c6-14bbd61773b9 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:45.419451 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-05e13afa-0f14-4749-91c6-14bbd61773b9 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:45.420106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-05e13afa-0f14-4749-91c6-14bbd61773b9 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:45.607391 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-05e13afa-0f14-4749-91c6-14bbd61773b9 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:45.620630 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-05e13afa-0f14-4749-91c6-14bbd61773b9 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1315 microversion: 2.1 time: 0.222029 Oct 11 06:42:45.621835 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 98/198] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:45 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:42:45.690701 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-58bc793e-4e8a-49c3-b9a5-8dc6cf55b32e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:45.701136 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-58bc793e-4e8a-49c3-b9a5-8dc6cf55b32e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1366 microversion: 2.1 time: 0.333604 Oct 11 06:42:45.701707 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 101/199] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:45 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1366 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:45.811724 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-e0b5db07-6970-42db-9f37-d187d5797726 req-c26be586-f88f-4c9a-b606-840fbacd037c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43d48211-8dab-4abd-8c95-e850b83382ff", "tag": "f963366d-bbf2-4aff-84d1-f61c69977089"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:42:45.823545 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-e0b5db07-6970-42db-9f37-d187d5797726 req-c26be586-f88f-4c9a-b606-840fbacd037c service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:45.824258 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-e0b5db07-6970-42db-9f37-d187d5797726 req-c26be586-f88f-4c9a-b606-840fbacd037c service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:45.824682 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-e0b5db07-6970-42db-9f37-d187d5797726 req-c26be586-f88f-4c9a-b606-840fbacd037c service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:45.836890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-e0b5db07-6970-42db-9f37-d187d5797726 req-c26be586-f88f-4c9a-b606-840fbacd037c service nova] Creating event network-changed:f963366d-bbf2-4aff-84d1-f61c69977089 for instance 43d48211-8dab-4abd-8c95-e850b83382ff on hv-cinder-85495 Oct 11 06:42:45.842109 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-e0b5db07-6970-42db-9f37-d187d5797726 req-c26be586-f88f-4c9a-b606-840fbacd037c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034615 Oct 11 06:42:45.843178 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 99/200] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:42:46.043150 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0d8cc835-8488-4777-9f1c-86ae7341977b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:46.045442 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0d8cc835-8488-4777-9f1c-86ae7341977b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:46.058300 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0d8cc835-8488-4777-9f1c-86ae7341977b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:46.059038 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0d8cc835-8488-4777-9f1c-86ae7341977b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:46.059731 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0d8cc835-8488-4777-9f1c-86ae7341977b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:46.060658 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0d8cc835-8488-4777-9f1c-86ae7341977b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:46.061280 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0d8cc835-8488-4777-9f1c-86ae7341977b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:46.061934 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0d8cc835-8488-4777-9f1c-86ae7341977b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:46.255209 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0d8cc835-8488-4777-9f1c-86ae7341977b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:46.276237 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0d8cc835-8488-4777-9f1c-86ae7341977b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1322 microversion: 2.1 time: 0.238584 Oct 11 06:42:46.294082 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 102/201] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:46 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:46.648843 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-223f7180-14dc-4738-8cf4-40261a4317b3 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:46.649578 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-223f7180-14dc-4738-8cf4-40261a4317b3 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:46.659483 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-223f7180-14dc-4738-8cf4-40261a4317b3 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:46.659974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-223f7180-14dc-4738-8cf4-40261a4317b3 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:46.660411 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-223f7180-14dc-4738-8cf4-40261a4317b3 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:46.662703 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-223f7180-14dc-4738-8cf4-40261a4317b3 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:46.664266 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-223f7180-14dc-4738-8cf4-40261a4317b3 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:46.666492 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-223f7180-14dc-4738-8cf4-40261a4317b3 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:46.727862 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-27f58494-c913-4882-b65b-9ff0c465c705 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:46.728973 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-27f58494-c913-4882-b65b-9ff0c465c705 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:46.741411 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-27f58494-c913-4882-b65b-9ff0c465c705 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:46.746836 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-27f58494-c913-4882-b65b-9ff0c465c705 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:46.747588 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-27f58494-c913-4882-b65b-9ff0c465c705 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:46.749175 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-27f58494-c913-4882-b65b-9ff0c465c705 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:46.751748 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-27f58494-c913-4882-b65b-9ff0c465c705 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:46.759865 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-27f58494-c913-4882-b65b-9ff0c465c705 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:46.923545 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-223f7180-14dc-4738-8cf4-40261a4317b3 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:46.944325 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-223f7180-14dc-4738-8cf4-40261a4317b3 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1502 microversion: 2.1 time: 0.300918 Oct 11 06:42:46.952462 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 100/202] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:46 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1502 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:47.060486 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-27f58494-c913-4882-b65b-9ff0c465c705 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:47.075287 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-27f58494-c913-4882-b65b-9ff0c465c705 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1555 microversion: 2.1 time: 0.351979 Oct 11 06:42:47.076230 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 103/203] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:46 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1555 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:47.099391 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-eaca3175-1ff9-4c2f-a163-77dadf618e08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:47.100176 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-eaca3175-1ff9-4c2f-a163-77dadf618e08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:47.106826 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eaca3175-1ff9-4c2f-a163-77dadf618e08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:47.107686 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eaca3175-1ff9-4c2f-a163-77dadf618e08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:47.108396 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eaca3175-1ff9-4c2f-a163-77dadf618e08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:47.109602 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eaca3175-1ff9-4c2f-a163-77dadf618e08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:47.110349 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eaca3175-1ff9-4c2f-a163-77dadf618e08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:47.111673 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eaca3175-1ff9-4c2f-a163-77dadf618e08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:47.242032 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-eaca3175-1ff9-4c2f-a163-77dadf618e08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.146328 Oct 11 06:42:47.242930 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 101/204] 10.222.0.39 () {58 vars in 1275 bytes} [Tue Oct 11 06:42:47 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:42:47.305118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4efdbe8b-3b1b-48a4-946b-d0f472738e78 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:47.306144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4efdbe8b-3b1b-48a4-946b-d0f472738e78 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:47.321033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4efdbe8b-3b1b-48a4-946b-d0f472738e78 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:47.321918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4efdbe8b-3b1b-48a4-946b-d0f472738e78 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:47.322516 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4efdbe8b-3b1b-48a4-946b-d0f472738e78 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:47.323907 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4efdbe8b-3b1b-48a4-946b-d0f472738e78 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:47.324574 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4efdbe8b-3b1b-48a4-946b-d0f472738e78 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:47.325191 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4efdbe8b-3b1b-48a4-946b-d0f472738e78 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:47.587155 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4efdbe8b-3b1b-48a4-946b-d0f472738e78 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:47.594931 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4efdbe8b-3b1b-48a4-946b-d0f472738e78 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1322 microversion: 2.1 time: 0.294914 Oct 11 06:42:47.606025 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 104/205] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:47 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1322 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:48.512202 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-34cadd86-5152-46b7-984c-e8c613764f3b req-4a05ad18-6345-48b5-a118-b8c0e51514c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2ce136a-30ab-4986-931e-5af38b37875e", "tag": "3280a926-f599-464d-a89c-2446cca4d1a4"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:42:48.522264 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-34cadd86-5152-46b7-984c-e8c613764f3b req-4a05ad18-6345-48b5-a118-b8c0e51514c6 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:48.522741 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-34cadd86-5152-46b7-984c-e8c613764f3b req-4a05ad18-6345-48b5-a118-b8c0e51514c6 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:48.523167 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-34cadd86-5152-46b7-984c-e8c613764f3b req-4a05ad18-6345-48b5-a118-b8c0e51514c6 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:48.534583 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-34cadd86-5152-46b7-984c-e8c613764f3b req-4a05ad18-6345-48b5-a118-b8c0e51514c6 service nova] Creating event network-changed:3280a926-f599-464d-a89c-2446cca4d1a4 for instance a2ce136a-30ab-4986-931e-5af38b37875e on hv-cinder-85495 Oct 11 06:42:48.543778 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-34cadd86-5152-46b7-984c-e8c613764f3b req-4a05ad18-6345-48b5-a118-b8c0e51514c6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035059 Oct 11 06:42:48.544587 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 102/206] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:42:48.618738 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-adcf1706-cdc2-45a5-8841-d5e156eab88e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:48.619985 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-adcf1706-cdc2-45a5-8841-d5e156eab88e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:48.627285 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-adcf1706-cdc2-45a5-8841-d5e156eab88e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:48.628057 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-adcf1706-cdc2-45a5-8841-d5e156eab88e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:48.628666 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-adcf1706-cdc2-45a5-8841-d5e156eab88e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:48.629518 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-adcf1706-cdc2-45a5-8841-d5e156eab88e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:48.630275 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-adcf1706-cdc2-45a5-8841-d5e156eab88e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:48.631560 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-adcf1706-cdc2-45a5-8841-d5e156eab88e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:48.874277 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-adcf1706-cdc2-45a5-8841-d5e156eab88e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:48.882850 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-adcf1706-cdc2-45a5-8841-d5e156eab88e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1322 microversion: 2.1 time: 0.268617 Oct 11 06:42:48.883718 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 105/207] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:48 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1322 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:49.907565 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b788201f-a28c-4816-bb56-f659306fe35e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:49.908862 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b788201f-a28c-4816-bb56-f659306fe35e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:49.917761 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b788201f-a28c-4816-bb56-f659306fe35e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:49.918538 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b788201f-a28c-4816-bb56-f659306fe35e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:49.919177 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b788201f-a28c-4816-bb56-f659306fe35e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:49.920153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b788201f-a28c-4816-bb56-f659306fe35e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:49.920953 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b788201f-a28c-4816-bb56-f659306fe35e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:49.921603 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b788201f-a28c-4816-bb56-f659306fe35e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:50.076463 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b788201f-a28c-4816-bb56-f659306fe35e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:50.085663 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b788201f-a28c-4816-bb56-f659306fe35e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1322 microversion: 2.1 time: 0.182585 Oct 11 06:42:50.086823 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 103/208] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:49 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:50.689188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e54d2ebc-1c49-4eb6-9953-6e99bbc91602 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f4943ab-045e-4fe4-ac76-f15cd488ac51"}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:42:50.691795 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e54d2ebc-1c49-4eb6-9953-6e99bbc91602 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:50.698089 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e54d2ebc-1c49-4eb6-9953-6e99bbc91602 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:50.698561 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e54d2ebc-1c49-4eb6-9953-6e99bbc91602 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:50.698988 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e54d2ebc-1c49-4eb6-9953-6e99bbc91602 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:50.699969 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e54d2ebc-1c49-4eb6-9953-6e99bbc91602 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:50.700494 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e54d2ebc-1c49-4eb6-9953-6e99bbc91602 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:50.701116 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e54d2ebc-1c49-4eb6-9953-6e99bbc91602 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:51.120161 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3962843c-e7aa-4084-99ba-744fd165aafd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:51.120161 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3962843c-e7aa-4084-99ba-744fd165aafd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:51.131868 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3962843c-e7aa-4084-99ba-744fd165aafd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:51.132253 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3962843c-e7aa-4084-99ba-744fd165aafd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:51.133337 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3962843c-e7aa-4084-99ba-744fd165aafd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:51.134183 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3962843c-e7aa-4084-99ba-744fd165aafd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:51.134800 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3962843c-e7aa-4084-99ba-744fd165aafd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:51.135231 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3962843c-e7aa-4084-99ba-744fd165aafd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:51.315337 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3962843c-e7aa-4084-99ba-744fd165aafd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:51.325146 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3962843c-e7aa-4084-99ba-744fd165aafd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1322 microversion: 2.1 time: 0.215126 Oct 11 06:42:51.326234 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 104/209] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:51 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:42:51.372708 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:51.406395 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e54d2ebc-1c49-4eb6-9953-6e99bbc91602 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "POST /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.719763 Oct 11 06:42:51.406395 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 106/210] 10.222.0.39 () {60 vars in 1323 bytes} [Tue Oct 11 06:42:50 2022] POST /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3/os-volume_attachments => generated 194 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:42:52.350338 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c25936ee-a73e-4f5a-81cf-6e815d1c7d1a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:52.350962 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c25936ee-a73e-4f5a-81cf-6e815d1c7d1a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:52.356858 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c25936ee-a73e-4f5a-81cf-6e815d1c7d1a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:52.357332 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c25936ee-a73e-4f5a-81cf-6e815d1c7d1a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:52.357764 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c25936ee-a73e-4f5a-81cf-6e815d1c7d1a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:52.358448 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c25936ee-a73e-4f5a-81cf-6e815d1c7d1a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:52.358893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c25936ee-a73e-4f5a-81cf-6e815d1c7d1a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:52.359315 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c25936ee-a73e-4f5a-81cf-6e815d1c7d1a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:52.483967 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c25936ee-a73e-4f5a-81cf-6e815d1c7d1a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:52.491550 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c25936ee-a73e-4f5a-81cf-6e815d1c7d1a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1515 microversion: 2.1 time: 0.145440 Oct 11 06:42:52.492051 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 105/211] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:52 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1515 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:52.516174 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-adca37f6-8f46-4f0d-ab90-b331e1da860b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:42:52.519046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-adca37f6-8f46-4f0d-ab90-b331e1da860b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:52.525858 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-adca37f6-8f46-4f0d-ab90-b331e1da860b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:52.526374 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-adca37f6-8f46-4f0d-ab90-b331e1da860b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:52.526804 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-adca37f6-8f46-4f0d-ab90-b331e1da860b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:52.527616 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-adca37f6-8f46-4f0d-ab90-b331e1da860b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:52.528063 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-adca37f6-8f46-4f0d-ab90-b331e1da860b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:52.528481 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-adca37f6-8f46-4f0d-ab90-b331e1da860b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:52.560934 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.objects.instance [None req-adca37f6-8f46-4f0d-ab90-b331e1da860b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lazy-loading 'flavor' on Instance uuid 63ee206c-410a-4d60-89ab-e6d6319e64b6 {{(pid=125266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 06:42:52.616844 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3a9a3bed-1082-43b4-9729-ca4bc87bd53f tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-989066359", "imageRef": "2303551c-410e-4a2b-8eeb-dea686876901", "flavorRef": "452", "networks": [{"uuid": "ba1b0919-ff00-4aaa-90bf-c000e38c5340"}]}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:42:52.675186 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.network.neutron [None req-3a9a3bed-1082-43b4-9729-ca4bc87bd53f tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] validate_networks() for [('ba1b0919-ff00-4aaa-90bf-c000e38c5340', None, None, None, None, None)] {{(pid=125267) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 06:42:52.681393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-adca37f6-8f46-4f0d-ab90-b331e1da860b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "POST /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6/action" status: 200 len: 32 microversion: 2.1 time: 0.170291 Oct 11 06:42:52.682286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 107/212] 10.222.0.39 () {60 vars in 1278 bytes} [Tue Oct 11 06:42:52 2022] POST /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6/action => generated 32 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 06:42:52.691607 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-67c3c3d2-69b0-4395-9a5c-e75d60973e73 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:52.692304 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-67c3c3d2-69b0-4395-9a5c-e75d60973e73 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:52.699380 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67c3c3d2-69b0-4395-9a5c-e75d60973e73 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:52.699889 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67c3c3d2-69b0-4395-9a5c-e75d60973e73 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:52.700322 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67c3c3d2-69b0-4395-9a5c-e75d60973e73 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:52.701016 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67c3c3d2-69b0-4395-9a5c-e75d60973e73 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:52.701532 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67c3c3d2-69b0-4395-9a5c-e75d60973e73 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:52.701884 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67c3c3d2-69b0-4395-9a5c-e75d60973e73 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:52.830683 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-67c3c3d2-69b0-4395-9a5c-e75d60973e73 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:52.839704 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-67c3c3d2-69b0-4395-9a5c-e75d60973e73 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.151968 Oct 11 06:42:52.840283 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 108/213] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:52 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:42:53.028039 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-3a9a3bed-1082-43b4-9729-ca4bc87bd53f tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Flavor limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 06:42:53.028490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-3a9a3bed-1082-43b4-9729-ca4bc87bd53f tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Image limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 06:42:53.028963 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-3a9a3bed-1082-43b4-9729-ca4bc87bd53f tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Flavor pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 06:42:53.029371 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-3a9a3bed-1082-43b4-9729-ca4bc87bd53f tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Image pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 06:42:53.030046 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-3a9a3bed-1082-43b4-9729-ca4bc87bd53f tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 06:42:53.038684 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a9a3bed-1082-43b4-9729-ca4bc87bd53f tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:53.039158 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a9a3bed-1082-43b4-9729-ca4bc87bd53f tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:53.039636 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a9a3bed-1082-43b4-9729-ca4bc87bd53f tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:53.040364 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a9a3bed-1082-43b4-9729-ca4bc87bd53f tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:53.040834 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a9a3bed-1082-43b4-9729-ca4bc87bd53f tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:53.041241 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a9a3bed-1082-43b4-9729-ca4bc87bd53f tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:53.047955 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:53.058912 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-3a9a3bed-1082-43b4-9729-ca4bc87bd53f tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Getting quotas for project bc43c2d6c1364f23b21d203467adb5c5. Resources: {'cores', 'ram', 'instances'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 06:42:53.062859 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-3a9a3bed-1082-43b4-9729-ca4bc87bd53f tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Getting quotas for user 0a48c619ff834ca7942d9be275fe61ea and project bc43c2d6c1364f23b21d203467adb5c5. Resources: {'cores', 'ram', 'instances'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 06:42:53.074130 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3a9a3bed-1082-43b4-9729-ca4bc87bd53f tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Going to run 1 instances... {{(pid=125267) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 06:42:53.076448 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3a9a3bed-1082-43b4-9729-ca4bc87bd53f tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: db08ae39-c1c5-4ad9-b37a-e4315bc48e62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2303551c-410e-4a2b-8eeb-dea686876901',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 06:42:53.122965 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3a9a3bed-1082-43b4-9729-ca4bc87bd53f tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.510685 Oct 11 06:42:53.123641 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 106/214] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Oct 11 06:42:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 06:42:53.135244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cb66488a-4768-4502-813f-2be83f2e5051 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:53.136036 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cb66488a-4768-4502-813f-2be83f2e5051 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: db08ae39-c1c5-4ad9-b37a-e4315bc48e62] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:53.192260 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cb66488a-4768-4502-813f-2be83f2e5051 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:53.199858 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cb66488a-4768-4502-813f-2be83f2e5051 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62" status: 200 len: 1213 microversion: 2.1 time: 0.068564 Oct 11 06:42:53.200468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 109/215] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:53 2022] GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62 => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:42:53.861976 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7a0efd5c-9008-40be-82c2-8a9f26ea9e5c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:53.862586 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7a0efd5c-9008-40be-82c2-8a9f26ea9e5c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:53.869293 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7a0efd5c-9008-40be-82c2-8a9f26ea9e5c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:53.869739 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7a0efd5c-9008-40be-82c2-8a9f26ea9e5c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:53.875430 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7a0efd5c-9008-40be-82c2-8a9f26ea9e5c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:53.875430 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7a0efd5c-9008-40be-82c2-8a9f26ea9e5c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:53.875430 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7a0efd5c-9008-40be-82c2-8a9f26ea9e5c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:53.875430 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7a0efd5c-9008-40be-82c2-8a9f26ea9e5c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:54.003727 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7a0efd5c-9008-40be-82c2-8a9f26ea9e5c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:54.011361 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7a0efd5c-9008-40be-82c2-8a9f26ea9e5c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.153338 Oct 11 06:42:54.011940 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 107/216] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:53 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:54.222108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b01df109-c971-4a03-81d5-2cbf4bddf8f8 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:54.222611 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b01df109-c971-4a03-81d5-2cbf4bddf8f8 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: db08ae39-c1c5-4ad9-b37a-e4315bc48e62] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:54.230623 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b01df109-c971-4a03-81d5-2cbf4bddf8f8 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:54.231097 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b01df109-c971-4a03-81d5-2cbf4bddf8f8 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:54.231694 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b01df109-c971-4a03-81d5-2cbf4bddf8f8 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:54.232387 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b01df109-c971-4a03-81d5-2cbf4bddf8f8 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:54.232859 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b01df109-c971-4a03-81d5-2cbf4bddf8f8 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:54.233281 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b01df109-c971-4a03-81d5-2cbf4bddf8f8 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:54.293721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b01df109-c971-4a03-81d5-2cbf4bddf8f8 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:54.301136 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b01df109-c971-4a03-81d5-2cbf4bddf8f8 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62" status: 200 len: 1217 microversion: 2.1 time: 0.082984 Oct 11 06:42:54.301695 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 110/217] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:54 2022] GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:55.034135 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3c9c9361-633a-4dd9-a320-7d00bec4b2e2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:55.034745 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3c9c9361-633a-4dd9-a320-7d00bec4b2e2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:55.041421 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c9c9361-633a-4dd9-a320-7d00bec4b2e2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:55.041902 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c9c9361-633a-4dd9-a320-7d00bec4b2e2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:55.042328 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c9c9361-633a-4dd9-a320-7d00bec4b2e2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:55.043022 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c9c9361-633a-4dd9-a320-7d00bec4b2e2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:55.043501 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c9c9361-633a-4dd9-a320-7d00bec4b2e2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:55.043918 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c9c9361-633a-4dd9-a320-7d00bec4b2e2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:55.222257 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3c9c9361-633a-4dd9-a320-7d00bec4b2e2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:55.231238 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3c9c9361-633a-4dd9-a320-7d00bec4b2e2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.200929 Oct 11 06:42:55.231930 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 108/218] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:55 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:55.324034 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1183c0e3-8355-473d-b605-1dba7be2f050 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:55.324914 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1183c0e3-8355-473d-b605-1dba7be2f050 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: db08ae39-c1c5-4ad9-b37a-e4315bc48e62] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:55.331853 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1183c0e3-8355-473d-b605-1dba7be2f050 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:55.332400 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1183c0e3-8355-473d-b605-1dba7be2f050 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:55.332832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1183c0e3-8355-473d-b605-1dba7be2f050 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:55.333525 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1183c0e3-8355-473d-b605-1dba7be2f050 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:55.333999 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1183c0e3-8355-473d-b605-1dba7be2f050 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:55.334415 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1183c0e3-8355-473d-b605-1dba7be2f050 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:55.437284 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1183c0e3-8355-473d-b605-1dba7be2f050 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:55.444752 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1183c0e3-8355-473d-b605-1dba7be2f050 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62" status: 200 len: 1209 microversion: 2.1 time: 0.124650 Oct 11 06:42:55.445320 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 111/219] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:55 2022] GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62 => generated 1209 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:56.255436 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8a860a30-48e7-42ce-9d91-1c9e33f4513f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:56.256221 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8a860a30-48e7-42ce-9d91-1c9e33f4513f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:56.262662 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8a860a30-48e7-42ce-9d91-1c9e33f4513f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:56.263139 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8a860a30-48e7-42ce-9d91-1c9e33f4513f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:56.263610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8a860a30-48e7-42ce-9d91-1c9e33f4513f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:56.264288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8a860a30-48e7-42ce-9d91-1c9e33f4513f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:56.264735 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8a860a30-48e7-42ce-9d91-1c9e33f4513f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:56.265152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8a860a30-48e7-42ce-9d91-1c9e33f4513f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:56.402815 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8a860a30-48e7-42ce-9d91-1c9e33f4513f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:56.411100 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8a860a30-48e7-42ce-9d91-1c9e33f4513f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.159486 Oct 11 06:42:56.411709 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 109/220] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:56 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:56.470994 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5ae9b2fa-ce7a-4089-bba9-53d26ec6964a tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:56.471635 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5ae9b2fa-ce7a-4089-bba9-53d26ec6964a tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: db08ae39-c1c5-4ad9-b37a-e4315bc48e62] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:56.477939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ae9b2fa-ce7a-4089-bba9-53d26ec6964a tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:56.478413 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ae9b2fa-ce7a-4089-bba9-53d26ec6964a tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:56.478834 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ae9b2fa-ce7a-4089-bba9-53d26ec6964a tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:56.479539 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ae9b2fa-ce7a-4089-bba9-53d26ec6964a tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:56.479983 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ae9b2fa-ce7a-4089-bba9-53d26ec6964a tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:56.480395 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ae9b2fa-ce7a-4089-bba9-53d26ec6964a tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:56.544637 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5ae9b2fa-ce7a-4089-bba9-53d26ec6964a tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:56.552730 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5ae9b2fa-ce7a-4089-bba9-53d26ec6964a tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62" status: 200 len: 1265 microversion: 2.1 time: 0.086032 Oct 11 06:42:56.553931 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 112/221] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:56 2022] GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62 => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:57.433961 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c969eb41-b3fe-4a81-b24e-f99847415885 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:57.435321 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c969eb41-b3fe-4a81-b24e-f99847415885 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:57.441981 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c969eb41-b3fe-4a81-b24e-f99847415885 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:57.442464 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c969eb41-b3fe-4a81-b24e-f99847415885 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:57.442887 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c969eb41-b3fe-4a81-b24e-f99847415885 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:57.444121 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c969eb41-b3fe-4a81-b24e-f99847415885 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:57.444564 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c969eb41-b3fe-4a81-b24e-f99847415885 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:57.444979 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c969eb41-b3fe-4a81-b24e-f99847415885 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:57.575936 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-aa133257-e8d7-4a11-910e-24a1904a5ca6 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:57.576545 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-aa133257-e8d7-4a11-910e-24a1904a5ca6 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: db08ae39-c1c5-4ad9-b37a-e4315bc48e62] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:57.582995 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aa133257-e8d7-4a11-910e-24a1904a5ca6 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:57.583381 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aa133257-e8d7-4a11-910e-24a1904a5ca6 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:57.583844 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aa133257-e8d7-4a11-910e-24a1904a5ca6 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:57.585085 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aa133257-e8d7-4a11-910e-24a1904a5ca6 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:57.585532 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aa133257-e8d7-4a11-910e-24a1904a5ca6 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:57.585952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aa133257-e8d7-4a11-910e-24a1904a5ca6 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:57.630072 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c969eb41-b3fe-4a81-b24e-f99847415885 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:57.640140 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c969eb41-b3fe-4a81-b24e-f99847415885 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.209680 Oct 11 06:42:57.640969 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 110/222] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:57 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:57.655490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-aa133257-e8d7-4a11-910e-24a1904a5ca6 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:57.666901 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-aa133257-e8d7-4a11-910e-24a1904a5ca6 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62" status: 200 len: 1265 microversion: 2.1 time: 0.094563 Oct 11 06:42:57.667827 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 113/223] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:57 2022] GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62 => generated 1265 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:42:58.664616 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8eb707c1-0d13-41c5-9987-e19d18e63e28 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:58.665228 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8eb707c1-0d13-41c5-9987-e19d18e63e28 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:58.671044 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8eb707c1-0d13-41c5-9987-e19d18e63e28 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:58.671555 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8eb707c1-0d13-41c5-9987-e19d18e63e28 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:58.671987 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8eb707c1-0d13-41c5-9987-e19d18e63e28 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:58.672672 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8eb707c1-0d13-41c5-9987-e19d18e63e28 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:58.673127 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8eb707c1-0d13-41c5-9987-e19d18e63e28 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:58.673543 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8eb707c1-0d13-41c5-9987-e19d18e63e28 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:58.689787 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-23df476e-c161-42f5-8f6f-0c43d46e0e18 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:58.690922 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-23df476e-c161-42f5-8f6f-0c43d46e0e18 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: db08ae39-c1c5-4ad9-b37a-e4315bc48e62] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:58.698390 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-23df476e-c161-42f5-8f6f-0c43d46e0e18 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:58.699056 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-23df476e-c161-42f5-8f6f-0c43d46e0e18 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:58.699661 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-23df476e-c161-42f5-8f6f-0c43d46e0e18 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:58.700537 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-23df476e-c161-42f5-8f6f-0c43d46e0e18 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:58.700974 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-23df476e-c161-42f5-8f6f-0c43d46e0e18 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:58.701547 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-23df476e-c161-42f5-8f6f-0c43d46e0e18 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:58.780083 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-23df476e-c161-42f5-8f6f-0c43d46e0e18 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:58.788567 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-23df476e-c161-42f5-8f6f-0c43d46e0e18 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62" status: 200 len: 1265 microversion: 2.1 time: 0.102398 Oct 11 06:42:58.789211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 114/224] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:58 2022] GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62 => generated 1265 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:42:58.813755 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8eb707c1-0d13-41c5-9987-e19d18e63e28 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:58.821596 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8eb707c1-0d13-41c5-9987-e19d18e63e28 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.160838 Oct 11 06:42:58.822155 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 111/225] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:58 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:59.811725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fb2e04b7-8a2a-4f1b-9a28-a4b234ea7674 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:59.812327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fb2e04b7-8a2a-4f1b-9a28-a4b234ea7674 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: db08ae39-c1c5-4ad9-b37a-e4315bc48e62] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:59.818746 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fb2e04b7-8a2a-4f1b-9a28-a4b234ea7674 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:59.819221 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fb2e04b7-8a2a-4f1b-9a28-a4b234ea7674 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:59.819669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fb2e04b7-8a2a-4f1b-9a28-a4b234ea7674 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:59.820342 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fb2e04b7-8a2a-4f1b-9a28-a4b234ea7674 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:59.820782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fb2e04b7-8a2a-4f1b-9a28-a4b234ea7674 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:59.821194 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fb2e04b7-8a2a-4f1b-9a28-a4b234ea7674 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:59.844589 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c97f8eb8-783b-4577-918f-b0ea5a0d0271 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:42:59.845181 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c97f8eb8-783b-4577-918f-b0ea5a0d0271 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:42:59.851690 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c97f8eb8-783b-4577-918f-b0ea5a0d0271 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:59.852169 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c97f8eb8-783b-4577-918f-b0ea5a0d0271 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:59.852598 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c97f8eb8-783b-4577-918f-b0ea5a0d0271 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:59.853290 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c97f8eb8-783b-4577-918f-b0ea5a0d0271 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:42:59.853738 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c97f8eb8-783b-4577-918f-b0ea5a0d0271 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:42:59.854155 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c97f8eb8-783b-4577-918f-b0ea5a0d0271 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:42:59.884659 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fb2e04b7-8a2a-4f1b-9a28-a4b234ea7674 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:42:59.892579 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fb2e04b7-8a2a-4f1b-9a28-a4b234ea7674 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62" status: 200 len: 1283 microversion: 2.1 time: 0.084746 Oct 11 06:42:59.893138 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 115/226] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:59 2022] GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62 => generated 1283 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:42:59.990206 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c97f8eb8-783b-4577-918f-b0ea5a0d0271 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:00.000535 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c97f8eb8-783b-4577-918f-b0ea5a0d0271 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.159618 Oct 11 06:43:00.015330 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 112/227] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:42:59 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:43:00.916967 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1192f56a-93f8-4b9b-8817-b95dc27b3f30 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:00.917668 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1192f56a-93f8-4b9b-8817-b95dc27b3f30 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: db08ae39-c1c5-4ad9-b37a-e4315bc48e62] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:00.923944 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1192f56a-93f8-4b9b-8817-b95dc27b3f30 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:00.924412 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1192f56a-93f8-4b9b-8817-b95dc27b3f30 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:00.924834 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1192f56a-93f8-4b9b-8817-b95dc27b3f30 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:00.925514 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1192f56a-93f8-4b9b-8817-b95dc27b3f30 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:00.925969 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1192f56a-93f8-4b9b-8817-b95dc27b3f30 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:00.926364 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1192f56a-93f8-4b9b-8817-b95dc27b3f30 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:01.026393 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c2625178-1e1a-48e1-819b-852d45b72aa9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:01.027233 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c2625178-1e1a-48e1-819b-852d45b72aa9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:01.033501 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c2625178-1e1a-48e1-819b-852d45b72aa9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:01.033982 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c2625178-1e1a-48e1-819b-852d45b72aa9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:01.034449 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c2625178-1e1a-48e1-819b-852d45b72aa9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:01.035142 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c2625178-1e1a-48e1-819b-852d45b72aa9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:01.035620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c2625178-1e1a-48e1-819b-852d45b72aa9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:01.036043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c2625178-1e1a-48e1-819b-852d45b72aa9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:01.153411 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1192f56a-93f8-4b9b-8817-b95dc27b3f30 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:01.163371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1192f56a-93f8-4b9b-8817-b95dc27b3f30 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62" status: 200 len: 1313 microversion: 2.1 time: 0.250924 Oct 11 06:43:01.163996 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 116/228] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:00 2022] GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62 => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:01.175605 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c2625178-1e1a-48e1-819b-852d45b72aa9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:01.184754 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c2625178-1e1a-48e1-819b-852d45b72aa9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.162586 Oct 11 06:43:01.185329 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 113/229] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:01 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:01.622759 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-2f234e48-f123-4648-8d3d-0ea6884bed66 req-484a63c2-25a8-4089-a62d-185191e9b5ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db08ae39-c1c5-4ad9-b37a-e4315bc48e62", "tag": "a36635cf-c709-48b6-b73f-9404b6e651af"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:43:01.637674 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-2f234e48-f123-4648-8d3d-0ea6884bed66 req-484a63c2-25a8-4089-a62d-185191e9b5ec service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:01.638103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-2f234e48-f123-4648-8d3d-0ea6884bed66 req-484a63c2-25a8-4089-a62d-185191e9b5ec service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:01.638583 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-2f234e48-f123-4648-8d3d-0ea6884bed66 req-484a63c2-25a8-4089-a62d-185191e9b5ec service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:01.654080 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-2f234e48-f123-4648-8d3d-0ea6884bed66 req-484a63c2-25a8-4089-a62d-185191e9b5ec service nova] Creating event network-changed:a36635cf-c709-48b6-b73f-9404b6e651af for instance db08ae39-c1c5-4ad9-b37a-e4315bc48e62 on hv-cinder-85495 Oct 11 06:43:01.659788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-2f234e48-f123-4648-8d3d-0ea6884bed66 req-484a63c2-25a8-4089-a62d-185191e9b5ec service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042903 Oct 11 06:43:01.661003 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 117/230] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:43:02.188014 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-03f8ba9c-519d-4577-a792-87e188a6fd20 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:02.188583 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-03f8ba9c-519d-4577-a792-87e188a6fd20 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: db08ae39-c1c5-4ad9-b37a-e4315bc48e62] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:02.196971 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-03f8ba9c-519d-4577-a792-87e188a6fd20 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:02.197450 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-03f8ba9c-519d-4577-a792-87e188a6fd20 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:02.197879 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-03f8ba9c-519d-4577-a792-87e188a6fd20 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:02.198572 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-03f8ba9c-519d-4577-a792-87e188a6fd20 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:02.199019 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-03f8ba9c-519d-4577-a792-87e188a6fd20 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:02.199452 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-03f8ba9c-519d-4577-a792-87e188a6fd20 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:02.209035 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9ed90ff5-93c2-4118-919b-d3fb835a1720 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:02.209972 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9ed90ff5-93c2-4118-919b-d3fb835a1720 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:02.216156 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9ed90ff5-93c2-4118-919b-d3fb835a1720 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:02.216637 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9ed90ff5-93c2-4118-919b-d3fb835a1720 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:02.217069 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9ed90ff5-93c2-4118-919b-d3fb835a1720 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:02.217768 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9ed90ff5-93c2-4118-919b-d3fb835a1720 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:02.218228 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9ed90ff5-93c2-4118-919b-d3fb835a1720 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:02.218641 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9ed90ff5-93c2-4118-919b-d3fb835a1720 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:02.328800 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-03f8ba9c-519d-4577-a792-87e188a6fd20 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:02.336535 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-03f8ba9c-519d-4577-a792-87e188a6fd20 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62" status: 200 len: 1313 microversion: 2.1 time: 0.152404 Oct 11 06:43:02.337100 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 114/231] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:02 2022] GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:02.354248 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9ed90ff5-93c2-4118-919b-d3fb835a1720 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:02.361823 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9ed90ff5-93c2-4118-919b-d3fb835a1720 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.157463 Oct 11 06:43:02.362381 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 118/232] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:02 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:43:03.359575 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f536e7dc-aa10-4e83-b345-0fecb41ac496 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:03.360021 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f536e7dc-aa10-4e83-b345-0fecb41ac496 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: db08ae39-c1c5-4ad9-b37a-e4315bc48e62] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:03.361704 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=2 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:03.362385 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=6 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:03.368827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f536e7dc-aa10-4e83-b345-0fecb41ac496 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:03.369299 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f536e7dc-aa10-4e83-b345-0fecb41ac496 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:03.369719 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f536e7dc-aa10-4e83-b345-0fecb41ac496 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:03.370407 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f536e7dc-aa10-4e83-b345-0fecb41ac496 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:03.370845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f536e7dc-aa10-4e83-b345-0fecb41ac496 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:03.371253 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f536e7dc-aa10-4e83-b345-0fecb41ac496 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:03.399651 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d8a14167-665c-4cd1-813f-92889af170ae tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:03.399651 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d8a14167-665c-4cd1-813f-92889af170ae tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:03.399651 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:03.399651 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=83 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:03.399651 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8a14167-665c-4cd1-813f-92889af170ae tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:03.400396 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8a14167-665c-4cd1-813f-92889af170ae tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:03.400396 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8a14167-665c-4cd1-813f-92889af170ae tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:03.400396 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8a14167-665c-4cd1-813f-92889af170ae tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:03.400396 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8a14167-665c-4cd1-813f-92889af170ae tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:03.400714 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8a14167-665c-4cd1-813f-92889af170ae tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:03.535820 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f536e7dc-aa10-4e83-b345-0fecb41ac496 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:03.544305 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f536e7dc-aa10-4e83-b345-0fecb41ac496 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62" status: 200 len: 1313 microversion: 2.1 time: 0.189101 Oct 11 06:43:03.544883 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 115/233] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:03 2022] GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62 => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:03.558679 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d8a14167-665c-4cd1-813f-92889af170ae tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:03.567164 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d8a14167-665c-4cd1-813f-92889af170ae tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.185139 Oct 11 06:43:03.567984 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 119/234] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:03 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:43:04.566969 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ce0f0f1d-860f-4729-b773-0b258da7bd8b tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:04.567599 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ce0f0f1d-860f-4729-b773-0b258da7bd8b tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: db08ae39-c1c5-4ad9-b37a-e4315bc48e62] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:04.574136 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ce0f0f1d-860f-4729-b773-0b258da7bd8b tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:04.574605 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ce0f0f1d-860f-4729-b773-0b258da7bd8b tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:04.575030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ce0f0f1d-860f-4729-b773-0b258da7bd8b tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:04.575809 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ce0f0f1d-860f-4729-b773-0b258da7bd8b tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:04.576257 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ce0f0f1d-860f-4729-b773-0b258da7bd8b tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:04.576673 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ce0f0f1d-860f-4729-b773-0b258da7bd8b tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:04.590704 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a25eb214-7bb8-4544-8102-671591289ae6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:04.591481 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a25eb214-7bb8-4544-8102-671591289ae6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:04.599410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a25eb214-7bb8-4544-8102-671591289ae6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:04.600113 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a25eb214-7bb8-4544-8102-671591289ae6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:04.600639 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a25eb214-7bb8-4544-8102-671591289ae6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:04.601600 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a25eb214-7bb8-4544-8102-671591289ae6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:04.602151 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a25eb214-7bb8-4544-8102-671591289ae6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:04.602688 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a25eb214-7bb8-4544-8102-671591289ae6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:04.710215 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ce0f0f1d-860f-4729-b773-0b258da7bd8b tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:04.718061 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ce0f0f1d-860f-4729-b773-0b258da7bd8b tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62" status: 200 len: 1313 microversion: 2.1 time: 0.154896 Oct 11 06:43:04.718812 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 116/235] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:04 2022] GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:04.740058 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a25eb214-7bb8-4544-8102-671591289ae6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:04.748114 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a25eb214-7bb8-4544-8102-671591289ae6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.161605 Oct 11 06:43:04.748669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 120/236] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:04 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:05.740476 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1399dbfc-5062-496e-9d1a-4a8928e485fa tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:05.741105 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1399dbfc-5062-496e-9d1a-4a8928e485fa tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: db08ae39-c1c5-4ad9-b37a-e4315bc48e62] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:05.747073 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1399dbfc-5062-496e-9d1a-4a8928e485fa tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:05.747568 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1399dbfc-5062-496e-9d1a-4a8928e485fa tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:05.747990 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1399dbfc-5062-496e-9d1a-4a8928e485fa tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:05.748662 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1399dbfc-5062-496e-9d1a-4a8928e485fa tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:05.749102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1399dbfc-5062-496e-9d1a-4a8928e485fa tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:05.749513 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1399dbfc-5062-496e-9d1a-4a8928e485fa tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:05.770536 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7c63e33a-df05-4884-9698-2eeff15b6f08 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:05.771342 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7c63e33a-df05-4884-9698-2eeff15b6f08 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:05.778434 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7c63e33a-df05-4884-9698-2eeff15b6f08 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:05.778916 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7c63e33a-df05-4884-9698-2eeff15b6f08 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:05.779351 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7c63e33a-df05-4884-9698-2eeff15b6f08 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:05.780333 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7c63e33a-df05-4884-9698-2eeff15b6f08 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:05.780787 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7c63e33a-df05-4884-9698-2eeff15b6f08 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:05.781358 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7c63e33a-df05-4884-9698-2eeff15b6f08 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:05.880358 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1399dbfc-5062-496e-9d1a-4a8928e485fa tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:05.888617 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1399dbfc-5062-496e-9d1a-4a8928e485fa tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62" status: 200 len: 1313 microversion: 2.1 time: 0.151900 Oct 11 06:43:05.889190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 117/237] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:05 2022] GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:05.912172 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7c63e33a-df05-4884-9698-2eeff15b6f08 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:05.919750 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7c63e33a-df05-4884-9698-2eeff15b6f08 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.152923 Oct 11 06:43:05.920253 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 121/238] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:05 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:43:06.911298 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7f926e8d-5804-47e0-a1cf-f3adcaa9c723 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:06.911929 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7f926e8d-5804-47e0-a1cf-f3adcaa9c723 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: db08ae39-c1c5-4ad9-b37a-e4315bc48e62] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:06.918453 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7f926e8d-5804-47e0-a1cf-f3adcaa9c723 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:06.918932 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7f926e8d-5804-47e0-a1cf-f3adcaa9c723 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:06.919362 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7f926e8d-5804-47e0-a1cf-f3adcaa9c723 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:06.920068 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7f926e8d-5804-47e0-a1cf-f3adcaa9c723 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:06.920514 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7f926e8d-5804-47e0-a1cf-f3adcaa9c723 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:06.920927 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7f926e8d-5804-47e0-a1cf-f3adcaa9c723 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:06.942463 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-885a3a75-076e-4a00-959c-f5c19e70145b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:06.943070 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-885a3a75-076e-4a00-959c-f5c19e70145b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:06.951471 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-885a3a75-076e-4a00-959c-f5c19e70145b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:06.951964 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-885a3a75-076e-4a00-959c-f5c19e70145b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:06.952397 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-885a3a75-076e-4a00-959c-f5c19e70145b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:06.953094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-885a3a75-076e-4a00-959c-f5c19e70145b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:06.953550 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-885a3a75-076e-4a00-959c-f5c19e70145b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:06.953969 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-885a3a75-076e-4a00-959c-f5c19e70145b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:07.051433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7f926e8d-5804-47e0-a1cf-f3adcaa9c723 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:07.059227 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7f926e8d-5804-47e0-a1cf-f3adcaa9c723 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62" status: 200 len: 1313 microversion: 2.1 time: 0.151711 Oct 11 06:43:07.059849 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 118/239] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:06 2022] GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:07.099235 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-885a3a75-076e-4a00-959c-f5c19e70145b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:07.103066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:07.109416 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-885a3a75-076e-4a00-959c-f5c19e70145b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.171195 Oct 11 06:43:07.110252 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 122/240] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:06 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:43:08.083135 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1f019237-378a-49d4-bf7d-329ffb556079 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:08.083852 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1f019237-378a-49d4-bf7d-329ffb556079 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: db08ae39-c1c5-4ad9-b37a-e4315bc48e62] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:08.086979 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:08.093097 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1f019237-378a-49d4-bf7d-329ffb556079 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:08.093694 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1f019237-378a-49d4-bf7d-329ffb556079 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:08.094241 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1f019237-378a-49d4-bf7d-329ffb556079 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:08.094973 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1f019237-378a-49d4-bf7d-329ffb556079 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:08.095561 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1f019237-378a-49d4-bf7d-329ffb556079 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:08.096013 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1f019237-378a-49d4-bf7d-329ffb556079 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:08.138366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-be63767e-0e80-40b0-a78a-55dc9344f89e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:08.139098 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-be63767e-0e80-40b0-a78a-55dc9344f89e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:08.148791 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-be63767e-0e80-40b0-a78a-55dc9344f89e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:08.149401 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-be63767e-0e80-40b0-a78a-55dc9344f89e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:08.149848 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-be63767e-0e80-40b0-a78a-55dc9344f89e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:08.150573 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-be63767e-0e80-40b0-a78a-55dc9344f89e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:08.151062 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-be63767e-0e80-40b0-a78a-55dc9344f89e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:08.151507 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-be63767e-0e80-40b0-a78a-55dc9344f89e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:08.227718 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1f019237-378a-49d4-bf7d-329ffb556079 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:08.235995 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1f019237-378a-49d4-bf7d-329ffb556079 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62" status: 200 len: 1313 microversion: 2.1 time: 0.157317 Oct 11 06:43:08.236663 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 119/241] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:08 2022] GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:08.289060 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-be63767e-0e80-40b0-a78a-55dc9344f89e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:08.296978 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-be63767e-0e80-40b0-a78a-55dc9344f89e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.164076 Oct 11 06:43:08.297538 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 123/242] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:08 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:43:09.262608 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-39eef9fd-bf88-4f25-a43f-ef77268a7dc7 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:09.264046 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-39eef9fd-bf88-4f25-a43f-ef77268a7dc7 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: db08ae39-c1c5-4ad9-b37a-e4315bc48e62] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:09.273039 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-39eef9fd-bf88-4f25-a43f-ef77268a7dc7 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:09.274303 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-39eef9fd-bf88-4f25-a43f-ef77268a7dc7 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:09.274944 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-39eef9fd-bf88-4f25-a43f-ef77268a7dc7 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:09.276456 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-39eef9fd-bf88-4f25-a43f-ef77268a7dc7 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:09.285130 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-39eef9fd-bf88-4f25-a43f-ef77268a7dc7 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:09.286435 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-39eef9fd-bf88-4f25-a43f-ef77268a7dc7 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:09.326794 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9df333f2-1fc3-4a23-9f14-24f6771083ba tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:09.328197 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9df333f2-1fc3-4a23-9f14-24f6771083ba tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:09.336247 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9df333f2-1fc3-4a23-9f14-24f6771083ba tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:09.336792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9df333f2-1fc3-4a23-9f14-24f6771083ba tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:09.337233 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9df333f2-1fc3-4a23-9f14-24f6771083ba tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:09.349773 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9df333f2-1fc3-4a23-9f14-24f6771083ba tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:09.350401 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9df333f2-1fc3-4a23-9f14-24f6771083ba tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:09.350841 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9df333f2-1fc3-4a23-9f14-24f6771083ba tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:09.575726 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-39eef9fd-bf88-4f25-a43f-ef77268a7dc7 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:09.587882 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-39eef9fd-bf88-4f25-a43f-ef77268a7dc7 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62" status: 200 len: 1313 microversion: 2.1 time: 0.329617 Oct 11 06:43:09.588417 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 120/243] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:09 2022] GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62 => generated 1313 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:09.610066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9df333f2-1fc3-4a23-9f14-24f6771083ba tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:09.620121 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-70e1f8b2-b110-4fd4-99c8-bd92c31635b9 req-933477cd-665e-40e6-8a12-bf9b4902f017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db08ae39-c1c5-4ad9-b37a-e4315bc48e62", "name": "network-vif-plugged", "status": "completed", "tag": "a36635cf-c709-48b6-b73f-9404b6e651af"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:43:09.620307 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9df333f2-1fc3-4a23-9f14-24f6771083ba tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.300289 Oct 11 06:43:09.621133 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 124/244] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:09 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:09.636691 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-70e1f8b2-b110-4fd4-99c8-bd92c31635b9 req-933477cd-665e-40e6-8a12-bf9b4902f017 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:09.637445 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-70e1f8b2-b110-4fd4-99c8-bd92c31635b9 req-933477cd-665e-40e6-8a12-bf9b4902f017 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:09.638099 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-70e1f8b2-b110-4fd4-99c8-bd92c31635b9 req-933477cd-665e-40e6-8a12-bf9b4902f017 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:09.652215 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-70e1f8b2-b110-4fd4-99c8-bd92c31635b9 req-933477cd-665e-40e6-8a12-bf9b4902f017 service nova] Creating event network-vif-plugged:a36635cf-c709-48b6-b73f-9404b6e651af for instance db08ae39-c1c5-4ad9-b37a-e4315bc48e62 on hv-cinder-85495 Oct 11 06:43:09.658522 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-70e1f8b2-b110-4fd4-99c8-bd92c31635b9 req-933477cd-665e-40e6-8a12-bf9b4902f017 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042518 Oct 11 06:43:09.659660 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 121/245] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:43:09.663760 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-23282e1b-1ced-4779-abf3-5685db914fcf tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:09.664152 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-23282e1b-1ced-4779-abf3-5685db914fcf tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:09.671399 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-23282e1b-1ced-4779-abf3-5685db914fcf tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:09.671966 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-23282e1b-1ced-4779-abf3-5685db914fcf tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:09.672415 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-23282e1b-1ced-4779-abf3-5685db914fcf tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:09.673092 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-23282e1b-1ced-4779-abf3-5685db914fcf tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:09.674008 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-23282e1b-1ced-4779-abf3-5685db914fcf tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:09.674431 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-23282e1b-1ced-4779-abf3-5685db914fcf tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:09.706459 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-23282e1b-1ced-4779-abf3-5685db914fcf tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Going to try to terminate instance {{(pid=125266) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 06:43:09.795454 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-23282e1b-1ced-4779-abf3-5685db914fcf tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "DELETE /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 204 len: 0 microversion: 2.1 time: 0.135295 Oct 11 06:43:09.796205 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 125/246] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Oct 11 06:43:09 2022] DELETE /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 06:43:09.807616 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-872383b3-db0d-41e2-9be2-d5b03e45f85a tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:09.808627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-872383b3-db0d-41e2-9be2-d5b03e45f85a tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:09.816984 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-872383b3-db0d-41e2-9be2-d5b03e45f85a tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:09.817473 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-872383b3-db0d-41e2-9be2-d5b03e45f85a tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:09.817905 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-872383b3-db0d-41e2-9be2-d5b03e45f85a tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:09.819163 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-872383b3-db0d-41e2-9be2-d5b03e45f85a tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:09.819700 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-872383b3-db0d-41e2-9be2-d5b03e45f85a tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:09.820168 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-872383b3-db0d-41e2-9be2-d5b03e45f85a tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:09.961031 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-872383b3-db0d-41e2-9be2-d5b03e45f85a tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:09.969574 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-872383b3-db0d-41e2-9be2-d5b03e45f85a tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1554 microversion: 2.1 time: 0.168765 Oct 11 06:43:09.970191 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 122/247] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:09 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:10.614071 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-98205e4d-9b1c-4065-a40f-bbd6bef4dd23 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:10.614776 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-98205e4d-9b1c-4065-a40f-bbd6bef4dd23 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: db08ae39-c1c5-4ad9-b37a-e4315bc48e62] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:10.630607 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-98205e4d-9b1c-4065-a40f-bbd6bef4dd23 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:10.631074 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-98205e4d-9b1c-4065-a40f-bbd6bef4dd23 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:10.631503 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-98205e4d-9b1c-4065-a40f-bbd6bef4dd23 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:10.632212 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-98205e4d-9b1c-4065-a40f-bbd6bef4dd23 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:10.632795 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-98205e4d-9b1c-4065-a40f-bbd6bef4dd23 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:10.633217 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-98205e4d-9b1c-4065-a40f-bbd6bef4dd23 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:10.646721 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d34fa3f1-0311-44ed-9821-85119ce5e814 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:10.647859 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d34fa3f1-0311-44ed-9821-85119ce5e814 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:10.654202 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d34fa3f1-0311-44ed-9821-85119ce5e814 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:10.655246 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d34fa3f1-0311-44ed-9821-85119ce5e814 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:10.655818 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d34fa3f1-0311-44ed-9821-85119ce5e814 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:10.656625 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d34fa3f1-0311-44ed-9821-85119ce5e814 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:10.657180 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d34fa3f1-0311-44ed-9821-85119ce5e814 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:10.658182 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d34fa3f1-0311-44ed-9821-85119ce5e814 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:10.801506 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-98205e4d-9b1c-4065-a40f-bbd6bef4dd23 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:10.811278 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d34fa3f1-0311-44ed-9821-85119ce5e814 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:10.811863 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-98205e4d-9b1c-4065-a40f-bbd6bef4dd23 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62" status: 200 len: 1313 microversion: 2.1 time: 0.201672 Oct 11 06:43:10.812978 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 126/248] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:10 2022] GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62 => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:10.820226 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d34fa3f1-0311-44ed-9821-85119ce5e814 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.177870 Oct 11 06:43:10.821124 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 123/249] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:10 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:43:10.993788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b82d1418-f17f-45bc-9675-751e43bd12fd tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:10.994720 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b82d1418-f17f-45bc-9675-751e43bd12fd tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:11.001817 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b82d1418-f17f-45bc-9675-751e43bd12fd tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:11.002551 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b82d1418-f17f-45bc-9675-751e43bd12fd tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:11.003171 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b82d1418-f17f-45bc-9675-751e43bd12fd tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:11.004078 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b82d1418-f17f-45bc-9675-751e43bd12fd tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:11.004564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b82d1418-f17f-45bc-9675-751e43bd12fd tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:11.004942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b82d1418-f17f-45bc-9675-751e43bd12fd tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:11.137791 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b82d1418-f17f-45bc-9675-751e43bd12fd tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:11.145795 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b82d1418-f17f-45bc-9675-751e43bd12fd tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1554 microversion: 2.1 time: 0.157172 Oct 11 06:43:11.147200 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 127/250] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:10 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:11.838328 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c268bfb5-3e96-4b4e-8cc7-bc3f06c95ef4 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:11.838880 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c268bfb5-3e96-4b4e-8cc7-bc3f06c95ef4 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: db08ae39-c1c5-4ad9-b37a-e4315bc48e62] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:11.846714 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-82cce704-f0ad-4d03-92f6-9b242792dcc9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:11.847273 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-82cce704-f0ad-4d03-92f6-9b242792dcc9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:11.848237 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c268bfb5-3e96-4b4e-8cc7-bc3f06c95ef4 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:11.850622 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c268bfb5-3e96-4b4e-8cc7-bc3f06c95ef4 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:11.851278 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c268bfb5-3e96-4b4e-8cc7-bc3f06c95ef4 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:11.852273 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c268bfb5-3e96-4b4e-8cc7-bc3f06c95ef4 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:11.854545 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-82cce704-f0ad-4d03-92f6-9b242792dcc9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:11.854762 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c268bfb5-3e96-4b4e-8cc7-bc3f06c95ef4 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:11.855120 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-82cce704-f0ad-4d03-92f6-9b242792dcc9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:11.855249 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c268bfb5-3e96-4b4e-8cc7-bc3f06c95ef4 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:11.855719 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-82cce704-f0ad-4d03-92f6-9b242792dcc9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:11.856967 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-82cce704-f0ad-4d03-92f6-9b242792dcc9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:11.857435 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-82cce704-f0ad-4d03-92f6-9b242792dcc9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:11.858001 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-82cce704-f0ad-4d03-92f6-9b242792dcc9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:11.863826 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:11.999211 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c268bfb5-3e96-4b4e-8cc7-bc3f06c95ef4 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:12.008466 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c268bfb5-3e96-4b4e-8cc7-bc3f06c95ef4 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62" status: 200 len: 1313 microversion: 2.1 time: 0.174873 Oct 11 06:43:12.009611 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 124/251] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:11 2022] GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:12.024645 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-82cce704-f0ad-4d03-92f6-9b242792dcc9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:12.035054 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-82cce704-f0ad-4d03-92f6-9b242792dcc9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.194064 Oct 11 06:43:12.036288 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 128/252] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:11 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:43:12.171103 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5c33bb61-ae3e-4783-8e2b-3d28fe7ea753 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:12.171823 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5c33bb61-ae3e-4783-8e2b-3d28fe7ea753 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:12.179340 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5c33bb61-ae3e-4783-8e2b-3d28fe7ea753 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:12.179951 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5c33bb61-ae3e-4783-8e2b-3d28fe7ea753 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:12.180611 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5c33bb61-ae3e-4783-8e2b-3d28fe7ea753 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:12.181383 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5c33bb61-ae3e-4783-8e2b-3d28fe7ea753 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:12.181908 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5c33bb61-ae3e-4783-8e2b-3d28fe7ea753 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:12.182895 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5c33bb61-ae3e-4783-8e2b-3d28fe7ea753 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:12.326918 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5c33bb61-ae3e-4783-8e2b-3d28fe7ea753 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:12.340721 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5c33bb61-ae3e-4783-8e2b-3d28fe7ea753 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1554 microversion: 2.1 time: 0.174706 Oct 11 06:43:12.342328 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 125/253] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:12 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:13.033416 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a6cd43d5-5dec-4769-aebb-16f7b27c8a25 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:13.034264 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a6cd43d5-5dec-4769-aebb-16f7b27c8a25 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: db08ae39-c1c5-4ad9-b37a-e4315bc48e62] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:13.041850 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6cd43d5-5dec-4769-aebb-16f7b27c8a25 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:13.042571 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6cd43d5-5dec-4769-aebb-16f7b27c8a25 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:13.043192 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6cd43d5-5dec-4769-aebb-16f7b27c8a25 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:13.044099 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6cd43d5-5dec-4769-aebb-16f7b27c8a25 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:13.044548 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6cd43d5-5dec-4769-aebb-16f7b27c8a25 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:13.044968 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6cd43d5-5dec-4769-aebb-16f7b27c8a25 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:13.061875 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ce4a8255-9301-4693-b6b9-5a69127db450 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:13.062541 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ce4a8255-9301-4693-b6b9-5a69127db450 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:13.068635 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ce4a8255-9301-4693-b6b9-5a69127db450 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:13.069614 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ce4a8255-9301-4693-b6b9-5a69127db450 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:13.070037 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ce4a8255-9301-4693-b6b9-5a69127db450 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:13.070725 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ce4a8255-9301-4693-b6b9-5a69127db450 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:13.071163 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ce4a8255-9301-4693-b6b9-5a69127db450 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:13.071788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ce4a8255-9301-4693-b6b9-5a69127db450 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:13.201627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ce4a8255-9301-4693-b6b9-5a69127db450 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:13.209283 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ce4a8255-9301-4693-b6b9-5a69127db450 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.151145 Oct 11 06:43:13.210405 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 126/254] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:13 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:43:13.311861 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a6cd43d5-5dec-4769-aebb-16f7b27c8a25 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:13.319949 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a6cd43d5-5dec-4769-aebb-16f7b27c8a25 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62" status: 200 len: 1313 microversion: 2.1 time: 0.292116 Oct 11 06:43:13.320504 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 129/255] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:13 2022] GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62 => generated 1313 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:13.383633 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-30acfe90-374e-4c4a-9b76-23322876a819 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:13.384442 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-30acfe90-374e-4c4a-9b76-23322876a819 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:13.390698 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30acfe90-374e-4c4a-9b76-23322876a819 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:13.391267 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30acfe90-374e-4c4a-9b76-23322876a819 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:13.391679 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30acfe90-374e-4c4a-9b76-23322876a819 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:13.392386 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30acfe90-374e-4c4a-9b76-23322876a819 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:13.392829 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30acfe90-374e-4c4a-9b76-23322876a819 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:13.393278 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30acfe90-374e-4c4a-9b76-23322876a819 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:13.565173 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-30acfe90-374e-4c4a-9b76-23322876a819 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:13.574320 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-30acfe90-374e-4c4a-9b76-23322876a819 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1554 microversion: 2.1 time: 0.213259 Oct 11 06:43:13.574978 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 127/256] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:13 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1554 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:13.689683 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-5b6fc889-aca1-4c90-a09d-24b25a301ab5 req-30504d9d-57e4-40a2-a9cc-780644f52461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07799819-eaa3-484d-bbcf-2c3c97ea26f3", "name": "network-vif-deleted", "tag": "5513024a-3af1-4db9-810a-0131e7119a57"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:43:13.700226 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-5b6fc889-aca1-4c90-a09d-24b25a301ab5 req-30504d9d-57e4-40a2-a9cc-780644f52461 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:13.700734 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-5b6fc889-aca1-4c90-a09d-24b25a301ab5 req-30504d9d-57e4-40a2-a9cc-780644f52461 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:13.701162 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-5b6fc889-aca1-4c90-a09d-24b25a301ab5 req-30504d9d-57e4-40a2-a9cc-780644f52461 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:13.712878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-5b6fc889-aca1-4c90-a09d-24b25a301ab5 req-30504d9d-57e4-40a2-a9cc-780644f52461 service nova] Creating event network-vif-deleted:5513024a-3af1-4db9-810a-0131e7119a57 for instance 07799819-eaa3-484d-bbcf-2c3c97ea26f3 on hv-cinder-85495 Oct 11 06:43:13.718465 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-5b6fc889-aca1-4c90-a09d-24b25a301ab5 req-30504d9d-57e4-40a2-a9cc-780644f52461 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032590 Oct 11 06:43:13.719069 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 130/257] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:43:14.233323 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f60d3ca1-79a4-46a6-9b59-59795fea743a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:14.234011 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f60d3ca1-79a4-46a6-9b59-59795fea743a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:14.240239 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f60d3ca1-79a4-46a6-9b59-59795fea743a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:14.240758 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f60d3ca1-79a4-46a6-9b59-59795fea743a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:14.241205 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f60d3ca1-79a4-46a6-9b59-59795fea743a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:14.241951 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f60d3ca1-79a4-46a6-9b59-59795fea743a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:14.242445 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f60d3ca1-79a4-46a6-9b59-59795fea743a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:14.242881 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f60d3ca1-79a4-46a6-9b59-59795fea743a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:14.343179 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-45786b84-2d9a-4e9e-87eb-6c8ed7f75006 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:14.343897 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-45786b84-2d9a-4e9e-87eb-6c8ed7f75006 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: db08ae39-c1c5-4ad9-b37a-e4315bc48e62] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:14.351018 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-45786b84-2d9a-4e9e-87eb-6c8ed7f75006 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:14.351513 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-45786b84-2d9a-4e9e-87eb-6c8ed7f75006 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:14.351938 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-45786b84-2d9a-4e9e-87eb-6c8ed7f75006 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:14.352619 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-45786b84-2d9a-4e9e-87eb-6c8ed7f75006 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:14.353060 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-45786b84-2d9a-4e9e-87eb-6c8ed7f75006 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:14.353472 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-45786b84-2d9a-4e9e-87eb-6c8ed7f75006 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:14.370243 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f60d3ca1-79a4-46a6-9b59-59795fea743a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:14.377869 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f60d3ca1-79a4-46a6-9b59-59795fea743a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.149054 Oct 11 06:43:14.378444 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 128/258] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:14 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:14.484241 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-45786b84-2d9a-4e9e-87eb-6c8ed7f75006 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:14.495330 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-45786b84-2d9a-4e9e-87eb-6c8ed7f75006 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62" status: 200 len: 1497 microversion: 2.1 time: 0.155893 Oct 11 06:43:14.496312 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 131/259] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:14 2022] GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62 => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:43:14.597683 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7030d3cc-59c2-43d9-aae3-a762fd2deec0 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:14.598290 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7030d3cc-59c2-43d9-aae3-a762fd2deec0 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:14.604577 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7030d3cc-59c2-43d9-aae3-a762fd2deec0 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:14.605063 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7030d3cc-59c2-43d9-aae3-a762fd2deec0 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:14.605497 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7030d3cc-59c2-43d9-aae3-a762fd2deec0 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:14.607014 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7030d3cc-59c2-43d9-aae3-a762fd2deec0 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:14.607487 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7030d3cc-59c2-43d9-aae3-a762fd2deec0 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:14.607909 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7030d3cc-59c2-43d9-aae3-a762fd2deec0 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:14.671545 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7030d3cc-59c2-43d9-aae3-a762fd2deec0 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:14.680420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7030d3cc-59c2-43d9-aae3-a762fd2deec0 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1346 microversion: 2.1 time: 0.086591 Oct 11 06:43:14.681377 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 129/260] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:14 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:15.401681 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c25ecc5c-f3af-4fee-a161-d369afc0cf62 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:15.402319 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c25ecc5c-f3af-4fee-a161-d369afc0cf62 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:15.409489 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c25ecc5c-f3af-4fee-a161-d369afc0cf62 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:15.409998 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c25ecc5c-f3af-4fee-a161-d369afc0cf62 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:15.410453 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c25ecc5c-f3af-4fee-a161-d369afc0cf62 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:15.411151 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c25ecc5c-f3af-4fee-a161-d369afc0cf62 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:15.411634 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c25ecc5c-f3af-4fee-a161-d369afc0cf62 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:15.412061 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c25ecc5c-f3af-4fee-a161-d369afc0cf62 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:15.540123 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c25ecc5c-f3af-4fee-a161-d369afc0cf62 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:15.547818 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c25ecc5c-f3af-4fee-a161-d369afc0cf62 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.150730 Oct 11 06:43:15.548384 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 132/261] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:15 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:15.704823 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3222e1a8-7a97-4ff8-8c65-bb3e37c2959e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:15.705359 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3222e1a8-7a97-4ff8-8c65-bb3e37c2959e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:15.711198 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3222e1a8-7a97-4ff8-8c65-bb3e37c2959e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:15.711774 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3222e1a8-7a97-4ff8-8c65-bb3e37c2959e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:15.712200 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3222e1a8-7a97-4ff8-8c65-bb3e37c2959e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:15.712879 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3222e1a8-7a97-4ff8-8c65-bb3e37c2959e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:15.713322 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3222e1a8-7a97-4ff8-8c65-bb3e37c2959e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:15.713737 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3222e1a8-7a97-4ff8-8c65-bb3e37c2959e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:15.775776 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3222e1a8-7a97-4ff8-8c65-bb3e37c2959e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:15.784156 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3222e1a8-7a97-4ff8-8c65-bb3e37c2959e tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1346 microversion: 2.1 time: 0.083239 Oct 11 06:43:15.784705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 130/262] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:15 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1346 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:16.570689 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-61f817cd-3317-433b-bbb6-5d88d7761328 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:16.571349 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-61f817cd-3317-433b-bbb6-5d88d7761328 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:16.577829 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-61f817cd-3317-433b-bbb6-5d88d7761328 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:16.578301 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-61f817cd-3317-433b-bbb6-5d88d7761328 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:16.578732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-61f817cd-3317-433b-bbb6-5d88d7761328 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:16.579466 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-61f817cd-3317-433b-bbb6-5d88d7761328 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:16.579969 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-61f817cd-3317-433b-bbb6-5d88d7761328 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:16.580469 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-61f817cd-3317-433b-bbb6-5d88d7761328 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:16.711315 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-61f817cd-3317-433b-bbb6-5d88d7761328 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:16.719237 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-61f817cd-3317-433b-bbb6-5d88d7761328 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.152592 Oct 11 06:43:16.719840 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 133/263] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:16 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:16.805951 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d50ba0fd-ac4f-4ea5-b7b7-0f37c6045c43 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:16.806586 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d50ba0fd-ac4f-4ea5-b7b7-0f37c6045c43 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:16.812522 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d50ba0fd-ac4f-4ea5-b7b7-0f37c6045c43 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:16.813001 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d50ba0fd-ac4f-4ea5-b7b7-0f37c6045c43 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:16.813430 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d50ba0fd-ac4f-4ea5-b7b7-0f37c6045c43 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:16.814111 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d50ba0fd-ac4f-4ea5-b7b7-0f37c6045c43 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:16.814557 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d50ba0fd-ac4f-4ea5-b7b7-0f37c6045c43 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:16.814975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d50ba0fd-ac4f-4ea5-b7b7-0f37c6045c43 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:16.874349 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d50ba0fd-ac4f-4ea5-b7b7-0f37c6045c43 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:16.883025 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d50ba0fd-ac4f-4ea5-b7b7-0f37c6045c43 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1346 microversion: 2.1 time: 0.080940 Oct 11 06:43:16.883607 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 131/264] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:16 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1346 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:43:17.738755 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-765366d1-7770-4b3b-b757-79dcfba5c2cc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:17.739318 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-765366d1-7770-4b3b-b757-79dcfba5c2cc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: db08ae39-c1c5-4ad9-b37a-e4315bc48e62] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:17.744958 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e3bc0e13-bb10-403e-9595-7d770511f95e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:17.745710 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e3bc0e13-bb10-403e-9595-7d770511f95e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:17.747034 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-765366d1-7770-4b3b-b757-79dcfba5c2cc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:17.747609 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-765366d1-7770-4b3b-b757-79dcfba5c2cc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:17.748019 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-765366d1-7770-4b3b-b757-79dcfba5c2cc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:17.748885 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-765366d1-7770-4b3b-b757-79dcfba5c2cc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:17.749324 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-765366d1-7770-4b3b-b757-79dcfba5c2cc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:17.749909 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-765366d1-7770-4b3b-b757-79dcfba5c2cc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:17.753313 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e3bc0e13-bb10-403e-9595-7d770511f95e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:17.754036 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e3bc0e13-bb10-403e-9595-7d770511f95e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:17.754667 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e3bc0e13-bb10-403e-9595-7d770511f95e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:17.755622 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e3bc0e13-bb10-403e-9595-7d770511f95e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:17.756155 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e3bc0e13-bb10-403e-9595-7d770511f95e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:17.756572 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e3bc0e13-bb10-403e-9595-7d770511f95e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:17.905685 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e3bc0e13-bb10-403e-9595-7d770511f95e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:17.914251 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e3bc0e13-bb10-403e-9595-7d770511f95e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.175415 Oct 11 06:43:17.914928 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 132/265] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:17 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:17.919399 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8f62f00b-be08-4a30-b0db-9e24f519417c tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:17.920148 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8f62f00b-be08-4a30-b0db-9e24f519417c tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:17.920270 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-765366d1-7770-4b3b-b757-79dcfba5c2cc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: db08ae39-c1c5-4ad9-b37a-e4315bc48e62] Going to try to terminate instance {{(pid=125266) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 06:43:17.926271 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f62f00b-be08-4a30-b0db-9e24f519417c tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:17.926752 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f62f00b-be08-4a30-b0db-9e24f519417c tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:17.927182 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f62f00b-be08-4a30-b0db-9e24f519417c tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:17.927903 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f62f00b-be08-4a30-b0db-9e24f519417c tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:17.928390 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f62f00b-be08-4a30-b0db-9e24f519417c tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:17.928805 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f62f00b-be08-4a30-b0db-9e24f519417c tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:17.960674 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f62f00b-be08-4a30-b0db-9e24f519417c tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:17.961245 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f62f00b-be08-4a30-b0db-9e24f519417c tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:17.961701 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f62f00b-be08-4a30-b0db-9e24f519417c tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:17.962191 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-8f62f00b-be08-4a30-b0db-9e24f519417c tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lazy-loading 'fault' on Instance uuid 07799819-eaa3-484d-bbcf-2c3c97ea26f3 {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 06:43:17.995796 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-765366d1-7770-4b3b-b757-79dcfba5c2cc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "DELETE /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62" status: 204 len: 0 microversion: 2.1 time: 0.260802 Oct 11 06:43:17.996605 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 134/266] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Oct 11 06:43:17 2022] DELETE /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 06:43:18.004925 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c52c1c5d-daae-489d-b538-3c25943e1fb6 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:18.005611 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c52c1c5d-daae-489d-b538-3c25943e1fb6 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: db08ae39-c1c5-4ad9-b37a-e4315bc48e62] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:18.007063 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8f62f00b-be08-4a30-b0db-9e24f519417c tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:18.011359 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c52c1c5d-daae-489d-b538-3c25943e1fb6 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:18.011863 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c52c1c5d-daae-489d-b538-3c25943e1fb6 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:18.012287 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c52c1c5d-daae-489d-b538-3c25943e1fb6 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:18.012975 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c52c1c5d-daae-489d-b538-3c25943e1fb6 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:18.013417 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c52c1c5d-daae-489d-b538-3c25943e1fb6 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:18.013828 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c52c1c5d-daae-489d-b538-3c25943e1fb6 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:18.015474 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8f62f00b-be08-4a30-b0db-9e24f519417c tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1351 microversion: 2.1 time: 0.099487 Oct 11 06:43:18.016030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 133/267] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:17 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1351 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:18.141687 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c52c1c5d-daae-489d-b538-3c25943e1fb6 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:18.149792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c52c1c5d-daae-489d-b538-3c25943e1fb6 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62" status: 200 len: 1503 microversion: 2.1 time: 0.148961 Oct 11 06:43:18.150358 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 135/268] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:17 2022] GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62 => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:43:18.937041 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9bfc77e1-1b02-445f-8e3e-c924268cf3eb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:18.937650 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9bfc77e1-1b02-445f-8e3e-c924268cf3eb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:18.944360 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9bfc77e1-1b02-445f-8e3e-c924268cf3eb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:18.944841 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9bfc77e1-1b02-445f-8e3e-c924268cf3eb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:18.945275 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9bfc77e1-1b02-445f-8e3e-c924268cf3eb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:18.945962 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9bfc77e1-1b02-445f-8e3e-c924268cf3eb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:18.946393 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9bfc77e1-1b02-445f-8e3e-c924268cf3eb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:18.946814 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9bfc77e1-1b02-445f-8e3e-c924268cf3eb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:19.040902 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e0259c63-699a-480d-8742-c98b4f3a68db tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:19.043003 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e0259c63-699a-480d-8742-c98b4f3a68db tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:19.049715 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0259c63-699a-480d-8742-c98b4f3a68db tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:19.050201 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0259c63-699a-480d-8742-c98b4f3a68db tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:19.050645 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0259c63-699a-480d-8742-c98b4f3a68db tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:19.051405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0259c63-699a-480d-8742-c98b4f3a68db tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:19.052040 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0259c63-699a-480d-8742-c98b4f3a68db tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:19.052492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0259c63-699a-480d-8742-c98b4f3a68db tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:19.082982 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9bfc77e1-1b02-445f-8e3e-c924268cf3eb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:19.089939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0259c63-699a-480d-8742-c98b4f3a68db tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:19.090584 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0259c63-699a-480d-8742-c98b4f3a68db tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:19.090660 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9bfc77e1-1b02-445f-8e3e-c924268cf3eb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.157437 Oct 11 06:43:19.090855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0259c63-699a-480d-8742-c98b4f3a68db tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:19.093960 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.objects.instance [None req-e0259c63-699a-480d-8742-c98b4f3a68db tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lazy-loading 'fault' on Instance uuid 07799819-eaa3-484d-bbcf-2c3c97ea26f3 {{(pid=125266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 06:43:19.094100 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 134/269] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:18 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:19.098791 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:19.137856 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e0259c63-699a-480d-8742-c98b4f3a68db tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:19.145908 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e0259c63-699a-480d-8742-c98b4f3a68db tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1351 microversion: 2.1 time: 0.109546 Oct 11 06:43:19.146459 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 136/270] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:19 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1351 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:19.173243 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8c063f1b-8fff-4cef-8300-e5aff26d8f45 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:19.173767 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8c063f1b-8fff-4cef-8300-e5aff26d8f45 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: db08ae39-c1c5-4ad9-b37a-e4315bc48e62] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:19.180244 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8c063f1b-8fff-4cef-8300-e5aff26d8f45 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:19.180715 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8c063f1b-8fff-4cef-8300-e5aff26d8f45 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:19.181141 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8c063f1b-8fff-4cef-8300-e5aff26d8f45 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:19.181818 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8c063f1b-8fff-4cef-8300-e5aff26d8f45 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:19.182262 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8c063f1b-8fff-4cef-8300-e5aff26d8f45 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:19.182678 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8c063f1b-8fff-4cef-8300-e5aff26d8f45 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:19.308632 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8c063f1b-8fff-4cef-8300-e5aff26d8f45 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:19.316117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8c063f1b-8fff-4cef-8300-e5aff26d8f45 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62" status: 200 len: 1503 microversion: 2.1 time: 0.146715 Oct 11 06:43:19.316672 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 135/271] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:19 2022] GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62 => generated 1503 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:20.115453 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-11bb268a-872b-45f6-909c-f68a7850bbd8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:20.116052 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-11bb268a-872b-45f6-909c-f68a7850bbd8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:20.123271 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-11bb268a-872b-45f6-909c-f68a7850bbd8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:20.123766 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-11bb268a-872b-45f6-909c-f68a7850bbd8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:20.124190 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-11bb268a-872b-45f6-909c-f68a7850bbd8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:20.124868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-11bb268a-872b-45f6-909c-f68a7850bbd8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:20.125303 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-11bb268a-872b-45f6-909c-f68a7850bbd8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:20.127270 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-11bb268a-872b-45f6-909c-f68a7850bbd8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:20.169494 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4f5aa181-30d8-4495-a06b-d504eadbe25d tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:20.170220 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4f5aa181-30d8-4495-a06b-d504eadbe25d tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:20.176555 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4f5aa181-30d8-4495-a06b-d504eadbe25d tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:20.177111 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4f5aa181-30d8-4495-a06b-d504eadbe25d tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:20.177608 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4f5aa181-30d8-4495-a06b-d504eadbe25d tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:20.178364 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4f5aa181-30d8-4495-a06b-d504eadbe25d tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:20.178878 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4f5aa181-30d8-4495-a06b-d504eadbe25d tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:20.179447 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4f5aa181-30d8-4495-a06b-d504eadbe25d tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:20.215271 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4f5aa181-30d8-4495-a06b-d504eadbe25d tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:20.215789 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4f5aa181-30d8-4495-a06b-d504eadbe25d tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:20.216380 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4f5aa181-30d8-4495-a06b-d504eadbe25d tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:20.216820 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-4f5aa181-30d8-4495-a06b-d504eadbe25d tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lazy-loading 'fault' on Instance uuid 07799819-eaa3-484d-bbcf-2c3c97ea26f3 {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 06:43:20.256729 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4f5aa181-30d8-4495-a06b-d504eadbe25d tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:20.260195 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-11bb268a-872b-45f6-909c-f68a7850bbd8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:20.265389 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4f5aa181-30d8-4495-a06b-d504eadbe25d tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1351 microversion: 2.1 time: 0.100033 Oct 11 06:43:20.265947 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 136/272] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:20 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1351 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:43:20.269705 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-11bb268a-872b-45f6-909c-f68a7850bbd8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.158179 Oct 11 06:43:20.270337 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 137/273] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:20 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:20.338103 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-662e895b-683e-497e-91c8-4b66313634ed tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:20.338705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-662e895b-683e-497e-91c8-4b66313634ed tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: db08ae39-c1c5-4ad9-b37a-e4315bc48e62] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:20.344634 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-662e895b-683e-497e-91c8-4b66313634ed tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:20.345124 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-662e895b-683e-497e-91c8-4b66313634ed tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:20.345542 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-662e895b-683e-497e-91c8-4b66313634ed tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:20.346212 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-662e895b-683e-497e-91c8-4b66313634ed tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:20.346657 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-662e895b-683e-497e-91c8-4b66313634ed tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:20.347074 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-662e895b-683e-497e-91c8-4b66313634ed tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:20.477190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-662e895b-683e-497e-91c8-4b66313634ed tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:20.485600 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-662e895b-683e-497e-91c8-4b66313634ed tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62" status: 200 len: 1503 microversion: 2.1 time: 0.151269 Oct 11 06:43:20.486162 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 137/274] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:20 2022] GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62 => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:21.288052 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0bd51df8-5645-4b5d-9c41-df91d9cfeb73 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:21.288668 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0bd51df8-5645-4b5d-9c41-df91d9cfeb73 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:21.293986 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7b27b1e4-3edd-43a4-b34e-b6b217f06276 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:21.294683 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7b27b1e4-3edd-43a4-b34e-b6b217f06276 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:21.294807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0bd51df8-5645-4b5d-9c41-df91d9cfeb73 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:21.295213 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0bd51df8-5645-4b5d-9c41-df91d9cfeb73 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:21.295682 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0bd51df8-5645-4b5d-9c41-df91d9cfeb73 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:21.296370 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0bd51df8-5645-4b5d-9c41-df91d9cfeb73 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:21.297017 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0bd51df8-5645-4b5d-9c41-df91d9cfeb73 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:21.297436 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0bd51df8-5645-4b5d-9c41-df91d9cfeb73 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:21.300699 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b27b1e4-3edd-43a4-b34e-b6b217f06276 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:21.301335 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b27b1e4-3edd-43a4-b34e-b6b217f06276 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:21.301757 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b27b1e4-3edd-43a4-b34e-b6b217f06276 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:21.302436 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b27b1e4-3edd-43a4-b34e-b6b217f06276 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:21.302877 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b27b1e4-3edd-43a4-b34e-b6b217f06276 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:21.303288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b27b1e4-3edd-43a4-b34e-b6b217f06276 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:21.329235 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0bd51df8-5645-4b5d-9c41-df91d9cfeb73 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:21.329872 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0bd51df8-5645-4b5d-9c41-df91d9cfeb73 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:21.330418 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0bd51df8-5645-4b5d-9c41-df91d9cfeb73 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:21.330950 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.objects.instance [None req-0bd51df8-5645-4b5d-9c41-df91d9cfeb73 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lazy-loading 'fault' on Instance uuid 07799819-eaa3-484d-bbcf-2c3c97ea26f3 {{(pid=125266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 06:43:21.370406 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0bd51df8-5645-4b5d-9c41-df91d9cfeb73 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:21.378685 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0bd51df8-5645-4b5d-9c41-df91d9cfeb73 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1351 microversion: 2.1 time: 0.094462 Oct 11 06:43:21.379322 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 138/275] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:21 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1351 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:21.437202 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7b27b1e4-3edd-43a4-b34e-b6b217f06276 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:21.445076 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7b27b1e4-3edd-43a4-b34e-b6b217f06276 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.154874 Oct 11 06:43:21.445639 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 138/276] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:21 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:21.509457 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1901f874-c59d-48a6-b808-5c85379e4846 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:21.509979 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1901f874-c59d-48a6-b808-5c85379e4846 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: db08ae39-c1c5-4ad9-b37a-e4315bc48e62] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:21.515885 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1901f874-c59d-48a6-b808-5c85379e4846 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:21.516360 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1901f874-c59d-48a6-b808-5c85379e4846 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:21.516784 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1901f874-c59d-48a6-b808-5c85379e4846 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:21.517469 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1901f874-c59d-48a6-b808-5c85379e4846 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:21.517914 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1901f874-c59d-48a6-b808-5c85379e4846 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:21.518333 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1901f874-c59d-48a6-b808-5c85379e4846 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:21.649662 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1901f874-c59d-48a6-b808-5c85379e4846 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:21.657799 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1901f874-c59d-48a6-b808-5c85379e4846 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62" status: 200 len: 1503 microversion: 2.1 time: 0.152126 Oct 11 06:43:21.658238 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 139/277] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:21 2022] GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:22.402726 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c8985afb-9a91-4bf1-9c66-238f7c2788bf tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:22.403332 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c8985afb-9a91-4bf1-9c66-238f7c2788bf tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:22.412953 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8985afb-9a91-4bf1-9c66-238f7c2788bf tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:22.413428 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8985afb-9a91-4bf1-9c66-238f7c2788bf tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:22.413864 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8985afb-9a91-4bf1-9c66-238f7c2788bf tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:22.414581 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8985afb-9a91-4bf1-9c66-238f7c2788bf tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:22.415318 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8985afb-9a91-4bf1-9c66-238f7c2788bf tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:22.415774 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8985afb-9a91-4bf1-9c66-238f7c2788bf tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:22.446998 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8985afb-9a91-4bf1-9c66-238f7c2788bf tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:22.447503 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8985afb-9a91-4bf1-9c66-238f7c2788bf tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:22.448116 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8985afb-9a91-4bf1-9c66-238f7c2788bf tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:22.448444 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-c8985afb-9a91-4bf1-9c66-238f7c2788bf tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lazy-loading 'fault' on Instance uuid 07799819-eaa3-484d-bbcf-2c3c97ea26f3 {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 06:43:22.468869 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7da83958-2c1f-4d40-9efc-1aadd9d74f38 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:22.469569 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7da83958-2c1f-4d40-9efc-1aadd9d74f38 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:22.477619 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7da83958-2c1f-4d40-9efc-1aadd9d74f38 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:22.478335 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7da83958-2c1f-4d40-9efc-1aadd9d74f38 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:22.478837 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7da83958-2c1f-4d40-9efc-1aadd9d74f38 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:22.480258 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7da83958-2c1f-4d40-9efc-1aadd9d74f38 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:22.481031 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7da83958-2c1f-4d40-9efc-1aadd9d74f38 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:22.481537 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7da83958-2c1f-4d40-9efc-1aadd9d74f38 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:22.500421 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c8985afb-9a91-4bf1-9c66-238f7c2788bf tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:22.503726 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:22.510066 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c8985afb-9a91-4bf1-9c66-238f7c2788bf tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1351 microversion: 2.1 time: 0.112329 Oct 11 06:43:22.510677 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 139/278] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:22 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1351 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:22.616221 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7da83958-2c1f-4d40-9efc-1aadd9d74f38 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:22.625854 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7da83958-2c1f-4d40-9efc-1aadd9d74f38 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.162741 Oct 11 06:43:22.626415 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 140/279] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:22 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:43:22.682017 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-807bd136-45bd-4dc3-a1c9-c3b8bb455bfc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:22.682737 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-807bd136-45bd-4dc3-a1c9-c3b8bb455bfc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: db08ae39-c1c5-4ad9-b37a-e4315bc48e62] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:22.688986 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-807bd136-45bd-4dc3-a1c9-c3b8bb455bfc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:22.689483 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-807bd136-45bd-4dc3-a1c9-c3b8bb455bfc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:22.689915 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-807bd136-45bd-4dc3-a1c9-c3b8bb455bfc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:22.690628 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-807bd136-45bd-4dc3-a1c9-c3b8bb455bfc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:22.691066 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-807bd136-45bd-4dc3-a1c9-c3b8bb455bfc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:22.691504 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-807bd136-45bd-4dc3-a1c9-c3b8bb455bfc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:22.855330 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-807bd136-45bd-4dc3-a1c9-c3b8bb455bfc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:22.863402 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-807bd136-45bd-4dc3-a1c9-c3b8bb455bfc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62" status: 200 len: 1503 microversion: 2.1 time: 0.186481 Oct 11 06:43:22.867687 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 140/280] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:22 2022] GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62 => generated 1503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:23.532929 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8ee6ec2c-867c-452e-9a18-cc671ed6eb79 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:23.533536 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8ee6ec2c-867c-452e-9a18-cc671ed6eb79 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:23.540401 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ee6ec2c-867c-452e-9a18-cc671ed6eb79 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:23.540401 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ee6ec2c-867c-452e-9a18-cc671ed6eb79 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:23.540843 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ee6ec2c-867c-452e-9a18-cc671ed6eb79 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:23.542301 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ee6ec2c-867c-452e-9a18-cc671ed6eb79 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:23.542498 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ee6ec2c-867c-452e-9a18-cc671ed6eb79 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:23.542920 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ee6ec2c-867c-452e-9a18-cc671ed6eb79 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:23.574636 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ee6ec2c-867c-452e-9a18-cc671ed6eb79 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:23.575157 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ee6ec2c-867c-452e-9a18-cc671ed6eb79 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:23.575977 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ee6ec2c-867c-452e-9a18-cc671ed6eb79 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:23.576415 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.objects.instance [None req-8ee6ec2c-867c-452e-9a18-cc671ed6eb79 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lazy-loading 'fault' on Instance uuid 07799819-eaa3-484d-bbcf-2c3c97ea26f3 {{(pid=125266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 06:43:23.618033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8ee6ec2c-867c-452e-9a18-cc671ed6eb79 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:23.626760 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8ee6ec2c-867c-452e-9a18-cc671ed6eb79 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1351 microversion: 2.1 time: 0.098025 Oct 11 06:43:23.627711 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 141/281] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:23 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:23.649276 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-55e603b7-3647-46bd-8e7d-cd7ea221fc10 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:23.649906 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-55e603b7-3647-46bd-8e7d-cd7ea221fc10 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:23.656676 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-55e603b7-3647-46bd-8e7d-cd7ea221fc10 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:23.657215 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-55e603b7-3647-46bd-8e7d-cd7ea221fc10 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:23.657829 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-55e603b7-3647-46bd-8e7d-cd7ea221fc10 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:23.658519 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-55e603b7-3647-46bd-8e7d-cd7ea221fc10 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:23.658958 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-55e603b7-3647-46bd-8e7d-cd7ea221fc10 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:23.659373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-55e603b7-3647-46bd-8e7d-cd7ea221fc10 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:23.791577 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-55e603b7-3647-46bd-8e7d-cd7ea221fc10 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:23.799739 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-55e603b7-3647-46bd-8e7d-cd7ea221fc10 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.154389 Oct 11 06:43:23.800304 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 141/282] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:23 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:23.889644 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ab0e44cb-4584-452a-aafd-a89486e0f6c3 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:23.890256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ab0e44cb-4584-452a-aafd-a89486e0f6c3 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: db08ae39-c1c5-4ad9-b37a-e4315bc48e62] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:23.896177 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ab0e44cb-4584-452a-aafd-a89486e0f6c3 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:23.896689 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ab0e44cb-4584-452a-aafd-a89486e0f6c3 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:23.897094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ab0e44cb-4584-452a-aafd-a89486e0f6c3 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:23.897786 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ab0e44cb-4584-452a-aafd-a89486e0f6c3 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:23.898235 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ab0e44cb-4584-452a-aafd-a89486e0f6c3 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:23.898658 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ab0e44cb-4584-452a-aafd-a89486e0f6c3 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:24.034659 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ab0e44cb-4584-452a-aafd-a89486e0f6c3 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:24.043256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ab0e44cb-4584-452a-aafd-a89486e0f6c3 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62" status: 200 len: 1503 microversion: 2.1 time: 0.157524 Oct 11 06:43:24.043862 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 142/283] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:23 2022] GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:24.649859 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-43fe0a2a-2dd0-4b45-bd2e-6f263fb7c9d1 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:24.650498 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-43fe0a2a-2dd0-4b45-bd2e-6f263fb7c9d1 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:24.658214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-43fe0a2a-2dd0-4b45-bd2e-6f263fb7c9d1 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:24.658934 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-43fe0a2a-2dd0-4b45-bd2e-6f263fb7c9d1 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:24.659552 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-43fe0a2a-2dd0-4b45-bd2e-6f263fb7c9d1 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:24.660608 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-43fe0a2a-2dd0-4b45-bd2e-6f263fb7c9d1 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:24.661056 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-43fe0a2a-2dd0-4b45-bd2e-6f263fb7c9d1 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:24.661485 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-43fe0a2a-2dd0-4b45-bd2e-6f263fb7c9d1 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:24.699668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-43fe0a2a-2dd0-4b45-bd2e-6f263fb7c9d1 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:24.700146 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-43fe0a2a-2dd0-4b45-bd2e-6f263fb7c9d1 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:24.700575 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-43fe0a2a-2dd0-4b45-bd2e-6f263fb7c9d1 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:24.701015 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-43fe0a2a-2dd0-4b45-bd2e-6f263fb7c9d1 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lazy-loading 'fault' on Instance uuid 07799819-eaa3-484d-bbcf-2c3c97ea26f3 {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 06:43:24.745097 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-43fe0a2a-2dd0-4b45-bd2e-6f263fb7c9d1 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97edc31dd834fd8811ad1bb25f1168b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048f1b5e89c8417695e7916b444e2778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:24.753660 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-43fe0a2a-2dd0-4b45-bd2e-6f263fb7c9d1 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 200 len: 1351 microversion: 2.1 time: 0.107837 Oct 11 06:43:24.754212 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 142/284] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:24 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 1351 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:24.821832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-718084af-2642-4cbf-bd1a-e26e7e76ac5d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:24.822447 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-718084af-2642-4cbf-bd1a-e26e7e76ac5d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:24.828794 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-718084af-2642-4cbf-bd1a-e26e7e76ac5d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:24.829278 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-718084af-2642-4cbf-bd1a-e26e7e76ac5d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:24.829711 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-718084af-2642-4cbf-bd1a-e26e7e76ac5d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:24.830403 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-718084af-2642-4cbf-bd1a-e26e7e76ac5d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:24.830856 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-718084af-2642-4cbf-bd1a-e26e7e76ac5d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:24.831280 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-718084af-2642-4cbf-bd1a-e26e7e76ac5d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:24.974072 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-718084af-2642-4cbf-bd1a-e26e7e76ac5d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:24.982245 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-718084af-2642-4cbf-bd1a-e26e7e76ac5d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.164158 Oct 11 06:43:24.982802 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 143/285] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:24 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:25.065832 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0af86abc-4cc4-4274-aeeb-5d179cecc026 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:25.066446 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0af86abc-4cc4-4274-aeeb-5d179cecc026 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: db08ae39-c1c5-4ad9-b37a-e4315bc48e62] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:25.072497 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0af86abc-4cc4-4274-aeeb-5d179cecc026 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:25.073951 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0af86abc-4cc4-4274-aeeb-5d179cecc026 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:25.074389 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0af86abc-4cc4-4274-aeeb-5d179cecc026 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:25.075087 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0af86abc-4cc4-4274-aeeb-5d179cecc026 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:25.075734 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0af86abc-4cc4-4274-aeeb-5d179cecc026 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:25.076159 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0af86abc-4cc4-4274-aeeb-5d179cecc026 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:25.224475 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0af86abc-4cc4-4274-aeeb-5d179cecc026 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:25.233793 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0af86abc-4cc4-4274-aeeb-5d179cecc026 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62" status: 200 len: 1503 microversion: 2.1 time: 0.171656 Oct 11 06:43:25.234348 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 143/286] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:25 2022] GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62 => generated 1503 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:25.781567 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1b741503-09a5-445c-8350-1df8e664b7b0 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:25.782169 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1b741503-09a5-445c-8350-1df8e664b7b0 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:25.789082 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b741503-09a5-445c-8350-1df8e664b7b0 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:25.789831 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b741503-09a5-445c-8350-1df8e664b7b0 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:25.790337 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b741503-09a5-445c-8350-1df8e664b7b0 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:25.791152 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b741503-09a5-445c-8350-1df8e664b7b0 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:25.792475 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b741503-09a5-445c-8350-1df8e664b7b0 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:25.793236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b741503-09a5-445c-8350-1df8e664b7b0 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:25.809183 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-1b741503-09a5-445c-8350-1df8e664b7b0 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] HTTP exception thrown: Instance 07799819-eaa3-484d-bbcf-2c3c97ea26f3 could not be found. Oct 11 06:43:25.814468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1b741503-09a5-445c-8350-1df8e664b7b0 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Request method failure captured: Oct 11 06:43:25.814468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: request: GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 HTTP/1.1 Oct 11 06:43:25.814468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept: application/json Oct 11 06:43:25.814468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Oct 11 06:43:25.814468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Connection: close Oct 11 06:43:25.814468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Length: 0 Oct 11 06:43:25.814468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Type: application/json Oct 11 06:43:25.814468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Host: 10.222.0.39 Oct 11 06:43:25.814468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Oct 11 06:43:25.814468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.12 Oct 11 06:43:25.814468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABjRRA4acwrDPax20-kw1Wxp_RnEeDEwRLDz8PMJ2jlcZvp0MGpfe5g-YswjjzsFB8gKApMOqN_CbMhX0IW1MD-FyKu7X8VCvVzXX6SvrsGHL3ye1kCF1ytCdpn60r6kEfqM9WC6024K0d8yAN6pcb9bDeuvodWUIRo3A9wNg0f7DCaTE8 Oct 11 06:43:25.814468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Oct 11 06:43:25.814468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Oct 11 06:43:25.814468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Oct 11 06:43:25.814468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Oct 11 06:43:25.814468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Oct 11 06:43:25.814468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Oct 11 06:43:25.814468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Id: 048f1b5e89c8417695e7916b444e2778 Oct 11 06:43:25.814468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-DeleteServersTestJSON-311276191 Oct 11 06:43:25.814468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Role: reader,member Oct 11 06:43:25.814468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Oct 11 06:43:25.815838 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_048f1b5e89c8417695e7916b444e2778"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/048f1b5e89c8417695e7916b444e2778"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/048f1b5e89c8417695e7916b444e2778"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/048f1b5e89c8417695e7916b444e2778"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 06:43:25.815838 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-DeleteServersTestJSON-311276191 Oct 11 06:43:25.815838 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 048f1b5e89c8417695e7916b444e2778 Oct 11 06:43:25.815838 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-DeleteServersTestJSON-311276191 Oct 11 06:43:25.815838 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User: tempest-DeleteServersTestJSON-311276191-project Oct 11 06:43:25.815838 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Oct 11 06:43:25.815838 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Oct 11 06:43:25.815838 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Id: e97edc31dd834fd8811ad1bb25f1168b Oct 11 06:43:25.815838 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-DeleteServersTestJSON-311276191-project Oct 11 06:43:25.815838 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: method: > Oct 11 06:43:25.815838 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: exception: Instance 07799819-eaa3-484d-bbcf-2c3c97ea26f3 could not be found. Oct 11 06:43:25.815838 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: action_args: {'id': '07799819-eaa3-484d-bbcf-2c3c97ea26f3'} Oct 11 06:43:25.816564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 06:43:25.816564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:43:25.816564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 06:43:25.816564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 06:43:25.816564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 06:43:25.816564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 06:43:25.816564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 06:43:25.816564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 06:43:25.816564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 06:43:25.816564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 06:43:25.816564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07799819-eaa3-484d-bbcf-2c3c97ea26f3 could not be found. Oct 11 06:43:25.816564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:43:25.816564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:43:25.816564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:43:25.816564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:43:25.816564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:43:25.816564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:43:25.816564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 06:43:25.816564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 06:43:25.816564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 06:43:25.818161 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 06:43:25.818161 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 06:43:25.818161 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 06:43:25.818161 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 06:43:25.818161 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 06:43:25.818161 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 06:43:25.818161 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 06:43:25.818161 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07799819-eaa3-484d-bbcf-2c3c97ea26f3 could not be found. Oct 11 06:43:25.818161 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:43:25.818161 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:43:25.818161 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:43:25.818161 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:43:25.818161 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:43:25.818161 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:43:25.818161 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 06:43:25.818161 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 06:43:25.818161 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07799819-eaa3-484d-bbcf-2c3c97ea26f3 could not be found. Oct 11 06:43:25.818161 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:43:25.819807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1b741503-09a5-445c-8350-1df8e664b7b0 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Returning 404 to user: Instance 07799819-eaa3-484d-bbcf-2c3c97ea26f3 could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 06:43:25.819807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1b741503-09a5-445c-8350-1df8e664b7b0 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 404 len: 111 microversion: 2.1 time: 0.038954 Oct 11 06:43:25.819807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 144/287] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:25 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 06:43:25.947827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-ec3d770a-3014-48d2-bb44-95f882d3dda9 req-617e496d-1ab7-47fc-bcae-a15e876bc652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db08ae39-c1c5-4ad9-b37a-e4315bc48e62", "name": "network-vif-deleted", "tag": "a36635cf-c709-48b6-b73f-9404b6e651af"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:43:25.959846 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-459787d4-8407-47f5-9e8f-647ba3581bea tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:25.961231 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-ec3d770a-3014-48d2-bb44-95f882d3dda9 req-617e496d-1ab7-47fc-bcae-a15e876bc652 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:25.961781 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-ec3d770a-3014-48d2-bb44-95f882d3dda9 req-617e496d-1ab7-47fc-bcae-a15e876bc652 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:25.962144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-459787d4-8407-47f5-9e8f-647ba3581bea tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:25.962526 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-ec3d770a-3014-48d2-bb44-95f882d3dda9 req-617e496d-1ab7-47fc-bcae-a15e876bc652 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:25.975235 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-459787d4-8407-47f5-9e8f-647ba3581bea tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:25.975821 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-459787d4-8407-47f5-9e8f-647ba3581bea tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:25.976228 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-459787d4-8407-47f5-9e8f-647ba3581bea tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:25.977148 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-459787d4-8407-47f5-9e8f-647ba3581bea tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:25.977799 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-459787d4-8407-47f5-9e8f-647ba3581bea tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:25.978476 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-459787d4-8407-47f5-9e8f-647ba3581bea tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:25.981820 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-ec3d770a-3014-48d2-bb44-95f882d3dda9 req-617e496d-1ab7-47fc-bcae-a15e876bc652 service nova] Creating event network-vif-deleted:a36635cf-c709-48b6-b73f-9404b6e651af for instance db08ae39-c1c5-4ad9-b37a-e4315bc48e62 on hv-cinder-85495 Oct 11 06:43:25.987750 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-ec3d770a-3014-48d2-bb44-95f882d3dda9 req-617e496d-1ab7-47fc-bcae-a15e876bc652 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044276 Oct 11 06:43:25.988500 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 144/288] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:43:25.993935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-459787d4-8407-47f5-9e8f-647ba3581bea tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] HTTP exception thrown: Instance 07799819-eaa3-484d-bbcf-2c3c97ea26f3 could not be found. Oct 11 06:43:25.996296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-459787d4-8407-47f5-9e8f-647ba3581bea tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Request method failure captured: Oct 11 06:43:25.996296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: request: GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3/os-volume_attachments HTTP/1.1 Oct 11 06:43:25.996296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept: application/json Oct 11 06:43:25.996296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Oct 11 06:43:25.996296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Connection: close Oct 11 06:43:25.996296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Length: 0 Oct 11 06:43:25.996296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Type: application/json Oct 11 06:43:25.996296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Host: 10.222.0.39 Oct 11 06:43:25.996296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Oct 11 06:43:25.996296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.12 Oct 11 06:43:25.996296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABjRRA4acwrDPax20-kw1Wxp_RnEeDEwRLDz8PMJ2jlcZvp0MGpfe5g-YswjjzsFB8gKApMOqN_CbMhX0IW1MD-FyKu7X8VCvVzXX6SvrsGHL3ye1kCF1ytCdpn60r6kEfqM9WC6024K0d8yAN6pcb9bDeuvodWUIRo3A9wNg0f7DCaTE8 Oct 11 06:43:25.996296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Oct 11 06:43:25.996296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Oct 11 06:43:25.996296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Oct 11 06:43:25.996296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Oct 11 06:43:25.996296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Oct 11 06:43:25.996296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Oct 11 06:43:25.996296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Id: 048f1b5e89c8417695e7916b444e2778 Oct 11 06:43:25.996296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-DeleteServersTestJSON-311276191 Oct 11 06:43:25.996296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Role: reader,member Oct 11 06:43:25.996296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Oct 11 06:43:25.997725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_048f1b5e89c8417695e7916b444e2778"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/048f1b5e89c8417695e7916b444e2778"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/048f1b5e89c8417695e7916b444e2778"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/048f1b5e89c8417695e7916b444e2778"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 06:43:25.997725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-DeleteServersTestJSON-311276191 Oct 11 06:43:25.997725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 048f1b5e89c8417695e7916b444e2778 Oct 11 06:43:25.997725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-DeleteServersTestJSON-311276191 Oct 11 06:43:25.997725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User: tempest-DeleteServersTestJSON-311276191-project Oct 11 06:43:25.997725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Oct 11 06:43:25.997725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Oct 11 06:43:25.997725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Id: e97edc31dd834fd8811ad1bb25f1168b Oct 11 06:43:25.997725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-DeleteServersTestJSON-311276191-project Oct 11 06:43:25.997725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: method: > Oct 11 06:43:25.997725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: exception: Instance 07799819-eaa3-484d-bbcf-2c3c97ea26f3 could not be found. Oct 11 06:43:25.997725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: action_args: {'server_id': '07799819-eaa3-484d-bbcf-2c3c97ea26f3'} Oct 11 06:43:26.000013 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 06:43:26.000013 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:43:26.000013 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 06:43:26.000013 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 06:43:26.000013 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 06:43:26.000013 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 06:43:26.000013 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 06:43:26.000013 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 06:43:26.000013 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 06:43:26.000013 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 06:43:26.000013 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07799819-eaa3-484d-bbcf-2c3c97ea26f3 could not be found. Oct 11 06:43:26.000013 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:43:26.000013 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:43:26.000013 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:43:26.000013 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:43:26.000013 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:43:26.000013 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:43:26.000013 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 06:43:26.000013 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 06:43:26.000013 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 06:43:26.001531 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 06:43:26.001531 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 06:43:26.001531 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 06:43:26.001531 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 06:43:26.001531 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 06:43:26.001531 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 11 06:43:26.001531 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 11 06:43:26.001531 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 06:43:26.001531 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 06:43:26.001531 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07799819-eaa3-484d-bbcf-2c3c97ea26f3 could not be found. Oct 11 06:43:26.001531 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:43:26.001531 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:43:26.001531 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:43:26.001531 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:43:26.001531 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:43:26.001531 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:43:26.001531 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 06:43:26.001531 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 06:43:26.001531 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07799819-eaa3-484d-bbcf-2c3c97ea26f3 could not be found. Oct 11 06:43:26.001531 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:43:26.002807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-459787d4-8407-47f5-9e8f-647ba3581bea tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Returning 404 to user: Instance 07799819-eaa3-484d-bbcf-2c3c97ea26f3 could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 06:43:26.002807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-459787d4-8407-47f5-9e8f-647ba3581bea tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042118 Oct 11 06:43:26.002807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 145/289] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:43:25 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 06:43:26.012944 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-097640cf-d414-42e3-ab77-95cb8168dcab tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:26.013640 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-097640cf-d414-42e3-ab77-95cb8168dcab tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:26.020226 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-097640cf-d414-42e3-ab77-95cb8168dcab tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:26.020712 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-097640cf-d414-42e3-ab77-95cb8168dcab tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:26.021143 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-097640cf-d414-42e3-ab77-95cb8168dcab tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:26.021838 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-097640cf-d414-42e3-ab77-95cb8168dcab tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:26.022284 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-097640cf-d414-42e3-ab77-95cb8168dcab tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:26.022705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-097640cf-d414-42e3-ab77-95cb8168dcab tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:26.164954 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-097640cf-d414-42e3-ab77-95cb8168dcab tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:26.175470 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-097640cf-d414-42e3-ab77-95cb8168dcab tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.166611 Oct 11 06:43:26.176458 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 145/290] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:26 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:26.256686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5451baae-8770-445f-a927-4a492ca321dd tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:26.257305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5451baae-8770-445f-a927-4a492ca321dd tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: db08ae39-c1c5-4ad9-b37a-e4315bc48e62] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:26.263208 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5451baae-8770-445f-a927-4a492ca321dd tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:26.263724 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5451baae-8770-445f-a927-4a492ca321dd tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:26.264152 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5451baae-8770-445f-a927-4a492ca321dd tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:26.264841 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5451baae-8770-445f-a927-4a492ca321dd tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:26.265286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5451baae-8770-445f-a927-4a492ca321dd tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:26.265707 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5451baae-8770-445f-a927-4a492ca321dd tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:26.297666 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5451baae-8770-445f-a927-4a492ca321dd tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:26.298123 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5451baae-8770-445f-a927-4a492ca321dd tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:26.298556 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5451baae-8770-445f-a927-4a492ca321dd tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:26.298990 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.objects.instance [None req-5451baae-8770-445f-a927-4a492ca321dd tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lazy-loading 'fault' on Instance uuid db08ae39-c1c5-4ad9-b37a-e4315bc48e62 {{(pid=125266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 06:43:26.339485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5451baae-8770-445f-a927-4a492ca321dd tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:26.347082 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5451baae-8770-445f-a927-4a492ca321dd tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62" status: 200 len: 1303 microversion: 2.1 time: 0.094185 Oct 11 06:43:26.347662 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 146/291] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:26 2022] GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62 => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:27.202695 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8e198f82-63fb-4e56-873e-bc81fcf50f24 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:27.203408 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8e198f82-63fb-4e56-873e-bc81fcf50f24 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:27.209217 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e198f82-63fb-4e56-873e-bc81fcf50f24 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:27.209712 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e198f82-63fb-4e56-873e-bc81fcf50f24 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:27.210138 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e198f82-63fb-4e56-873e-bc81fcf50f24 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:27.210836 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e198f82-63fb-4e56-873e-bc81fcf50f24 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:27.211285 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e198f82-63fb-4e56-873e-bc81fcf50f24 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:27.211741 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e198f82-63fb-4e56-873e-bc81fcf50f24 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:27.243905 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-89f67a46-15de-4e0c-91f3-ade0fcdfcea7 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:27.244589 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-89f67a46-15de-4e0c-91f3-ade0fcdfcea7 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:27.251583 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89f67a46-15de-4e0c-91f3-ade0fcdfcea7 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:27.252068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89f67a46-15de-4e0c-91f3-ade0fcdfcea7 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:27.252503 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89f67a46-15de-4e0c-91f3-ade0fcdfcea7 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:27.253203 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89f67a46-15de-4e0c-91f3-ade0fcdfcea7 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:27.253652 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89f67a46-15de-4e0c-91f3-ade0fcdfcea7 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:27.254077 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89f67a46-15de-4e0c-91f3-ade0fcdfcea7 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:27.269398 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-89f67a46-15de-4e0c-91f3-ade0fcdfcea7 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] HTTP exception thrown: Instance 07799819-eaa3-484d-bbcf-2c3c97ea26f3 could not be found. Oct 11 06:43:27.270935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-89f67a46-15de-4e0c-91f3-ade0fcdfcea7 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Request method failure captured: Oct 11 06:43:27.270935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: request: DELETE /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 HTTP/1.1 Oct 11 06:43:27.270935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept: application/json Oct 11 06:43:27.270935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Oct 11 06:43:27.270935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Connection: close Oct 11 06:43:27.270935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Length: 0 Oct 11 06:43:27.270935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Type: application/json Oct 11 06:43:27.270935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Host: 10.222.0.39 Oct 11 06:43:27.270935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Oct 11 06:43:27.270935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.12 Oct 11 06:43:27.270935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABjRRA4acwrDPax20-kw1Wxp_RnEeDEwRLDz8PMJ2jlcZvp0MGpfe5g-YswjjzsFB8gKApMOqN_CbMhX0IW1MD-FyKu7X8VCvVzXX6SvrsGHL3ye1kCF1ytCdpn60r6kEfqM9WC6024K0d8yAN6pcb9bDeuvodWUIRo3A9wNg0f7DCaTE8 Oct 11 06:43:27.270935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Oct 11 06:43:27.270935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Oct 11 06:43:27.270935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Oct 11 06:43:27.270935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Oct 11 06:43:27.270935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Oct 11 06:43:27.270935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Oct 11 06:43:27.270935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Id: 048f1b5e89c8417695e7916b444e2778 Oct 11 06:43:27.270935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-DeleteServersTestJSON-311276191 Oct 11 06:43:27.270935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Role: reader,member Oct 11 06:43:27.270935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Oct 11 06:43:27.272206 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_048f1b5e89c8417695e7916b444e2778"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/048f1b5e89c8417695e7916b444e2778"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/048f1b5e89c8417695e7916b444e2778"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/048f1b5e89c8417695e7916b444e2778"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 06:43:27.272206 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-DeleteServersTestJSON-311276191 Oct 11 06:43:27.272206 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 048f1b5e89c8417695e7916b444e2778 Oct 11 06:43:27.272206 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-DeleteServersTestJSON-311276191 Oct 11 06:43:27.272206 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User: tempest-DeleteServersTestJSON-311276191-project Oct 11 06:43:27.272206 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Oct 11 06:43:27.272206 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Oct 11 06:43:27.272206 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Id: e97edc31dd834fd8811ad1bb25f1168b Oct 11 06:43:27.272206 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-DeleteServersTestJSON-311276191-project Oct 11 06:43:27.272206 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: method: > Oct 11 06:43:27.272206 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: exception: Instance 07799819-eaa3-484d-bbcf-2c3c97ea26f3 could not be found. Oct 11 06:43:27.272206 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: action_args: {'id': '07799819-eaa3-484d-bbcf-2c3c97ea26f3'} Oct 11 06:43:27.272881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 06:43:27.272881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:43:27.272881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 06:43:27.272881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 06:43:27.272881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 06:43:27.272881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 06:43:27.272881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 06:43:27.272881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 06:43:27.272881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 06:43:27.272881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 06:43:27.272881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07799819-eaa3-484d-bbcf-2c3c97ea26f3 could not be found. Oct 11 06:43:27.272881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:43:27.272881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:43:27.272881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:43:27.272881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:43:27.272881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:43:27.272881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:43:27.272881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 06:43:27.272881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 06:43:27.272881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 06:43:27.274371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 06:43:27.274371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 06:43:27.274371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 06:43:27.274371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 06:43:27.274371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 06:43:27.274371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 06:43:27.274371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 06:43:27.274371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 06:43:27.274371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 06:43:27.274371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07799819-eaa3-484d-bbcf-2c3c97ea26f3 could not be found. Oct 11 06:43:27.274371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:43:27.274371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:43:27.274371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:43:27.274371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:43:27.274371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:43:27.274371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:43:27.274371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 06:43:27.274371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 06:43:27.274371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07799819-eaa3-484d-bbcf-2c3c97ea26f3 could not be found. Oct 11 06:43:27.274371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:43:27.275760 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-89f67a46-15de-4e0c-91f3-ade0fcdfcea7 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Returning 404 to user: Instance 07799819-eaa3-484d-bbcf-2c3c97ea26f3 could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 06:43:27.275760 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-89f67a46-15de-4e0c-91f3-ade0fcdfcea7 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "DELETE /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 404 len: 111 microversion: 2.1 time: 0.032580 Oct 11 06:43:27.275760 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 147/292] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Oct 11 06:43:27 2022] DELETE /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 06:43:27.280824 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5c56e652-95a1-443a-a8f2-4ba2a49aa413 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:27.281423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5c56e652-95a1-443a-a8f2-4ba2a49aa413 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] [instance: 07799819-eaa3-484d-bbcf-2c3c97ea26f3] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:27.287011 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5c56e652-95a1-443a-a8f2-4ba2a49aa413 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:27.287508 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5c56e652-95a1-443a-a8f2-4ba2a49aa413 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:27.287930 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5c56e652-95a1-443a-a8f2-4ba2a49aa413 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:27.288608 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5c56e652-95a1-443a-a8f2-4ba2a49aa413 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:27.289044 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5c56e652-95a1-443a-a8f2-4ba2a49aa413 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:27.289458 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5c56e652-95a1-443a-a8f2-4ba2a49aa413 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:27.303748 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-5c56e652-95a1-443a-a8f2-4ba2a49aa413 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] HTTP exception thrown: Instance 07799819-eaa3-484d-bbcf-2c3c97ea26f3 could not be found. Oct 11 06:43:27.305244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5c56e652-95a1-443a-a8f2-4ba2a49aa413 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Request method failure captured: Oct 11 06:43:27.305244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: request: GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 HTTP/1.1 Oct 11 06:43:27.305244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept: application/json Oct 11 06:43:27.305244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Oct 11 06:43:27.305244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Connection: close Oct 11 06:43:27.305244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Length: 0 Oct 11 06:43:27.305244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Type: application/json Oct 11 06:43:27.305244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Host: 10.222.0.39 Oct 11 06:43:27.305244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Oct 11 06:43:27.305244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.12 Oct 11 06:43:27.305244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABjRRA4acwrDPax20-kw1Wxp_RnEeDEwRLDz8PMJ2jlcZvp0MGpfe5g-YswjjzsFB8gKApMOqN_CbMhX0IW1MD-FyKu7X8VCvVzXX6SvrsGHL3ye1kCF1ytCdpn60r6kEfqM9WC6024K0d8yAN6pcb9bDeuvodWUIRo3A9wNg0f7DCaTE8 Oct 11 06:43:27.305244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Oct 11 06:43:27.305244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Oct 11 06:43:27.305244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Oct 11 06:43:27.305244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Oct 11 06:43:27.305244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Oct 11 06:43:27.305244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Oct 11 06:43:27.305244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Id: 048f1b5e89c8417695e7916b444e2778 Oct 11 06:43:27.305244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-DeleteServersTestJSON-311276191 Oct 11 06:43:27.305244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Role: reader,member Oct 11 06:43:27.305244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Oct 11 06:43:27.306603 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_048f1b5e89c8417695e7916b444e2778"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/048f1b5e89c8417695e7916b444e2778"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/048f1b5e89c8417695e7916b444e2778"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/048f1b5e89c8417695e7916b444e2778"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 06:43:27.306603 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-DeleteServersTestJSON-311276191 Oct 11 06:43:27.306603 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 048f1b5e89c8417695e7916b444e2778 Oct 11 06:43:27.306603 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-DeleteServersTestJSON-311276191 Oct 11 06:43:27.306603 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User: tempest-DeleteServersTestJSON-311276191-project Oct 11 06:43:27.306603 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Oct 11 06:43:27.306603 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Oct 11 06:43:27.306603 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Id: e97edc31dd834fd8811ad1bb25f1168b Oct 11 06:43:27.306603 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-DeleteServersTestJSON-311276191-project Oct 11 06:43:27.306603 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: method: > Oct 11 06:43:27.306603 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: exception: Instance 07799819-eaa3-484d-bbcf-2c3c97ea26f3 could not be found. Oct 11 06:43:27.306603 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: action_args: {'id': '07799819-eaa3-484d-bbcf-2c3c97ea26f3'} Oct 11 06:43:27.307236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 06:43:27.307236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:43:27.307236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 06:43:27.307236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 06:43:27.307236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 06:43:27.307236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 06:43:27.307236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 06:43:27.307236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 06:43:27.307236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 06:43:27.307236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 06:43:27.307236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07799819-eaa3-484d-bbcf-2c3c97ea26f3 could not be found. Oct 11 06:43:27.307236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:43:27.307236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:43:27.307236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:43:27.307236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:43:27.307236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:43:27.307236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:43:27.307236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 06:43:27.307236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 06:43:27.307236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 06:43:27.308952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 06:43:27.308952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 06:43:27.308952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 06:43:27.308952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 06:43:27.308952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 06:43:27.308952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 06:43:27.308952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 06:43:27.308952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07799819-eaa3-484d-bbcf-2c3c97ea26f3 could not be found. Oct 11 06:43:27.308952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:43:27.308952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:43:27.308952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:43:27.308952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:43:27.308952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:43:27.308952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:43:27.308952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 06:43:27.308952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 06:43:27.308952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07799819-eaa3-484d-bbcf-2c3c97ea26f3 could not be found. Oct 11 06:43:27.308952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:43:27.310004 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5c56e652-95a1-443a-a8f2-4ba2a49aa413 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] Returning 404 to user: Instance 07799819-eaa3-484d-bbcf-2c3c97ea26f3 could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 06:43:27.310004 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5c56e652-95a1-443a-a8f2-4ba2a49aa413 tempest-DeleteServersTestJSON-311276191 tempest-DeleteServersTestJSON-311276191-project] 10.222.0.39 "GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3" status: 404 len: 111 microversion: 2.1 time: 0.029613 Oct 11 06:43:27.310004 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 148/293] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:27 2022] GET /compute/v2.1/servers/07799819-eaa3-484d-bbcf-2c3c97ea26f3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 06:43:27.347952 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8e198f82-63fb-4e56-873e-bc81fcf50f24 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:27.356149 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8e198f82-63fb-4e56-873e-bc81fcf50f24 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.157374 Oct 11 06:43:27.356808 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 146/294] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:27 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:43:27.370748 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ee092868-6f27-4383-946a-05be6f128019 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:27.371626 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ee092868-6f27-4383-946a-05be6f128019 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: db08ae39-c1c5-4ad9-b37a-e4315bc48e62] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:27.378355 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ee092868-6f27-4383-946a-05be6f128019 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:27.378826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ee092868-6f27-4383-946a-05be6f128019 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:27.379250 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ee092868-6f27-4383-946a-05be6f128019 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:27.379962 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ee092868-6f27-4383-946a-05be6f128019 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:27.380399 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ee092868-6f27-4383-946a-05be6f128019 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:27.380809 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ee092868-6f27-4383-946a-05be6f128019 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:27.394281 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-ee092868-6f27-4383-946a-05be6f128019 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] HTTP exception thrown: Instance db08ae39-c1c5-4ad9-b37a-e4315bc48e62 could not be found. Oct 11 06:43:27.395832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ee092868-6f27-4383-946a-05be6f128019 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Request method failure captured: Oct 11 06:43:27.395832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: request: GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62 HTTP/1.1 Oct 11 06:43:27.395832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept: application/json Oct 11 06:43:27.395832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Oct 11 06:43:27.395832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Connection: close Oct 11 06:43:27.395832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Length: 0 Oct 11 06:43:27.395832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Type: application/json Oct 11 06:43:27.395832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Host: 10.222.0.39 Oct 11 06:43:27.395832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Oct 11 06:43:27.395832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.12 Oct 11 06:43:27.395832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABjRRBq4GiCZDu3sSDc4REQ2qevHv9BelDVFN7r5Pppw_XnRsQeH1DkCf_6vRdsDQqQj_TAPF0TSc0rD2Gb27tjTXAlbyhvaiU9FZBWWqj6UzJya1M3YlKN7u1yAsiShZgN6hKJ-OJNmw8rbvzwaH170N2kB76Hu40iEBy-v-eyGKiIhjg Oct 11 06:43:27.395832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Oct 11 06:43:27.395832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Oct 11 06:43:27.395832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Oct 11 06:43:27.395832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Oct 11 06:43:27.395832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Oct 11 06:43:27.395832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Oct 11 06:43:27.395832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Id: bc43c2d6c1364f23b21d203467adb5c5 Oct 11 06:43:27.395832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-VolumesActionsTest-2023171458 Oct 11 06:43:27.395832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Role: reader,member Oct 11 06:43:27.395832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Oct 11 06:43:27.397146 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bc43c2d6c1364f23b21d203467adb5c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bc43c2d6c1364f23b21d203467adb5c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bc43c2d6c1364f23b21d203467adb5c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bc43c2d6c1364f23b21d203467adb5c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 06:43:27.397146 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-VolumesActionsTest-2023171458 Oct 11 06:43:27.397146 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Id: bc43c2d6c1364f23b21d203467adb5c5 Oct 11 06:43:27.397146 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-VolumesActionsTest-2023171458 Oct 11 06:43:27.397146 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User: tempest-VolumesActionsTest-2023171458-project Oct 11 06:43:27.397146 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Oct 11 06:43:27.397146 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Oct 11 06:43:27.397146 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Id: 0a48c619ff834ca7942d9be275fe61ea Oct 11 06:43:27.397146 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-VolumesActionsTest-2023171458-project Oct 11 06:43:27.397146 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: method: > Oct 11 06:43:27.397146 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: exception: Instance db08ae39-c1c5-4ad9-b37a-e4315bc48e62 could not be found. Oct 11 06:43:27.397146 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: action_args: {'id': 'db08ae39-c1c5-4ad9-b37a-e4315bc48e62'} Oct 11 06:43:27.397939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 06:43:27.397939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:43:27.397939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 06:43:27.397939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 06:43:27.397939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 06:43:27.397939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 06:43:27.397939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 06:43:27.397939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 06:43:27.397939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 06:43:27.397939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 06:43:27.397939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db08ae39-c1c5-4ad9-b37a-e4315bc48e62 could not be found. Oct 11 06:43:27.397939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:43:27.397939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:43:27.397939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:43:27.397939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:43:27.397939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:43:27.397939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:43:27.397939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 06:43:27.397939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 06:43:27.397939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 06:43:27.399211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 06:43:27.399211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 06:43:27.399211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 06:43:27.399211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 06:43:27.399211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 06:43:27.399211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 06:43:27.399211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 06:43:27.399211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db08ae39-c1c5-4ad9-b37a-e4315bc48e62 could not be found. Oct 11 06:43:27.399211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:43:27.399211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:43:27.399211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:43:27.399211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:43:27.399211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:43:27.399211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:43:27.399211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 06:43:27.399211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 06:43:27.399211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db08ae39-c1c5-4ad9-b37a-e4315bc48e62 could not be found. Oct 11 06:43:27.399211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:43:27.400202 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ee092868-6f27-4383-946a-05be6f128019 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Returning 404 to user: Instance db08ae39-c1c5-4ad9-b37a-e4315bc48e62 could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 06:43:27.400202 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ee092868-6f27-4383-946a-05be6f128019 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62" status: 404 len: 111 microversion: 2.1 time: 0.030955 Oct 11 06:43:27.400202 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 149/295] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:27 2022] GET /compute/v2.1/servers/db08ae39-c1c5-4ad9-b37a-e4315bc48e62 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 06:43:27.498115 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c0eeea53-9470-49f7-92e2-dbe92d17bbfc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1694593811", "imageRef": "2303551c-410e-4a2b-8eeb-dea686876901", "flavorRef": "452", "networks": [{"uuid": "ba1b0919-ff00-4aaa-90bf-c000e38c5340"}]}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:43:27.554036 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.network.neutron [None req-c0eeea53-9470-49f7-92e2-dbe92d17bbfc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] validate_networks() for [('ba1b0919-ff00-4aaa-90bf-c000e38c5340', None, None, None, None, None)] {{(pid=125267) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 06:43:27.903786 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-c0eeea53-9470-49f7-92e2-dbe92d17bbfc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Flavor limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 06:43:27.904129 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-c0eeea53-9470-49f7-92e2-dbe92d17bbfc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Image limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 06:43:27.904855 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-c0eeea53-9470-49f7-92e2-dbe92d17bbfc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Flavor pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 06:43:27.905255 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-c0eeea53-9470-49f7-92e2-dbe92d17bbfc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Image pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 06:43:27.905659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-c0eeea53-9470-49f7-92e2-dbe92d17bbfc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 06:43:27.914803 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c0eeea53-9470-49f7-92e2-dbe92d17bbfc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:27.915476 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c0eeea53-9470-49f7-92e2-dbe92d17bbfc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:27.916048 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c0eeea53-9470-49f7-92e2-dbe92d17bbfc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:27.917498 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c0eeea53-9470-49f7-92e2-dbe92d17bbfc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:27.918242 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c0eeea53-9470-49f7-92e2-dbe92d17bbfc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:27.918852 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c0eeea53-9470-49f7-92e2-dbe92d17bbfc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:27.937686 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-c0eeea53-9470-49f7-92e2-dbe92d17bbfc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Getting quotas for project bc43c2d6c1364f23b21d203467adb5c5. Resources: {'cores', 'ram', 'instances'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 06:43:27.942346 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-c0eeea53-9470-49f7-92e2-dbe92d17bbfc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Getting quotas for user 0a48c619ff834ca7942d9be275fe61ea and project bc43c2d6c1364f23b21d203467adb5c5. Resources: {'cores', 'ram', 'instances'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 06:43:27.957765 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c0eeea53-9470-49f7-92e2-dbe92d17bbfc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Going to run 1 instances... {{(pid=125267) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 06:43:27.960492 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c0eeea53-9470-49f7-92e2-dbe92d17bbfc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: 6f767c28-1b70-44a4-b38d-3427c4356a8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2303551c-410e-4a2b-8eeb-dea686876901',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 06:43:28.009447 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c0eeea53-9470-49f7-92e2-dbe92d17bbfc tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.515143 Oct 11 06:43:28.010078 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 147/296] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Oct 11 06:43:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 06:43:28.021312 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9cbfa9d2-365c-4bc2-9d32-1370d0f7b986 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:28.021916 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9cbfa9d2-365c-4bc2-9d32-1370d0f7b986 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: 6f767c28-1b70-44a4-b38d-3427c4356a8f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:28.093236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9cbfa9d2-365c-4bc2-9d32-1370d0f7b986 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:28.100882 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9cbfa9d2-365c-4bc2-9d32-1370d0f7b986 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f" status: 200 len: 1214 microversion: 2.1 time: 0.083505 Oct 11 06:43:28.102043 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 150/297] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:28 2022] GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:28.380090 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0795d363-7bb0-42bd-a96e-c423aa5d964d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:28.381389 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0795d363-7bb0-42bd-a96e-c423aa5d964d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:28.389186 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0795d363-7bb0-42bd-a96e-c423aa5d964d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:28.390012 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0795d363-7bb0-42bd-a96e-c423aa5d964d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:28.390656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0795d363-7bb0-42bd-a96e-c423aa5d964d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:28.391711 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0795d363-7bb0-42bd-a96e-c423aa5d964d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:28.392795 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0795d363-7bb0-42bd-a96e-c423aa5d964d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:28.393513 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0795d363-7bb0-42bd-a96e-c423aa5d964d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:28.579704 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0795d363-7bb0-42bd-a96e-c423aa5d964d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:28.589590 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0795d363-7bb0-42bd-a96e-c423aa5d964d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.213871 Oct 11 06:43:28.591236 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 148/298] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:28 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:29.125425 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cb9912c4-9072-41c7-a8ab-4022b5506e13 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:29.126762 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cb9912c4-9072-41c7-a8ab-4022b5506e13 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: 6f767c28-1b70-44a4-b38d-3427c4356a8f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:29.133745 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb9912c4-9072-41c7-a8ab-4022b5506e13 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:29.134275 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb9912c4-9072-41c7-a8ab-4022b5506e13 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:29.134661 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb9912c4-9072-41c7-a8ab-4022b5506e13 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:29.135452 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb9912c4-9072-41c7-a8ab-4022b5506e13 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:29.136668 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb9912c4-9072-41c7-a8ab-4022b5506e13 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:29.137296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb9912c4-9072-41c7-a8ab-4022b5506e13 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:29.222018 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cb9912c4-9072-41c7-a8ab-4022b5506e13 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:29.231834 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cb9912c4-9072-41c7-a8ab-4022b5506e13 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f" status: 200 len: 1266 microversion: 2.1 time: 0.112341 Oct 11 06:43:29.232829 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 151/299] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:29 2022] GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f => generated 1266 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:29.613315 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8661f2f6-4d93-43ed-afa3-5e4b4be5071f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:29.614032 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8661f2f6-4d93-43ed-afa3-5e4b4be5071f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:29.620735 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8661f2f6-4d93-43ed-afa3-5e4b4be5071f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:29.621300 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8661f2f6-4d93-43ed-afa3-5e4b4be5071f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:29.621723 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8661f2f6-4d93-43ed-afa3-5e4b4be5071f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:29.622410 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8661f2f6-4d93-43ed-afa3-5e4b4be5071f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:29.622861 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8661f2f6-4d93-43ed-afa3-5e4b4be5071f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:29.623287 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8661f2f6-4d93-43ed-afa3-5e4b4be5071f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:30.041490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8661f2f6-4d93-43ed-afa3-5e4b4be5071f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:30.049887 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8661f2f6-4d93-43ed-afa3-5e4b4be5071f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.440355 Oct 11 06:43:30.050447 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 149/300] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:29 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:30.255713 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fa2bb298-8643-4464-8ecc-170038f209e1 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:30.256289 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fa2bb298-8643-4464-8ecc-170038f209e1 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: 6f767c28-1b70-44a4-b38d-3427c4356a8f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:30.263887 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa2bb298-8643-4464-8ecc-170038f209e1 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:30.264361 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa2bb298-8643-4464-8ecc-170038f209e1 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:30.264779 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa2bb298-8643-4464-8ecc-170038f209e1 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:30.265470 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa2bb298-8643-4464-8ecc-170038f209e1 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:30.265912 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa2bb298-8643-4464-8ecc-170038f209e1 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:30.266323 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa2bb298-8643-4464-8ecc-170038f209e1 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:30.355502 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fa2bb298-8643-4464-8ecc-170038f209e1 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:30.363618 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fa2bb298-8643-4464-8ecc-170038f209e1 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f" status: 200 len: 1266 microversion: 2.1 time: 0.111762 Oct 11 06:43:30.364294 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 152/301] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:30 2022] GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f => generated 1266 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:31.072870 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-81639cd7-0eba-4ad2-8c1c-9f17adf6f763 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:31.073501 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-81639cd7-0eba-4ad2-8c1c-9f17adf6f763 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:31.080382 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81639cd7-0eba-4ad2-8c1c-9f17adf6f763 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:31.080860 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81639cd7-0eba-4ad2-8c1c-9f17adf6f763 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:31.081339 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81639cd7-0eba-4ad2-8c1c-9f17adf6f763 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:31.082046 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81639cd7-0eba-4ad2-8c1c-9f17adf6f763 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:31.082487 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81639cd7-0eba-4ad2-8c1c-9f17adf6f763 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:31.082931 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81639cd7-0eba-4ad2-8c1c-9f17adf6f763 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:31.223317 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-81639cd7-0eba-4ad2-8c1c-9f17adf6f763 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:31.232485 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-81639cd7-0eba-4ad2-8c1c-9f17adf6f763 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.163387 Oct 11 06:43:31.233034 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 150/302] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:31 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:31.385927 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d64517fd-e599-4b39-82d0-195ae56e7651 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:31.386526 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d64517fd-e599-4b39-82d0-195ae56e7651 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: 6f767c28-1b70-44a4-b38d-3427c4356a8f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:31.393598 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d64517fd-e599-4b39-82d0-195ae56e7651 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:31.394205 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d64517fd-e599-4b39-82d0-195ae56e7651 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:31.394785 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d64517fd-e599-4b39-82d0-195ae56e7651 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:31.395680 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d64517fd-e599-4b39-82d0-195ae56e7651 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:31.396273 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d64517fd-e599-4b39-82d0-195ae56e7651 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:31.396686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d64517fd-e599-4b39-82d0-195ae56e7651 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:31.463184 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d64517fd-e599-4b39-82d0-195ae56e7651 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:31.471297 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d64517fd-e599-4b39-82d0-195ae56e7651 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f" status: 200 len: 1266 microversion: 2.1 time: 0.089240 Oct 11 06:43:31.471902 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 153/303] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:31 2022] GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:32.256898 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ae7b3c57-8a62-44b9-b46c-cacebe1cab63 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:32.258047 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ae7b3c57-8a62-44b9-b46c-cacebe1cab63 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:32.268772 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ae7b3c57-8a62-44b9-b46c-cacebe1cab63 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:32.271295 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ae7b3c57-8a62-44b9-b46c-cacebe1cab63 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:32.272023 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ae7b3c57-8a62-44b9-b46c-cacebe1cab63 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:32.273230 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ae7b3c57-8a62-44b9-b46c-cacebe1cab63 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:32.274614 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ae7b3c57-8a62-44b9-b46c-cacebe1cab63 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:32.276473 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ae7b3c57-8a62-44b9-b46c-cacebe1cab63 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:32.494618 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c60b2258-44d3-478e-a5c4-1f1890a25595 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:32.495371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c60b2258-44d3-478e-a5c4-1f1890a25595 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: 6f767c28-1b70-44a4-b38d-3427c4356a8f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:32.506249 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c60b2258-44d3-478e-a5c4-1f1890a25595 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:32.506826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c60b2258-44d3-478e-a5c4-1f1890a25595 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:32.507928 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c60b2258-44d3-478e-a5c4-1f1890a25595 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:32.509282 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c60b2258-44d3-478e-a5c4-1f1890a25595 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:32.512653 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c60b2258-44d3-478e-a5c4-1f1890a25595 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:32.515557 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c60b2258-44d3-478e-a5c4-1f1890a25595 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:32.515974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ae7b3c57-8a62-44b9-b46c-cacebe1cab63 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:32.523827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ae7b3c57-8a62-44b9-b46c-cacebe1cab63 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.270925 Oct 11 06:43:32.525553 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 151/304] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:32 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:32.629366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c60b2258-44d3-478e-a5c4-1f1890a25595 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:32.637301 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c60b2258-44d3-478e-a5c4-1f1890a25595 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f" status: 200 len: 1272 microversion: 2.1 time: 0.147067 Oct 11 06:43:32.637869 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 154/305] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:32 2022] GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f => generated 1272 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:43:33.549999 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d9c9033a-e349-4c72-b110-7c1d753092a8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:33.550779 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d9c9033a-e349-4c72-b110-7c1d753092a8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:33.557913 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d9c9033a-e349-4c72-b110-7c1d753092a8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:33.558918 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d9c9033a-e349-4c72-b110-7c1d753092a8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:33.559918 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d9c9033a-e349-4c72-b110-7c1d753092a8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:33.560888 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d9c9033a-e349-4c72-b110-7c1d753092a8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:33.561641 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d9c9033a-e349-4c72-b110-7c1d753092a8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:33.562402 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d9c9033a-e349-4c72-b110-7c1d753092a8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:33.662459 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-acac68d6-1deb-4f7f-9b89-39ce3742c84c tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:33.663306 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-acac68d6-1deb-4f7f-9b89-39ce3742c84c tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: 6f767c28-1b70-44a4-b38d-3427c4356a8f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:33.667540 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:33.683818 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-acac68d6-1deb-4f7f-9b89-39ce3742c84c tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:33.685619 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-acac68d6-1deb-4f7f-9b89-39ce3742c84c tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:33.686416 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-acac68d6-1deb-4f7f-9b89-39ce3742c84c tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:33.687237 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-acac68d6-1deb-4f7f-9b89-39ce3742c84c tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:33.687908 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-acac68d6-1deb-4f7f-9b89-39ce3742c84c tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:33.688546 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-acac68d6-1deb-4f7f-9b89-39ce3742c84c tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:33.758481 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d9c9033a-e349-4c72-b110-7c1d753092a8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:33.772724 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d9c9033a-e349-4c72-b110-7c1d753092a8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.227016 Oct 11 06:43:33.773506 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 152/306] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:33 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:33.958390 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-acac68d6-1deb-4f7f-9b89-39ce3742c84c tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:33.967347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-acac68d6-1deb-4f7f-9b89-39ce3742c84c tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f" status: 200 len: 1314 microversion: 2.1 time: 0.310434 Oct 11 06:43:33.970142 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 155/307] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:33 2022] GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:34.053153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-fc431a02-3569-4d48-8921-2258602d244e req-fd233602-5301-4acf-9e5e-8377392ed11e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f767c28-1b70-44a4-b38d-3427c4356a8f", "tag": "a7546388-0d1c-45e2-b5ee-4105348ad852"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:43:34.064004 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-fc431a02-3569-4d48-8921-2258602d244e req-fd233602-5301-4acf-9e5e-8377392ed11e service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:34.064575 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-fc431a02-3569-4d48-8921-2258602d244e req-fd233602-5301-4acf-9e5e-8377392ed11e service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:34.065134 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-fc431a02-3569-4d48-8921-2258602d244e req-fd233602-5301-4acf-9e5e-8377392ed11e service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:34.083126 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-fc431a02-3569-4d48-8921-2258602d244e req-fd233602-5301-4acf-9e5e-8377392ed11e service nova] Creating event network-changed:a7546388-0d1c-45e2-b5ee-4105348ad852 for instance 6f767c28-1b70-44a4-b38d-3427c4356a8f on hv-cinder-85495 Oct 11 06:43:34.092004 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-fc431a02-3569-4d48-8921-2258602d244e req-fd233602-5301-4acf-9e5e-8377392ed11e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042972 Oct 11 06:43:34.093431 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 153/308] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:43:34.800639 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7be73a17-fc53-4009-b02e-14cf1cc9241e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:34.801179 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7be73a17-fc53-4009-b02e-14cf1cc9241e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:34.808566 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7be73a17-fc53-4009-b02e-14cf1cc9241e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:34.809138 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7be73a17-fc53-4009-b02e-14cf1cc9241e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:34.809660 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7be73a17-fc53-4009-b02e-14cf1cc9241e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:34.810457 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7be73a17-fc53-4009-b02e-14cf1cc9241e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:34.810904 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7be73a17-fc53-4009-b02e-14cf1cc9241e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:34.811321 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7be73a17-fc53-4009-b02e-14cf1cc9241e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:34.829646 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:34.944865 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7be73a17-fc53-4009-b02e-14cf1cc9241e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:34.952329 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7be73a17-fc53-4009-b02e-14cf1cc9241e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.155644 Oct 11 06:43:34.952877 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 156/309] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:34 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:34.994345 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4e042ddc-04e4-4da4-949b-8888799a549c tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:34.995701 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4e042ddc-04e4-4da4-949b-8888799a549c tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: 6f767c28-1b70-44a4-b38d-3427c4356a8f] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:35.001697 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4e042ddc-04e4-4da4-949b-8888799a549c tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:35.002172 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4e042ddc-04e4-4da4-949b-8888799a549c tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:35.002594 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4e042ddc-04e4-4da4-949b-8888799a549c tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:35.003274 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4e042ddc-04e4-4da4-949b-8888799a549c tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:35.003752 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4e042ddc-04e4-4da4-949b-8888799a549c tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:35.004183 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4e042ddc-04e4-4da4-949b-8888799a549c tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:35.128461 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4e042ddc-04e4-4da4-949b-8888799a549c tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:35.135920 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4e042ddc-04e4-4da4-949b-8888799a549c tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f" status: 200 len: 1314 microversion: 2.1 time: 0.145836 Oct 11 06:43:35.136471 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 154/310] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:34 2022] GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:35.974611 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1da44bb8-7d1b-4b6d-acbb-49b891fbf2b3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:35.975212 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1da44bb8-7d1b-4b6d-acbb-49b891fbf2b3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:35.982267 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1da44bb8-7d1b-4b6d-acbb-49b891fbf2b3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:35.982738 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1da44bb8-7d1b-4b6d-acbb-49b891fbf2b3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:35.983159 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1da44bb8-7d1b-4b6d-acbb-49b891fbf2b3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:35.983868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1da44bb8-7d1b-4b6d-acbb-49b891fbf2b3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:35.984310 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1da44bb8-7d1b-4b6d-acbb-49b891fbf2b3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:35.984899 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1da44bb8-7d1b-4b6d-acbb-49b891fbf2b3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:36.126997 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1da44bb8-7d1b-4b6d-acbb-49b891fbf2b3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:36.134896 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1da44bb8-7d1b-4b6d-acbb-49b891fbf2b3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.164289 Oct 11 06:43:36.136015 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 157/311] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:35 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:36.158341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ccf3972c-8740-43a1-bfdd-caa98644202a tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:36.158944 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ccf3972c-8740-43a1-bfdd-caa98644202a tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: 6f767c28-1b70-44a4-b38d-3427c4356a8f] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:36.165930 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ccf3972c-8740-43a1-bfdd-caa98644202a tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:36.166422 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ccf3972c-8740-43a1-bfdd-caa98644202a tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:36.166883 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ccf3972c-8740-43a1-bfdd-caa98644202a tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:36.167723 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ccf3972c-8740-43a1-bfdd-caa98644202a tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:36.168165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ccf3972c-8740-43a1-bfdd-caa98644202a tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:36.168777 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ccf3972c-8740-43a1-bfdd-caa98644202a tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:36.305791 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ccf3972c-8740-43a1-bfdd-caa98644202a tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:36.314213 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ccf3972c-8740-43a1-bfdd-caa98644202a tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f" status: 200 len: 1314 microversion: 2.1 time: 0.159541 Oct 11 06:43:36.314809 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 155/312] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:36 2022] GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:37.159760 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b5c963d7-3533-4bc7-8c5e-ff21ad0b36f4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:37.160889 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b5c963d7-3533-4bc7-8c5e-ff21ad0b36f4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:37.170250 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b5c963d7-3533-4bc7-8c5e-ff21ad0b36f4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:37.170955 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b5c963d7-3533-4bc7-8c5e-ff21ad0b36f4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:37.171674 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b5c963d7-3533-4bc7-8c5e-ff21ad0b36f4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:37.172530 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b5c963d7-3533-4bc7-8c5e-ff21ad0b36f4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:37.173146 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b5c963d7-3533-4bc7-8c5e-ff21ad0b36f4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:37.173709 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b5c963d7-3533-4bc7-8c5e-ff21ad0b36f4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:37.337701 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c05eb8cb-206f-4d49-8852-b64b97cd8f43 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:37.339696 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c05eb8cb-206f-4d49-8852-b64b97cd8f43 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: 6f767c28-1b70-44a4-b38d-3427c4356a8f] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:37.342976 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b5c963d7-3533-4bc7-8c5e-ff21ad0b36f4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:37.347499 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c05eb8cb-206f-4d49-8852-b64b97cd8f43 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:37.348248 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c05eb8cb-206f-4d49-8852-b64b97cd8f43 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:37.348777 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c05eb8cb-206f-4d49-8852-b64b97cd8f43 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:37.349693 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c05eb8cb-206f-4d49-8852-b64b97cd8f43 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:37.350353 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c05eb8cb-206f-4d49-8852-b64b97cd8f43 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:37.350987 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c05eb8cb-206f-4d49-8852-b64b97cd8f43 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:37.354939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b5c963d7-3533-4bc7-8c5e-ff21ad0b36f4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1521 microversion: 2.1 time: 0.198343 Oct 11 06:43:37.355674 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 158/313] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:37 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:37.523693 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c05eb8cb-206f-4d49-8852-b64b97cd8f43 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:37.532576 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c05eb8cb-206f-4d49-8852-b64b97cd8f43 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f" status: 200 len: 1314 microversion: 2.1 time: 0.199205 Oct 11 06:43:37.533147 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 156/314] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:37 2022] GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:43:38.379245 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c6fde97e-5517-4e46-a346-1a24ce8a6aa0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:38.383032 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c6fde97e-5517-4e46-a346-1a24ce8a6aa0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:38.394780 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:38.402748 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c6fde97e-5517-4e46-a346-1a24ce8a6aa0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:38.403241 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c6fde97e-5517-4e46-a346-1a24ce8a6aa0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:38.403703 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c6fde97e-5517-4e46-a346-1a24ce8a6aa0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:38.404672 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c6fde97e-5517-4e46-a346-1a24ce8a6aa0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:38.405285 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c6fde97e-5517-4e46-a346-1a24ce8a6aa0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:38.405718 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c6fde97e-5517-4e46-a346-1a24ce8a6aa0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:38.554977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1dd987d4-8611-4bac-a408-44cbfe01fcd3 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:38.555609 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1dd987d4-8611-4bac-a408-44cbfe01fcd3 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: 6f767c28-1b70-44a4-b38d-3427c4356a8f] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:38.557930 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=2 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:38.558849 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=6 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:38.559537 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:38.566784 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1dd987d4-8611-4bac-a408-44cbfe01fcd3 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:38.567386 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1dd987d4-8611-4bac-a408-44cbfe01fcd3 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:38.567902 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1dd987d4-8611-4bac-a408-44cbfe01fcd3 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:38.568799 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1dd987d4-8611-4bac-a408-44cbfe01fcd3 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:38.569354 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1dd987d4-8611-4bac-a408-44cbfe01fcd3 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:38.569847 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1dd987d4-8611-4bac-a408-44cbfe01fcd3 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:38.576848 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c6fde97e-5517-4e46-a346-1a24ce8a6aa0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:38.585561 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c6fde97e-5517-4e46-a346-1a24ce8a6aa0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1501 microversion: 2.1 time: 0.211191 Oct 11 06:43:38.586123 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 159/315] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:38 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1501 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:43:38.609237 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-18e32942-ee56-458e-be57-2cd3d2ec51ed tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:38.609840 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-18e32942-ee56-458e-be57-2cd3d2ec51ed tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:38.616193 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18e32942-ee56-458e-be57-2cd3d2ec51ed tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:38.616655 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18e32942-ee56-458e-be57-2cd3d2ec51ed tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:38.617265 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18e32942-ee56-458e-be57-2cd3d2ec51ed tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:38.618110 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18e32942-ee56-458e-be57-2cd3d2ec51ed tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:38.618535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18e32942-ee56-458e-be57-2cd3d2ec51ed tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:38.619118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18e32942-ee56-458e-be57-2cd3d2ec51ed tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:38.714820 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1dd987d4-8611-4bac-a408-44cbfe01fcd3 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:38.723268 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1dd987d4-8611-4bac-a408-44cbfe01fcd3 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f" status: 200 len: 1314 microversion: 2.1 time: 0.172053 Oct 11 06:43:38.724113 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 157/316] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:38 2022] GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:43:38.758604 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-18e32942-ee56-458e-be57-2cd3d2ec51ed tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:38.767262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-18e32942-ee56-458e-be57-2cd3d2ec51ed tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1515 microversion: 2.1 time: 0.161850 Oct 11 06:43:38.767701 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 160/317] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:38 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:43:39.746468 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-863582be-dae6-494c-8e8d-55b637cbed15 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:39.747074 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-863582be-dae6-494c-8e8d-55b637cbed15 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: 6f767c28-1b70-44a4-b38d-3427c4356a8f] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:39.754305 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-863582be-dae6-494c-8e8d-55b637cbed15 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:39.754825 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-863582be-dae6-494c-8e8d-55b637cbed15 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:39.755272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-863582be-dae6-494c-8e8d-55b637cbed15 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:39.756120 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-863582be-dae6-494c-8e8d-55b637cbed15 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:39.756553 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-863582be-dae6-494c-8e8d-55b637cbed15 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:39.757136 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-863582be-dae6-494c-8e8d-55b637cbed15 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:39.762958 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:39.897702 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-863582be-dae6-494c-8e8d-55b637cbed15 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:39.908406 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-863582be-dae6-494c-8e8d-55b637cbed15 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f" status: 200 len: 1314 microversion: 2.1 time: 0.166063 Oct 11 06:43:39.909139 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 158/318] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:39 2022] GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:43:39.921629 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-48704d08-bc2f-454c-9587-cf6c21b5c365 req-d392ef8b-67b4-4355-b8f6-db55cabe72aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f767c28-1b70-44a4-b38d-3427c4356a8f", "name": "network-vif-plugged", "status": "completed", "tag": "a7546388-0d1c-45e2-b5ee-4105348ad852"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:43:39.932611 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-48704d08-bc2f-454c-9587-cf6c21b5c365 req-d392ef8b-67b4-4355-b8f6-db55cabe72aa service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:39.933166 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-48704d08-bc2f-454c-9587-cf6c21b5c365 req-d392ef8b-67b4-4355-b8f6-db55cabe72aa service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:39.933732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-48704d08-bc2f-454c-9587-cf6c21b5c365 req-d392ef8b-67b4-4355-b8f6-db55cabe72aa service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:39.945519 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-48704d08-bc2f-454c-9587-cf6c21b5c365 req-d392ef8b-67b4-4355-b8f6-db55cabe72aa service nova] Creating event network-vif-plugged:a7546388-0d1c-45e2-b5ee-4105348ad852 for instance 6f767c28-1b70-44a4-b38d-3427c4356a8f on hv-cinder-85495 Oct 11 06:43:39.950967 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-48704d08-bc2f-454c-9587-cf6c21b5c365 req-d392ef8b-67b4-4355-b8f6-db55cabe72aa service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033031 Oct 11 06:43:39.951580 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 161/319] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:43:40.188690 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8eaabb27-5681-4443-8bec-25e927e8961b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:43:40.191214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8eaabb27-5681-4443-8bec-25e927e8961b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:40.198597 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8eaabb27-5681-4443-8bec-25e927e8961b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:40.199076 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8eaabb27-5681-4443-8bec-25e927e8961b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:40.199543 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8eaabb27-5681-4443-8bec-25e927e8961b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:40.200245 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8eaabb27-5681-4443-8bec-25e927e8961b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:40.200716 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8eaabb27-5681-4443-8bec-25e927e8961b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:40.201188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8eaabb27-5681-4443-8bec-25e927e8961b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:40.224720 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-8eaabb27-5681-4443-8bec-25e927e8961b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lazy-loading 'flavor' on Instance uuid 03687593-229b-46bf-b79a-f09a1db51ac2 {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 06:43:40.343259 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8eaabb27-5681-4443-8bec-25e927e8961b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "POST /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2/action" status: 200 len: 32 microversion: 2.1 time: 0.158670 Oct 11 06:43:40.343844 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 159/320] 10.222.0.39 () {60 vars in 1278 bytes} [Tue Oct 11 06:43:40 2022] POST /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2/action => generated 32 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 06:43:40.353989 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a86c6fa4-fbcd-4f25-b92a-5bea3ab74933 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:40.354685 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a86c6fa4-fbcd-4f25-b92a-5bea3ab74933 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:40.360810 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a86c6fa4-fbcd-4f25-b92a-5bea3ab74933 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:40.361291 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a86c6fa4-fbcd-4f25-b92a-5bea3ab74933 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:40.361723 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a86c6fa4-fbcd-4f25-b92a-5bea3ab74933 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:40.362414 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a86c6fa4-fbcd-4f25-b92a-5bea3ab74933 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:40.362885 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a86c6fa4-fbcd-4f25-b92a-5bea3ab74933 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:40.363522 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a86c6fa4-fbcd-4f25-b92a-5bea3ab74933 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:40.539110 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a86c6fa4-fbcd-4f25-b92a-5bea3ab74933 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:40.546729 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a86c6fa4-fbcd-4f25-b92a-5bea3ab74933 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1521 microversion: 2.1 time: 0.197182 Oct 11 06:43:40.547522 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 162/321] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:40 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:40.933174 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7de5010e-86d6-4007-a467-7daf6016a2d5 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:40.933993 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7de5010e-86d6-4007-a467-7daf6016a2d5 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: 6f767c28-1b70-44a4-b38d-3427c4356a8f] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:40.940017 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7de5010e-86d6-4007-a467-7daf6016a2d5 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:40.940631 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7de5010e-86d6-4007-a467-7daf6016a2d5 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:40.941064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7de5010e-86d6-4007-a467-7daf6016a2d5 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:40.941758 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7de5010e-86d6-4007-a467-7daf6016a2d5 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:40.942204 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7de5010e-86d6-4007-a467-7daf6016a2d5 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:40.942623 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7de5010e-86d6-4007-a467-7daf6016a2d5 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:41.078679 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7de5010e-86d6-4007-a467-7daf6016a2d5 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:41.086726 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7de5010e-86d6-4007-a467-7daf6016a2d5 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f" status: 200 len: 1314 microversion: 2.1 time: 0.158499 Oct 11 06:43:41.087480 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 160/322] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:40 2022] GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:41.387809 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c388575f-7876-4005-9c8f-6d9f43d072a0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:41.388316 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c388575f-7876-4005-9c8f-6d9f43d072a0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:41.394555 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c388575f-7876-4005-9c8f-6d9f43d072a0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:41.395033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c388575f-7876-4005-9c8f-6d9f43d072a0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:41.395496 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c388575f-7876-4005-9c8f-6d9f43d072a0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:41.396182 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c388575f-7876-4005-9c8f-6d9f43d072a0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:41.396629 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c388575f-7876-4005-9c8f-6d9f43d072a0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:41.397066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c388575f-7876-4005-9c8f-6d9f43d072a0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:41.421419 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c388575f-7876-4005-9c8f-6d9f43d072a0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/ips" status: 200 len: 146 microversion: 2.1 time: 0.037908 Oct 11 06:43:41.421995 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 163/323] 10.222.0.39 () {58 vars in 1248 bytes} [Tue Oct 11 06:43:41 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:43:41.570395 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-484e92d0-fef7-4a77-b3f0-be6c837e36a4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:41.571056 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-484e92d0-fef7-4a77-b3f0-be6c837e36a4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:41.577975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-484e92d0-fef7-4a77-b3f0-be6c837e36a4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:41.578455 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-484e92d0-fef7-4a77-b3f0-be6c837e36a4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:41.578884 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-484e92d0-fef7-4a77-b3f0-be6c837e36a4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:41.579600 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-484e92d0-fef7-4a77-b3f0-be6c837e36a4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:41.580107 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-484e92d0-fef7-4a77-b3f0-be6c837e36a4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:41.580595 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-484e92d0-fef7-4a77-b3f0-be6c837e36a4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:41.712034 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-484e92d0-fef7-4a77-b3f0-be6c837e36a4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:41.720470 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-484e92d0-fef7-4a77-b3f0-be6c837e36a4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1521 microversion: 2.1 time: 0.154320 Oct 11 06:43:41.721216 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 161/324] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:41 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:42.109656 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8f6ab1b1-9ec7-47f5-bb30-6a364d807b90 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:42.110255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8f6ab1b1-9ec7-47f5-bb30-6a364d807b90 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: 6f767c28-1b70-44a4-b38d-3427c4356a8f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:42.116156 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f6ab1b1-9ec7-47f5-bb30-6a364d807b90 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:42.116628 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f6ab1b1-9ec7-47f5-bb30-6a364d807b90 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:42.117048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f6ab1b1-9ec7-47f5-bb30-6a364d807b90 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:42.117731 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f6ab1b1-9ec7-47f5-bb30-6a364d807b90 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:42.118171 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f6ab1b1-9ec7-47f5-bb30-6a364d807b90 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:42.118583 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f6ab1b1-9ec7-47f5-bb30-6a364d807b90 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:42.258921 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8f6ab1b1-9ec7-47f5-bb30-6a364d807b90 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:42.266707 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8f6ab1b1-9ec7-47f5-bb30-6a364d807b90 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f" status: 200 len: 1314 microversion: 2.1 time: 0.160820 Oct 11 06:43:42.267267 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 164/325] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:42 2022] GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:42.743970 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e74afba9-1419-4a1a-9ef4-8cbcd614d8ce tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:42.744730 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e74afba9-1419-4a1a-9ef4-8cbcd614d8ce tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:42.752529 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e74afba9-1419-4a1a-9ef4-8cbcd614d8ce tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:42.753485 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e74afba9-1419-4a1a-9ef4-8cbcd614d8ce tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:42.754427 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e74afba9-1419-4a1a-9ef4-8cbcd614d8ce tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:42.755453 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e74afba9-1419-4a1a-9ef4-8cbcd614d8ce tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:42.756189 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e74afba9-1419-4a1a-9ef4-8cbcd614d8ce tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:42.779355 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e74afba9-1419-4a1a-9ef4-8cbcd614d8ce tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:42.944456 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e74afba9-1419-4a1a-9ef4-8cbcd614d8ce tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:42.952786 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e74afba9-1419-4a1a-9ef4-8cbcd614d8ce tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1521 microversion: 2.1 time: 0.213206 Oct 11 06:43:42.953340 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 162/326] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:42 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:43.289829 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-79cb1534-a3ce-473a-8c66-f3d64ff81c55 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:43.290431 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-79cb1534-a3ce-473a-8c66-f3d64ff81c55 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: 6f767c28-1b70-44a4-b38d-3427c4356a8f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:43.296767 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-79cb1534-a3ce-473a-8c66-f3d64ff81c55 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:43.297255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-79cb1534-a3ce-473a-8c66-f3d64ff81c55 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:43.297659 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-79cb1534-a3ce-473a-8c66-f3d64ff81c55 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:43.298341 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-79cb1534-a3ce-473a-8c66-f3d64ff81c55 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:43.298784 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-79cb1534-a3ce-473a-8c66-f3d64ff81c55 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:43.299349 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-79cb1534-a3ce-473a-8c66-f3d64ff81c55 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:43.449624 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-79cb1534-a3ce-473a-8c66-f3d64ff81c55 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:43.457481 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-79cb1534-a3ce-473a-8c66-f3d64ff81c55 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f" status: 200 len: 1314 microversion: 2.1 time: 0.171483 Oct 11 06:43:43.458282 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 165/327] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:43 2022] GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:43.975852 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-011219b6-fb76-45a9-b5dd-b7e349d46e83 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:43.977096 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-011219b6-fb76-45a9-b5dd-b7e349d46e83 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:43.990288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-011219b6-fb76-45a9-b5dd-b7e349d46e83 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:43.990776 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-011219b6-fb76-45a9-b5dd-b7e349d46e83 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:43.991406 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-011219b6-fb76-45a9-b5dd-b7e349d46e83 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:43.992151 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-011219b6-fb76-45a9-b5dd-b7e349d46e83 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:43.992597 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-011219b6-fb76-45a9-b5dd-b7e349d46e83 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:43.993016 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-011219b6-fb76-45a9-b5dd-b7e349d46e83 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:44.137467 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-011219b6-fb76-45a9-b5dd-b7e349d46e83 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:44.146017 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-011219b6-fb76-45a9-b5dd-b7e349d46e83 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1521 microversion: 2.1 time: 0.173867 Oct 11 06:43:44.160165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 163/328] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:43 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:44.160511 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7de03a19-ab9f-47c3-a3f3-660c23ce694b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e5e70f5-98d8-41a7-a98e-a665c3b44a19"}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:43:44.163094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7de03a19-ab9f-47c3-a3f3-660c23ce694b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:44.169667 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7de03a19-ab9f-47c3-a3f3-660c23ce694b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:44.170145 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7de03a19-ab9f-47c3-a3f3-660c23ce694b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:44.170571 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7de03a19-ab9f-47c3-a3f3-660c23ce694b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:44.171293 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7de03a19-ab9f-47c3-a3f3-660c23ce694b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:44.171816 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7de03a19-ab9f-47c3-a3f3-660c23ce694b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:44.172237 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7de03a19-ab9f-47c3-a3f3-660c23ce694b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:44.481151 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8c818cfd-ac65-4e73-955f-213f62d84685 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:44.482172 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8c818cfd-ac65-4e73-955f-213f62d84685 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: 6f767c28-1b70-44a4-b38d-3427c4356a8f] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:44.491893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8c818cfd-ac65-4e73-955f-213f62d84685 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:44.492628 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8c818cfd-ac65-4e73-955f-213f62d84685 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:44.493169 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8c818cfd-ac65-4e73-955f-213f62d84685 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:44.494123 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8c818cfd-ac65-4e73-955f-213f62d84685 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:44.494681 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8c818cfd-ac65-4e73-955f-213f62d84685 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:44.495240 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8c818cfd-ac65-4e73-955f-213f62d84685 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:44.772332 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8c818cfd-ac65-4e73-955f-213f62d84685 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:44.781131 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8c818cfd-ac65-4e73-955f-213f62d84685 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f" status: 200 len: 1499 microversion: 2.1 time: 0.304326 Oct 11 06:43:44.781956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 164/329] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:44 2022] GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f => generated 1499 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:43:45.171041 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-76e2ce78-a450-4fe8-8918-d96636b5ee24 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:45.171722 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-76e2ce78-a450-4fe8-8918-d96636b5ee24 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:45.177887 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-76e2ce78-a450-4fe8-8918-d96636b5ee24 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:45.178344 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-76e2ce78-a450-4fe8-8918-d96636b5ee24 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:45.178797 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-76e2ce78-a450-4fe8-8918-d96636b5ee24 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:45.179557 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-76e2ce78-a450-4fe8-8918-d96636b5ee24 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:45.180004 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-76e2ce78-a450-4fe8-8918-d96636b5ee24 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:45.180424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-76e2ce78-a450-4fe8-8918-d96636b5ee24 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:45.328994 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-76e2ce78-a450-4fe8-8918-d96636b5ee24 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:45.337753 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-76e2ce78-a450-4fe8-8918-d96636b5ee24 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1521 microversion: 2.1 time: 0.170612 Oct 11 06:43:45.338904 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 165/330] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:45 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:43:45.391111 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7de03a19-ab9f-47c3-a3f3-660c23ce694b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "POST /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.234665 Oct 11 06:43:45.392093 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 166/331] 10.222.0.39 () {60 vars in 1323 bytes} [Tue Oct 11 06:43:44 2022] POST /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 194 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:43:45.405274 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f3ad215e-e2a6-48d1-9665-3f52441bbf5f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:45.406015 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f3ad215e-e2a6-48d1-9665-3f52441bbf5f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:45.414325 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3ad215e-e2a6-48d1-9665-3f52441bbf5f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:45.414897 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3ad215e-e2a6-48d1-9665-3f52441bbf5f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:45.415370 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3ad215e-e2a6-48d1-9665-3f52441bbf5f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:45.416163 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3ad215e-e2a6-48d1-9665-3f52441bbf5f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:45.416605 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3ad215e-e2a6-48d1-9665-3f52441bbf5f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:45.417209 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3ad215e-e2a6-48d1-9665-3f52441bbf5f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:45.438053 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-54cd067a-dccb-451a-8b94-2a2ca1a0479d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:45.438901 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-54cd067a-dccb-451a-8b94-2a2ca1a0479d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:45.444159 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f3ad215e-e2a6-48d1-9665-3f52441bbf5f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/ips" status: 200 len: 152 microversion: 2.20 time: 0.051758 Oct 11 06:43:45.444723 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 166/332] 10.222.0.39 () {60 vars in 1289 bytes} [Tue Oct 11 06:43:45 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/ips => generated 152 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:43:45.446000 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54cd067a-dccb-451a-8b94-2a2ca1a0479d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:45.446488 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54cd067a-dccb-451a-8b94-2a2ca1a0479d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:45.446923 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54cd067a-dccb-451a-8b94-2a2ca1a0479d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:45.448188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54cd067a-dccb-451a-8b94-2a2ca1a0479d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:45.448813 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54cd067a-dccb-451a-8b94-2a2ca1a0479d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:45.449584 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54cd067a-dccb-451a-8b94-2a2ca1a0479d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:45.475244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-54cd067a-dccb-451a-8b94-2a2ca1a0479d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/ips" status: 200 len: 148 microversion: 2.1 time: 0.042289 Oct 11 06:43:45.475922 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 167/333] 10.222.0.39 () {58 vars in 1248 bytes} [Tue Oct 11 06:43:45 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/ips => generated 148 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:43:45.770303 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0306ba02-d627-49e7-98fd-8e124def1637 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:45.771127 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0306ba02-d627-49e7-98fd-8e124def1637 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: 6f767c28-1b70-44a4-b38d-3427c4356a8f] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:45.787576 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0306ba02-d627-49e7-98fd-8e124def1637 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:45.791459 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0306ba02-d627-49e7-98fd-8e124def1637 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:45.791877 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0306ba02-d627-49e7-98fd-8e124def1637 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:45.792949 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0306ba02-d627-49e7-98fd-8e124def1637 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:45.793556 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0306ba02-d627-49e7-98fd-8e124def1637 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:45.794138 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0306ba02-d627-49e7-98fd-8e124def1637 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:45.847294 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0306ba02-d627-49e7-98fd-8e124def1637 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: 6f767c28-1b70-44a4-b38d-3427c4356a8f] Going to try to terminate instance {{(pid=125267) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 06:43:45.969342 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0306ba02-d627-49e7-98fd-8e124def1637 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f" status: 204 len: 0 microversion: 2.1 time: 0.203288 Oct 11 06:43:45.970863 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 167/334] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Oct 11 06:43:45 2022] DELETE /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 06:43:45.979788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-88892c91-edc1-45c7-ad15-4fbd0639f22d tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:45.980678 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-88892c91-edc1-45c7-ad15-4fbd0639f22d tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: 6f767c28-1b70-44a4-b38d-3427c4356a8f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:45.987566 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-88892c91-edc1-45c7-ad15-4fbd0639f22d tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:45.988440 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-88892c91-edc1-45c7-ad15-4fbd0639f22d tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:45.989025 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-88892c91-edc1-45c7-ad15-4fbd0639f22d tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:45.989880 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-88892c91-edc1-45c7-ad15-4fbd0639f22d tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:45.990679 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-88892c91-edc1-45c7-ad15-4fbd0639f22d tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:45.991435 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-88892c91-edc1-45c7-ad15-4fbd0639f22d tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:46.155698 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-88892c91-edc1-45c7-ad15-4fbd0639f22d tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:46.170252 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-88892c91-edc1-45c7-ad15-4fbd0639f22d tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f" status: 200 len: 1505 microversion: 2.1 time: 0.194893 Oct 11 06:43:46.171241 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 168/335] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:45 2022] GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f => generated 1505 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:46.362350 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b1a1de38-ec64-43a6-a958-1a5eab131e47 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:46.363205 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b1a1de38-ec64-43a6-a958-1a5eab131e47 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:46.369955 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b1a1de38-ec64-43a6-a958-1a5eab131e47 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:46.370434 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b1a1de38-ec64-43a6-a958-1a5eab131e47 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:46.370910 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b1a1de38-ec64-43a6-a958-1a5eab131e47 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:46.371670 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b1a1de38-ec64-43a6-a958-1a5eab131e47 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:46.372122 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b1a1de38-ec64-43a6-a958-1a5eab131e47 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:46.372542 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b1a1de38-ec64-43a6-a958-1a5eab131e47 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:46.504765 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b1a1de38-ec64-43a6-a958-1a5eab131e47 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:46.513006 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b1a1de38-ec64-43a6-a958-1a5eab131e47 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1521 microversion: 2.1 time: 0.154872 Oct 11 06:43:46.514045 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 168/336] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:46 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:47.195102 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fbcf9bce-f357-4efc-bf0d-8f1b12768261 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:47.195973 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fbcf9bce-f357-4efc-bf0d-8f1b12768261 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: 6f767c28-1b70-44a4-b38d-3427c4356a8f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:47.208565 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fbcf9bce-f357-4efc-bf0d-8f1b12768261 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:47.209051 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fbcf9bce-f357-4efc-bf0d-8f1b12768261 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:47.209478 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fbcf9bce-f357-4efc-bf0d-8f1b12768261 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:47.210229 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fbcf9bce-f357-4efc-bf0d-8f1b12768261 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:47.210714 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fbcf9bce-f357-4efc-bf0d-8f1b12768261 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:47.211127 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fbcf9bce-f357-4efc-bf0d-8f1b12768261 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:47.286358 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a8fec473-eded-40da-a2a8-2c3e8899a406 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f0cf8e2-9a0e-4e89-a630-1b108c7ea64f"}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:43:47.288710 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a8fec473-eded-40da-a2a8-2c3e8899a406 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:47.296893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a8fec473-eded-40da-a2a8-2c3e8899a406 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:47.297793 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a8fec473-eded-40da-a2a8-2c3e8899a406 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:47.298106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a8fec473-eded-40da-a2a8-2c3e8899a406 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:47.298692 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a8fec473-eded-40da-a2a8-2c3e8899a406 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:47.299323 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a8fec473-eded-40da-a2a8-2c3e8899a406 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:47.299964 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a8fec473-eded-40da-a2a8-2c3e8899a406 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:47.357448 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fbcf9bce-f357-4efc-bf0d-8f1b12768261 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:47.365082 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fbcf9bce-f357-4efc-bf0d-8f1b12768261 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f" status: 200 len: 1505 microversion: 2.1 time: 0.174410 Oct 11 06:43:47.365630 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 169/337] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:47 2022] GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f => generated 1505 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:47.538962 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a8e2b600-8084-4721-978c-f0586bf515cb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:47.539801 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a8e2b600-8084-4721-978c-f0586bf515cb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:47.547551 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a8e2b600-8084-4721-978c-f0586bf515cb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:47.548195 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a8e2b600-8084-4721-978c-f0586bf515cb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:47.548680 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a8e2b600-8084-4721-978c-f0586bf515cb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:47.549383 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a8e2b600-8084-4721-978c-f0586bf515cb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:47.549824 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a8e2b600-8084-4721-978c-f0586bf515cb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:47.550238 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a8e2b600-8084-4721-978c-f0586bf515cb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:47.795659 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a8e2b600-8084-4721-978c-f0586bf515cb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:47.807577 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a8e2b600-8084-4721-978c-f0586bf515cb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1521 microversion: 2.1 time: 0.275945 Oct 11 06:43:47.808142 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 170/338] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:47 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:47.824144 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a8fec473-eded-40da-a2a8-2c3e8899a406 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "POST /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.541622 Oct 11 06:43:47.825005 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 169/339] 10.222.0.39 () {60 vars in 1323 bytes} [Tue Oct 11 06:43:47 2022] POST /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 194 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:43:48.397937 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1bc3b1ca-a7c3-4d3c-bb35-1266e2c50258 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:48.398547 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1bc3b1ca-a7c3-4d3c-bb35-1266e2c50258 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: 6f767c28-1b70-44a4-b38d-3427c4356a8f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:48.404893 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1bc3b1ca-a7c3-4d3c-bb35-1266e2c50258 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:48.405380 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1bc3b1ca-a7c3-4d3c-bb35-1266e2c50258 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:48.405822 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1bc3b1ca-a7c3-4d3c-bb35-1266e2c50258 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:48.406573 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1bc3b1ca-a7c3-4d3c-bb35-1266e2c50258 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:48.407013 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1bc3b1ca-a7c3-4d3c-bb35-1266e2c50258 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:48.407632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1bc3b1ca-a7c3-4d3c-bb35-1266e2c50258 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:48.631488 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1bc3b1ca-a7c3-4d3c-bb35-1266e2c50258 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:48.640355 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1bc3b1ca-a7c3-4d3c-bb35-1266e2c50258 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f" status: 200 len: 1505 microversion: 2.1 time: 0.248183 Oct 11 06:43:48.650621 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 171/340] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:48 2022] GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f => generated 1505 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:48.783641 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c101cf86-8434-4d45-948d-4ad4355df37c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:43:48.784659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c101cf86-8434-4d45-948d-4ad4355df37c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:48.791084 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c101cf86-8434-4d45-948d-4ad4355df37c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:48.791749 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c101cf86-8434-4d45-948d-4ad4355df37c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:48.792213 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c101cf86-8434-4d45-948d-4ad4355df37c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:48.793116 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c101cf86-8434-4d45-948d-4ad4355df37c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:48.793572 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c101cf86-8434-4d45-948d-4ad4355df37c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:48.793994 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c101cf86-8434-4d45-948d-4ad4355df37c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:48.797747 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:48.818575 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-c101cf86-8434-4d45-948d-4ad4355df37c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lazy-loading 'flavor' on Instance uuid 43d48211-8dab-4abd-8c95-e850b83382ff {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 06:43:48.831829 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1df55b06-c2ba-4a36-9b35-c40ba9dc2d53 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:48.832689 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1df55b06-c2ba-4a36-9b35-c40ba9dc2d53 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:48.838998 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1df55b06-c2ba-4a36-9b35-c40ba9dc2d53 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:48.839569 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1df55b06-c2ba-4a36-9b35-c40ba9dc2d53 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:48.840057 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1df55b06-c2ba-4a36-9b35-c40ba9dc2d53 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:48.840984 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1df55b06-c2ba-4a36-9b35-c40ba9dc2d53 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:48.841782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1df55b06-c2ba-4a36-9b35-c40ba9dc2d53 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:48.842309 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1df55b06-c2ba-4a36-9b35-c40ba9dc2d53 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:49.146608 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c101cf86-8434-4d45-948d-4ad4355df37c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "POST /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/action" status: 202 len: 0 microversion: 2.20 time: 0.368108 Oct 11 06:43:49.148733 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 170/341] 10.222.0.39 () {62 vars in 1319 bytes} [Tue Oct 11 06:43:48 2022] POST /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 06:43:49.184766 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-dc652854-6101-4f3b-99fb-cb7a6d68ad62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:49.186129 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-dc652854-6101-4f3b-99fb-cb7a6d68ad62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:49.203803 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dc652854-6101-4f3b-99fb-cb7a6d68ad62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:49.204575 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dc652854-6101-4f3b-99fb-cb7a6d68ad62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:49.205763 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dc652854-6101-4f3b-99fb-cb7a6d68ad62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:49.207185 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dc652854-6101-4f3b-99fb-cb7a6d68ad62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:49.207975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dc652854-6101-4f3b-99fb-cb7a6d68ad62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:49.208432 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dc652854-6101-4f3b-99fb-cb7a6d68ad62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:49.217837 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1df55b06-c2ba-4a36-9b35-c40ba9dc2d53 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:49.227126 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1df55b06-c2ba-4a36-9b35-c40ba9dc2d53 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1521 microversion: 2.1 time: 0.399363 Oct 11 06:43:49.227968 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 172/342] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:48 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1521 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:43:49.233568 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-c776f842-7422-4edc-a951-b0ea2bb58334 req-58d7a6e6-5bea-4417-b23d-9ddc7cbb692e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f767c28-1b70-44a4-b38d-3427c4356a8f", "name": "network-vif-deleted", "tag": "a7546388-0d1c-45e2-b5ee-4105348ad852"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:43:49.243541 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-c776f842-7422-4edc-a951-b0ea2bb58334 req-58d7a6e6-5bea-4417-b23d-9ddc7cbb692e service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:49.244806 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-c776f842-7422-4edc-a951-b0ea2bb58334 req-58d7a6e6-5bea-4417-b23d-9ddc7cbb692e service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:49.245233 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-c776f842-7422-4edc-a951-b0ea2bb58334 req-58d7a6e6-5bea-4417-b23d-9ddc7cbb692e service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:49.262587 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:49.279349 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-c776f842-7422-4edc-a951-b0ea2bb58334 req-58d7a6e6-5bea-4417-b23d-9ddc7cbb692e service nova] Creating event network-vif-deleted:a7546388-0d1c-45e2-b5ee-4105348ad852 for instance 6f767c28-1b70-44a4-b38d-3427c4356a8f on hv-cinder-85495 Oct 11 06:43:49.298136 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-c776f842-7422-4edc-a951-b0ea2bb58334 req-58d7a6e6-5bea-4417-b23d-9ddc7cbb692e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067868 Oct 11 06:43:49.300740 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 173/343] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:43:49.370071 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-dc652854-6101-4f3b-99fb-cb7a6d68ad62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:49.380203 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-dc652854-6101-4f3b-99fb-cb7a6d68ad62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:49.381650 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-dc652854-6101-4f3b-99fb-cb7a6d68ad62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:49.383076 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-dc652854-6101-4f3b-99fb-cb7a6d68ad62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1723 microversion: 2.20 time: 0.219450 Oct 11 06:43:49.383659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 171/344] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:43:49 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:43:49.668256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bc3df082-f577-4e69-9403-0e090f4975d4 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:49.670947 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bc3df082-f577-4e69-9403-0e090f4975d4 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: 6f767c28-1b70-44a4-b38d-3427c4356a8f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:49.679150 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc3df082-f577-4e69-9403-0e090f4975d4 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:49.679973 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc3df082-f577-4e69-9403-0e090f4975d4 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:49.680627 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc3df082-f577-4e69-9403-0e090f4975d4 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:49.681848 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc3df082-f577-4e69-9403-0e090f4975d4 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:49.682644 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc3df082-f577-4e69-9403-0e090f4975d4 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:49.683301 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc3df082-f577-4e69-9403-0e090f4975d4 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:49.744955 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc3df082-f577-4e69-9403-0e090f4975d4 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:49.745519 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc3df082-f577-4e69-9403-0e090f4975d4 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:49.746113 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc3df082-f577-4e69-9403-0e090f4975d4 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:49.746708 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.objects.instance [None req-bc3df082-f577-4e69-9403-0e090f4975d4 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lazy-loading 'fault' on Instance uuid 6f767c28-1b70-44a4-b38d-3427c4356a8f {{(pid=125266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 06:43:49.804480 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bc3df082-f577-4e69-9403-0e090f4975d4 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:49.813088 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bc3df082-f577-4e69-9403-0e090f4975d4 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f" status: 200 len: 1304 microversion: 2.1 time: 0.151436 Oct 11 06:43:49.814066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 174/345] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:49 2022] GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f => generated 1304 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:49.858605 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4dde93a2-e803-46e5-aa28-58d9acadf6d1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:43:49.865117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4dde93a2-e803-46e5-aa28-58d9acadf6d1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:49.865582 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4dde93a2-e803-46e5-aa28-58d9acadf6d1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:49.866234 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4dde93a2-e803-46e5-aa28-58d9acadf6d1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:49.954932 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4dde93a2-e803-46e5-aa28-58d9acadf6d1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Going to try to stop instance {{(pid=125267) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 06:43:49.998313 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4dde93a2-e803-46e5-aa28-58d9acadf6d1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "POST /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/action" status: 202 len: 0 microversion: 2.1 time: 0.143574 Oct 11 06:43:49.998975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 172/346] 10.222.0.39 () {60 vars in 1278 bytes} [Tue Oct 11 06:43:49 2022] POST /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 06:43:50.006917 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bd50104b-7ec6-4540-a098-3a462644de74 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:50.007525 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bd50104b-7ec6-4540-a098-3a462644de74 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:50.015250 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bd50104b-7ec6-4540-a098-3a462644de74 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:50.015756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bd50104b-7ec6-4540-a098-3a462644de74 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:50.016191 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bd50104b-7ec6-4540-a098-3a462644de74 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:50.016894 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bd50104b-7ec6-4540-a098-3a462644de74 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:50.017342 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bd50104b-7ec6-4540-a098-3a462644de74 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:50.018197 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bd50104b-7ec6-4540-a098-3a462644de74 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:50.161193 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bd50104b-7ec6-4540-a098-3a462644de74 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:50.171551 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bd50104b-7ec6-4540-a098-3a462644de74 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1722 microversion: 2.1 time: 0.166222 Oct 11 06:43:50.171551 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 175/347] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:50 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:50.253017 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b1962c8c-8e0e-41f9-a5cf-cbb682b92553 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:50.254409 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b1962c8c-8e0e-41f9-a5cf-cbb682b92553 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:50.262724 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b1962c8c-8e0e-41f9-a5cf-cbb682b92553 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:50.263212 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b1962c8c-8e0e-41f9-a5cf-cbb682b92553 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:50.263665 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b1962c8c-8e0e-41f9-a5cf-cbb682b92553 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:50.264365 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b1962c8c-8e0e-41f9-a5cf-cbb682b92553 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:50.264809 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b1962c8c-8e0e-41f9-a5cf-cbb682b92553 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:50.265227 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b1962c8c-8e0e-41f9-a5cf-cbb682b92553 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:50.409630 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1010bc8b-3a26-499c-9603-0274e7f946cd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:50.410504 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1010bc8b-3a26-499c-9603-0274e7f946cd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:50.417982 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b1962c8c-8e0e-41f9-a5cf-cbb682b92553 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:50.418139 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1010bc8b-3a26-499c-9603-0274e7f946cd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:50.418687 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1010bc8b-3a26-499c-9603-0274e7f946cd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:50.419117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1010bc8b-3a26-499c-9603-0274e7f946cd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:50.420044 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1010bc8b-3a26-499c-9603-0274e7f946cd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:50.421332 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1010bc8b-3a26-499c-9603-0274e7f946cd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:50.421974 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1010bc8b-3a26-499c-9603-0274e7f946cd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:50.425871 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b1962c8c-8e0e-41f9-a5cf-cbb682b92553 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1521 microversion: 2.1 time: 0.178799 Oct 11 06:43:50.426430 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 173/348] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:50 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:50.577682 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1010bc8b-3a26-499c-9603-0274e7f946cd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:50.585897 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1010bc8b-3a26-499c-9603-0274e7f946cd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:50.587323 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1010bc8b-3a26-499c-9603-0274e7f946cd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:50.588722 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1010bc8b-3a26-499c-9603-0274e7f946cd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1723 microversion: 2.20 time: 0.182970 Oct 11 06:43:50.589642 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 176/349] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:43:50 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:43:50.839335 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-afc84766-507d-4bbc-a975-9803e09ba440 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:50.839988 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-afc84766-507d-4bbc-a975-9803e09ba440 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: 6f767c28-1b70-44a4-b38d-3427c4356a8f] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:50.846179 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-afc84766-507d-4bbc-a975-9803e09ba440 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:50.846664 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-afc84766-507d-4bbc-a975-9803e09ba440 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:50.847090 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-afc84766-507d-4bbc-a975-9803e09ba440 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:50.847880 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-afc84766-507d-4bbc-a975-9803e09ba440 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:50.848355 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-afc84766-507d-4bbc-a975-9803e09ba440 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:50.848793 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-afc84766-507d-4bbc-a975-9803e09ba440 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:50.884882 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-afc84766-507d-4bbc-a975-9803e09ba440 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:50.885816 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-afc84766-507d-4bbc-a975-9803e09ba440 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:50.886681 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-afc84766-507d-4bbc-a975-9803e09ba440 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:50.887297 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-afc84766-507d-4bbc-a975-9803e09ba440 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lazy-loading 'fault' on Instance uuid 6f767c28-1b70-44a4-b38d-3427c4356a8f {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 06:43:50.938506 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-afc84766-507d-4bbc-a975-9803e09ba440 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a48c619ff834ca7942d9be275fe61ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43c2d6c1364f23b21d203467adb5c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:50.947727 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-afc84766-507d-4bbc-a975-9803e09ba440 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f" status: 200 len: 1304 microversion: 2.1 time: 0.114173 Oct 11 06:43:50.948544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 174/350] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:50 2022] GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:51.193067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-00dc448e-63a6-4e9b-b3ca-deb6ce7626a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:51.193744 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-00dc448e-63a6-4e9b-b3ca-deb6ce7626a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:51.201248 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-00dc448e-63a6-4e9b-b3ca-deb6ce7626a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:51.201878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-00dc448e-63a6-4e9b-b3ca-deb6ce7626a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:51.202157 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-00dc448e-63a6-4e9b-b3ca-deb6ce7626a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:51.202861 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-00dc448e-63a6-4e9b-b3ca-deb6ce7626a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:51.203309 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-00dc448e-63a6-4e9b-b3ca-deb6ce7626a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:51.203765 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-00dc448e-63a6-4e9b-b3ca-deb6ce7626a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:51.363362 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-00dc448e-63a6-4e9b-b3ca-deb6ce7626a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:51.372668 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-00dc448e-63a6-4e9b-b3ca-deb6ce7626a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1722 microversion: 2.1 time: 0.183888 Oct 11 06:43:51.373237 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 177/351] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:51 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:51.453183 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-77ab1e4e-36cd-4ae4-836a-22f2910d0a5e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:51.454034 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-77ab1e4e-36cd-4ae4-836a-22f2910d0a5e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:51.480485 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-77ab1e4e-36cd-4ae4-836a-22f2910d0a5e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:51.481972 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-77ab1e4e-36cd-4ae4-836a-22f2910d0a5e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:51.482411 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-77ab1e4e-36cd-4ae4-836a-22f2910d0a5e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:51.483122 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-77ab1e4e-36cd-4ae4-836a-22f2910d0a5e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:51.487749 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-77ab1e4e-36cd-4ae4-836a-22f2910d0a5e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:51.489051 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-77ab1e4e-36cd-4ae4-836a-22f2910d0a5e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:51.616022 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-882cd7b6-a1f9-43af-9c37-fff57434ac5d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:51.617005 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-882cd7b6-a1f9-43af-9c37-fff57434ac5d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:51.625261 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-882cd7b6-a1f9-43af-9c37-fff57434ac5d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:51.626231 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-882cd7b6-a1f9-43af-9c37-fff57434ac5d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:51.626898 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-882cd7b6-a1f9-43af-9c37-fff57434ac5d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:51.627754 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-882cd7b6-a1f9-43af-9c37-fff57434ac5d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:51.628572 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-882cd7b6-a1f9-43af-9c37-fff57434ac5d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:51.629215 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-882cd7b6-a1f9-43af-9c37-fff57434ac5d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:51.667743 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-77ab1e4e-36cd-4ae4-836a-22f2910d0a5e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:51.678485 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-77ab1e4e-36cd-4ae4-836a-22f2910d0a5e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1521 microversion: 2.1 time: 0.231144 Oct 11 06:43:51.692584 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 175/352] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:51 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:51.799012 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-882cd7b6-a1f9-43af-9c37-fff57434ac5d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:51.810631 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-882cd7b6-a1f9-43af-9c37-fff57434ac5d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:51.812642 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-882cd7b6-a1f9-43af-9c37-fff57434ac5d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:51.814661 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-882cd7b6-a1f9-43af-9c37-fff57434ac5d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1723 microversion: 2.20 time: 0.203819 Oct 11 06:43:51.821061 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 178/353] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:43:51 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:43:51.972774 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e899e84a-f468-4f01-8d73-6a394dbc7ca0 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:51.973937 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e899e84a-f468-4f01-8d73-6a394dbc7ca0 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] [instance: 6f767c28-1b70-44a4-b38d-3427c4356a8f] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:51.982208 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e899e84a-f468-4f01-8d73-6a394dbc7ca0 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:51.983021 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e899e84a-f468-4f01-8d73-6a394dbc7ca0 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:51.983562 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e899e84a-f468-4f01-8d73-6a394dbc7ca0 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:51.984470 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e899e84a-f468-4f01-8d73-6a394dbc7ca0 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:51.985122 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e899e84a-f468-4f01-8d73-6a394dbc7ca0 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:51.986078 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e899e84a-f468-4f01-8d73-6a394dbc7ca0 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:52.002478 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-e899e84a-f468-4f01-8d73-6a394dbc7ca0 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] HTTP exception thrown: Instance 6f767c28-1b70-44a4-b38d-3427c4356a8f could not be found. Oct 11 06:43:52.007705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e899e84a-f468-4f01-8d73-6a394dbc7ca0 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Request method failure captured: Oct 11 06:43:52.007705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: request: GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f HTTP/1.1 Oct 11 06:43:52.007705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept: application/json Oct 11 06:43:52.007705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Oct 11 06:43:52.007705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Connection: close Oct 11 06:43:52.007705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Length: 0 Oct 11 06:43:52.007705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Type: application/json Oct 11 06:43:52.007705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Host: 10.222.0.39 Oct 11 06:43:52.007705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Oct 11 06:43:52.007705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.12 Oct 11 06:43:52.007705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABjRRBq4GiCZDu3sSDc4REQ2qevHv9BelDVFN7r5Pppw_XnRsQeH1DkCf_6vRdsDQqQj_TAPF0TSc0rD2Gb27tjTXAlbyhvaiU9FZBWWqj6UzJya1M3YlKN7u1yAsiShZgN6hKJ-OJNmw8rbvzwaH170N2kB76Hu40iEBy-v-eyGKiIhjg Oct 11 06:43:52.007705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Oct 11 06:43:52.007705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Oct 11 06:43:52.007705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Oct 11 06:43:52.007705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Oct 11 06:43:52.007705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Oct 11 06:43:52.007705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Oct 11 06:43:52.007705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Id: bc43c2d6c1364f23b21d203467adb5c5 Oct 11 06:43:52.007705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-VolumesActionsTest-2023171458 Oct 11 06:43:52.007705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Role: reader,member Oct 11 06:43:52.007705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Oct 11 06:43:52.009125 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bc43c2d6c1364f23b21d203467adb5c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bc43c2d6c1364f23b21d203467adb5c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bc43c2d6c1364f23b21d203467adb5c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bc43c2d6c1364f23b21d203467adb5c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 06:43:52.009125 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-VolumesActionsTest-2023171458 Oct 11 06:43:52.009125 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Id: bc43c2d6c1364f23b21d203467adb5c5 Oct 11 06:43:52.009125 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-VolumesActionsTest-2023171458 Oct 11 06:43:52.009125 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User: tempest-VolumesActionsTest-2023171458-project Oct 11 06:43:52.009125 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Oct 11 06:43:52.009125 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Oct 11 06:43:52.009125 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Id: 0a48c619ff834ca7942d9be275fe61ea Oct 11 06:43:52.009125 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-VolumesActionsTest-2023171458-project Oct 11 06:43:52.009125 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: method: > Oct 11 06:43:52.009125 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: exception: Instance 6f767c28-1b70-44a4-b38d-3427c4356a8f could not be found. Oct 11 06:43:52.009125 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: action_args: {'id': '6f767c28-1b70-44a4-b38d-3427c4356a8f'} Oct 11 06:43:52.010560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 06:43:52.010560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:43:52.010560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 06:43:52.010560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 06:43:52.010560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 06:43:52.010560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 06:43:52.010560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 06:43:52.010560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 06:43:52.010560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 06:43:52.010560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 06:43:52.010560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f767c28-1b70-44a4-b38d-3427c4356a8f could not be found. Oct 11 06:43:52.010560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 06:43:52.010560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:43:52.010560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 06:43:52.010560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:43:52.010560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:43:52.010560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:43:52.010560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 06:43:52.010560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 06:43:52.010560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 06:43:52.012214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 06:43:52.012214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 06:43:52.012214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 06:43:52.012214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 06:43:52.012214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 06:43:52.012214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 06:43:52.012214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 06:43:52.012214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f767c28-1b70-44a4-b38d-3427c4356a8f could not be found. Oct 11 06:43:52.012214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 06:43:52.012214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:43:52.012214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 06:43:52.012214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:43:52.012214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:43:52.012214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:43:52.012214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 06:43:52.012214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 06:43:52.012214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f767c28-1b70-44a4-b38d-3427c4356a8f could not be found. Oct 11 06:43:52.012214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 06:43:52.014116 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e899e84a-f468-4f01-8d73-6a394dbc7ca0 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] Returning 404 to user: Instance 6f767c28-1b70-44a4-b38d-3427c4356a8f could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 06:43:52.014116 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e899e84a-f468-4f01-8d73-6a394dbc7ca0 tempest-VolumesActionsTest-2023171458 tempest-VolumesActionsTest-2023171458-project] 10.222.0.39 "GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f" status: 404 len: 111 microversion: 2.1 time: 0.043177 Oct 11 06:43:52.018000 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 176/354] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:51 2022] GET /compute/v2.1/servers/6f767c28-1b70-44a4-b38d-3427c4356a8f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 06:43:52.324129 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3fae5663-fe46-4e30-863a-30c678dcb409 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Action: 'create', calling method: .version_select at 0x7f8e26f29280>, body: {"keypair": {"name": "tempest-keypair-379756893", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJW/pWuGN2Z0lAt1HFKtzxwL+he/djJu3Imb5/H6Lc94i2x6BHU6digJEXz44UnIjlb1+DLFzYTPxkEeMOrrcIaffB/TsJln2uvpCHOcM2XDGDPgKsxubzByxkUB2FGG1w=="}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:43:52.341824 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-3fae5663-fe46-4e30-863a-30c678dcb409 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Getting quotas for project 5af47e2321de4d299ff3a7fb3d3d9e3c. Resources: {'key_pairs'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 06:43:52.346731 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-3fae5663-fe46-4e30-863a-30c678dcb409 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Getting quotas for user 2e63c3f83f3d41018e6330f26ed7b8a0 and project 5af47e2321de4d299ff3a7fb3d3d9e3c. Resources: {'key_pairs'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 06:43:52.372940 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3fae5663-fe46-4e30-863a-30c678dcb409 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053783 Oct 11 06:43:52.381093 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 179/355] 10.222.0.39 () {60 vars in 1159 bytes} [Tue Oct 11 06:43:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:43:52.399245 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8ac459f8-84fc-4637-b016-a34da7b2f1de tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:52.399909 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8ac459f8-84fc-4637-b016-a34da7b2f1de tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:52.413776 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8ac459f8-84fc-4637-b016-a34da7b2f1de tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:52.414274 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8ac459f8-84fc-4637-b016-a34da7b2f1de tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:52.414715 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8ac459f8-84fc-4637-b016-a34da7b2f1de tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:52.415460 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8ac459f8-84fc-4637-b016-a34da7b2f1de tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:52.415940 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8ac459f8-84fc-4637-b016-a34da7b2f1de tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:52.416458 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8ac459f8-84fc-4637-b016-a34da7b2f1de tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:52.709479 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bcac45c5-f669-4d95-a7a2-c86ca6f09d40 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:52.710588 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bcac45c5-f669-4d95-a7a2-c86ca6f09d40 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:52.722511 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bcac45c5-f669-4d95-a7a2-c86ca6f09d40 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:52.723088 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bcac45c5-f669-4d95-a7a2-c86ca6f09d40 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:52.724796 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bcac45c5-f669-4d95-a7a2-c86ca6f09d40 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:52.725826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bcac45c5-f669-4d95-a7a2-c86ca6f09d40 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:52.727695 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bcac45c5-f669-4d95-a7a2-c86ca6f09d40 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:52.728485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bcac45c5-f669-4d95-a7a2-c86ca6f09d40 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:52.817523 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8ac459f8-84fc-4637-b016-a34da7b2f1de tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:52.832939 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8ac459f8-84fc-4637-b016-a34da7b2f1de tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1722 microversion: 2.1 time: 0.437391 Oct 11 06:43:52.843726 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 177/356] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:52 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1722 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:52.857388 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-519f00bf-684e-417f-af08-cf66e12dc2e2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:52.858028 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-519f00bf-684e-417f-af08-cf66e12dc2e2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:52.867918 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-519f00bf-684e-417f-af08-cf66e12dc2e2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:52.878602 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-519f00bf-684e-417f-af08-cf66e12dc2e2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:52.879700 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-519f00bf-684e-417f-af08-cf66e12dc2e2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:52.881103 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-519f00bf-684e-417f-af08-cf66e12dc2e2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:52.881767 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-519f00bf-684e-417f-af08-cf66e12dc2e2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:52.882277 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-519f00bf-684e-417f-af08-cf66e12dc2e2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:53.095388 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bcac45c5-f669-4d95-a7a2-c86ca6f09d40 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:53.114424 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bcac45c5-f669-4d95-a7a2-c86ca6f09d40 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1521 microversion: 2.1 time: 0.413185 Oct 11 06:43:53.115381 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 180/357] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:52 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1521 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:53.160590 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-519f00bf-684e-417f-af08-cf66e12dc2e2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:53.171239 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-519f00bf-684e-417f-af08-cf66e12dc2e2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:53.173054 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-519f00bf-684e-417f-af08-cf66e12dc2e2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:53.174379 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-519f00bf-684e-417f-af08-cf66e12dc2e2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1723 microversion: 2.20 time: 0.321604 Oct 11 06:43:53.175037 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 178/358] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:43:52 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1723 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:43:53.858699 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a0fe669b-bbc9-40db-8b15-97d9d75d71c5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:53.859879 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a0fe669b-bbc9-40db-8b15-97d9d75d71c5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:53.866288 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a0fe669b-bbc9-40db-8b15-97d9d75d71c5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:53.866996 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a0fe669b-bbc9-40db-8b15-97d9d75d71c5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:53.867610 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a0fe669b-bbc9-40db-8b15-97d9d75d71c5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:53.868471 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a0fe669b-bbc9-40db-8b15-97d9d75d71c5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:53.869617 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a0fe669b-bbc9-40db-8b15-97d9d75d71c5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:53.870037 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a0fe669b-bbc9-40db-8b15-97d9d75d71c5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:54.071228 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a0fe669b-bbc9-40db-8b15-97d9d75d71c5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:54.080513 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a0fe669b-bbc9-40db-8b15-97d9d75d71c5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1722 microversion: 2.1 time: 0.225540 Oct 11 06:43:54.081561 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 181/359] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:53 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:54.142938 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4ecf0e74-cae4-4f89-a285-4c3ea7a278ca tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:54.144085 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4ecf0e74-cae4-4f89-a285-4c3ea7a278ca tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:54.150515 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4ecf0e74-cae4-4f89-a285-4c3ea7a278ca tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:54.151373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4ecf0e74-cae4-4f89-a285-4c3ea7a278ca tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:54.152002 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4ecf0e74-cae4-4f89-a285-4c3ea7a278ca tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:54.152727 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4ecf0e74-cae4-4f89-a285-4c3ea7a278ca tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:54.153332 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4ecf0e74-cae4-4f89-a285-4c3ea7a278ca tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:54.154911 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4ecf0e74-cae4-4f89-a285-4c3ea7a278ca tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:54.203053 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-405c98d5-5b14-45c9-93f8-9945b86e2339 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:54.203714 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-405c98d5-5b14-45c9-93f8-9945b86e2339 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:54.209840 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-405c98d5-5b14-45c9-93f8-9945b86e2339 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:54.210324 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-405c98d5-5b14-45c9-93f8-9945b86e2339 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:54.210758 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-405c98d5-5b14-45c9-93f8-9945b86e2339 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:54.211667 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-405c98d5-5b14-45c9-93f8-9945b86e2339 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:54.212359 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-405c98d5-5b14-45c9-93f8-9945b86e2339 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:54.212944 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-405c98d5-5b14-45c9-93f8-9945b86e2339 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:54.334987 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4ecf0e74-cae4-4f89-a285-4c3ea7a278ca tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:54.348716 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4ecf0e74-cae4-4f89-a285-4c3ea7a278ca tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1521 microversion: 2.1 time: 0.209666 Oct 11 06:43:54.350908 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 179/360] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:54 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:54.447243 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-405c98d5-5b14-45c9-93f8-9945b86e2339 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:54.455406 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-405c98d5-5b14-45c9-93f8-9945b86e2339 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:54.456861 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-405c98d5-5b14-45c9-93f8-9945b86e2339 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:54.458046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-405c98d5-5b14-45c9-93f8-9945b86e2339 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1723 microversion: 2.20 time: 0.259643 Oct 11 06:43:54.458592 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 182/361] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:43:54 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:43:54.543232 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-11cbabba-7c3d-4b72-9338-5a0363aaf525 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1176375545", "imageRef": "2303551c-410e-4a2b-8eeb-dea686876901", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21c482a1-7bc7-4511-a714-740a34b4b762"}], "security_groups": [{"name": "tempest-securitygroup--1319353564"}], "key_name": "tempest-keypair-379756893", "user_data": "}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:43:54.641692 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.network.neutron [None req-11cbabba-7c3d-4b72-9338-5a0363aaf525 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] validate_networks() for [('21c482a1-7bc7-4511-a714-740a34b4b762', None, None, None, None, None)] {{(pid=125267) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 06:43:55.002515 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-11cbabba-7c3d-4b72-9338-5a0363aaf525 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Flavor limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 06:43:55.002928 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-11cbabba-7c3d-4b72-9338-5a0363aaf525 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Image limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 06:43:55.003387 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-11cbabba-7c3d-4b72-9338-5a0363aaf525 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Flavor pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 06:43:55.003817 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-11cbabba-7c3d-4b72-9338-5a0363aaf525 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Image pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 06:43:55.004215 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-11cbabba-7c3d-4b72-9338-5a0363aaf525 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 06:43:55.013369 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-11cbabba-7c3d-4b72-9338-5a0363aaf525 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:55.013832 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-11cbabba-7c3d-4b72-9338-5a0363aaf525 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:55.014279 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-11cbabba-7c3d-4b72-9338-5a0363aaf525 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:55.014991 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-11cbabba-7c3d-4b72-9338-5a0363aaf525 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:55.015452 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-11cbabba-7c3d-4b72-9338-5a0363aaf525 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:55.015867 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-11cbabba-7c3d-4b72-9338-5a0363aaf525 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:55.032828 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-11cbabba-7c3d-4b72-9338-5a0363aaf525 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Getting quotas for project 5af47e2321de4d299ff3a7fb3d3d9e3c. Resources: {'cores', 'ram', 'instances'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 06:43:55.036677 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-11cbabba-7c3d-4b72-9338-5a0363aaf525 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Getting quotas for user 2e63c3f83f3d41018e6330f26ed7b8a0 and project 5af47e2321de4d299ff3a7fb3d3d9e3c. Resources: {'cores', 'ram', 'instances'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 06:43:55.047331 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-11cbabba-7c3d-4b72-9338-5a0363aaf525 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Going to run 1 instances... {{(pid=125267) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 06:43:55.049603 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-11cbabba-7c3d-4b72-9338-5a0363aaf525 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: fe4c25ff-9873-41dc-8396-d4af6cecd1f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2303551c-410e-4a2b-8eeb-dea686876901',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 06:43:55.096784 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-11cbabba-7c3d-4b72-9338-5a0363aaf525 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.558338 Oct 11 06:43:55.097690 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 180/362] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Oct 11 06:43:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 06:43:55.104737 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-53b54cdb-4848-45b7-93e7-9ccccb539a92 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:55.105919 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-53b54cdb-4848-45b7-93e7-9ccccb539a92 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:55.110208 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-87d13fd4-e7a0-4172-a040-1e1b20e0a46e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:55.110895 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-87d13fd4-e7a0-4172-a040-1e1b20e0a46e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: fe4c25ff-9873-41dc-8396-d4af6cecd1f8] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:55.112815 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-53b54cdb-4848-45b7-93e7-9ccccb539a92 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:55.113307 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-53b54cdb-4848-45b7-93e7-9ccccb539a92 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:55.113739 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-53b54cdb-4848-45b7-93e7-9ccccb539a92 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:55.114629 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-53b54cdb-4848-45b7-93e7-9ccccb539a92 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:55.115069 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-53b54cdb-4848-45b7-93e7-9ccccb539a92 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:55.116049 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-53b54cdb-4848-45b7-93e7-9ccccb539a92 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:55.172820 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-87d13fd4-e7a0-4172-a040-1e1b20e0a46e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:55.184005 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-87d13fd4-e7a0-4172-a040-1e1b20e0a46e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8" status: 200 len: 1241 microversion: 2.1 time: 0.079202 Oct 11 06:43:55.184713 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 181/363] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:55 2022] GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8 => generated 1241 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:43:55.265325 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-53b54cdb-4848-45b7-93e7-9ccccb539a92 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:55.273732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-53b54cdb-4848-45b7-93e7-9ccccb539a92 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1722 microversion: 2.1 time: 0.173607 Oct 11 06:43:55.274334 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 183/364] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:55 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:55.372853 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-512944bb-5660-49ba-8490-1a543288dd18 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:55.373451 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-512944bb-5660-49ba-8490-1a543288dd18 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:55.379311 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-512944bb-5660-49ba-8490-1a543288dd18 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:55.379827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-512944bb-5660-49ba-8490-1a543288dd18 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:55.380256 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-512944bb-5660-49ba-8490-1a543288dd18 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:55.380932 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-512944bb-5660-49ba-8490-1a543288dd18 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:55.381387 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-512944bb-5660-49ba-8490-1a543288dd18 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:55.381826 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-512944bb-5660-49ba-8490-1a543288dd18 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:55.483581 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4f709844-55dc-4fa7-8675-19ec07c551ef tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:55.484394 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4f709844-55dc-4fa7-8675-19ec07c551ef tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:55.496140 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f709844-55dc-4fa7-8675-19ec07c551ef tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:55.496622 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f709844-55dc-4fa7-8675-19ec07c551ef tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:55.497048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f709844-55dc-4fa7-8675-19ec07c551ef tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:55.497818 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f709844-55dc-4fa7-8675-19ec07c551ef tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:55.498267 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f709844-55dc-4fa7-8675-19ec07c551ef tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:55.498684 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f709844-55dc-4fa7-8675-19ec07c551ef tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:55.554246 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-512944bb-5660-49ba-8490-1a543288dd18 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:55.562485 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-512944bb-5660-49ba-8490-1a543288dd18 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1521 microversion: 2.1 time: 0.193986 Oct 11 06:43:55.563039 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 182/365] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:55 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:55.629054 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4f709844-55dc-4fa7-8675-19ec07c551ef tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:55.637846 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4f709844-55dc-4fa7-8675-19ec07c551ef tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:55.639295 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4f709844-55dc-4fa7-8675-19ec07c551ef tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:55.640465 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4f709844-55dc-4fa7-8675-19ec07c551ef tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1723 microversion: 2.20 time: 0.160777 Oct 11 06:43:55.641012 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 184/366] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:43:55 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:43:56.211643 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7d7741fd-da1b-449b-834a-7ba8aedd26f6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:56.211643 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7d7741fd-da1b-449b-834a-7ba8aedd26f6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: fe4c25ff-9873-41dc-8396-d4af6cecd1f8] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:56.215888 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7d7741fd-da1b-449b-834a-7ba8aedd26f6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:56.216362 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7d7741fd-da1b-449b-834a-7ba8aedd26f6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:56.216788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7d7741fd-da1b-449b-834a-7ba8aedd26f6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:56.217467 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7d7741fd-da1b-449b-834a-7ba8aedd26f6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:56.217908 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7d7741fd-da1b-449b-834a-7ba8aedd26f6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:56.218321 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7d7741fd-da1b-449b-834a-7ba8aedd26f6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:56.280206 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7d7741fd-da1b-449b-834a-7ba8aedd26f6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:56.287809 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7d7741fd-da1b-449b-834a-7ba8aedd26f6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8" status: 200 len: 1245 microversion: 2.1 time: 0.083715 Oct 11 06:43:56.288366 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 183/367] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:56 2022] GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:56.297541 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ffdb0ba6-dd95-4b88-9000-b14fb3d6b94b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:56.298553 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ffdb0ba6-dd95-4b88-9000-b14fb3d6b94b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:56.305235 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ffdb0ba6-dd95-4b88-9000-b14fb3d6b94b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:56.305723 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ffdb0ba6-dd95-4b88-9000-b14fb3d6b94b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:56.306159 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ffdb0ba6-dd95-4b88-9000-b14fb3d6b94b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:56.307151 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ffdb0ba6-dd95-4b88-9000-b14fb3d6b94b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:56.307642 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ffdb0ba6-dd95-4b88-9000-b14fb3d6b94b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:56.308064 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ffdb0ba6-dd95-4b88-9000-b14fb3d6b94b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:56.434886 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ffdb0ba6-dd95-4b88-9000-b14fb3d6b94b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:56.445971 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ffdb0ba6-dd95-4b88-9000-b14fb3d6b94b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1722 microversion: 2.1 time: 0.151484 Oct 11 06:43:56.456325 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 185/368] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:56 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:56.585815 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1e8d229b-5869-4a02-a551-9fe05708ed68 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:56.586419 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1e8d229b-5869-4a02-a551-9fe05708ed68 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:56.592820 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1e8d229b-5869-4a02-a551-9fe05708ed68 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:56.593292 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1e8d229b-5869-4a02-a551-9fe05708ed68 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:56.593720 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1e8d229b-5869-4a02-a551-9fe05708ed68 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:56.594432 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1e8d229b-5869-4a02-a551-9fe05708ed68 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:56.594876 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1e8d229b-5869-4a02-a551-9fe05708ed68 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:56.595286 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1e8d229b-5869-4a02-a551-9fe05708ed68 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:56.667790 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9e68bee1-7b4e-4f74-92a3-63937f6cd5a9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:56.668667 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9e68bee1-7b4e-4f74-92a3-63937f6cd5a9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:56.675660 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e68bee1-7b4e-4f74-92a3-63937f6cd5a9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:56.676404 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e68bee1-7b4e-4f74-92a3-63937f6cd5a9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:56.676836 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e68bee1-7b4e-4f74-92a3-63937f6cd5a9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:56.677929 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e68bee1-7b4e-4f74-92a3-63937f6cd5a9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:56.678270 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e68bee1-7b4e-4f74-92a3-63937f6cd5a9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:56.679069 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e68bee1-7b4e-4f74-92a3-63937f6cd5a9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:56.732540 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1e8d229b-5869-4a02-a551-9fe05708ed68 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:56.740299 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1e8d229b-5869-4a02-a551-9fe05708ed68 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1521 microversion: 2.1 time: 0.158192 Oct 11 06:43:56.741066 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 184/369] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:56 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:56.812013 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9e68bee1-7b4e-4f74-92a3-63937f6cd5a9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:56.820541 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9e68bee1-7b4e-4f74-92a3-63937f6cd5a9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:56.822616 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9e68bee1-7b4e-4f74-92a3-63937f6cd5a9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:56.823786 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9e68bee1-7b4e-4f74-92a3-63937f6cd5a9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1723 microversion: 2.20 time: 0.161909 Oct 11 06:43:56.824397 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 186/370] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:43:56 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:43:57.314507 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-84c4be47-2e47-4a33-8bfa-6cb61402f242 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:57.315864 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-84c4be47-2e47-4a33-8bfa-6cb61402f242 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: fe4c25ff-9873-41dc-8396-d4af6cecd1f8] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:57.325146 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-84c4be47-2e47-4a33-8bfa-6cb61402f242 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:57.325826 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-84c4be47-2e47-4a33-8bfa-6cb61402f242 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:57.326368 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-84c4be47-2e47-4a33-8bfa-6cb61402f242 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:57.327194 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-84c4be47-2e47-4a33-8bfa-6cb61402f242 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:57.327765 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-84c4be47-2e47-4a33-8bfa-6cb61402f242 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:57.328199 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-84c4be47-2e47-4a33-8bfa-6cb61402f242 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:57.393620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-84c4be47-2e47-4a33-8bfa-6cb61402f242 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:57.397214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:57.402302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-84c4be47-2e47-4a33-8bfa-6cb61402f242 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8" status: 200 len: 1311 microversion: 2.1 time: 0.093058 Oct 11 06:43:57.402930 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 185/371] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:57 2022] GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8 => generated 1311 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:57.469959 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9acb37f6-c9b4-41fc-8a58-27ef6872a17c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:57.470569 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9acb37f6-c9b4-41fc-8a58-27ef6872a17c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:57.476897 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9acb37f6-c9b4-41fc-8a58-27ef6872a17c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:57.477599 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9acb37f6-c9b4-41fc-8a58-27ef6872a17c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:57.478590 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9acb37f6-c9b4-41fc-8a58-27ef6872a17c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:57.479296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9acb37f6-c9b4-41fc-8a58-27ef6872a17c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:57.479791 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9acb37f6-c9b4-41fc-8a58-27ef6872a17c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:57.480186 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9acb37f6-c9b4-41fc-8a58-27ef6872a17c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:57.619350 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e0460ac1-954a-4bca-aca3-dbd1fb65eb88 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-310421072", "imageRef": "2303551c-410e-4a2b-8eeb-dea686876901", "flavorRef": "452", "networks": [{"uuid": "93a41e02-3036-4983-9bb4-b9856a79bcce"}]}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:43:57.629932 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9acb37f6-c9b4-41fc-8a58-27ef6872a17c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:57.639270 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9acb37f6-c9b4-41fc-8a58-27ef6872a17c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1722 microversion: 2.1 time: 0.173095 Oct 11 06:43:57.639877 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 187/372] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:57 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:57.764381 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-13eb51ef-f27b-4d9a-b475-673441887de9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:57.765363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-13eb51ef-f27b-4d9a-b475-673441887de9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:57.771488 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-13eb51ef-f27b-4d9a-b475-673441887de9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:57.772053 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-13eb51ef-f27b-4d9a-b475-673441887de9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:57.772561 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-13eb51ef-f27b-4d9a-b475-673441887de9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:57.773493 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-13eb51ef-f27b-4d9a-b475-673441887de9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:57.773812 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-13eb51ef-f27b-4d9a-b475-673441887de9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:57.774222 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-13eb51ef-f27b-4d9a-b475-673441887de9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:58.268917 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-13eb51ef-f27b-4d9a-b475-673441887de9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:58.281052 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-13eb51ef-f27b-4d9a-b475-673441887de9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1521 microversion: 2.1 time: 0.520398 Oct 11 06:43:58.282391 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 188/373] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:57 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1521 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:43:58.288204 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-204e5797-995c-48bb-bb50-fe429134eddd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:58.288977 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-204e5797-995c-48bb-bb50-fe429134eddd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:58.296672 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-204e5797-995c-48bb-bb50-fe429134eddd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:58.297386 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-204e5797-995c-48bb-bb50-fe429134eddd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:58.297988 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-204e5797-995c-48bb-bb50-fe429134eddd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:58.298718 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-204e5797-995c-48bb-bb50-fe429134eddd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:58.299354 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-204e5797-995c-48bb-bb50-fe429134eddd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:58.300069 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-204e5797-995c-48bb-bb50-fe429134eddd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:58.543708 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-204e5797-995c-48bb-bb50-fe429134eddd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:58.553701 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-204e5797-995c-48bb-bb50-fe429134eddd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:58.555718 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-204e5797-995c-48bb-bb50-fe429134eddd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:58.558266 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-204e5797-995c-48bb-bb50-fe429134eddd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1723 microversion: 2.20 time: 0.274092 Oct 11 06:43:58.558953 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 189/374] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:43:58 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1723 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:43:58.564804 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-dbfe8af4-2e0b-4cc8-8c0c-455253c79826 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:58.565785 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-dbfe8af4-2e0b-4cc8-8c0c-455253c79826 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: fe4c25ff-9873-41dc-8396-d4af6cecd1f8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:58.573722 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dbfe8af4-2e0b-4cc8-8c0c-455253c79826 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:58.576681 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dbfe8af4-2e0b-4cc8-8c0c-455253c79826 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:58.577323 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dbfe8af4-2e0b-4cc8-8c0c-455253c79826 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:58.578039 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dbfe8af4-2e0b-4cc8-8c0c-455253c79826 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:58.578501 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dbfe8af4-2e0b-4cc8-8c0c-455253c79826 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:58.578970 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dbfe8af4-2e0b-4cc8-8c0c-455253c79826 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:58.826206 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-dbfe8af4-2e0b-4cc8-8c0c-455253c79826 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:58.837018 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-dbfe8af4-2e0b-4cc8-8c0c-455253c79826 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8" status: 200 len: 1367 microversion: 2.1 time: 0.276842 Oct 11 06:43:58.838713 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 190/375] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:58 2022] GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8 => generated 1367 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:58.844717 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-55dac69b-2d9b-4c86-b05d-7a696ea65e84 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:58.845553 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-55dac69b-2d9b-4c86-b05d-7a696ea65e84 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:58.856305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-55dac69b-2d9b-4c86-b05d-7a696ea65e84 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:58.857081 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-55dac69b-2d9b-4c86-b05d-7a696ea65e84 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:58.857683 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-55dac69b-2d9b-4c86-b05d-7a696ea65e84 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:58.858567 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-55dac69b-2d9b-4c86-b05d-7a696ea65e84 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:58.859178 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-55dac69b-2d9b-4c86-b05d-7a696ea65e84 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:58.859778 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-55dac69b-2d9b-4c86-b05d-7a696ea65e84 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:58.865236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:59.114710 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-55dac69b-2d9b-4c86-b05d-7a696ea65e84 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:59.123990 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-55dac69b-2d9b-4c86-b05d-7a696ea65e84 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1722 microversion: 2.1 time: 0.283928 Oct 11 06:43:59.135465 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 191/376] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:58 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1722 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:43:59.304084 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6a076b53-9ee4-41b3-8754-69640b358d2d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:59.304776 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6a076b53-9ee4-41b3-8754-69640b358d2d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:59.315042 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a076b53-9ee4-41b3-8754-69640b358d2d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:59.315561 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a076b53-9ee4-41b3-8754-69640b358d2d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:59.315988 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a076b53-9ee4-41b3-8754-69640b358d2d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:59.317295 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a076b53-9ee4-41b3-8754-69640b358d2d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:59.317770 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a076b53-9ee4-41b3-8754-69640b358d2d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:59.318159 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a076b53-9ee4-41b3-8754-69640b358d2d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:59.541434 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6a076b53-9ee4-41b3-8754-69640b358d2d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:59.550715 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6a076b53-9ee4-41b3-8754-69640b358d2d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1521 microversion: 2.1 time: 0.250341 Oct 11 06:43:59.579655 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 192/377] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:59 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:43:59.585503 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2d91052d-770b-4bfb-8e12-e1e8b3a3c7d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:59.586444 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2d91052d-770b-4bfb-8e12-e1e8b3a3c7d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:59.593826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2d91052d-770b-4bfb-8e12-e1e8b3a3c7d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:59.594647 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2d91052d-770b-4bfb-8e12-e1e8b3a3c7d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:59.595254 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2d91052d-770b-4bfb-8e12-e1e8b3a3c7d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:59.596186 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2d91052d-770b-4bfb-8e12-e1e8b3a3c7d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:59.596812 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2d91052d-770b-4bfb-8e12-e1e8b3a3c7d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:59.597399 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2d91052d-770b-4bfb-8e12-e1e8b3a3c7d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:59.838332 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2d91052d-770b-4bfb-8e12-e1e8b3a3c7d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:59.848872 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2d91052d-770b-4bfb-8e12-e1e8b3a3c7d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:59.850330 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2d91052d-770b-4bfb-8e12-e1e8b3a3c7d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:43:59.851733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2d91052d-770b-4bfb-8e12-e1e8b3a3c7d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1723 microversion: 2.20 time: 0.270753 Oct 11 06:43:59.852356 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 193/378] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:43:59 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1723 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:43:59.890939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d1e41d91-c862-4b03-a7b8-3ad5aee29573 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:43:59.891744 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d1e41d91-c862-4b03-a7b8-3ad5aee29573 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: fe4c25ff-9873-41dc-8396-d4af6cecd1f8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:43:59.898647 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d1e41d91-c862-4b03-a7b8-3ad5aee29573 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:59.899133 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d1e41d91-c862-4b03-a7b8-3ad5aee29573 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:59.899813 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d1e41d91-c862-4b03-a7b8-3ad5aee29573 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:43:59.900687 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d1e41d91-c862-4b03-a7b8-3ad5aee29573 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:43:59.901293 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d1e41d91-c862-4b03-a7b8-3ad5aee29573 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:43:59.901869 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d1e41d91-c862-4b03-a7b8-3ad5aee29573 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:00.064388 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d1e41d91-c862-4b03-a7b8-3ad5aee29573 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:00.074360 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d1e41d91-c862-4b03-a7b8-3ad5aee29573 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8" status: 200 len: 1367 microversion: 2.1 time: 0.213700 Oct 11 06:44:00.075837 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 194/379] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:43:59 2022] GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:00.082055 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-ab508611-6de3-43d4-9083-5ebad82dbd5c req-135bf1c7-f6f7-4e1e-9bc6-dd1f2fc918ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe4c25ff-9873-41dc-8396-d4af6cecd1f8", "tag": "78c2e971-09ba-4d80-94d5-26027dd14435"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:44:00.093642 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-ab508611-6de3-43d4-9083-5ebad82dbd5c req-135bf1c7-f6f7-4e1e-9bc6-dd1f2fc918ac service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:00.094123 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-ab508611-6de3-43d4-9083-5ebad82dbd5c req-135bf1c7-f6f7-4e1e-9bc6-dd1f2fc918ac service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:00.094857 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-ab508611-6de3-43d4-9083-5ebad82dbd5c req-135bf1c7-f6f7-4e1e-9bc6-dd1f2fc918ac service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:00.110644 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-ab508611-6de3-43d4-9083-5ebad82dbd5c req-135bf1c7-f6f7-4e1e-9bc6-dd1f2fc918ac service nova] Creating event network-changed:78c2e971-09ba-4d80-94d5-26027dd14435 for instance fe4c25ff-9873-41dc-8396-d4af6cecd1f8 on hv-cinder-85495 Oct 11 06:44:00.118621 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-ab508611-6de3-43d4-9083-5ebad82dbd5c req-135bf1c7-f6f7-4e1e-9bc6-dd1f2fc918ac service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039709 Oct 11 06:44:00.119762 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 195/380] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:44:00.154014 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1984ebc5-7fc9-4ac6-94dd-27855a6bb84b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:00.154814 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1984ebc5-7fc9-4ac6-94dd-27855a6bb84b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:00.161475 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1984ebc5-7fc9-4ac6-94dd-27855a6bb84b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:00.162096 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1984ebc5-7fc9-4ac6-94dd-27855a6bb84b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:00.162594 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1984ebc5-7fc9-4ac6-94dd-27855a6bb84b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:00.163354 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1984ebc5-7fc9-4ac6-94dd-27855a6bb84b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:00.163941 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1984ebc5-7fc9-4ac6-94dd-27855a6bb84b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:00.164471 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1984ebc5-7fc9-4ac6-94dd-27855a6bb84b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:00.418452 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1984ebc5-7fc9-4ac6-94dd-27855a6bb84b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:00.427169 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1984ebc5-7fc9-4ac6-94dd-27855a6bb84b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1722 microversion: 2.1 time: 0.280578 Oct 11 06:44:00.428292 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 196/381] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:00 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1722 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:00.591686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1acc03f3-c139-4cd8-ba2c-2b4a2bab32d9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:00.592545 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1acc03f3-c139-4cd8-ba2c-2b4a2bab32d9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:00.599105 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1acc03f3-c139-4cd8-ba2c-2b4a2bab32d9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:00.599634 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1acc03f3-c139-4cd8-ba2c-2b4a2bab32d9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:00.600063 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1acc03f3-c139-4cd8-ba2c-2b4a2bab32d9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:00.600805 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1acc03f3-c139-4cd8-ba2c-2b4a2bab32d9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:00.601229 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1acc03f3-c139-4cd8-ba2c-2b4a2bab32d9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:00.601667 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1acc03f3-c139-4cd8-ba2c-2b4a2bab32d9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:00.750608 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1acc03f3-c139-4cd8-ba2c-2b4a2bab32d9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:00.758820 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1acc03f3-c139-4cd8-ba2c-2b4a2bab32d9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1521 microversion: 2.1 time: 0.171581 Oct 11 06:44:00.759983 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 197/382] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:00 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:00.878297 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f1d1a627-7f34-4a3a-879a-6d184ed7de0c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:00.878894 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f1d1a627-7f34-4a3a-879a-6d184ed7de0c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:00.885643 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1d1a627-7f34-4a3a-879a-6d184ed7de0c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:00.886146 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1d1a627-7f34-4a3a-879a-6d184ed7de0c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:00.886896 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1d1a627-7f34-4a3a-879a-6d184ed7de0c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:00.887660 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1d1a627-7f34-4a3a-879a-6d184ed7de0c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:00.888123 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1d1a627-7f34-4a3a-879a-6d184ed7de0c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:00.888526 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1d1a627-7f34-4a3a-879a-6d184ed7de0c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:01.038898 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f1d1a627-7f34-4a3a-879a-6d184ed7de0c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:01.051093 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f1d1a627-7f34-4a3a-879a-6d184ed7de0c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:01.052793 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f1d1a627-7f34-4a3a-879a-6d184ed7de0c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:01.054202 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f1d1a627-7f34-4a3a-879a-6d184ed7de0c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1723 microversion: 2.20 time: 0.179625 Oct 11 06:44:01.054529 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 198/383] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:00 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:44:01.100831 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0820ceae-c4ac-4343-a8ea-fa58ddff5976 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:01.101550 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0820ceae-c4ac-4343-a8ea-fa58ddff5976 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: fe4c25ff-9873-41dc-8396-d4af6cecd1f8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:01.103606 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:01.110271 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0820ceae-c4ac-4343-a8ea-fa58ddff5976 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:01.110790 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0820ceae-c4ac-4343-a8ea-fa58ddff5976 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:01.111225 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0820ceae-c4ac-4343-a8ea-fa58ddff5976 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:01.111957 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0820ceae-c4ac-4343-a8ea-fa58ddff5976 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:01.112410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0820ceae-c4ac-4343-a8ea-fa58ddff5976 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:01.112835 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0820ceae-c4ac-4343-a8ea-fa58ddff5976 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:01.258038 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0820ceae-c4ac-4343-a8ea-fa58ddff5976 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:01.266302 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0820ceae-c4ac-4343-a8ea-fa58ddff5976 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8" status: 200 len: 1367 microversion: 2.1 time: 0.169342 Oct 11 06:44:01.266861 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 199/384] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:01 2022] GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:01.452084 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-83fe29ce-da05-4a9e-b3fb-b1b026056446 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:01.453058 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-83fe29ce-da05-4a9e-b3fb-b1b026056446 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:01.459952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-83fe29ce-da05-4a9e-b3fb-b1b026056446 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:01.460754 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-83fe29ce-da05-4a9e-b3fb-b1b026056446 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:01.461277 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-83fe29ce-da05-4a9e-b3fb-b1b026056446 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:01.462443 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-83fe29ce-da05-4a9e-b3fb-b1b026056446 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:01.463316 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-83fe29ce-da05-4a9e-b3fb-b1b026056446 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:01.463947 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-83fe29ce-da05-4a9e-b3fb-b1b026056446 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:01.623130 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-83fe29ce-da05-4a9e-b3fb-b1b026056446 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:01.632599 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-83fe29ce-da05-4a9e-b3fb-b1b026056446 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1722 microversion: 2.1 time: 0.184573 Oct 11 06:44:01.633522 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 200/385] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:01 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:01.794824 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5a89620c-a031-4d0d-b5a4-6c002dc2310d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:01.795454 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5a89620c-a031-4d0d-b5a4-6c002dc2310d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:01.801890 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5a89620c-a031-4d0d-b5a4-6c002dc2310d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:01.802505 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5a89620c-a031-4d0d-b5a4-6c002dc2310d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:01.803023 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5a89620c-a031-4d0d-b5a4-6c002dc2310d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:01.803850 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5a89620c-a031-4d0d-b5a4-6c002dc2310d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:01.804516 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5a89620c-a031-4d0d-b5a4-6c002dc2310d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:01.805133 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5a89620c-a031-4d0d-b5a4-6c002dc2310d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:01.983843 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5a89620c-a031-4d0d-b5a4-6c002dc2310d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:01.991888 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5a89620c-a031-4d0d-b5a4-6c002dc2310d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1521 microversion: 2.1 time: 0.212561 Oct 11 06:44:02.005362 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 201/386] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:01 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:02.080284 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f102a416-8805-4d0c-93eb-a790e88cf035 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:02.080795 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f102a416-8805-4d0c-93eb-a790e88cf035 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:02.088907 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f102a416-8805-4d0c-93eb-a790e88cf035 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:02.089213 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f102a416-8805-4d0c-93eb-a790e88cf035 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:02.089636 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f102a416-8805-4d0c-93eb-a790e88cf035 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:02.090405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f102a416-8805-4d0c-93eb-a790e88cf035 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:02.090844 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f102a416-8805-4d0c-93eb-a790e88cf035 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:02.091451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f102a416-8805-4d0c-93eb-a790e88cf035 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:02.333114 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f102a416-8805-4d0c-93eb-a790e88cf035 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:02.345183 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f102a416-8805-4d0c-93eb-a790e88cf035 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:02.346648 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f102a416-8805-4d0c-93eb-a790e88cf035 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:02.347922 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f102a416-8805-4d0c-93eb-a790e88cf035 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1723 microversion: 2.20 time: 0.271556 Oct 11 06:44:02.348580 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 202/387] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:02 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1723 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:44:02.353785 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2c586865-2664-4771-8de6-a84d54348301 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:02.354400 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2c586865-2664-4771-8de6-a84d54348301 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: fe4c25ff-9873-41dc-8396-d4af6cecd1f8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:02.367538 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=4 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:02.373923 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c586865-2664-4771-8de6-a84d54348301 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:02.374480 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c586865-2664-4771-8de6-a84d54348301 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:02.374959 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c586865-2664-4771-8de6-a84d54348301 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:02.375816 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c586865-2664-4771-8de6-a84d54348301 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:02.376186 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c586865-2664-4771-8de6-a84d54348301 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:02.376623 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c586865-2664-4771-8de6-a84d54348301 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:02.639175 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2c586865-2664-4771-8de6-a84d54348301 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:02.654250 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2c586865-2664-4771-8de6-a84d54348301 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8" status: 200 len: 1367 microversion: 2.1 time: 0.304394 Oct 11 06:44:02.655774 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 203/388] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:02 2022] GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8 => generated 1367 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:02.669293 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f2a9e95a-8340-4c0f-a379-08e6f548d128 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:02.674489 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f2a9e95a-8340-4c0f-a379-08e6f548d128 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:02.686505 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f2a9e95a-8340-4c0f-a379-08e6f548d128 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:02.687384 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f2a9e95a-8340-4c0f-a379-08e6f548d128 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:02.688749 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f2a9e95a-8340-4c0f-a379-08e6f548d128 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:02.689676 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f2a9e95a-8340-4c0f-a379-08e6f548d128 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:02.690331 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f2a9e95a-8340-4c0f-a379-08e6f548d128 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:02.690954 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f2a9e95a-8340-4c0f-a379-08e6f548d128 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:02.866544 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f2a9e95a-8340-4c0f-a379-08e6f548d128 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:02.875893 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f2a9e95a-8340-4c0f-a379-08e6f548d128 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1722 microversion: 2.1 time: 0.218766 Oct 11 06:44:02.876464 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 204/389] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:02 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:03.016249 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f184434f-ee75-45fe-b340-38269d42b589 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:03.017040 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f184434f-ee75-45fe-b340-38269d42b589 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:03.023298 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f184434f-ee75-45fe-b340-38269d42b589 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:03.023799 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f184434f-ee75-45fe-b340-38269d42b589 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:03.024258 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f184434f-ee75-45fe-b340-38269d42b589 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:03.025288 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f184434f-ee75-45fe-b340-38269d42b589 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:03.025735 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f184434f-ee75-45fe-b340-38269d42b589 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:03.026159 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f184434f-ee75-45fe-b340-38269d42b589 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:03.175674 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f184434f-ee75-45fe-b340-38269d42b589 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:03.184979 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f184434f-ee75-45fe-b340-38269d42b589 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1521 microversion: 2.1 time: 0.172634 Oct 11 06:44:03.199752 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 205/390] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:03 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:03.378072 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3b5a33c2-071b-491b-ba73-60a51caf5676 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:03.378649 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3b5a33c2-071b-491b-ba73-60a51caf5676 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:03.385453 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b5a33c2-071b-491b-ba73-60a51caf5676 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:03.386202 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b5a33c2-071b-491b-ba73-60a51caf5676 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:03.386812 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b5a33c2-071b-491b-ba73-60a51caf5676 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:03.387737 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b5a33c2-071b-491b-ba73-60a51caf5676 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:03.388188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b5a33c2-071b-491b-ba73-60a51caf5676 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:03.388602 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b5a33c2-071b-491b-ba73-60a51caf5676 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:03.530613 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3b5a33c2-071b-491b-ba73-60a51caf5676 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:03.539434 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3b5a33c2-071b-491b-ba73-60a51caf5676 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:03.541511 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3b5a33c2-071b-491b-ba73-60a51caf5676 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:03.542695 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3b5a33c2-071b-491b-ba73-60a51caf5676 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1723 microversion: 2.20 time: 0.168854 Oct 11 06:44:03.543432 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 206/391] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:03 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:44:03.684470 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-260d6de2-e7d5-45b1-aa79-642480e2a656 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:03.685200 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-260d6de2-e7d5-45b1-aa79-642480e2a656 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: fe4c25ff-9873-41dc-8396-d4af6cecd1f8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:03.692977 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-260d6de2-e7d5-45b1-aa79-642480e2a656 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:03.693646 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-260d6de2-e7d5-45b1-aa79-642480e2a656 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:03.694831 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-260d6de2-e7d5-45b1-aa79-642480e2a656 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:03.696053 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-260d6de2-e7d5-45b1-aa79-642480e2a656 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:03.697066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-260d6de2-e7d5-45b1-aa79-642480e2a656 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:03.697705 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-260d6de2-e7d5-45b1-aa79-642480e2a656 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:03.847290 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-260d6de2-e7d5-45b1-aa79-642480e2a656 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:03.857521 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-260d6de2-e7d5-45b1-aa79-642480e2a656 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8" status: 200 len: 1367 microversion: 2.1 time: 0.179186 Oct 11 06:44:03.871438 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 207/392] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:03 2022] GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:03.903398 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f2542731-916c-4022-8dfe-7d2980eb2f88 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:03.904314 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f2542731-916c-4022-8dfe-7d2980eb2f88 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:03.910711 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f2542731-916c-4022-8dfe-7d2980eb2f88 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:03.911342 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f2542731-916c-4022-8dfe-7d2980eb2f88 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:03.911822 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f2542731-916c-4022-8dfe-7d2980eb2f88 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:03.912703 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f2542731-916c-4022-8dfe-7d2980eb2f88 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:03.913168 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f2542731-916c-4022-8dfe-7d2980eb2f88 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:03.913595 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f2542731-916c-4022-8dfe-7d2980eb2f88 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:03.940119 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:04.079716 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f2542731-916c-4022-8dfe-7d2980eb2f88 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:04.098054 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f2542731-916c-4022-8dfe-7d2980eb2f88 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1722 microversion: 2.1 time: 0.198480 Oct 11 06:44:04.098896 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 208/393] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:03 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:04.210561 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e7332698-7333-4d82-92a1-e004487d6230 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:04.211102 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e7332698-7333-4d82-92a1-e004487d6230 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:04.218874 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7332698-7333-4d82-92a1-e004487d6230 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:04.219379 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7332698-7333-4d82-92a1-e004487d6230 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:04.219869 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7332698-7333-4d82-92a1-e004487d6230 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:04.220575 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7332698-7333-4d82-92a1-e004487d6230 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:04.221230 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7332698-7333-4d82-92a1-e004487d6230 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:04.221658 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7332698-7333-4d82-92a1-e004487d6230 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:04.363819 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e7332698-7333-4d82-92a1-e004487d6230 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:04.373881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e7332698-7333-4d82-92a1-e004487d6230 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1521 microversion: 2.1 time: 0.167771 Oct 11 06:44:04.389550 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 209/394] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:04 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:04.568407 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fbdb7e91-9d79-4a9f-8516-b2d220ebff00 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:04.569275 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fbdb7e91-9d79-4a9f-8516-b2d220ebff00 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:04.575728 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fbdb7e91-9d79-4a9f-8516-b2d220ebff00 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:04.576456 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fbdb7e91-9d79-4a9f-8516-b2d220ebff00 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:04.577060 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fbdb7e91-9d79-4a9f-8516-b2d220ebff00 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:04.577975 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fbdb7e91-9d79-4a9f-8516-b2d220ebff00 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:04.578442 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fbdb7e91-9d79-4a9f-8516-b2d220ebff00 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:04.578876 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fbdb7e91-9d79-4a9f-8516-b2d220ebff00 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:04.721266 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fbdb7e91-9d79-4a9f-8516-b2d220ebff00 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:04.730467 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fbdb7e91-9d79-4a9f-8516-b2d220ebff00 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:04.731993 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fbdb7e91-9d79-4a9f-8516-b2d220ebff00 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:04.733175 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fbdb7e91-9d79-4a9f-8516-b2d220ebff00 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1723 microversion: 2.20 time: 0.168885 Oct 11 06:44:04.733720 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 210/395] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:04 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:44:04.880600 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-be8b7c3b-aae5-4614-8434-d13e23cf69e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:04.881232 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-be8b7c3b-aae5-4614-8434-d13e23cf69e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: fe4c25ff-9873-41dc-8396-d4af6cecd1f8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:04.887901 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-be8b7c3b-aae5-4614-8434-d13e23cf69e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:04.888423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-be8b7c3b-aae5-4614-8434-d13e23cf69e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:04.888934 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-be8b7c3b-aae5-4614-8434-d13e23cf69e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:04.889706 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-be8b7c3b-aae5-4614-8434-d13e23cf69e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:04.890067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-be8b7c3b-aae5-4614-8434-d13e23cf69e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:04.890493 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-be8b7c3b-aae5-4614-8434-d13e23cf69e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:05.024573 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=2 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:05.043116 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-be8b7c3b-aae5-4614-8434-d13e23cf69e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:05.051197 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-be8b7c3b-aae5-4614-8434-d13e23cf69e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8" status: 200 len: 1367 microversion: 2.1 time: 0.174426 Oct 11 06:44:05.051792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 211/396] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:04 2022] GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:05.123850 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-056665e0-453b-40c5-8b6b-41b6e9d37f1e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:05.124803 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-056665e0-453b-40c5-8b6b-41b6e9d37f1e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:05.132548 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-056665e0-453b-40c5-8b6b-41b6e9d37f1e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:05.133049 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-056665e0-453b-40c5-8b6b-41b6e9d37f1e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:05.133605 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-056665e0-453b-40c5-8b6b-41b6e9d37f1e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:05.135336 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-056665e0-453b-40c5-8b6b-41b6e9d37f1e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:05.136047 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-056665e0-453b-40c5-8b6b-41b6e9d37f1e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:05.136649 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-056665e0-453b-40c5-8b6b-41b6e9d37f1e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:05.179150 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=8 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:05.290202 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-056665e0-453b-40c5-8b6b-41b6e9d37f1e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:05.298503 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-056665e0-453b-40c5-8b6b-41b6e9d37f1e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1722 microversion: 2.1 time: 0.179466 Oct 11 06:44:05.299158 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 212/397] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:05 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:05.397011 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6f8c5d0b-0175-4dde-b7dc-25755edb93c6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:05.397547 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6f8c5d0b-0175-4dde-b7dc-25755edb93c6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:05.404268 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f8c5d0b-0175-4dde-b7dc-25755edb93c6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:05.404783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f8c5d0b-0175-4dde-b7dc-25755edb93c6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:05.405220 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f8c5d0b-0175-4dde-b7dc-25755edb93c6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:05.405926 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f8c5d0b-0175-4dde-b7dc-25755edb93c6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:05.406371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f8c5d0b-0175-4dde-b7dc-25755edb93c6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:05.406788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f8c5d0b-0175-4dde-b7dc-25755edb93c6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:05.566606 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6f8c5d0b-0175-4dde-b7dc-25755edb93c6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:05.574846 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6f8c5d0b-0175-4dde-b7dc-25755edb93c6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1521 microversion: 2.1 time: 0.181807 Oct 11 06:44:05.575527 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 213/398] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:05 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:05.764866 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-969008dd-b54d-460b-b852-d7bf00377833 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:05.765908 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-969008dd-b54d-460b-b852-d7bf00377833 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:05.783242 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-969008dd-b54d-460b-b852-d7bf00377833 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:05.784418 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-969008dd-b54d-460b-b852-d7bf00377833 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:05.784802 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-969008dd-b54d-460b-b852-d7bf00377833 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:05.785624 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-969008dd-b54d-460b-b852-d7bf00377833 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:05.786775 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-969008dd-b54d-460b-b852-d7bf00377833 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:05.787662 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-969008dd-b54d-460b-b852-d7bf00377833 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:05.973131 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-969008dd-b54d-460b-b852-d7bf00377833 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:05.987521 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-969008dd-b54d-460b-b852-d7bf00377833 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:05.989009 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-969008dd-b54d-460b-b852-d7bf00377833 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:05.990222 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-969008dd-b54d-460b-b852-d7bf00377833 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1723 microversion: 2.20 time: 0.231367 Oct 11 06:44:06.007902 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 214/399] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:05 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:44:06.007902 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-e0006800-9c45-4785-a3ab-ff3c2710c6b3 req-ac1e600f-fe9e-490b-b309-5867e2912ddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe4c25ff-9873-41dc-8396-d4af6cecd1f8", "name": "network-vif-plugged", "status": "completed", "tag": "78c2e971-09ba-4d80-94d5-26027dd14435"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:44:06.014781 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-e0006800-9c45-4785-a3ab-ff3c2710c6b3 req-ac1e600f-fe9e-490b-b309-5867e2912ddc service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:06.015559 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-e0006800-9c45-4785-a3ab-ff3c2710c6b3 req-ac1e600f-fe9e-490b-b309-5867e2912ddc service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:06.016372 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-e0006800-9c45-4785-a3ab-ff3c2710c6b3 req-ac1e600f-fe9e-490b-b309-5867e2912ddc service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:06.033677 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-e0006800-9c45-4785-a3ab-ff3c2710c6b3 req-ac1e600f-fe9e-490b-b309-5867e2912ddc service nova] Creating event network-vif-plugged:78c2e971-09ba-4d80-94d5-26027dd14435 for instance fe4c25ff-9873-41dc-8396-d4af6cecd1f8 on hv-cinder-85495 Oct 11 06:44:06.041726 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-e0006800-9c45-4785-a3ab-ff3c2710c6b3 req-ac1e600f-fe9e-490b-b309-5867e2912ddc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048169 Oct 11 06:44:06.042976 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 215/400] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:44:06.075862 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a423a1da-e577-4c23-b934-0ac89f9b454b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:06.076565 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a423a1da-e577-4c23-b934-0ac89f9b454b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: fe4c25ff-9873-41dc-8396-d4af6cecd1f8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:06.084360 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a423a1da-e577-4c23-b934-0ac89f9b454b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:06.084631 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a423a1da-e577-4c23-b934-0ac89f9b454b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:06.085066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a423a1da-e577-4c23-b934-0ac89f9b454b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:06.085776 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a423a1da-e577-4c23-b934-0ac89f9b454b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:06.086227 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a423a1da-e577-4c23-b934-0ac89f9b454b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:06.088137 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a423a1da-e577-4c23-b934-0ac89f9b454b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:06.247676 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a423a1da-e577-4c23-b934-0ac89f9b454b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:06.261961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a423a1da-e577-4c23-b934-0ac89f9b454b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8" status: 200 len: 1367 microversion: 2.1 time: 0.190819 Oct 11 06:44:06.279442 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 216/401] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:06 2022] GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:06.325514 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-68f1b09e-1cc6-45d8-b09f-adbafe4595c0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:06.326031 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-68f1b09e-1cc6-45d8-b09f-adbafe4595c0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:06.331946 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-68f1b09e-1cc6-45d8-b09f-adbafe4595c0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:06.332431 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-68f1b09e-1cc6-45d8-b09f-adbafe4595c0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:06.332860 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-68f1b09e-1cc6-45d8-b09f-adbafe4595c0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:06.333540 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-68f1b09e-1cc6-45d8-b09f-adbafe4595c0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:06.333993 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-68f1b09e-1cc6-45d8-b09f-adbafe4595c0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:06.334448 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-68f1b09e-1cc6-45d8-b09f-adbafe4595c0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:06.514093 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-68f1b09e-1cc6-45d8-b09f-adbafe4595c0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:06.523124 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-68f1b09e-1cc6-45d8-b09f-adbafe4595c0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1722 microversion: 2.1 time: 0.204181 Oct 11 06:44:06.538461 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 217/402] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:06 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:06.601494 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e125cf6b-9c6b-4629-9ed6-3590c996f6a6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:06.602109 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e125cf6b-9c6b-4629-9ed6-3590c996f6a6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:06.613041 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e125cf6b-9c6b-4629-9ed6-3590c996f6a6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:06.613531 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e125cf6b-9c6b-4629-9ed6-3590c996f6a6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:06.613968 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e125cf6b-9c6b-4629-9ed6-3590c996f6a6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:06.614786 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e125cf6b-9c6b-4629-9ed6-3590c996f6a6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:06.615153 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e125cf6b-9c6b-4629-9ed6-3590c996f6a6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:06.615607 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e125cf6b-9c6b-4629-9ed6-3590c996f6a6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:06.801988 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e125cf6b-9c6b-4629-9ed6-3590c996f6a6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:06.811117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e125cf6b-9c6b-4629-9ed6-3590c996f6a6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1521 microversion: 2.1 time: 0.216587 Oct 11 06:44:06.811818 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 218/403] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:06 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:07.015600 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-90f8dd94-6600-4a27-8c92-2e8c05e33fdc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:07.016299 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-90f8dd94-6600-4a27-8c92-2e8c05e33fdc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:07.022429 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-90f8dd94-6600-4a27-8c92-2e8c05e33fdc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:07.022912 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-90f8dd94-6600-4a27-8c92-2e8c05e33fdc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:07.023355 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-90f8dd94-6600-4a27-8c92-2e8c05e33fdc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:07.024117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-90f8dd94-6600-4a27-8c92-2e8c05e33fdc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:07.024686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-90f8dd94-6600-4a27-8c92-2e8c05e33fdc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:07.025038 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-90f8dd94-6600-4a27-8c92-2e8c05e33fdc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:07.190880 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-90f8dd94-6600-4a27-8c92-2e8c05e33fdc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:07.202206 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-90f8dd94-6600-4a27-8c92-2e8c05e33fdc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:07.203825 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-90f8dd94-6600-4a27-8c92-2e8c05e33fdc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:07.205191 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-90f8dd94-6600-4a27-8c92-2e8c05e33fdc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1723 microversion: 2.20 time: 0.193872 Oct 11 06:44:07.205848 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 219/404] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:07 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:44:07.288712 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-03d00277-0609-4103-9844-0e3d397c270e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:07.289335 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-03d00277-0609-4103-9844-0e3d397c270e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: fe4c25ff-9873-41dc-8396-d4af6cecd1f8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:07.296585 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-03d00277-0609-4103-9844-0e3d397c270e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:07.297051 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-03d00277-0609-4103-9844-0e3d397c270e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:07.297474 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-03d00277-0609-4103-9844-0e3d397c270e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:07.298260 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-03d00277-0609-4103-9844-0e3d397c270e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:07.298708 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-03d00277-0609-4103-9844-0e3d397c270e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:07.299128 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-03d00277-0609-4103-9844-0e3d397c270e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:07.456813 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-03d00277-0609-4103-9844-0e3d397c270e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:07.465878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-03d00277-0609-4103-9844-0e3d397c270e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8" status: 200 len: 1367 microversion: 2.1 time: 0.181015 Oct 11 06:44:07.466633 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 220/405] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:07 2022] GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:07.547779 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a7738502-580b-413c-a660-82832729422b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:07.548457 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a7738502-580b-413c-a660-82832729422b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:07.557695 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a7738502-580b-413c-a660-82832729422b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:07.558388 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a7738502-580b-413c-a660-82832729422b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:07.558924 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a7738502-580b-413c-a660-82832729422b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:07.559729 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a7738502-580b-413c-a660-82832729422b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:07.560261 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a7738502-580b-413c-a660-82832729422b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:07.560804 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a7738502-580b-413c-a660-82832729422b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:07.643458 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:07.716292 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a7738502-580b-413c-a660-82832729422b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:07.724777 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a7738502-580b-413c-a660-82832729422b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1699 microversion: 2.1 time: 0.180944 Oct 11 06:44:07.725501 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 221/406] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:07 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1699 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:07.750133 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e0a486bf-c55a-4e84-a7d8-33a7cc7f270a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:44:07.756106 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0a486bf-c55a-4e84-a7d8-33a7cc7f270a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:07.756704 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0a486bf-c55a-4e84-a7d8-33a7cc7f270a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:07.756994 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0a486bf-c55a-4e84-a7d8-33a7cc7f270a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:07.822256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e0a486bf-c55a-4e84-a7d8-33a7cc7f270a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Going to try to start instance {{(pid=125266) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 11 06:44:07.870793 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e0a486bf-c55a-4e84-a7d8-33a7cc7f270a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "POST /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/action" status: 202 len: 0 microversion: 2.1 time: 0.124273 Oct 11 06:44:07.871782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 222/407] 10.222.0.39 () {60 vars in 1278 bytes} [Tue Oct 11 06:44:07 2022] POST /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 06:44:07.877925 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6a523872-13aa-46a1-840c-97a6708f8f26 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:07.878749 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6a523872-13aa-46a1-840c-97a6708f8f26 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:07.886905 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a523872-13aa-46a1-840c-97a6708f8f26 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:07.887461 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a523872-13aa-46a1-840c-97a6708f8f26 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:07.888317 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a523872-13aa-46a1-840c-97a6708f8f26 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:07.889238 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a523872-13aa-46a1-840c-97a6708f8f26 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:07.890122 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a523872-13aa-46a1-840c-97a6708f8f26 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:07.890495 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a523872-13aa-46a1-840c-97a6708f8f26 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:08.051435 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6a523872-13aa-46a1-840c-97a6708f8f26 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:08.061552 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6a523872-13aa-46a1-840c-97a6708f8f26 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1521 microversion: 2.1 time: 0.188686 Oct 11 06:44:08.062124 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 223/408] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:07 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:08.067231 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e7c597e5-1a3d-463a-ab01-36136da80034 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:08.067980 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e7c597e5-1a3d-463a-ab01-36136da80034 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:08.079780 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7c597e5-1a3d-463a-ab01-36136da80034 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:08.080186 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7c597e5-1a3d-463a-ab01-36136da80034 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:08.080670 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7c597e5-1a3d-463a-ab01-36136da80034 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:08.081552 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7c597e5-1a3d-463a-ab01-36136da80034 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:08.082100 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7c597e5-1a3d-463a-ab01-36136da80034 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:08.082612 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7c597e5-1a3d-463a-ab01-36136da80034 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:08.261982 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e7c597e5-1a3d-463a-ab01-36136da80034 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:08.265872 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:08.272151 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e7c597e5-1a3d-463a-ab01-36136da80034 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1708 microversion: 2.1 time: 0.208846 Oct 11 06:44:08.289683 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 224/409] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:08 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1708 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:08.289683 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bceae17f-447b-4ecf-8cb3-703356af836d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:08.289683 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bceae17f-447b-4ecf-8cb3-703356af836d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:08.296291 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bceae17f-447b-4ecf-8cb3-703356af836d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:08.296799 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bceae17f-447b-4ecf-8cb3-703356af836d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:08.297244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bceae17f-447b-4ecf-8cb3-703356af836d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:08.297973 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bceae17f-447b-4ecf-8cb3-703356af836d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:08.298426 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bceae17f-447b-4ecf-8cb3-703356af836d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:08.298858 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bceae17f-447b-4ecf-8cb3-703356af836d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:08.459348 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bceae17f-447b-4ecf-8cb3-703356af836d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:08.469713 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bceae17f-447b-4ecf-8cb3-703356af836d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:08.471439 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bceae17f-447b-4ecf-8cb3-703356af836d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:08.472749 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bceae17f-447b-4ecf-8cb3-703356af836d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1723 microversion: 2.20 time: 0.198605 Oct 11 06:44:08.473488 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 225/410] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:08 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:44:08.492294 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c3c65b64-822c-4b8b-8600-a20f2e2abba6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:08.492949 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c3c65b64-822c-4b8b-8600-a20f2e2abba6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: fe4c25ff-9873-41dc-8396-d4af6cecd1f8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:08.501359 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c3c65b64-822c-4b8b-8600-a20f2e2abba6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:08.501935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c3c65b64-822c-4b8b-8600-a20f2e2abba6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:08.502713 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c3c65b64-822c-4b8b-8600-a20f2e2abba6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:08.503892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c3c65b64-822c-4b8b-8600-a20f2e2abba6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:08.504334 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c3c65b64-822c-4b8b-8600-a20f2e2abba6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:08.505095 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c3c65b64-822c-4b8b-8600-a20f2e2abba6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:08.743780 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c3c65b64-822c-4b8b-8600-a20f2e2abba6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:08.754961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c3c65b64-822c-4b8b-8600-a20f2e2abba6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8" status: 200 len: 1557 microversion: 2.1 time: 0.267236 Oct 11 06:44:08.774840 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 226/411] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:08 2022] GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8 => generated 1557 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:08.780585 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ba31564a-3974-491e-b508-64e2d9a2db0a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:08.781186 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ba31564a-3974-491e-b508-64e2d9a2db0a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: fe4c25ff-9873-41dc-8396-d4af6cecd1f8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:08.788010 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ba31564a-3974-491e-b508-64e2d9a2db0a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:08.788456 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ba31564a-3974-491e-b508-64e2d9a2db0a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:08.788979 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ba31564a-3974-491e-b508-64e2d9a2db0a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:08.790350 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ba31564a-3974-491e-b508-64e2d9a2db0a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:08.792647 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ba31564a-3974-491e-b508-64e2d9a2db0a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:08.793325 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ba31564a-3974-491e-b508-64e2d9a2db0a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:08.912391 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ba31564a-3974-491e-b508-64e2d9a2db0a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.135992 Oct 11 06:44:08.920667 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 227/412] 10.222.0.39 () {58 vars in 1275 bytes} [Tue Oct 11 06:44:08 2022] GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8/os-interface => generated 285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:44:09.086102 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f5bc7cae-5cca-406c-8b8f-79f994696c9c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:09.088067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f5bc7cae-5cca-406c-8b8f-79f994696c9c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:09.095225 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f5bc7cae-5cca-406c-8b8f-79f994696c9c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:09.096019 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f5bc7cae-5cca-406c-8b8f-79f994696c9c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:09.096714 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f5bc7cae-5cca-406c-8b8f-79f994696c9c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:09.098065 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f5bc7cae-5cca-406c-8b8f-79f994696c9c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:09.098749 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f5bc7cae-5cca-406c-8b8f-79f994696c9c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:09.099741 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f5bc7cae-5cca-406c-8b8f-79f994696c9c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:09.486406 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f5bc7cae-5cca-406c-8b8f-79f994696c9c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:09.500686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f5bc7cae-5cca-406c-8b8f-79f994696c9c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1521 microversion: 2.1 time: 0.418264 Oct 11 06:44:09.501968 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 228/413] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:09 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1521 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:09.513015 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9af221a6-55f1-408e-b17d-74eb319a4162 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:09.517244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9af221a6-55f1-408e-b17d-74eb319a4162 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:09.526834 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9af221a6-55f1-408e-b17d-74eb319a4162 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:09.527386 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9af221a6-55f1-408e-b17d-74eb319a4162 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:09.528210 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9af221a6-55f1-408e-b17d-74eb319a4162 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:09.529312 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9af221a6-55f1-408e-b17d-74eb319a4162 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:09.529770 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9af221a6-55f1-408e-b17d-74eb319a4162 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:09.530608 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9af221a6-55f1-408e-b17d-74eb319a4162 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:09.742534 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9af221a6-55f1-408e-b17d-74eb319a4162 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:09.756485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9af221a6-55f1-408e-b17d-74eb319a4162 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1708 microversion: 2.1 time: 0.248372 Oct 11 06:44:09.757215 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 229/414] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:09 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1708 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:09.771502 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8de8c604-d292-4030-afdd-85ba27030473 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:09.772231 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8de8c604-d292-4030-afdd-85ba27030473 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:09.784686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8de8c604-d292-4030-afdd-85ba27030473 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:09.787091 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8de8c604-d292-4030-afdd-85ba27030473 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:09.787578 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8de8c604-d292-4030-afdd-85ba27030473 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:09.788308 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8de8c604-d292-4030-afdd-85ba27030473 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:09.788767 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8de8c604-d292-4030-afdd-85ba27030473 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:09.789204 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8de8c604-d292-4030-afdd-85ba27030473 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:10.058008 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8de8c604-d292-4030-afdd-85ba27030473 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:10.071800 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8de8c604-d292-4030-afdd-85ba27030473 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:10.075459 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8de8c604-d292-4030-afdd-85ba27030473 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:10.075830 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8de8c604-d292-4030-afdd-85ba27030473 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1723 microversion: 2.20 time: 0.317277 Oct 11 06:44:10.076766 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 230/415] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:09 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1723 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:44:10.349997 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-e7ff3c20-754a-46c6-93b1-3bdf06846a79 req-846ed30d-b1b5-4874-b835-639adead1891 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe4c25ff-9873-41dc-8396-d4af6cecd1f8", "tag": "78c2e971-09ba-4d80-94d5-26027dd14435"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:44:10.360638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-e7ff3c20-754a-46c6-93b1-3bdf06846a79 req-846ed30d-b1b5-4874-b835-639adead1891 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:10.361215 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-e7ff3c20-754a-46c6-93b1-3bdf06846a79 req-846ed30d-b1b5-4874-b835-639adead1891 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:10.361741 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-e7ff3c20-754a-46c6-93b1-3bdf06846a79 req-846ed30d-b1b5-4874-b835-639adead1891 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:10.373858 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-e7ff3c20-754a-46c6-93b1-3bdf06846a79 req-846ed30d-b1b5-4874-b835-639adead1891 service nova] Creating event network-changed:78c2e971-09ba-4d80-94d5-26027dd14435 for instance fe4c25ff-9873-41dc-8396-d4af6cecd1f8 on hv-cinder-85495 Oct 11 06:44:10.380402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-e7ff3c20-754a-46c6-93b1-3bdf06846a79 req-846ed30d-b1b5-4874-b835-639adead1891 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034018 Oct 11 06:44:10.381457 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 231/416] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:44:10.526689 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-863a7e51-c315-4512-98b7-a76966276e23 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:10.527634 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-863a7e51-c315-4512-98b7-a76966276e23 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:10.541105 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-863a7e51-c315-4512-98b7-a76966276e23 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:10.545735 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-863a7e51-c315-4512-98b7-a76966276e23 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:10.550908 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-863a7e51-c315-4512-98b7-a76966276e23 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:10.551810 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-863a7e51-c315-4512-98b7-a76966276e23 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:10.552366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-863a7e51-c315-4512-98b7-a76966276e23 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:10.556197 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-863a7e51-c315-4512-98b7-a76966276e23 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:10.859026 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-863a7e51-c315-4512-98b7-a76966276e23 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:10.870540 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-863a7e51-c315-4512-98b7-a76966276e23 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1521 microversion: 2.1 time: 0.348393 Oct 11 06:44:10.886680 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 232/417] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:10 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:10.906444 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-529fd831-e396-473f-b558-3fba822c2b8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:10.910558 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-529fd831-e396-473f-b558-3fba822c2b8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:10.921656 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-529fd831-e396-473f-b558-3fba822c2b8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:10.922384 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-529fd831-e396-473f-b558-3fba822c2b8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:10.922989 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-529fd831-e396-473f-b558-3fba822c2b8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:10.923896 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-529fd831-e396-473f-b558-3fba822c2b8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:10.924518 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-529fd831-e396-473f-b558-3fba822c2b8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:10.925268 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-529fd831-e396-473f-b558-3fba822c2b8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:11.126441 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-529fd831-e396-473f-b558-3fba822c2b8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:11.136483 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-529fd831-e396-473f-b558-3fba822c2b8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1708 microversion: 2.1 time: 0.247691 Oct 11 06:44:11.137385 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 233/418] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:10 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1708 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:11.142429 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6a82590f-0348-45d4-a0a0-e177179166be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:11.143136 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6a82590f-0348-45d4-a0a0-e177179166be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:11.150065 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a82590f-0348-45d4-a0a0-e177179166be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:11.150736 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a82590f-0348-45d4-a0a0-e177179166be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:11.151247 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a82590f-0348-45d4-a0a0-e177179166be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:11.152244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a82590f-0348-45d4-a0a0-e177179166be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:11.152766 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a82590f-0348-45d4-a0a0-e177179166be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:11.153271 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a82590f-0348-45d4-a0a0-e177179166be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:11.331191 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6a82590f-0348-45d4-a0a0-e177179166be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:11.340096 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6a82590f-0348-45d4-a0a0-e177179166be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:11.341558 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6a82590f-0348-45d4-a0a0-e177179166be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:11.342701 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6a82590f-0348-45d4-a0a0-e177179166be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1744 microversion: 2.20 time: 0.204550 Oct 11 06:44:11.343477 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 234/419] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:11 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1744 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:44:11.819971 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.network.neutron [None req-e0460ac1-954a-4bca-aca3-dbd1fb65eb88 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] validate_networks() for [('93a41e02-3036-4983-9bb4-b9856a79bcce', None, None, None, None, None)] {{(pid=125267) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 06:44:11.896113 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5bc6010c-86ca-4ca8-a15c-dcc3998b153f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:11.901900 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5bc6010c-86ca-4ca8-a15c-dcc3998b153f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:11.917597 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5bc6010c-86ca-4ca8-a15c-dcc3998b153f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:11.918296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5bc6010c-86ca-4ca8-a15c-dcc3998b153f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:11.918933 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5bc6010c-86ca-4ca8-a15c-dcc3998b153f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:11.919996 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5bc6010c-86ca-4ca8-a15c-dcc3998b153f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:11.920611 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5bc6010c-86ca-4ca8-a15c-dcc3998b153f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:11.921193 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5bc6010c-86ca-4ca8-a15c-dcc3998b153f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:12.296335 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5bc6010c-86ca-4ca8-a15c-dcc3998b153f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:12.305903 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5bc6010c-86ca-4ca8-a15c-dcc3998b153f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1521 microversion: 2.1 time: 0.415076 Oct 11 06:44:12.307776 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 235/420] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:11 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1521 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:12.314359 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-da40f7f4-ab95-411c-869e-f7ab4d0086d2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:12.315845 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-da40f7f4-ab95-411c-869e-f7ab4d0086d2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:12.323391 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-da40f7f4-ab95-411c-869e-f7ab4d0086d2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:12.324172 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-da40f7f4-ab95-411c-869e-f7ab4d0086d2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:12.324844 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-da40f7f4-ab95-411c-869e-f7ab4d0086d2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:12.325762 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-da40f7f4-ab95-411c-869e-f7ab4d0086d2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:12.326423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-da40f7f4-ab95-411c-869e-f7ab4d0086d2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:12.327044 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-da40f7f4-ab95-411c-869e-f7ab4d0086d2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:12.495600 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-e0460ac1-954a-4bca-aca3-dbd1fb65eb88 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Flavor limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 06:44:12.497141 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-e0460ac1-954a-4bca-aca3-dbd1fb65eb88 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Image limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 06:44:12.497628 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-e0460ac1-954a-4bca-aca3-dbd1fb65eb88 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Flavor pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 06:44:12.501069 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-e0460ac1-954a-4bca-aca3-dbd1fb65eb88 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Image pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 06:44:12.503551 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-e0460ac1-954a-4bca-aca3-dbd1fb65eb88 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 06:44:12.539974 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-da40f7f4-ab95-411c-869e-f7ab4d0086d2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:12.550196 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-da40f7f4-ab95-411c-869e-f7ab4d0086d2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1712 microversion: 2.1 time: 0.239976 Oct 11 06:44:12.551000 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 236/421] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:12 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1712 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:12.556481 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b838d080-b161-4793-9b8b-584e7895f8fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:12.557379 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b838d080-b161-4793-9b8b-584e7895f8fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:12.561429 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e0460ac1-954a-4bca-aca3-dbd1fb65eb88 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:12.561926 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e0460ac1-954a-4bca-aca3-dbd1fb65eb88 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:12.562361 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e0460ac1-954a-4bca-aca3-dbd1fb65eb88 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:12.564368 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b838d080-b161-4793-9b8b-584e7895f8fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:12.565078 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b838d080-b161-4793-9b8b-584e7895f8fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:12.565351 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e0460ac1-954a-4bca-aca3-dbd1fb65eb88 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:12.565821 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e0460ac1-954a-4bca-aca3-dbd1fb65eb88 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:12.566250 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e0460ac1-954a-4bca-aca3-dbd1fb65eb88 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:12.566621 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b838d080-b161-4793-9b8b-584e7895f8fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:12.567599 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b838d080-b161-4793-9b8b-584e7895f8fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:12.568259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b838d080-b161-4793-9b8b-584e7895f8fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:12.568896 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b838d080-b161-4793-9b8b-584e7895f8fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:12.603327 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-e0460ac1-954a-4bca-aca3-dbd1fb65eb88 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Getting quotas for project 9ca42ed577ae40258f333875e0efbd62. Resources: {'cores', 'ram', 'instances'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 06:44:12.607339 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-e0460ac1-954a-4bca-aca3-dbd1fb65eb88 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Getting quotas for user cccdf0e0e8214d11867cc9a47c997b40 and project 9ca42ed577ae40258f333875e0efbd62. Resources: {'cores', 'ram', 'instances'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 06:44:12.619574 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e0460ac1-954a-4bca-aca3-dbd1fb65eb88 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Going to run 1 instances... {{(pid=125267) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 06:44:12.622052 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e0460ac1-954a-4bca-aca3-dbd1fb65eb88 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2303551c-410e-4a2b-8eeb-dea686876901',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 06:44:12.699123 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e0460ac1-954a-4bca-aca3-dbd1fb65eb88 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 15.084188 Oct 11 06:44:12.700782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 186/422] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Oct 11 06:43:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 15087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 06:44:12.726601 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cfd97fda-3489-41de-a3b6-66d86749500c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:12.727255 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cfd97fda-3489-41de-a3b6-66d86749500c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:12.763067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b838d080-b161-4793-9b8b-584e7895f8fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:12.776773 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b838d080-b161-4793-9b8b-584e7895f8fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:12.779121 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b838d080-b161-4793-9b8b-584e7895f8fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:12.781122 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b838d080-b161-4793-9b8b-584e7895f8fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1744 microversion: 2.20 time: 0.228719 Oct 11 06:44:12.796134 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 237/423] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:12 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1744 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:44:12.814251 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cfd97fda-3489-41de-a3b6-66d86749500c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:12.827782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cfd97fda-3489-41de-a3b6-66d86749500c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1218 microversion: 2.1 time: 0.110191 Oct 11 06:44:12.830924 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 187/424] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:12 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:13.331317 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7025b581-b62f-4fdf-b61e-eeb27042d629 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:13.331946 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7025b581-b62f-4fdf-b61e-eeb27042d629 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:13.339266 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7025b581-b62f-4fdf-b61e-eeb27042d629 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:13.339781 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7025b581-b62f-4fdf-b61e-eeb27042d629 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:13.340209 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7025b581-b62f-4fdf-b61e-eeb27042d629 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:13.340895 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7025b581-b62f-4fdf-b61e-eeb27042d629 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:13.341338 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7025b581-b62f-4fdf-b61e-eeb27042d629 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:13.341780 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7025b581-b62f-4fdf-b61e-eeb27042d629 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:13.525740 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7025b581-b62f-4fdf-b61e-eeb27042d629 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:13.546243 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7025b581-b62f-4fdf-b61e-eeb27042d629 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1521 microversion: 2.1 time: 0.217882 Oct 11 06:44:13.547256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 238/425] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:13 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:13.807006 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-99c3c563-9298-4da8-81cb-85b65205216a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:13.807839 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-99c3c563-9298-4da8-81cb-85b65205216a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:13.818409 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99c3c563-9298-4da8-81cb-85b65205216a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:13.819208 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99c3c563-9298-4da8-81cb-85b65205216a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:13.819891 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99c3c563-9298-4da8-81cb-85b65205216a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:13.821375 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99c3c563-9298-4da8-81cb-85b65205216a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:13.822044 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99c3c563-9298-4da8-81cb-85b65205216a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:13.822705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99c3c563-9298-4da8-81cb-85b65205216a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:13.859107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3e489723-6778-45b4-bf99-1e29e96edea8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:13.859967 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3e489723-6778-45b4-bf99-1e29e96edea8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:13.869566 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e489723-6778-45b4-bf99-1e29e96edea8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:13.870864 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e489723-6778-45b4-bf99-1e29e96edea8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:13.885180 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e489723-6778-45b4-bf99-1e29e96edea8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:13.885962 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e489723-6778-45b4-bf99-1e29e96edea8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:13.886636 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e489723-6778-45b4-bf99-1e29e96edea8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:13.888290 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e489723-6778-45b4-bf99-1e29e96edea8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:13.988505 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3e489723-6778-45b4-bf99-1e29e96edea8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:13.997522 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3e489723-6778-45b4-bf99-1e29e96edea8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1270 microversion: 2.1 time: 0.142585 Oct 11 06:44:14.015981 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 239/426] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:13 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:14.031861 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-99c3c563-9298-4da8-81cb-85b65205216a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:14.041025 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-4e6ba83a-45c8-48f6-84a1-383df4ba8845 req-2f4fa12c-0394-4fd4-95d2-63df405bd011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43d48211-8dab-4abd-8c95-e850b83382ff", "name": "network-vif-plugged", "status": "completed", "tag": "f963366d-bbf2-4aff-84d1-f61c69977089"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:44:14.041412 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-99c3c563-9298-4da8-81cb-85b65205216a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:14.043068 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-99c3c563-9298-4da8-81cb-85b65205216a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:14.044431 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-99c3c563-9298-4da8-81cb-85b65205216a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1744 microversion: 2.20 time: 0.241963 Oct 11 06:44:14.053274 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-4e6ba83a-45c8-48f6-84a1-383df4ba8845 req-2f4fa12c-0394-4fd4-95d2-63df405bd011 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:14.054317 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-4e6ba83a-45c8-48f6-84a1-383df4ba8845 req-2f4fa12c-0394-4fd4-95d2-63df405bd011 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:14.054923 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-4e6ba83a-45c8-48f6-84a1-383df4ba8845 req-2f4fa12c-0394-4fd4-95d2-63df405bd011 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:14.058094 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 188/427] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:13 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1744 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:44:14.070037 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-4e6ba83a-45c8-48f6-84a1-383df4ba8845 req-2f4fa12c-0394-4fd4-95d2-63df405bd011 service nova] Creating event network-vif-plugged:f963366d-bbf2-4aff-84d1-f61c69977089 for instance 43d48211-8dab-4abd-8c95-e850b83382ff on hv-cinder-85495 Oct 11 06:44:14.080699 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-4e6ba83a-45c8-48f6-84a1-383df4ba8845 req-2f4fa12c-0394-4fd4-95d2-63df405bd011 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046077 Oct 11 06:44:14.081306 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 240/428] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:44:14.573699 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e34196a3-e5d8-4b72-afe8-4d628189e432 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:14.574854 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e34196a3-e5d8-4b72-afe8-4d628189e432 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:14.587348 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e34196a3-e5d8-4b72-afe8-4d628189e432 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:14.588563 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e34196a3-e5d8-4b72-afe8-4d628189e432 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:14.589337 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e34196a3-e5d8-4b72-afe8-4d628189e432 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:14.590307 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e34196a3-e5d8-4b72-afe8-4d628189e432 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:14.591078 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e34196a3-e5d8-4b72-afe8-4d628189e432 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:14.591916 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e34196a3-e5d8-4b72-afe8-4d628189e432 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:14.765218 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e34196a3-e5d8-4b72-afe8-4d628189e432 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:14.780713 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e34196a3-e5d8-4b72-afe8-4d628189e432 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1521 microversion: 2.1 time: 0.212254 Oct 11 06:44:14.782870 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 189/429] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:14 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:15.028066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bdee31b3-54ad-4ffd-8cfd-c83ca4f9138a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:15.029125 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bdee31b3-54ad-4ffd-8cfd-c83ca4f9138a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:15.042270 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bdee31b3-54ad-4ffd-8cfd-c83ca4f9138a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:15.043600 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bdee31b3-54ad-4ffd-8cfd-c83ca4f9138a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:15.043600 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bdee31b3-54ad-4ffd-8cfd-c83ca4f9138a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:15.044016 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bdee31b3-54ad-4ffd-8cfd-c83ca4f9138a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:15.044487 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bdee31b3-54ad-4ffd-8cfd-c83ca4f9138a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:15.044920 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bdee31b3-54ad-4ffd-8cfd-c83ca4f9138a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:15.092229 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-65fca60b-8637-4b17-8461-012b257c93a5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:15.094310 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-65fca60b-8637-4b17-8461-012b257c93a5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:15.106863 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65fca60b-8637-4b17-8461-012b257c93a5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:15.108255 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65fca60b-8637-4b17-8461-012b257c93a5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:15.109330 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65fca60b-8637-4b17-8461-012b257c93a5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:15.110874 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65fca60b-8637-4b17-8461-012b257c93a5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:15.111878 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65fca60b-8637-4b17-8461-012b257c93a5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:15.112722 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65fca60b-8637-4b17-8461-012b257c93a5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:15.231802 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bdee31b3-54ad-4ffd-8cfd-c83ca4f9138a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:15.261234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bdee31b3-54ad-4ffd-8cfd-c83ca4f9138a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1270 microversion: 2.1 time: 0.238595 Oct 11 06:44:15.263705 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 241/430] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:15 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1270 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:15.302583 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-65fca60b-8637-4b17-8461-012b257c93a5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:15.321673 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-65fca60b-8637-4b17-8461-012b257c93a5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:15.324257 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-65fca60b-8637-4b17-8461-012b257c93a5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:15.326222 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-65fca60b-8637-4b17-8461-012b257c93a5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1739 microversion: 2.20 time: 0.241566 Oct 11 06:44:15.327860 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 190/431] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:15 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1739 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:44:15.807469 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-11286522-b4d4-4143-bd83-eb59bcf27d1e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:15.808315 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-11286522-b4d4-4143-bd83-eb59bcf27d1e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:15.818433 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-11286522-b4d4-4143-bd83-eb59bcf27d1e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:15.819133 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-11286522-b4d4-4143-bd83-eb59bcf27d1e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:15.819796 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-11286522-b4d4-4143-bd83-eb59bcf27d1e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:15.821378 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-11286522-b4d4-4143-bd83-eb59bcf27d1e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:15.822107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-11286522-b4d4-4143-bd83-eb59bcf27d1e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:15.822831 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-11286522-b4d4-4143-bd83-eb59bcf27d1e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:15.967139 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-11286522-b4d4-4143-bd83-eb59bcf27d1e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:15.975623 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-11286522-b4d4-4143-bd83-eb59bcf27d1e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1501 microversion: 2.1 time: 0.173709 Oct 11 06:44:15.977067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 242/432] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:15 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1501 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:15.999873 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5939b67d-b0c5-4b57-8190-38d367ffa8d0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2791fcda-a938-4449-a41f-55281a47b142"}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:44:16.002692 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5939b67d-b0c5-4b57-8190-38d367ffa8d0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:16.010166 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5939b67d-b0c5-4b57-8190-38d367ffa8d0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:16.010920 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5939b67d-b0c5-4b57-8190-38d367ffa8d0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:16.011585 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5939b67d-b0c5-4b57-8190-38d367ffa8d0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:16.012480 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5939b67d-b0c5-4b57-8190-38d367ffa8d0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:16.013186 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5939b67d-b0c5-4b57-8190-38d367ffa8d0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:16.013767 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5939b67d-b0c5-4b57-8190-38d367ffa8d0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:16.040288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-5939b67d-b0c5-4b57-8190-38d367ffa8d0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] HTTP exception thrown: Cannot 'attach_volume' instance 03687593-229b-46bf-b79a-f09a1db51ac2 while it is in vm_state rescued Oct 11 06:44:16.042424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5939b67d-b0c5-4b57-8190-38d367ffa8d0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Request method failure captured: Oct 11 06:44:16.042424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: request: POST /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2/os-volume_attachments HTTP/1.1 Oct 11 06:44:16.042424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept: application/json Oct 11 06:44:16.042424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Oct 11 06:44:16.042424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Connection: close Oct 11 06:44:16.042424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Length: 74 Oct 11 06:44:16.042424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Type: application/json Oct 11 06:44:16.042424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Host: 10.222.0.39 Oct 11 06:44:16.042424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Oct 11 06:44:16.042424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.12 Oct 11 06:44:16.042424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABjRRA0sVn3Y2hIF2KCTCm6FXTNfoGEy5FuwV9mGajfsKjzDTa2W9Zn9PNZ0bsNvHSl7YobIBptw1Er7VvGW1igZFTxkJHhoVOBLb1gJR4eRkspU0WbBpAL8LWZ9CfxGCRrXHXjyx2ZUoY97BLJ7CRdrgZs2_r5gQvEJLtS1fIO-euoHMg Oct 11 06:44:16.042424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Oct 11 06:44:16.042424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Oct 11 06:44:16.042424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Oct 11 06:44:16.042424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Oct 11 06:44:16.042424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Oct 11 06:44:16.042424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Oct 11 06:44:16.042424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Id: 0e4e977dc2e84b08a4fbaf7fd2fac42f Oct 11 06:44:16.042424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1829742552 Oct 11 06:44:16.042424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Role: reader,member Oct 11 06:44:16.042424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Oct 11 06:44:16.043889 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0e4e977dc2e84b08a4fbaf7fd2fac42f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0e4e977dc2e84b08a4fbaf7fd2fac42f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0e4e977dc2e84b08a4fbaf7fd2fac42f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0e4e977dc2e84b08a4fbaf7fd2fac42f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 06:44:16.043889 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1829742552 Oct 11 06:44:16.043889 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 0e4e977dc2e84b08a4fbaf7fd2fac42f Oct 11 06:44:16.043889 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1829742552 Oct 11 06:44:16.043889 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User: tempest-ServerRescueNegativeTestJSON-1829742552-project Oct 11 06:44:16.043889 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Oct 11 06:44:16.043889 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Oct 11 06:44:16.043889 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Id: 3d57230baeb24e8a8a511a0c6417077e Oct 11 06:44:16.043889 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1829742552-project Oct 11 06:44:16.043889 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Oct 11 06:44:16.043889 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: {"volumeAttachment": {"volumeId": "2791fcda-a938-4449-a41f-55281a47b142"}} Oct 11 06:44:16.043889 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: method: > Oct 11 06:44:16.045062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: exception: Cannot 'attach_volume' instance 03687593-229b-46bf-b79a-f09a1db51ac2 while it is in vm_state rescued Oct 11 06:44:16.045062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: action_args: {'server_id': '03687593-229b-46bf-b79a-f09a1db51ac2', 'body': {'volumeAttachment': {'volumeId': '2791fcda-a938-4449-a41f-55281a47b142'}}} Oct 11 06:44:16.045062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 06:44:16.045062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:44:16.045062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 11 06:44:16.045062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 11 06:44:16.045062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 06:44:16.045062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 06:44:16.045062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 06:44:16.045062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 06:44:16.045062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 03687593-229b-46bf-b79a-f09a1db51ac2 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 11 06:44:16.045062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 06:44:16.045062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:44:16.045062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 06:44:16.045062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:44:16.045062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:44:16.045062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:44:16.045062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 06:44:16.045062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 06:44:16.046413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 06:44:16.046413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 06:44:16.046413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 06:44:16.046413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 06:44:16.046413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 06:44:16.046413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 06:44:16.046413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 06:44:16.046413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 06:44:16.046413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 11 06:44:16.046413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 06:44:16.046413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 06:44:16.046413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 06:44:16.046413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 03687593-229b-46bf-b79a-f09a1db51ac2 while it is in vm_state rescued Oct 11 06:44:16.046413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 06:44:16.046413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:44:16.046413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 06:44:16.046413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:44:16.046413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:44:16.046413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:44:16.047718 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 06:44:16.047718 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 06:44:16.047718 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 03687593-229b-46bf-b79a-f09a1db51ac2 while it is in vm_state rescued Oct 11 06:44:16.047718 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 06:44:16.048778 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5939b67d-b0c5-4b57-8190-38d367ffa8d0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Returning 409 to user: Cannot 'attach_volume' instance 03687593-229b-46bf-b79a-f09a1db51ac2 while it is in vm_state rescued {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 06:44:16.049639 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5939b67d-b0c5-4b57-8190-38d367ffa8d0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "POST /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.054007 Oct 11 06:44:16.050588 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 191/433] 10.222.0.39 () {60 vars in 1323 bytes} [Tue Oct 11 06:44:15 2022] POST /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2/os-volume_attachments => generated 152 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 06:44:16.060058 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-600dd1da-18aa-4dc4-a96a-fa92c294c66a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:44:16.061203 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-600dd1da-18aa-4dc4-a96a-fa92c294c66a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:16.079710 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-600dd1da-18aa-4dc4-a96a-fa92c294c66a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:16.080313 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-600dd1da-18aa-4dc4-a96a-fa92c294c66a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:16.081532 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-600dd1da-18aa-4dc4-a96a-fa92c294c66a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:16.084381 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-600dd1da-18aa-4dc4-a96a-fa92c294c66a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:16.085658 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-600dd1da-18aa-4dc4-a96a-fa92c294c66a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:16.090978 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-600dd1da-18aa-4dc4-a96a-fa92c294c66a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:16.100746 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:16.226337 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-600dd1da-18aa-4dc4-a96a-fa92c294c66a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "POST /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2/action" status: 202 len: 0 microversion: 2.1 time: 0.170830 Oct 11 06:44:16.228113 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 243/434] 10.222.0.39 () {60 vars in 1278 bytes} [Tue Oct 11 06:44:16 2022] POST /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 06:44:16.237541 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e13872d7-bf81-47ec-a568-b466399cbec0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:16.238160 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e13872d7-bf81-47ec-a568-b466399cbec0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:16.248395 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e13872d7-bf81-47ec-a568-b466399cbec0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:16.249237 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e13872d7-bf81-47ec-a568-b466399cbec0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:16.249871 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e13872d7-bf81-47ec-a568-b466399cbec0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:16.250586 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e13872d7-bf81-47ec-a568-b466399cbec0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:16.251056 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e13872d7-bf81-47ec-a568-b466399cbec0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:16.251491 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e13872d7-bf81-47ec-a568-b466399cbec0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:16.304375 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-460119fe-7563-4c1b-b533-86ab80f3370d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:16.306015 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-460119fe-7563-4c1b-b533-86ab80f3370d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:16.322146 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-460119fe-7563-4c1b-b533-86ab80f3370d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:16.323324 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-460119fe-7563-4c1b-b533-86ab80f3370d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:16.324581 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-460119fe-7563-4c1b-b533-86ab80f3370d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:16.328281 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-460119fe-7563-4c1b-b533-86ab80f3370d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:16.330118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-460119fe-7563-4c1b-b533-86ab80f3370d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:16.331048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-460119fe-7563-4c1b-b533-86ab80f3370d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:16.424654 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-460119fe-7563-4c1b-b533-86ab80f3370d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:16.435487 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-460119fe-7563-4c1b-b533-86ab80f3370d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1270 microversion: 2.1 time: 0.137112 Oct 11 06:44:16.436105 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e13872d7-bf81-47ec-a568-b466399cbec0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:16.436785 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 244/435] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:16 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1270 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:16.441706 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fe328705-3dde-46da-af16-bce19d3ef0e6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:16.442450 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fe328705-3dde-46da-af16-bce19d3ef0e6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:16.450224 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fe328705-3dde-46da-af16-bce19d3ef0e6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:16.450795 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fe328705-3dde-46da-af16-bce19d3ef0e6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:16.451352 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fe328705-3dde-46da-af16-bce19d3ef0e6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:16.452459 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fe328705-3dde-46da-af16-bce19d3ef0e6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:16.452973 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fe328705-3dde-46da-af16-bce19d3ef0e6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:16.453487 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fe328705-3dde-46da-af16-bce19d3ef0e6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:16.462153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e13872d7-bf81-47ec-a568-b466399cbec0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1509 microversion: 2.1 time: 0.228900 Oct 11 06:44:16.463007 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 192/436] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:16 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1509 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:16.721140 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fe328705-3dde-46da-af16-bce19d3ef0e6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:16.743779 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fe328705-3dde-46da-af16-bce19d3ef0e6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:16.745466 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fe328705-3dde-46da-af16-bce19d3ef0e6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:16.753431 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fe328705-3dde-46da-af16-bce19d3ef0e6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1739 microversion: 2.20 time: 0.314539 Oct 11 06:44:16.768316 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 245/437] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:16 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1739 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:44:17.462038 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9bc40dc1-3b69-4dbf-bbe7-48571064dff5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:17.463392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9bc40dc1-3b69-4dbf-bbe7-48571064dff5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:17.483823 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9bc40dc1-3b69-4dbf-bbe7-48571064dff5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:17.484689 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9bc40dc1-3b69-4dbf-bbe7-48571064dff5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:17.485332 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9bc40dc1-3b69-4dbf-bbe7-48571064dff5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:17.486306 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9bc40dc1-3b69-4dbf-bbe7-48571064dff5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:17.486421 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a6945f2d-f64f-4d39-b7e0-ab29f6aa5953 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:17.486947 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a6945f2d-f64f-4d39-b7e0-ab29f6aa5953 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:17.487542 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9bc40dc1-3b69-4dbf-bbe7-48571064dff5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:17.489988 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9bc40dc1-3b69-4dbf-bbe7-48571064dff5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:17.495404 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6945f2d-f64f-4d39-b7e0-ab29f6aa5953 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:17.504199 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6945f2d-f64f-4d39-b7e0-ab29f6aa5953 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:17.504797 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6945f2d-f64f-4d39-b7e0-ab29f6aa5953 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:17.505829 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6945f2d-f64f-4d39-b7e0-ab29f6aa5953 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:17.506464 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6945f2d-f64f-4d39-b7e0-ab29f6aa5953 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:17.506894 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6945f2d-f64f-4d39-b7e0-ab29f6aa5953 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:17.619819 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9bc40dc1-3b69-4dbf-bbe7-48571064dff5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:17.641506 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9bc40dc1-3b69-4dbf-bbe7-48571064dff5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1276 microversion: 2.1 time: 0.183655 Oct 11 06:44:17.656605 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 193/438] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:17 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1276 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:17.786467 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-37cd707a-1168-4b63-b8e2-72fe764d9af0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:17.787083 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-37cd707a-1168-4b63-b8e2-72fe764d9af0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:17.798790 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-37cd707a-1168-4b63-b8e2-72fe764d9af0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:17.800114 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-37cd707a-1168-4b63-b8e2-72fe764d9af0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:17.800924 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-37cd707a-1168-4b63-b8e2-72fe764d9af0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:17.801807 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-37cd707a-1168-4b63-b8e2-72fe764d9af0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:17.803925 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-37cd707a-1168-4b63-b8e2-72fe764d9af0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:17.804526 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-37cd707a-1168-4b63-b8e2-72fe764d9af0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:18.135498 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a6945f2d-f64f-4d39-b7e0-ab29f6aa5953 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:18.135498 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a6945f2d-f64f-4d39-b7e0-ab29f6aa5953 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1509 microversion: 2.1 time: 0.624099 Oct 11 06:44:18.135498 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 246/439] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:17 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1509 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:18.266809 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-37cd707a-1168-4b63-b8e2-72fe764d9af0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:18.324056 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-37cd707a-1168-4b63-b8e2-72fe764d9af0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:18.325922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-37cd707a-1168-4b63-b8e2-72fe764d9af0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:18.327653 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-37cd707a-1168-4b63-b8e2-72fe764d9af0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1739 microversion: 2.20 time: 0.544950 Oct 11 06:44:18.328400 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 194/440] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:17 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1739 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:44:18.666295 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-02659cf0-b852-4eab-8d9d-1e30018025fc tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:18.667805 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-02659cf0-b852-4eab-8d9d-1e30018025fc tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:18.684756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02659cf0-b852-4eab-8d9d-1e30018025fc tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:18.688172 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02659cf0-b852-4eab-8d9d-1e30018025fc tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:18.690140 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02659cf0-b852-4eab-8d9d-1e30018025fc tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:18.691184 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02659cf0-b852-4eab-8d9d-1e30018025fc tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:18.691933 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02659cf0-b852-4eab-8d9d-1e30018025fc tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:18.698055 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02659cf0-b852-4eab-8d9d-1e30018025fc tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:18.841548 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-02659cf0-b852-4eab-8d9d-1e30018025fc tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:18.854294 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-02659cf0-b852-4eab-8d9d-1e30018025fc tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1276 microversion: 2.1 time: 0.191692 Oct 11 06:44:18.864153 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 247/441] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:18 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1276 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:19.142006 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a93fc1cc-bf1b-4cc5-8789-3e1259b7fec9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:19.143356 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a93fc1cc-bf1b-4cc5-8789-3e1259b7fec9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:19.162282 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a93fc1cc-bf1b-4cc5-8789-3e1259b7fec9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:19.163033 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a93fc1cc-bf1b-4cc5-8789-3e1259b7fec9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:19.163674 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a93fc1cc-bf1b-4cc5-8789-3e1259b7fec9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:19.165138 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a93fc1cc-bf1b-4cc5-8789-3e1259b7fec9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:19.166095 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a93fc1cc-bf1b-4cc5-8789-3e1259b7fec9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:19.167039 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a93fc1cc-bf1b-4cc5-8789-3e1259b7fec9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:19.365739 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c102cb40-146c-409d-b089-26228706d583 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:19.367290 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c102cb40-146c-409d-b089-26228706d583 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:19.381852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c102cb40-146c-409d-b089-26228706d583 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:19.382653 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c102cb40-146c-409d-b089-26228706d583 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:19.383390 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c102cb40-146c-409d-b089-26228706d583 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:19.384297 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c102cb40-146c-409d-b089-26228706d583 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:19.384911 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c102cb40-146c-409d-b089-26228706d583 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:19.385577 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c102cb40-146c-409d-b089-26228706d583 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:19.436554 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a93fc1cc-bf1b-4cc5-8789-3e1259b7fec9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:19.446844 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a93fc1cc-bf1b-4cc5-8789-3e1259b7fec9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1509 microversion: 2.1 time: 0.308434 Oct 11 06:44:19.450408 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 195/442] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:19 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1509 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:19.593246 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c102cb40-146c-409d-b089-26228706d583 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:19.604971 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c102cb40-146c-409d-b089-26228706d583 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:19.608336 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c102cb40-146c-409d-b089-26228706d583 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:19.609623 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c102cb40-146c-409d-b089-26228706d583 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1739 microversion: 2.20 time: 0.252897 Oct 11 06:44:19.610621 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 248/443] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:19 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1739 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:44:19.880602 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c4bf943a-addf-49e6-946d-f6c8314c8daa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:19.881522 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c4bf943a-addf-49e6-946d-f6c8314c8daa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:19.891594 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4bf943a-addf-49e6-946d-f6c8314c8daa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:19.892341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4bf943a-addf-49e6-946d-f6c8314c8daa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:19.892991 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4bf943a-addf-49e6-946d-f6c8314c8daa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:19.894192 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4bf943a-addf-49e6-946d-f6c8314c8daa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:19.894859 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4bf943a-addf-49e6-946d-f6c8314c8daa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:19.895513 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4bf943a-addf-49e6-946d-f6c8314c8daa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:20.040500 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c4bf943a-addf-49e6-946d-f6c8314c8daa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:20.048527 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c4bf943a-addf-49e6-946d-f6c8314c8daa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1318 microversion: 2.1 time: 0.172756 Oct 11 06:44:20.049637 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 196/444] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:19 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:20.477771 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8a2f3d17-e556-4fc7-bd3a-79d7cf1d0aaa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:20.478551 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8a2f3d17-e556-4fc7-bd3a-79d7cf1d0aaa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:20.481219 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:20.486911 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8a2f3d17-e556-4fc7-bd3a-79d7cf1d0aaa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:20.487509 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8a2f3d17-e556-4fc7-bd3a-79d7cf1d0aaa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:20.488012 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8a2f3d17-e556-4fc7-bd3a-79d7cf1d0aaa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:20.488780 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8a2f3d17-e556-4fc7-bd3a-79d7cf1d0aaa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:20.489294 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8a2f3d17-e556-4fc7-bd3a-79d7cf1d0aaa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:20.489778 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8a2f3d17-e556-4fc7-bd3a-79d7cf1d0aaa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:20.634166 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0ded760d-6bf0-427d-a3d1-3d278ea821de tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:20.635574 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0ded760d-6bf0-427d-a3d1-3d278ea821de tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:20.642311 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0ded760d-6bf0-427d-a3d1-3d278ea821de tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:20.643089 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0ded760d-6bf0-427d-a3d1-3d278ea821de tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:20.643761 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0ded760d-6bf0-427d-a3d1-3d278ea821de tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:20.644693 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0ded760d-6bf0-427d-a3d1-3d278ea821de tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:20.645369 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0ded760d-6bf0-427d-a3d1-3d278ea821de tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:20.645997 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0ded760d-6bf0-427d-a3d1-3d278ea821de tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:20.651066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8a2f3d17-e556-4fc7-bd3a-79d7cf1d0aaa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:20.663487 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8a2f3d17-e556-4fc7-bd3a-79d7cf1d0aaa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1509 microversion: 2.1 time: 0.186029 Oct 11 06:44:20.664765 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 249/445] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:20 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1509 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:20.810629 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0ded760d-6bf0-427d-a3d1-3d278ea821de tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:20.820202 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0ded760d-6bf0-427d-a3d1-3d278ea821de tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:20.829246 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0ded760d-6bf0-427d-a3d1-3d278ea821de tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:20.830964 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0ded760d-6bf0-427d-a3d1-3d278ea821de tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1739 microversion: 2.20 time: 0.200664 Oct 11 06:44:20.831723 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 197/446] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:20 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:44:21.073940 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-89a62e0b-f346-4eaa-917f-a8c3249ec249 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:21.075065 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-89a62e0b-f346-4eaa-917f-a8c3249ec249 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:21.081398 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89a62e0b-f346-4eaa-917f-a8c3249ec249 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:21.081897 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89a62e0b-f346-4eaa-917f-a8c3249ec249 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:21.082403 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89a62e0b-f346-4eaa-917f-a8c3249ec249 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:21.083183 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89a62e0b-f346-4eaa-917f-a8c3249ec249 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:21.083771 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89a62e0b-f346-4eaa-917f-a8c3249ec249 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:21.084542 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89a62e0b-f346-4eaa-917f-a8c3249ec249 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:21.227808 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-89a62e0b-f346-4eaa-917f-a8c3249ec249 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:21.238144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-89a62e0b-f346-4eaa-917f-a8c3249ec249 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1318 microversion: 2.1 time: 0.166945 Oct 11 06:44:21.238144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 250/447] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:21 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:21.691965 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-15279211-798b-496e-8758-ce88df5eca43 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:21.693216 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-15279211-798b-496e-8758-ce88df5eca43 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:21.700007 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15279211-798b-496e-8758-ce88df5eca43 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:21.700485 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15279211-798b-496e-8758-ce88df5eca43 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:21.700913 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15279211-798b-496e-8758-ce88df5eca43 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:21.701613 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15279211-798b-496e-8758-ce88df5eca43 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:21.702060 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15279211-798b-496e-8758-ce88df5eca43 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:21.702480 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15279211-798b-496e-8758-ce88df5eca43 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:21.857483 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-24b43b79-6cb1-40ab-b61e-494eff199add tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:21.862888 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-15279211-798b-496e-8758-ce88df5eca43 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:21.866454 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-24b43b79-6cb1-40ab-b61e-494eff199add tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:21.873180 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-15279211-798b-496e-8758-ce88df5eca43 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1509 microversion: 2.1 time: 0.187324 Oct 11 06:44:21.873752 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 198/448] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:21 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1509 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:21.881023 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-24b43b79-6cb1-40ab-b61e-494eff199add tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:21.881779 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-24b43b79-6cb1-40ab-b61e-494eff199add tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:21.882217 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-24b43b79-6cb1-40ab-b61e-494eff199add tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:21.883531 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-24b43b79-6cb1-40ab-b61e-494eff199add tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:21.884126 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-24b43b79-6cb1-40ab-b61e-494eff199add tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:21.884682 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-24b43b79-6cb1-40ab-b61e-494eff199add tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:22.024941 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-24b43b79-6cb1-40ab-b61e-494eff199add tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:22.034506 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-24b43b79-6cb1-40ab-b61e-494eff199add tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:22.036201 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-24b43b79-6cb1-40ab-b61e-494eff199add tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:22.037506 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-24b43b79-6cb1-40ab-b61e-494eff199add tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1739 microversion: 2.20 time: 0.183881 Oct 11 06:44:22.051439 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 251/449] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:21 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:44:22.260217 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-27344ea2-3a7e-4c62-86ea-cca66cee12d9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:22.261285 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-27344ea2-3a7e-4c62-86ea-cca66cee12d9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:22.268220 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-27344ea2-3a7e-4c62-86ea-cca66cee12d9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:22.268919 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-27344ea2-3a7e-4c62-86ea-cca66cee12d9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:22.269526 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-27344ea2-3a7e-4c62-86ea-cca66cee12d9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:22.270425 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-27344ea2-3a7e-4c62-86ea-cca66cee12d9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:22.271082 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-27344ea2-3a7e-4c62-86ea-cca66cee12d9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:22.271519 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-27344ea2-3a7e-4c62-86ea-cca66cee12d9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:22.429550 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-27344ea2-3a7e-4c62-86ea-cca66cee12d9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:22.437591 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-27344ea2-3a7e-4c62-86ea-cca66cee12d9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1318 microversion: 2.1 time: 0.181525 Oct 11 06:44:22.438467 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 199/450] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:22 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:22.897370 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5ae0c1db-21df-45ed-a791-e6b93c020f75 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:22.898718 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5ae0c1db-21df-45ed-a791-e6b93c020f75 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:22.914548 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ae0c1db-21df-45ed-a791-e6b93c020f75 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:22.915038 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ae0c1db-21df-45ed-a791-e6b93c020f75 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:22.915494 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ae0c1db-21df-45ed-a791-e6b93c020f75 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:22.916200 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ae0c1db-21df-45ed-a791-e6b93c020f75 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:22.916820 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ae0c1db-21df-45ed-a791-e6b93c020f75 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:22.917457 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ae0c1db-21df-45ed-a791-e6b93c020f75 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:23.065818 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d0c44dc5-3620-475e-adef-2f6e81c4198f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:23.067107 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d0c44dc5-3620-475e-adef-2f6e81c4198f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:23.071079 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5ae0c1db-21df-45ed-a791-e6b93c020f75 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:23.084929 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5ae0c1db-21df-45ed-a791-e6b93c020f75 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1509 microversion: 2.1 time: 0.191671 Oct 11 06:44:23.087178 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=2 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:23.088682 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=8 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:23.091122 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 252/451] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:22 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1509 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:23.096129 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0c44dc5-3620-475e-adef-2f6e81c4198f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:23.096897 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0c44dc5-3620-475e-adef-2f6e81c4198f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:23.097505 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0c44dc5-3620-475e-adef-2f6e81c4198f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:23.098234 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0c44dc5-3620-475e-adef-2f6e81c4198f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:23.098685 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0c44dc5-3620-475e-adef-2f6e81c4198f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:23.099111 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0c44dc5-3620-475e-adef-2f6e81c4198f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:23.281705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d0c44dc5-3620-475e-adef-2f6e81c4198f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:23.308901 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d0c44dc5-3620-475e-adef-2f6e81c4198f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:23.310338 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d0c44dc5-3620-475e-adef-2f6e81c4198f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:23.312629 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d0c44dc5-3620-475e-adef-2f6e81c4198f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1739 microversion: 2.20 time: 0.251250 Oct 11 06:44:23.313290 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 200/452] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:23 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1739 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:44:23.460972 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cd48fdb8-e9c4-43b9-98bb-514936987ebe tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:23.462287 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cd48fdb8-e9c4-43b9-98bb-514936987ebe tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:23.469527 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cd48fdb8-e9c4-43b9-98bb-514936987ebe tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:23.470086 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cd48fdb8-e9c4-43b9-98bb-514936987ebe tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:23.470518 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cd48fdb8-e9c4-43b9-98bb-514936987ebe tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:23.471799 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cd48fdb8-e9c4-43b9-98bb-514936987ebe tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:23.471799 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cd48fdb8-e9c4-43b9-98bb-514936987ebe tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:23.472340 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cd48fdb8-e9c4-43b9-98bb-514936987ebe tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:23.774455 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cd48fdb8-e9c4-43b9-98bb-514936987ebe tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:23.786613 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cd48fdb8-e9c4-43b9-98bb-514936987ebe tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1318 microversion: 2.1 time: 0.329840 Oct 11 06:44:23.787526 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 253/453] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:23 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:24.129446 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7faee12c-de3e-408b-ae90-deb8233982a5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:24.130062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7faee12c-de3e-408b-ae90-deb8233982a5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:24.144629 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7faee12c-de3e-408b-ae90-deb8233982a5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:24.145498 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7faee12c-de3e-408b-ae90-deb8233982a5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:24.147786 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7faee12c-de3e-408b-ae90-deb8233982a5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:24.163723 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7faee12c-de3e-408b-ae90-deb8233982a5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:24.164348 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7faee12c-de3e-408b-ae90-deb8233982a5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:24.164790 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7faee12c-de3e-408b-ae90-deb8233982a5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:24.344293 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2787d57b-7d0a-49c2-af5f-3228151befd0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:24.344910 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2787d57b-7d0a-49c2-af5f-3228151befd0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:24.355789 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2787d57b-7d0a-49c2-af5f-3228151befd0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:24.356515 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2787d57b-7d0a-49c2-af5f-3228151befd0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:24.358302 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2787d57b-7d0a-49c2-af5f-3228151befd0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:24.359110 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2787d57b-7d0a-49c2-af5f-3228151befd0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:24.359610 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2787d57b-7d0a-49c2-af5f-3228151befd0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:24.360047 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2787d57b-7d0a-49c2-af5f-3228151befd0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:24.365499 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7faee12c-de3e-408b-ae90-deb8233982a5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:24.374041 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7faee12c-de3e-408b-ae90-deb8233982a5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1515 microversion: 2.1 time: 0.262713 Oct 11 06:44:24.376077 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 201/454] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:24 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1515 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:24.435170 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-347bd181-70ae-48d6-954b-3d342b97f8b2 req-d6270034-6de9-4ea4-98a7-773d5f4bb4b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0240e39b-9517-4a93-9789-705cd357e01c", "tag": "152b8dff-5676-4b2d-b774-671775bfbc7d"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:44:24.446476 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-347bd181-70ae-48d6-954b-3d342b97f8b2 req-d6270034-6de9-4ea4-98a7-773d5f4bb4b6 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:24.447339 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-347bd181-70ae-48d6-954b-3d342b97f8b2 req-d6270034-6de9-4ea4-98a7-773d5f4bb4b6 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:24.448017 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-347bd181-70ae-48d6-954b-3d342b97f8b2 req-d6270034-6de9-4ea4-98a7-773d5f4bb4b6 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:24.466102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-347bd181-70ae-48d6-954b-3d342b97f8b2 req-d6270034-6de9-4ea4-98a7-773d5f4bb4b6 service nova] Creating event network-changed:152b8dff-5676-4b2d-b774-671775bfbc7d for instance 0240e39b-9517-4a93-9789-705cd357e01c on hv-cinder-85495 Oct 11 06:44:24.472430 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-347bd181-70ae-48d6-954b-3d342b97f8b2 req-d6270034-6de9-4ea4-98a7-773d5f4bb4b6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040903 Oct 11 06:44:24.473969 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 202/455] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:44:24.606326 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2787d57b-7d0a-49c2-af5f-3228151befd0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:24.616372 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2787d57b-7d0a-49c2-af5f-3228151befd0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:24.618280 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2787d57b-7d0a-49c2-af5f-3228151befd0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:24.620438 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2787d57b-7d0a-49c2-af5f-3228151befd0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1739 microversion: 2.20 time: 0.279898 Oct 11 06:44:24.621449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 254/456] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:24 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1739 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:44:24.820031 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-98b769e1-24f0-4f4f-af47-ee78415ed1b7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:24.821021 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-98b769e1-24f0-4f4f-af47-ee78415ed1b7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:24.827490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-98b769e1-24f0-4f4f-af47-ee78415ed1b7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:24.828214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-98b769e1-24f0-4f4f-af47-ee78415ed1b7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:24.828811 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-98b769e1-24f0-4f4f-af47-ee78415ed1b7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:24.829770 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-98b769e1-24f0-4f4f-af47-ee78415ed1b7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:24.830619 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-98b769e1-24f0-4f4f-af47-ee78415ed1b7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:24.831195 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-98b769e1-24f0-4f4f-af47-ee78415ed1b7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:25.027310 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-98b769e1-24f0-4f4f-af47-ee78415ed1b7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:25.044565 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-98b769e1-24f0-4f4f-af47-ee78415ed1b7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1318 microversion: 2.1 time: 0.226246 Oct 11 06:44:25.046128 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 203/457] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:24 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:25.647135 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-20ae78a9-553b-4b81-abed-23771cdfec40 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:25.647960 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-20ae78a9-553b-4b81-abed-23771cdfec40 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:25.655598 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20ae78a9-553b-4b81-abed-23771cdfec40 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:25.656338 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20ae78a9-553b-4b81-abed-23771cdfec40 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:25.656978 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20ae78a9-553b-4b81-abed-23771cdfec40 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:25.657769 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20ae78a9-553b-4b81-abed-23771cdfec40 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:25.658273 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20ae78a9-553b-4b81-abed-23771cdfec40 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:25.658775 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20ae78a9-553b-4b81-abed-23771cdfec40 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:25.833062 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-20ae78a9-553b-4b81-abed-23771cdfec40 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:25.843278 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8d922b00-c6fc-4659-997a-377ccebed66c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Action: 'create', calling method: .version_select at 0x7f8e26dcc700>, body: {"keypair": {"name": "tempest-keypair-799405031", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHN6SUIK4D8T3DTp0KmYawSV7ok56CZ2RmoMKMd5oOjuTQX2lrMFu0lXerlr8gvrvsYEXrokpscdOdlqK34wKBATUcLouKjxycRwg14ivVUDRfUCH/f4qW3oetfJLaCa5w=="}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:44:25.857366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-20ae78a9-553b-4b81-abed-23771cdfec40 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:25.862812 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-20ae78a9-553b-4b81-abed-23771cdfec40 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:25.863165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-8d922b00-c6fc-4659-997a-377ccebed66c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Getting quotas for project 0e4e977dc2e84b08a4fbaf7fd2fac42f. Resources: {'key_pairs'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 06:44:25.864072 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-20ae78a9-553b-4b81-abed-23771cdfec40 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1739 microversion: 2.20 time: 0.221767 Oct 11 06:44:25.868541 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 255/458] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:25 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1739 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:44:25.880294 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-8d922b00-c6fc-4659-997a-377ccebed66c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Getting quotas for user 3d57230baeb24e8a8a511a0c6417077e and project 0e4e977dc2e84b08a4fbaf7fd2fac42f. Resources: {'key_pairs'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 06:44:25.912960 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8d922b00-c6fc-4659-997a-377ccebed66c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.077907 Oct 11 06:44:25.913731 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 204/459] 10.222.0.39 () {60 vars in 1159 bytes} [Tue Oct 11 06:44:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:44:26.068943 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9f8c26d6-8af1-4abb-bc4d-ba523820c50c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:26.069833 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9f8c26d6-8af1-4abb-bc4d-ba523820c50c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:26.082047 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9f8c26d6-8af1-4abb-bc4d-ba523820c50c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:26.082840 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9f8c26d6-8af1-4abb-bc4d-ba523820c50c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:26.083493 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9f8c26d6-8af1-4abb-bc4d-ba523820c50c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:26.084460 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9f8c26d6-8af1-4abb-bc4d-ba523820c50c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:26.085522 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9f8c26d6-8af1-4abb-bc4d-ba523820c50c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:26.087686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9f8c26d6-8af1-4abb-bc4d-ba523820c50c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:26.400946 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9f8c26d6-8af1-4abb-bc4d-ba523820c50c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:26.415204 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9f8c26d6-8af1-4abb-bc4d-ba523820c50c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1318 microversion: 2.1 time: 0.351141 Oct 11 06:44:26.416025 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 256/460] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:26 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1318 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:26.898274 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-370ab6b1-89f8-41be-abf4-b4b6a3a45447 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:26.899516 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-370ab6b1-89f8-41be-abf4-b4b6a3a45447 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:26.918981 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-370ab6b1-89f8-41be-abf4-b4b6a3a45447 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:26.919549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-370ab6b1-89f8-41be-abf4-b4b6a3a45447 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:26.920012 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-370ab6b1-89f8-41be-abf4-b4b6a3a45447 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:26.928953 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-370ab6b1-89f8-41be-abf4-b4b6a3a45447 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:26.931040 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-370ab6b1-89f8-41be-abf4-b4b6a3a45447 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:26.931975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-370ab6b1-89f8-41be-abf4-b4b6a3a45447 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:27.254222 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-370ab6b1-89f8-41be-abf4-b4b6a3a45447 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:27.277599 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-370ab6b1-89f8-41be-abf4-b4b6a3a45447 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:27.279982 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-370ab6b1-89f8-41be-abf4-b4b6a3a45447 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:27.281319 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-370ab6b1-89f8-41be-abf4-b4b6a3a45447 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1739 microversion: 2.20 time: 0.389051 Oct 11 06:44:27.282086 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 205/461] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:26 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1739 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:44:27.439694 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ca34d0a3-ee38-4bc0-b34b-94f0f039a25a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:27.440480 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ca34d0a3-ee38-4bc0-b34b-94f0f039a25a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:27.447503 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ca34d0a3-ee38-4bc0-b34b-94f0f039a25a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:27.448521 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ca34d0a3-ee38-4bc0-b34b-94f0f039a25a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:27.449173 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ca34d0a3-ee38-4bc0-b34b-94f0f039a25a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:27.450131 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ca34d0a3-ee38-4bc0-b34b-94f0f039a25a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:27.450826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ca34d0a3-ee38-4bc0-b34b-94f0f039a25a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:27.451351 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ca34d0a3-ee38-4bc0-b34b-94f0f039a25a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:27.682172 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ca34d0a3-ee38-4bc0-b34b-94f0f039a25a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:27.693797 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ca34d0a3-ee38-4bc0-b34b-94f0f039a25a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1318 microversion: 2.1 time: 0.259055 Oct 11 06:44:27.694538 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 257/462] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:27 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:28.068685 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-778f1331-c31d-4e80-a329-235bc00837c9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-811420808", "imageRef": "2303551c-410e-4a2b-8eeb-dea686876901", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "82722ee9-dbe3-45c3-9852-16d75ee6066b"}], "security_groups": [{"name": "tempest-securitygroup--791410294"}], "key_name": "tempest-keypair-799405031", "user_data": "}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:44:28.185455 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.network.neutron [None req-778f1331-c31d-4e80-a329-235bc00837c9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] validate_networks() for [('82722ee9-dbe3-45c3-9852-16d75ee6066b', None, None, None, None, None)] {{(pid=125267) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 06:44:28.307783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-67ce8e54-49e9-42a2-b908-83087c716038 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:28.308497 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-67ce8e54-49e9-42a2-b908-83087c716038 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:28.315216 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67ce8e54-49e9-42a2-b908-83087c716038 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:28.315863 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67ce8e54-49e9-42a2-b908-83087c716038 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:28.318163 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67ce8e54-49e9-42a2-b908-83087c716038 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:28.319180 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67ce8e54-49e9-42a2-b908-83087c716038 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:28.320055 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67ce8e54-49e9-42a2-b908-83087c716038 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:28.320714 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67ce8e54-49e9-42a2-b908-83087c716038 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:28.488323 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-67ce8e54-49e9-42a2-b908-83087c716038 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:28.492128 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:28.498177 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-67ce8e54-49e9-42a2-b908-83087c716038 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:28.504859 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-67ce8e54-49e9-42a2-b908-83087c716038 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:28.512951 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-67ce8e54-49e9-42a2-b908-83087c716038 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1739 microversion: 2.20 time: 0.209330 Oct 11 06:44:28.514241 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 258/463] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:28 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1739 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:44:28.626892 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-778f1331-c31d-4e80-a329-235bc00837c9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Flavor limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 06:44:28.627342 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-778f1331-c31d-4e80-a329-235bc00837c9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Image limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 06:44:28.627841 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-778f1331-c31d-4e80-a329-235bc00837c9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Flavor pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 06:44:28.628249 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-778f1331-c31d-4e80-a329-235bc00837c9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Image pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 06:44:28.628664 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-778f1331-c31d-4e80-a329-235bc00837c9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 06:44:28.639889 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-778f1331-c31d-4e80-a329-235bc00837c9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:28.640418 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-778f1331-c31d-4e80-a329-235bc00837c9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:28.640794 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-778f1331-c31d-4e80-a329-235bc00837c9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:28.641638 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-778f1331-c31d-4e80-a329-235bc00837c9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:28.642092 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-778f1331-c31d-4e80-a329-235bc00837c9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:28.642513 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-778f1331-c31d-4e80-a329-235bc00837c9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:28.651855 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:28.662847 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-778f1331-c31d-4e80-a329-235bc00837c9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Getting quotas for project 0e4e977dc2e84b08a4fbaf7fd2fac42f. Resources: {'cores', 'ram', 'instances'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 06:44:28.667285 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-778f1331-c31d-4e80-a329-235bc00837c9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Getting quotas for user 3d57230baeb24e8a8a511a0c6417077e and project 0e4e977dc2e84b08a4fbaf7fd2fac42f. Resources: {'cores', 'ram', 'instances'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 06:44:28.678530 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-778f1331-c31d-4e80-a329-235bc00837c9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Going to run 1 instances... {{(pid=125267) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 06:44:28.681084 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-778f1331-c31d-4e80-a329-235bc00837c9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2303551c-410e-4a2b-8eeb-dea686876901',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 06:44:28.718228 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6d346d36-3b3e-4597-921b-ed251f6cea74 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:28.719028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6d346d36-3b3e-4597-921b-ed251f6cea74 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:28.728182 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6d346d36-3b3e-4597-921b-ed251f6cea74 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:28.728675 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6d346d36-3b3e-4597-921b-ed251f6cea74 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:28.729114 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6d346d36-3b3e-4597-921b-ed251f6cea74 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:28.729908 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6d346d36-3b3e-4597-921b-ed251f6cea74 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:28.730618 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6d346d36-3b3e-4597-921b-ed251f6cea74 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:28.731210 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6d346d36-3b3e-4597-921b-ed251f6cea74 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:28.739146 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-778f1331-c31d-4e80-a329-235bc00837c9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.675346 Oct 11 06:44:28.740030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 206/464] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Oct 11 06:44:28 2022] POST /compute/v2.1/servers => generated 408 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 06:44:28.760257 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8ff7adda-f0de-4747-8cda-7a2acdb42b54 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:28.761505 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8ff7adda-f0de-4747-8cda-7a2acdb42b54 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:28.849758 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8ff7adda-f0de-4747-8cda-7a2acdb42b54 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:28.857830 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8ff7adda-f0de-4747-8cda-7a2acdb42b54 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1244 microversion: 2.1 time: 0.102848 Oct 11 06:44:28.871452 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 207/465] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:28 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1244 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:28.902626 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6d346d36-3b3e-4597-921b-ed251f6cea74 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:28.911080 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6d346d36-3b3e-4597-921b-ed251f6cea74 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1318 microversion: 2.1 time: 0.196980 Oct 11 06:44:28.911662 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 259/466] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:28 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:29.543940 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d19e2cfc-390c-41fa-a9fd-1a946e6fc844 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:29.544578 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d19e2cfc-390c-41fa-a9fd-1a946e6fc844 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:29.550942 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d19e2cfc-390c-41fa-a9fd-1a946e6fc844 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:29.551438 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d19e2cfc-390c-41fa-a9fd-1a946e6fc844 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:29.551885 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d19e2cfc-390c-41fa-a9fd-1a946e6fc844 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:29.552579 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d19e2cfc-390c-41fa-a9fd-1a946e6fc844 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:29.553034 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d19e2cfc-390c-41fa-a9fd-1a946e6fc844 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:29.553458 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d19e2cfc-390c-41fa-a9fd-1a946e6fc844 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:29.683274 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d19e2cfc-390c-41fa-a9fd-1a946e6fc844 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:29.691294 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d19e2cfc-390c-41fa-a9fd-1a946e6fc844 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:29.692753 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d19e2cfc-390c-41fa-a9fd-1a946e6fc844 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:29.693900 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d19e2cfc-390c-41fa-a9fd-1a946e6fc844 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1739 microversion: 2.20 time: 0.153898 Oct 11 06:44:29.694447 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 208/467] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:29 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:44:29.881122 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c42d56d0-30a9-4156-9498-da7ca04600f4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:29.881719 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c42d56d0-30a9-4156-9498-da7ca04600f4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:29.888067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c42d56d0-30a9-4156-9498-da7ca04600f4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:29.888535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c42d56d0-30a9-4156-9498-da7ca04600f4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:29.888957 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c42d56d0-30a9-4156-9498-da7ca04600f4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:29.889630 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c42d56d0-30a9-4156-9498-da7ca04600f4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:29.890069 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c42d56d0-30a9-4156-9498-da7ca04600f4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:29.890485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c42d56d0-30a9-4156-9498-da7ca04600f4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:29.933969 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3de51d5e-4c3a-4b74-b386-e847ab98d10b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:29.934485 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3de51d5e-4c3a-4b74-b386-e847ab98d10b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:29.940416 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3de51d5e-4c3a-4b74-b386-e847ab98d10b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:29.940889 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3de51d5e-4c3a-4b74-b386-e847ab98d10b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:29.941315 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3de51d5e-4c3a-4b74-b386-e847ab98d10b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:29.941998 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3de51d5e-4c3a-4b74-b386-e847ab98d10b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:29.942439 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3de51d5e-4c3a-4b74-b386-e847ab98d10b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:29.942854 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3de51d5e-4c3a-4b74-b386-e847ab98d10b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:29.952905 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c42d56d0-30a9-4156-9498-da7ca04600f4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:29.960504 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c42d56d0-30a9-4156-9498-da7ca04600f4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1248 microversion: 2.1 time: 0.083223 Oct 11 06:44:29.961566 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 260/468] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:29 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1248 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:30.068467 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3de51d5e-4c3a-4b74-b386-e847ab98d10b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:30.075949 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3de51d5e-4c3a-4b74-b386-e847ab98d10b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1318 microversion: 2.1 time: 0.145886 Oct 11 06:44:30.076508 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 209/469] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:29 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:30.718101 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6e6d7f80-4c4a-4eee-ac79-60a8a60f15c5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:30.718692 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6e6d7f80-4c4a-4eee-ac79-60a8a60f15c5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:30.724652 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6e6d7f80-4c4a-4eee-ac79-60a8a60f15c5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:30.725120 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6e6d7f80-4c4a-4eee-ac79-60a8a60f15c5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:30.725543 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6e6d7f80-4c4a-4eee-ac79-60a8a60f15c5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:30.726271 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6e6d7f80-4c4a-4eee-ac79-60a8a60f15c5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:30.726747 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6e6d7f80-4c4a-4eee-ac79-60a8a60f15c5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:30.727156 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6e6d7f80-4c4a-4eee-ac79-60a8a60f15c5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:30.862547 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6e6d7f80-4c4a-4eee-ac79-60a8a60f15c5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:30.871507 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6e6d7f80-4c4a-4eee-ac79-60a8a60f15c5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:30.872976 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6e6d7f80-4c4a-4eee-ac79-60a8a60f15c5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:30.874205 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6e6d7f80-4c4a-4eee-ac79-60a8a60f15c5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1739 microversion: 2.20 time: 0.159944 Oct 11 06:44:30.874770 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 261/470] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:30 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:44:30.983843 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d3e6c6b2-2e6f-436d-b75e-983d8ceb1bd0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:30.984537 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d3e6c6b2-2e6f-436d-b75e-983d8ceb1bd0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:30.991119 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d3e6c6b2-2e6f-436d-b75e-983d8ceb1bd0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:30.991642 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d3e6c6b2-2e6f-436d-b75e-983d8ceb1bd0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:30.992614 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d3e6c6b2-2e6f-436d-b75e-983d8ceb1bd0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:30.993293 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d3e6c6b2-2e6f-436d-b75e-983d8ceb1bd0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:30.993739 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d3e6c6b2-2e6f-436d-b75e-983d8ceb1bd0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:30.994149 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d3e6c6b2-2e6f-436d-b75e-983d8ceb1bd0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:31.060352 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d3e6c6b2-2e6f-436d-b75e-983d8ceb1bd0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:31.069839 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d3e6c6b2-2e6f-436d-b75e-983d8ceb1bd0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1296 microversion: 2.1 time: 0.090165 Oct 11 06:44:31.085684 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 210/471] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:30 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1296 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:31.098740 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7ea1b87d-ec1e-4d2d-a1c0-933a30d9ae7e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:31.099627 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7ea1b87d-ec1e-4d2d-a1c0-933a30d9ae7e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:31.107702 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7ea1b87d-ec1e-4d2d-a1c0-933a30d9ae7e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:31.107905 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7ea1b87d-ec1e-4d2d-a1c0-933a30d9ae7e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:31.108607 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7ea1b87d-ec1e-4d2d-a1c0-933a30d9ae7e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:31.109309 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7ea1b87d-ec1e-4d2d-a1c0-933a30d9ae7e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:31.109892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7ea1b87d-ec1e-4d2d-a1c0-933a30d9ae7e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:31.110315 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7ea1b87d-ec1e-4d2d-a1c0-933a30d9ae7e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:31.332302 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7ea1b87d-ec1e-4d2d-a1c0-933a30d9ae7e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:31.343857 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7ea1b87d-ec1e-4d2d-a1c0-933a30d9ae7e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1318 microversion: 2.1 time: 0.249182 Oct 11 06:44:31.357942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 262/472] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:31 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:31.900557 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-63ac287b-a5b2-4d82-bb0e-67dc06c5d157 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:31.901346 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-63ac287b-a5b2-4d82-bb0e-67dc06c5d157 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:31.907680 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-63ac287b-a5b2-4d82-bb0e-67dc06c5d157 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:31.908239 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-63ac287b-a5b2-4d82-bb0e-67dc06c5d157 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:31.908746 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-63ac287b-a5b2-4d82-bb0e-67dc06c5d157 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:31.910089 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-63ac287b-a5b2-4d82-bb0e-67dc06c5d157 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:31.910662 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-63ac287b-a5b2-4d82-bb0e-67dc06c5d157 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:31.911193 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-63ac287b-a5b2-4d82-bb0e-67dc06c5d157 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:32.053843 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-63ac287b-a5b2-4d82-bb0e-67dc06c5d157 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:32.062347 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-63ac287b-a5b2-4d82-bb0e-67dc06c5d157 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:32.064026 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-63ac287b-a5b2-4d82-bb0e-67dc06c5d157 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:32.065219 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-63ac287b-a5b2-4d82-bb0e-67dc06c5d157 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1721 microversion: 2.20 time: 0.169373 Oct 11 06:44:32.065764 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 211/473] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:31 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:44:32.092486 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cb6e3214-73ad-4e0e-8335-6659427f0ec4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:32.093092 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cb6e3214-73ad-4e0e-8335-6659427f0ec4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:32.098969 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb6e3214-73ad-4e0e-8335-6659427f0ec4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:32.099639 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb6e3214-73ad-4e0e-8335-6659427f0ec4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:32.099925 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb6e3214-73ad-4e0e-8335-6659427f0ec4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:32.100635 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb6e3214-73ad-4e0e-8335-6659427f0ec4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:32.101077 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb6e3214-73ad-4e0e-8335-6659427f0ec4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:32.101492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb6e3214-73ad-4e0e-8335-6659427f0ec4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:32.166927 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cb6e3214-73ad-4e0e-8335-6659427f0ec4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:32.174648 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cb6e3214-73ad-4e0e-8335-6659427f0ec4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1302 microversion: 2.1 time: 0.085898 Oct 11 06:44:32.175207 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 263/474] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:32 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1302 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:32.249878 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-a95fc166-c1ad-490b-873a-83ef5fac606a req-53474fcc-bdc6-42b2-971f-2850a1405f25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0240e39b-9517-4a93-9789-705cd357e01c", "name": "network-vif-plugged", "status": "completed", "tag": "152b8dff-5676-4b2d-b774-671775bfbc7d"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:44:32.262227 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-a95fc166-c1ad-490b-873a-83ef5fac606a req-53474fcc-bdc6-42b2-971f-2850a1405f25 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:32.262705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-a95fc166-c1ad-490b-873a-83ef5fac606a req-53474fcc-bdc6-42b2-971f-2850a1405f25 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:32.263125 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-a95fc166-c1ad-490b-873a-83ef5fac606a req-53474fcc-bdc6-42b2-971f-2850a1405f25 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:32.276114 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-a95fc166-c1ad-490b-873a-83ef5fac606a req-53474fcc-bdc6-42b2-971f-2850a1405f25 service nova] Creating event network-vif-plugged:152b8dff-5676-4b2d-b774-671775bfbc7d for instance 0240e39b-9517-4a93-9789-705cd357e01c on hv-cinder-85495 Oct 11 06:44:32.281776 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-a95fc166-c1ad-490b-873a-83ef5fac606a req-53474fcc-bdc6-42b2-971f-2850a1405f25 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035583 Oct 11 06:44:32.282353 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 212/475] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:44:32.368913 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c784cdf0-d6c9-453e-8861-f14ce2263051 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:32.369525 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c784cdf0-d6c9-453e-8861-f14ce2263051 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:32.375508 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c784cdf0-d6c9-453e-8861-f14ce2263051 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:32.376003 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c784cdf0-d6c9-453e-8861-f14ce2263051 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:32.376432 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c784cdf0-d6c9-453e-8861-f14ce2263051 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:32.377114 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c784cdf0-d6c9-453e-8861-f14ce2263051 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:32.377560 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c784cdf0-d6c9-453e-8861-f14ce2263051 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:32.377974 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c784cdf0-d6c9-453e-8861-f14ce2263051 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:32.506640 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c784cdf0-d6c9-453e-8861-f14ce2263051 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:32.514289 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c784cdf0-d6c9-453e-8861-f14ce2263051 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1318 microversion: 2.1 time: 0.149683 Oct 11 06:44:32.514844 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 264/476] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:32 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:33.092182 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6738b9f7-1d8a-41ef-b963-98bcf44dd806 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:33.092867 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6738b9f7-1d8a-41ef-b963-98bcf44dd806 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:33.099484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6738b9f7-1d8a-41ef-b963-98bcf44dd806 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:33.099968 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6738b9f7-1d8a-41ef-b963-98bcf44dd806 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:33.100404 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6738b9f7-1d8a-41ef-b963-98bcf44dd806 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:33.101723 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6738b9f7-1d8a-41ef-b963-98bcf44dd806 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:33.102180 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6738b9f7-1d8a-41ef-b963-98bcf44dd806 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:33.102602 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6738b9f7-1d8a-41ef-b963-98bcf44dd806 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:33.198781 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9bed8372-e946-4c6d-9178-f544e1bccec0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:33.199438 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9bed8372-e946-4c6d-9178-f544e1bccec0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:33.205750 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9bed8372-e946-4c6d-9178-f544e1bccec0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:33.206226 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9bed8372-e946-4c6d-9178-f544e1bccec0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:33.206651 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9bed8372-e946-4c6d-9178-f544e1bccec0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:33.207337 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9bed8372-e946-4c6d-9178-f544e1bccec0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:33.207808 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9bed8372-e946-4c6d-9178-f544e1bccec0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:33.208222 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9bed8372-e946-4c6d-9178-f544e1bccec0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:33.229701 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6738b9f7-1d8a-41ef-b963-98bcf44dd806 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:33.238087 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6738b9f7-1d8a-41ef-b963-98bcf44dd806 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:33.239589 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6738b9f7-1d8a-41ef-b963-98bcf44dd806 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:33.240828 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6738b9f7-1d8a-41ef-b963-98bcf44dd806 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1721 microversion: 2.20 time: 0.152843 Oct 11 06:44:33.241379 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 213/477] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:33 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:44:33.269270 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9bed8372-e946-4c6d-9178-f544e1bccec0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:33.277322 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9bed8372-e946-4c6d-9178-f544e1bccec0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1302 microversion: 2.1 time: 0.083214 Oct 11 06:44:33.277870 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 265/478] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:33 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1302 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:33.537135 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-79c914f8-bef5-4057-b74d-9b2da1f96a7f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:33.537674 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-79c914f8-bef5-4057-b74d-9b2da1f96a7f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:33.540691 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:33.544437 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-79c914f8-bef5-4057-b74d-9b2da1f96a7f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:33.544917 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-79c914f8-bef5-4057-b74d-9b2da1f96a7f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:33.545349 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-79c914f8-bef5-4057-b74d-9b2da1f96a7f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:33.546033 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-79c914f8-bef5-4057-b74d-9b2da1f96a7f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:33.546483 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-79c914f8-bef5-4057-b74d-9b2da1f96a7f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:33.546901 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-79c914f8-bef5-4057-b74d-9b2da1f96a7f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:33.679747 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-79c914f8-bef5-4057-b74d-9b2da1f96a7f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:33.687594 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-79c914f8-bef5-4057-b74d-9b2da1f96a7f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1318 microversion: 2.1 time: 0.154370 Oct 11 06:44:33.688147 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 214/479] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:33 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:34.266955 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-71f132b0-92f1-425e-b03b-076c0033bb62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:34.267699 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-71f132b0-92f1-425e-b03b-076c0033bb62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:34.274513 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-71f132b0-92f1-425e-b03b-076c0033bb62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:34.275633 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-71f132b0-92f1-425e-b03b-076c0033bb62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:34.276071 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-71f132b0-92f1-425e-b03b-076c0033bb62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:34.276775 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-71f132b0-92f1-425e-b03b-076c0033bb62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:34.277282 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-71f132b0-92f1-425e-b03b-076c0033bb62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:34.277748 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-71f132b0-92f1-425e-b03b-076c0033bb62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:34.300624 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9a41419b-ced9-43ad-bf69-95d7ed308931 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:34.301983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9a41419b-ced9-43ad-bf69-95d7ed308931 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:34.309034 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9a41419b-ced9-43ad-bf69-95d7ed308931 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:34.309692 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9a41419b-ced9-43ad-bf69-95d7ed308931 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:34.310219 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9a41419b-ced9-43ad-bf69-95d7ed308931 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:34.311021 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9a41419b-ced9-43ad-bf69-95d7ed308931 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:34.311743 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9a41419b-ced9-43ad-bf69-95d7ed308931 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:34.312350 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9a41419b-ced9-43ad-bf69-95d7ed308931 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:34.376905 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9a41419b-ced9-43ad-bf69-95d7ed308931 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:34.390937 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9a41419b-ced9-43ad-bf69-95d7ed308931 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1302 microversion: 2.1 time: 0.093824 Oct 11 06:44:34.391941 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 215/480] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:34 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1302 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:34.559716 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-71f132b0-92f1-425e-b03b-076c0033bb62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:34.568879 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-71f132b0-92f1-425e-b03b-076c0033bb62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:34.570306 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-71f132b0-92f1-425e-b03b-076c0033bb62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:34.571498 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-71f132b0-92f1-425e-b03b-076c0033bb62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1724 microversion: 2.20 time: 0.309066 Oct 11 06:44:34.572098 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 266/481] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:34 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1724 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:44:34.597082 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2fecb78b-92ec-4009-b75f-0dd6cffdf461 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "373addf3-b094-4b57-b450-5dc4773b3774"}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:44:34.599643 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2fecb78b-92ec-4009-b75f-0dd6cffdf461 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:34.606288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2fecb78b-92ec-4009-b75f-0dd6cffdf461 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:34.606771 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2fecb78b-92ec-4009-b75f-0dd6cffdf461 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:34.607201 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2fecb78b-92ec-4009-b75f-0dd6cffdf461 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:34.607929 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2fecb78b-92ec-4009-b75f-0dd6cffdf461 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:34.608380 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2fecb78b-92ec-4009-b75f-0dd6cffdf461 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:34.608801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2fecb78b-92ec-4009-b75f-0dd6cffdf461 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:34.712069 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-15e11402-fa5f-4c0a-960b-8139eebd0355 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:34.712677 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-15e11402-fa5f-4c0a-960b-8139eebd0355 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:34.719289 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-15e11402-fa5f-4c0a-960b-8139eebd0355 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:34.722361 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-15e11402-fa5f-4c0a-960b-8139eebd0355 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:34.722873 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-15e11402-fa5f-4c0a-960b-8139eebd0355 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:34.723544 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-15e11402-fa5f-4c0a-960b-8139eebd0355 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:34.723988 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-15e11402-fa5f-4c0a-960b-8139eebd0355 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:34.724404 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-15e11402-fa5f-4c0a-960b-8139eebd0355 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:34.893227 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-15e11402-fa5f-4c0a-960b-8139eebd0355 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:34.904160 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-15e11402-fa5f-4c0a-960b-8139eebd0355 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1318 microversion: 2.1 time: 0.195738 Oct 11 06:44:34.923277 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 267/482] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:34 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:34.967799 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2fecb78b-92ec-4009-b75f-0dd6cffdf461 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "POST /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.373948 Oct 11 06:44:34.968579 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 216/483] 10.222.0.39 () {62 vars in 1364 bytes} [Tue Oct 11 06:44:34 2022] POST /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 188 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 06:44:35.097991 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8dbcd8af-bb28-402f-aa91-92c6e426dd67 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:44:35.098587 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8dbcd8af-bb28-402f-aa91-92c6e426dd67 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:35.104479 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8dbcd8af-bb28-402f-aa91-92c6e426dd67 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:35.104964 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8dbcd8af-bb28-402f-aa91-92c6e426dd67 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:35.105399 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8dbcd8af-bb28-402f-aa91-92c6e426dd67 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:35.106093 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8dbcd8af-bb28-402f-aa91-92c6e426dd67 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:35.106542 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8dbcd8af-bb28-402f-aa91-92c6e426dd67 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:35.106962 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8dbcd8af-bb28-402f-aa91-92c6e426dd67 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:35.150138 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8dbcd8af-bb28-402f-aa91-92c6e426dd67 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125266) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 11 06:44:35.221015 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8dbcd8af-bb28-402f-aa91-92c6e426dd67 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "POST /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/action" status: 202 len: 0 microversion: 2.20 time: 0.126920 Oct 11 06:44:35.221868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 268/484] 10.222.0.39 () {62 vars in 1319 bytes} [Tue Oct 11 06:44:35 2022] POST /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 06:44:35.230769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-30b9d8ad-abca-4fd9-b052-5c353915edeb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:35.231316 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-30b9d8ad-abca-4fd9-b052-5c353915edeb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:35.238300 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30b9d8ad-abca-4fd9-b052-5c353915edeb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:35.238789 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30b9d8ad-abca-4fd9-b052-5c353915edeb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:35.239219 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30b9d8ad-abca-4fd9-b052-5c353915edeb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:35.239953 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30b9d8ad-abca-4fd9-b052-5c353915edeb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:35.240402 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30b9d8ad-abca-4fd9-b052-5c353915edeb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:35.240815 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30b9d8ad-abca-4fd9-b052-5c353915edeb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:35.399852 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-30b9d8ad-abca-4fd9-b052-5c353915edeb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:35.414743 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7a2605f0-8b19-450c-a8f8-0acb8b38e3e6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:35.415348 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7a2605f0-8b19-450c-a8f8-0acb8b38e3e6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:35.416454 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-30b9d8ad-abca-4fd9-b052-5c353915edeb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:35.418117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-30b9d8ad-abca-4fd9-b052-5c353915edeb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:35.419577 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-30b9d8ad-abca-4fd9-b052-5c353915edeb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1810 microversion: 2.20 time: 0.193165 Oct 11 06:44:35.431640 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 217/485] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:35 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1810 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:44:35.432060 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7a2605f0-8b19-450c-a8f8-0acb8b38e3e6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:35.432060 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7a2605f0-8b19-450c-a8f8-0acb8b38e3e6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:35.432060 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7a2605f0-8b19-450c-a8f8-0acb8b38e3e6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:35.432060 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7a2605f0-8b19-450c-a8f8-0acb8b38e3e6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:35.432387 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7a2605f0-8b19-450c-a8f8-0acb8b38e3e6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:35.432387 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7a2605f0-8b19-450c-a8f8-0acb8b38e3e6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:35.631365 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7a2605f0-8b19-450c-a8f8-0acb8b38e3e6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:35.639345 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7a2605f0-8b19-450c-a8f8-0acb8b38e3e6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1369 microversion: 2.1 time: 0.229223 Oct 11 06:44:35.639846 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 269/486] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:35 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1369 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:35.759157 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-d7b71c23-1035-498a-9ea8-e6e251e69879 req-53b3fcc8-9fc5-44a1-b31c-eb42e2dd79a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70f4927d-5233-4d2b-a109-a1739feef2eb", "tag": "d3558897-9eb2-44a5-8c6f-5fcac13e4072"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:44:35.772680 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-d7b71c23-1035-498a-9ea8-e6e251e69879 req-53b3fcc8-9fc5-44a1-b31c-eb42e2dd79a9 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:35.774219 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-d7b71c23-1035-498a-9ea8-e6e251e69879 req-53b3fcc8-9fc5-44a1-b31c-eb42e2dd79a9 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:35.775279 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-d7b71c23-1035-498a-9ea8-e6e251e69879 req-53b3fcc8-9fc5-44a1-b31c-eb42e2dd79a9 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:35.787260 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-d7b71c23-1035-498a-9ea8-e6e251e69879 req-53b3fcc8-9fc5-44a1-b31c-eb42e2dd79a9 service nova] Creating event network-changed:d3558897-9eb2-44a5-8c6f-5fcac13e4072 for instance 70f4927d-5233-4d2b-a109-a1739feef2eb on hv-cinder-85495 Oct 11 06:44:35.794166 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-d7b71c23-1035-498a-9ea8-e6e251e69879 req-53b3fcc8-9fc5-44a1-b31c-eb42e2dd79a9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039624 Oct 11 06:44:35.794958 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 218/487] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:44:35.928212 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-00bef6c6-93e0-4d7e-9eea-c7b1291ea314 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:35.929567 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-00bef6c6-93e0-4d7e-9eea-c7b1291ea314 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:35.936223 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-00bef6c6-93e0-4d7e-9eea-c7b1291ea314 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:35.936891 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-00bef6c6-93e0-4d7e-9eea-c7b1291ea314 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:35.937663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-00bef6c6-93e0-4d7e-9eea-c7b1291ea314 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:35.938526 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-00bef6c6-93e0-4d7e-9eea-c7b1291ea314 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:35.939148 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-00bef6c6-93e0-4d7e-9eea-c7b1291ea314 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:35.939764 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-00bef6c6-93e0-4d7e-9eea-c7b1291ea314 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:36.093081 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-00bef6c6-93e0-4d7e-9eea-c7b1291ea314 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:36.105154 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-00bef6c6-93e0-4d7e-9eea-c7b1291ea314 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1318 microversion: 2.1 time: 0.181498 Oct 11 06:44:36.106125 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 270/488] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:35 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:36.216780 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-379713a9-28ee-43d5-afc6-99c42ddefa46 req-863ac8f4-8f46-4e04-914c-3f0cfaf9bf9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43d48211-8dab-4abd-8c95-e850b83382ff", "name": "network-vif-unplugged", "status": "completed", "tag": "f963366d-bbf2-4aff-84d1-f61c69977089"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:44:36.232871 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-379713a9-28ee-43d5-afc6-99c42ddefa46 req-863ac8f4-8f46-4e04-914c-3f0cfaf9bf9e service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:36.233694 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-379713a9-28ee-43d5-afc6-99c42ddefa46 req-863ac8f4-8f46-4e04-914c-3f0cfaf9bf9e service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:36.234221 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-379713a9-28ee-43d5-afc6-99c42ddefa46 req-863ac8f4-8f46-4e04-914c-3f0cfaf9bf9e service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:36.246786 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.compute.server_external_events [req-379713a9-28ee-43d5-afc6-99c42ddefa46 req-863ac8f4-8f46-4e04-914c-3f0cfaf9bf9e service nova] Unable to find a host for instance 43d48211-8dab-4abd-8c95-e850b83382ff. Dropping event network-vif-unplugged {{(pid=125267) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 11 06:44:36.249178 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-379713a9-28ee-43d5-afc6-99c42ddefa46 req-863ac8f4-8f46-4e04-914c-3f0cfaf9bf9e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036302 Oct 11 06:44:36.252411 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 219/489] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 41 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 11 06:44:36.447241 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-54ceadbf-034f-4b77-8464-e272c5805531 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:36.447889 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-54ceadbf-034f-4b77-8464-e272c5805531 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:36.454114 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54ceadbf-034f-4b77-8464-e272c5805531 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:36.454585 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54ceadbf-034f-4b77-8464-e272c5805531 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:36.455008 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54ceadbf-034f-4b77-8464-e272c5805531 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:36.455708 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54ceadbf-034f-4b77-8464-e272c5805531 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:36.456156 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54ceadbf-034f-4b77-8464-e272c5805531 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:36.456559 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54ceadbf-034f-4b77-8464-e272c5805531 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:36.662685 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-641a2960-f316-4934-a149-6e8eaf76c533 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:36.663526 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-641a2960-f316-4934-a149-6e8eaf76c533 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:36.669903 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-641a2960-f316-4934-a149-6e8eaf76c533 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:36.670390 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-641a2960-f316-4934-a149-6e8eaf76c533 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:36.670823 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-641a2960-f316-4934-a149-6e8eaf76c533 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:36.671808 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-641a2960-f316-4934-a149-6e8eaf76c533 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:36.672414 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-641a2960-f316-4934-a149-6e8eaf76c533 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:36.673207 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-641a2960-f316-4934-a149-6e8eaf76c533 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:36.688244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-54ceadbf-034f-4b77-8464-e272c5805531 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:36.702048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-54ceadbf-034f-4b77-8464-e272c5805531 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:36.706805 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-54ceadbf-034f-4b77-8464-e272c5805531 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:36.708243 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-54ceadbf-034f-4b77-8464-e272c5805531 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1750 microversion: 2.20 time: 0.265571 Oct 11 06:44:36.708947 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 271/490] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:36 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1750 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:44:36.886832 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-641a2960-f316-4934-a149-6e8eaf76c533 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:36.896412 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-641a2960-f316-4934-a149-6e8eaf76c533 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1369 microversion: 2.1 time: 0.237814 Oct 11 06:44:36.914175 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 220/491] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:36 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1369 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:37.131709 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ce810c9b-327b-4289-b5b9-d6117d208ed4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:37.132478 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ce810c9b-327b-4289-b5b9-d6117d208ed4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:37.139485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ce810c9b-327b-4289-b5b9-d6117d208ed4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:37.140235 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ce810c9b-327b-4289-b5b9-d6117d208ed4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:37.140667 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ce810c9b-327b-4289-b5b9-d6117d208ed4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:37.141522 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ce810c9b-327b-4289-b5b9-d6117d208ed4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:37.142072 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ce810c9b-327b-4289-b5b9-d6117d208ed4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:37.142737 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ce810c9b-327b-4289-b5b9-d6117d208ed4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:37.278281 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ce810c9b-327b-4289-b5b9-d6117d208ed4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:37.286271 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ce810c9b-327b-4289-b5b9-d6117d208ed4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1508 microversion: 2.1 time: 0.161830 Oct 11 06:44:37.286878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 272/492] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:37 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:37.735087 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-57eeda8e-d72d-44d6-99b9-9c4c27ed96ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:37.735995 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-57eeda8e-d72d-44d6-99b9-9c4c27ed96ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:37.745782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57eeda8e-d72d-44d6-99b9-9c4c27ed96ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:37.745782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57eeda8e-d72d-44d6-99b9-9c4c27ed96ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:37.746280 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57eeda8e-d72d-44d6-99b9-9c4c27ed96ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:37.747091 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57eeda8e-d72d-44d6-99b9-9c4c27ed96ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:37.748633 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57eeda8e-d72d-44d6-99b9-9c4c27ed96ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:37.750055 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57eeda8e-d72d-44d6-99b9-9c4c27ed96ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:37.887115 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-57eeda8e-d72d-44d6-99b9-9c4c27ed96ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:37.896268 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-57eeda8e-d72d-44d6-99b9-9c4c27ed96ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:37.897767 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-57eeda8e-d72d-44d6-99b9-9c4c27ed96ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:37.898979 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-57eeda8e-d72d-44d6-99b9-9c4c27ed96ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1752 microversion: 2.20 time: 0.167701 Oct 11 06:44:37.907107 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 221/493] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:37 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1752 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:44:37.924321 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e82c9377-45d3-46a0-b4ee-9d4fe9caa750 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:37.927651 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e82c9377-45d3-46a0-b4ee-9d4fe9caa750 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:37.935456 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e82c9377-45d3-46a0-b4ee-9d4fe9caa750 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:37.936249 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e82c9377-45d3-46a0-b4ee-9d4fe9caa750 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:37.936725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e82c9377-45d3-46a0-b4ee-9d4fe9caa750 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:37.937481 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e82c9377-45d3-46a0-b4ee-9d4fe9caa750 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:37.937941 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e82c9377-45d3-46a0-b4ee-9d4fe9caa750 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:37.938360 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e82c9377-45d3-46a0-b4ee-9d4fe9caa750 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:38.074737 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e82c9377-45d3-46a0-b4ee-9d4fe9caa750 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:38.082658 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e82c9377-45d3-46a0-b4ee-9d4fe9caa750 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1369 microversion: 2.1 time: 0.164106 Oct 11 06:44:38.083480 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 273/494] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:37 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1369 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:38.937686 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8e528f14-d160-4f9f-8481-a25bb936aac5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:38.939089 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8e528f14-d160-4f9f-8481-a25bb936aac5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:38.941586 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=2 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:38.945530 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=12 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:38.952921 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e528f14-d160-4f9f-8481-a25bb936aac5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:38.953406 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e528f14-d160-4f9f-8481-a25bb936aac5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:38.953850 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e528f14-d160-4f9f-8481-a25bb936aac5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:38.954550 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e528f14-d160-4f9f-8481-a25bb936aac5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:38.954998 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e528f14-d160-4f9f-8481-a25bb936aac5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:38.955434 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e528f14-d160-4f9f-8481-a25bb936aac5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:39.106310 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e6824548-282b-4ba4-8725-a67a273a894b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:39.106944 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e6824548-282b-4ba4-8725-a67a273a894b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:39.118549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8e528f14-d160-4f9f-8481-a25bb936aac5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:39.126053 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e6824548-282b-4ba4-8725-a67a273a894b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:39.126685 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e6824548-282b-4ba4-8725-a67a273a894b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:39.127272 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e6824548-282b-4ba4-8725-a67a273a894b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:39.128316 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e6824548-282b-4ba4-8725-a67a273a894b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:39.128912 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e6824548-282b-4ba4-8725-a67a273a894b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:39.129456 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e6824548-282b-4ba4-8725-a67a273a894b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:39.144427 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8e528f14-d160-4f9f-8481-a25bb936aac5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:39.147385 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8e528f14-d160-4f9f-8481-a25bb936aac5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:39.148914 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8e528f14-d160-4f9f-8481-a25bb936aac5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1808 microversion: 2.20 time: 0.218001 Oct 11 06:44:39.151509 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 222/495] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:38 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1808 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:44:39.156015 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:39.276916 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e6824548-282b-4ba4-8725-a67a273a894b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:39.285307 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e6824548-282b-4ba4-8725-a67a273a894b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1369 microversion: 2.1 time: 0.182705 Oct 11 06:44:39.286021 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 274/496] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:39 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1369 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:40.178574 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2112fa8c-9ea9-438c-a777-5c9e07a4846b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:40.179602 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2112fa8c-9ea9-438c-a777-5c9e07a4846b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:40.190984 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2112fa8c-9ea9-438c-a777-5c9e07a4846b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:40.192252 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2112fa8c-9ea9-438c-a777-5c9e07a4846b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:40.192796 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2112fa8c-9ea9-438c-a777-5c9e07a4846b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:40.193631 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2112fa8c-9ea9-438c-a777-5c9e07a4846b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:40.194192 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2112fa8c-9ea9-438c-a777-5c9e07a4846b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:40.195278 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2112fa8c-9ea9-438c-a777-5c9e07a4846b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:40.309865 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b8c1b571-2fc0-46eb-9669-8f5679e06574 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:40.310456 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b8c1b571-2fc0-46eb-9669-8f5679e06574 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:40.325170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b8c1b571-2fc0-46eb-9669-8f5679e06574 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:40.325667 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b8c1b571-2fc0-46eb-9669-8f5679e06574 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:40.326107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b8c1b571-2fc0-46eb-9669-8f5679e06574 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:40.326831 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b8c1b571-2fc0-46eb-9669-8f5679e06574 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:40.327365 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b8c1b571-2fc0-46eb-9669-8f5679e06574 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:40.327882 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b8c1b571-2fc0-46eb-9669-8f5679e06574 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:40.373536 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2112fa8c-9ea9-438c-a777-5c9e07a4846b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:40.377346 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:40.384561 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2112fa8c-9ea9-438c-a777-5c9e07a4846b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:40.386290 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2112fa8c-9ea9-438c-a777-5c9e07a4846b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:40.387525 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2112fa8c-9ea9-438c-a777-5c9e07a4846b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1808 microversion: 2.20 time: 0.213181 Oct 11 06:44:40.393941 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 223/497] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:40 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1808 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:44:40.564581 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b8c1b571-2fc0-46eb-9669-8f5679e06574 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:40.572737 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b8c1b571-2fc0-46eb-9669-8f5679e06574 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1369 microversion: 2.1 time: 0.267107 Oct 11 06:44:40.573302 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 275/498] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:40 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1369 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:40.734845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e7b4f918-e305-4bb2-93b1-15b28665b7ba tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-845716263", "imageRef": "2303551c-410e-4a2b-8eeb-dea686876901", "flavorRef": "452"}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:44:40.794525 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.network.neutron [None req-e7b4f918-e305-4bb2-93b1-15b28665b7ba tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] validate_networks() for None {{(pid=125267) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 06:44:41.370911 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-e7b4f918-e305-4bb2-93b1-15b28665b7ba tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Flavor limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 06:44:41.371589 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-e7b4f918-e305-4bb2-93b1-15b28665b7ba tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Image limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 06:44:41.371859 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-e7b4f918-e305-4bb2-93b1-15b28665b7ba tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Flavor pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 06:44:41.372266 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-e7b4f918-e305-4bb2-93b1-15b28665b7ba tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Image pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 06:44:41.372674 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-e7b4f918-e305-4bb2-93b1-15b28665b7ba tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 06:44:41.382883 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7b4f918-e305-4bb2-93b1-15b28665b7ba tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:41.383348 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7b4f918-e305-4bb2-93b1-15b28665b7ba tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:41.383810 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7b4f918-e305-4bb2-93b1-15b28665b7ba tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:41.384542 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7b4f918-e305-4bb2-93b1-15b28665b7ba tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:41.384992 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7b4f918-e305-4bb2-93b1-15b28665b7ba tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:41.385413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7b4f918-e305-4bb2-93b1-15b28665b7ba tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:41.417408 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-350e80c9-0b0f-43d3-8ebd-7e2dbf85c467 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:41.417961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-350e80c9-0b0f-43d3-8ebd-7e2dbf85c467 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:41.421859 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-e7b4f918-e305-4bb2-93b1-15b28665b7ba tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Getting quotas for project 8c0cbe1cb0974454a2c4c7cbde3681e8. Resources: {'cores', 'ram', 'instances'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 06:44:41.426299 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-e7b4f918-e305-4bb2-93b1-15b28665b7ba tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Getting quotas for user 66a6c4a5e3f94f1c932fd3210ae9bf05 and project 8c0cbe1cb0974454a2c4c7cbde3681e8. Resources: {'cores', 'ram', 'instances'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 06:44:41.427181 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-350e80c9-0b0f-43d3-8ebd-7e2dbf85c467 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:41.427703 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-350e80c9-0b0f-43d3-8ebd-7e2dbf85c467 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:41.428133 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-350e80c9-0b0f-43d3-8ebd-7e2dbf85c467 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:41.438108 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e7b4f918-e305-4bb2-93b1-15b28665b7ba tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Going to run 1 instances... {{(pid=125267) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 06:44:41.439821 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-350e80c9-0b0f-43d3-8ebd-7e2dbf85c467 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:41.440544 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-350e80c9-0b0f-43d3-8ebd-7e2dbf85c467 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:41.440751 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e7b4f918-e305-4bb2-93b1-15b28665b7ba tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2303551c-410e-4a2b-8eeb-dea686876901',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 06:44:41.441254 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-350e80c9-0b0f-43d3-8ebd-7e2dbf85c467 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:41.501851 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e7b4f918-e305-4bb2-93b1-15b28665b7ba tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.771498 Oct 11 06:44:41.502506 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 224/499] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Oct 11 06:44:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 06:44:41.514046 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3f50c8d5-7d33-4e5e-bc91-78b6ceacb472 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:41.514839 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3f50c8d5-7d33-4e5e-bc91-78b6ceacb472 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:41.579049 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3f50c8d5-7d33-4e5e-bc91-78b6ceacb472 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a6c4a5e3f94f1c932fd3210ae9bf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0cbe1cb0974454a2c4c7cbde3681e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:41.601337 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3f50c8d5-7d33-4e5e-bc91-78b6ceacb472 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 200 len: 1214 microversion: 2.1 time: 0.090308 Oct 11 06:44:41.602756 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 225/500] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:41 2022] GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:41.619372 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bb2b3d55-4f9b-4c41-bf08-036ef878508e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:41.623196 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bb2b3d55-4f9b-4c41-bf08-036ef878508e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:41.629699 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb2b3d55-4f9b-4c41-bf08-036ef878508e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:41.630515 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb2b3d55-4f9b-4c41-bf08-036ef878508e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:41.631117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb2b3d55-4f9b-4c41-bf08-036ef878508e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:41.632580 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb2b3d55-4f9b-4c41-bf08-036ef878508e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:41.633190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb2b3d55-4f9b-4c41-bf08-036ef878508e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:41.633769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb2b3d55-4f9b-4c41-bf08-036ef878508e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:41.654376 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-350e80c9-0b0f-43d3-8ebd-7e2dbf85c467 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:41.664234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-350e80c9-0b0f-43d3-8ebd-7e2dbf85c467 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:41.670528 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-350e80c9-0b0f-43d3-8ebd-7e2dbf85c467 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:41.672163 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-350e80c9-0b0f-43d3-8ebd-7e2dbf85c467 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1808 microversion: 2.20 time: 0.262505 Oct 11 06:44:41.675219 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 276/501] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:41 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1808 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:44:41.812072 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-bb2b3d55-4f9b-4c41-bf08-036ef878508e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:41.828795 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bb2b3d55-4f9b-4c41-bf08-036ef878508e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1369 microversion: 2.1 time: 0.218515 Oct 11 06:44:41.829481 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 226/502] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:41 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1369 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:42.351867 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-413209b0-c2be-4a71-912c-005cdecdd66a req-ba3b1d8d-f1c5-4ee9-a015-f12038e27170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f4927d-5233-4d2b-a109-a1739feef2eb", "name": "network-vif-plugged", "status": "completed", "tag": "d3558897-9eb2-44a5-8c6f-5fcac13e4072"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:44:42.361858 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-413209b0-c2be-4a71-912c-005cdecdd66a req-ba3b1d8d-f1c5-4ee9-a015-f12038e27170 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:42.362355 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-413209b0-c2be-4a71-912c-005cdecdd66a req-ba3b1d8d-f1c5-4ee9-a015-f12038e27170 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:42.362752 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-413209b0-c2be-4a71-912c-005cdecdd66a req-ba3b1d8d-f1c5-4ee9-a015-f12038e27170 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:42.376319 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-413209b0-c2be-4a71-912c-005cdecdd66a req-ba3b1d8d-f1c5-4ee9-a015-f12038e27170 service nova] Creating event network-vif-plugged:d3558897-9eb2-44a5-8c6f-5fcac13e4072 for instance 70f4927d-5233-4d2b-a109-a1739feef2eb on hv-cinder-85495 Oct 11 06:44:42.381373 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-413209b0-c2be-4a71-912c-005cdecdd66a req-ba3b1d8d-f1c5-4ee9-a015-f12038e27170 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033847 Oct 11 06:44:42.381966 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 277/503] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:44:42.624794 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-99c4e97c-06a9-4586-afc1-aae066c57b17 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:42.625411 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-99c4e97c-06a9-4586-afc1-aae066c57b17 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:42.634631 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99c4e97c-06a9-4586-afc1-aae066c57b17 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:42.635357 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99c4e97c-06a9-4586-afc1-aae066c57b17 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:42.635923 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99c4e97c-06a9-4586-afc1-aae066c57b17 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:42.637158 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99c4e97c-06a9-4586-afc1-aae066c57b17 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:42.637752 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99c4e97c-06a9-4586-afc1-aae066c57b17 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:42.638310 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99c4e97c-06a9-4586-afc1-aae066c57b17 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:42.708282 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-18ac3d92-d2ca-485d-abca-67ddf3261767 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:42.710026 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-18ac3d92-d2ca-485d-abca-67ddf3261767 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:42.711327 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-99c4e97c-06a9-4586-afc1-aae066c57b17 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a6c4a5e3f94f1c932fd3210ae9bf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0cbe1cb0974454a2c4c7cbde3681e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:42.718004 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18ac3d92-d2ca-485d-abca-67ddf3261767 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:42.718709 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18ac3d92-d2ca-485d-abca-67ddf3261767 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:42.719323 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18ac3d92-d2ca-485d-abca-67ddf3261767 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:42.719818 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-99c4e97c-06a9-4586-afc1-aae066c57b17 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 200 len: 1218 microversion: 2.1 time: 0.098684 Oct 11 06:44:42.720362 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18ac3d92-d2ca-485d-abca-67ddf3261767 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:42.720810 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18ac3d92-d2ca-485d-abca-67ddf3261767 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:42.721387 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18ac3d92-d2ca-485d-abca-67ddf3261767 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:42.736386 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 227/504] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:42 2022] GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 1218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:42.852387 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-052d270e-7924-4f60-ab2d-663f7c6b2498 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:42.852997 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-052d270e-7924-4f60-ab2d-663f7c6b2498 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:42.858870 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-052d270e-7924-4f60-ab2d-663f7c6b2498 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:42.859353 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-052d270e-7924-4f60-ab2d-663f7c6b2498 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:42.859815 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-052d270e-7924-4f60-ab2d-663f7c6b2498 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:42.860509 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-052d270e-7924-4f60-ab2d-663f7c6b2498 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:42.860967 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-052d270e-7924-4f60-ab2d-663f7c6b2498 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:42.861390 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-052d270e-7924-4f60-ab2d-663f7c6b2498 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:42.876723 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-18ac3d92-d2ca-485d-abca-67ddf3261767 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:42.885403 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-18ac3d92-d2ca-485d-abca-67ddf3261767 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:42.886829 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-18ac3d92-d2ca-485d-abca-67ddf3261767 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:42.888035 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-18ac3d92-d2ca-485d-abca-67ddf3261767 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1808 microversion: 2.20 time: 0.186569 Oct 11 06:44:42.888582 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 278/505] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:42 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:44:42.989815 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-052d270e-7924-4f60-ab2d-663f7c6b2498 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:42.997700 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-052d270e-7924-4f60-ab2d-663f7c6b2498 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1369 microversion: 2.1 time: 0.149262 Oct 11 06:44:42.998257 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 228/506] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:42 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:43.743491 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c11d423a-b615-4ee1-98f2-819ab12d6cb2 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:43.744127 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c11d423a-b615-4ee1-98f2-819ab12d6cb2 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:43.750511 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c11d423a-b615-4ee1-98f2-819ab12d6cb2 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:43.751023 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c11d423a-b615-4ee1-98f2-819ab12d6cb2 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:43.751471 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c11d423a-b615-4ee1-98f2-819ab12d6cb2 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:43.752166 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c11d423a-b615-4ee1-98f2-819ab12d6cb2 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:43.752616 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c11d423a-b615-4ee1-98f2-819ab12d6cb2 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:43.753034 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c11d423a-b615-4ee1-98f2-819ab12d6cb2 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:43.822718 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c11d423a-b615-4ee1-98f2-819ab12d6cb2 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a6c4a5e3f94f1c932fd3210ae9bf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0cbe1cb0974454a2c4c7cbde3681e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:43.831951 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c11d423a-b615-4ee1-98f2-819ab12d6cb2 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 200 len: 1218 microversion: 2.1 time: 0.092967 Oct 11 06:44:43.832779 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 279/507] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:43 2022] GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:43.914166 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-df56a165-9ba3-42a5-a3e9-ee7f2732c3f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:43.914784 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-df56a165-9ba3-42a5-a3e9-ee7f2732c3f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:43.921223 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-df56a165-9ba3-42a5-a3e9-ee7f2732c3f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:43.921711 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-df56a165-9ba3-42a5-a3e9-ee7f2732c3f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:43.922153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-df56a165-9ba3-42a5-a3e9-ee7f2732c3f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:43.922852 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-df56a165-9ba3-42a5-a3e9-ee7f2732c3f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:43.923324 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-df56a165-9ba3-42a5-a3e9-ee7f2732c3f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:43.923777 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-df56a165-9ba3-42a5-a3e9-ee7f2732c3f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:44.024717 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7f113edd-3464-4c5b-9f01-e893635f27e6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:44.025331 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7f113edd-3464-4c5b-9f01-e893635f27e6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:44.040880 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7f113edd-3464-4c5b-9f01-e893635f27e6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:44.041631 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7f113edd-3464-4c5b-9f01-e893635f27e6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:44.042253 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7f113edd-3464-4c5b-9f01-e893635f27e6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:44.043129 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7f113edd-3464-4c5b-9f01-e893635f27e6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:44.044313 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7f113edd-3464-4c5b-9f01-e893635f27e6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:44.044903 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7f113edd-3464-4c5b-9f01-e893635f27e6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:44.064364 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-df56a165-9ba3-42a5-a3e9-ee7f2732c3f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:44.074344 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-df56a165-9ba3-42a5-a3e9-ee7f2732c3f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:44.076394 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-df56a165-9ba3-42a5-a3e9-ee7f2732c3f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:44.086743 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-df56a165-9ba3-42a5-a3e9-ee7f2732c3f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1808 microversion: 2.20 time: 0.176908 Oct 11 06:44:44.105176 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 229/508] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:43 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:44:44.197196 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7f113edd-3464-4c5b-9f01-e893635f27e6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:44.206802 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7f113edd-3464-4c5b-9f01-e893635f27e6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1369 microversion: 2.1 time: 0.189286 Oct 11 06:44:44.207387 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 280/509] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:44 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1369 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:44.861303 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1ddcf127-43f0-4340-8989-8e95bbec1649 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:44.861940 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1ddcf127-43f0-4340-8989-8e95bbec1649 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:44.869243 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1ddcf127-43f0-4340-8989-8e95bbec1649 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:44.869243 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1ddcf127-43f0-4340-8989-8e95bbec1649 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:44.869243 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1ddcf127-43f0-4340-8989-8e95bbec1649 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:44.870336 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1ddcf127-43f0-4340-8989-8e95bbec1649 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:44.870792 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1ddcf127-43f0-4340-8989-8e95bbec1649 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:44.871223 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1ddcf127-43f0-4340-8989-8e95bbec1649 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:44.946221 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1ddcf127-43f0-4340-8989-8e95bbec1649 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a6c4a5e3f94f1c932fd3210ae9bf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0cbe1cb0974454a2c4c7cbde3681e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:44.955216 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1ddcf127-43f0-4340-8989-8e95bbec1649 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 200 len: 1218 microversion: 2.1 time: 0.097705 Oct 11 06:44:44.955853 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 230/510] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:44 2022] GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:45.112021 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c5e0f53d-1344-4fb6-bcdd-3e30497b762a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:45.112568 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c5e0f53d-1344-4fb6-bcdd-3e30497b762a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:45.119712 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c5e0f53d-1344-4fb6-bcdd-3e30497b762a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:45.120191 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c5e0f53d-1344-4fb6-bcdd-3e30497b762a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:45.120621 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c5e0f53d-1344-4fb6-bcdd-3e30497b762a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:45.121307 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c5e0f53d-1344-4fb6-bcdd-3e30497b762a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:45.121749 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c5e0f53d-1344-4fb6-bcdd-3e30497b762a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:45.122167 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c5e0f53d-1344-4fb6-bcdd-3e30497b762a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:45.230801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-85467f05-54ad-4006-a26d-9ef9ccffb334 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:45.231822 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-85467f05-54ad-4006-a26d-9ef9ccffb334 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:45.241987 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85467f05-54ad-4006-a26d-9ef9ccffb334 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:45.254697 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85467f05-54ad-4006-a26d-9ef9ccffb334 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:45.255452 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85467f05-54ad-4006-a26d-9ef9ccffb334 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:45.256371 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85467f05-54ad-4006-a26d-9ef9ccffb334 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:45.260092 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85467f05-54ad-4006-a26d-9ef9ccffb334 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:45.260953 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85467f05-54ad-4006-a26d-9ef9ccffb334 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:45.264648 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c5e0f53d-1344-4fb6-bcdd-3e30497b762a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:45.274605 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c5e0f53d-1344-4fb6-bcdd-3e30497b762a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:45.276590 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c5e0f53d-1344-4fb6-bcdd-3e30497b762a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:45.277770 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c5e0f53d-1344-4fb6-bcdd-3e30497b762a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1808 microversion: 2.20 time: 0.169725 Oct 11 06:44:45.291953 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 281/511] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:45 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:44:45.407512 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-85467f05-54ad-4006-a26d-9ef9ccffb334 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:45.415850 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-85467f05-54ad-4006-a26d-9ef9ccffb334 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1369 microversion: 2.1 time: 0.188917 Oct 11 06:44:45.416418 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 231/512] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:45 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1369 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:45.977666 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c5d6b6d9-17dd-4136-95a6-ce8eb5f9e509 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:45.978269 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c5d6b6d9-17dd-4136-95a6-ce8eb5f9e509 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:45.984235 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c5d6b6d9-17dd-4136-95a6-ce8eb5f9e509 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:45.984710 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c5d6b6d9-17dd-4136-95a6-ce8eb5f9e509 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:45.985144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c5d6b6d9-17dd-4136-95a6-ce8eb5f9e509 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:45.985822 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c5d6b6d9-17dd-4136-95a6-ce8eb5f9e509 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:45.986263 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c5d6b6d9-17dd-4136-95a6-ce8eb5f9e509 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:45.986683 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c5d6b6d9-17dd-4136-95a6-ce8eb5f9e509 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:46.049894 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c5d6b6d9-17dd-4136-95a6-ce8eb5f9e509 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a6c4a5e3f94f1c932fd3210ae9bf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0cbe1cb0974454a2c4c7cbde3681e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:46.058233 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c5d6b6d9-17dd-4136-95a6-ce8eb5f9e509 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 200 len: 1218 microversion: 2.1 time: 0.084748 Oct 11 06:44:46.063579 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 282/513] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:45 2022] GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:46.303578 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2dd3a7d2-fc27-4c48-ae19-81849ac9efe2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:46.304188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2dd3a7d2-fc27-4c48-ae19-81849ac9efe2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:46.311159 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2dd3a7d2-fc27-4c48-ae19-81849ac9efe2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:46.311595 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2dd3a7d2-fc27-4c48-ae19-81849ac9efe2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:46.312027 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2dd3a7d2-fc27-4c48-ae19-81849ac9efe2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:46.312794 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2dd3a7d2-fc27-4c48-ae19-81849ac9efe2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:46.313248 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2dd3a7d2-fc27-4c48-ae19-81849ac9efe2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:46.313666 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2dd3a7d2-fc27-4c48-ae19-81849ac9efe2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:46.441826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5cfa1969-d1c4-493d-bd21-38b699028cdc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:46.442488 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5cfa1969-d1c4-493d-bd21-38b699028cdc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:46.445344 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2dd3a7d2-fc27-4c48-ae19-81849ac9efe2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:46.450067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5cfa1969-d1c4-493d-bd21-38b699028cdc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:46.450551 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5cfa1969-d1c4-493d-bd21-38b699028cdc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:46.450980 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5cfa1969-d1c4-493d-bd21-38b699028cdc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:46.451706 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5cfa1969-d1c4-493d-bd21-38b699028cdc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:46.452155 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5cfa1969-d1c4-493d-bd21-38b699028cdc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:46.452573 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5cfa1969-d1c4-493d-bd21-38b699028cdc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:46.454525 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2dd3a7d2-fc27-4c48-ae19-81849ac9efe2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:46.455985 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2dd3a7d2-fc27-4c48-ae19-81849ac9efe2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:46.457181 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2dd3a7d2-fc27-4c48-ae19-81849ac9efe2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1808 microversion: 2.20 time: 0.157476 Oct 11 06:44:46.457742 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 232/514] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:46 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:44:46.598797 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5cfa1969-d1c4-493d-bd21-38b699028cdc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:46.606810 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5cfa1969-d1c4-493d-bd21-38b699028cdc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1369 microversion: 2.1 time: 0.168955 Oct 11 06:44:46.607675 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 283/515] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:46 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1369 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:47.084628 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5c6b5356-e839-421f-91ea-f6ac5c1350ce tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:47.085263 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5c6b5356-e839-421f-91ea-f6ac5c1350ce tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:47.092186 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5c6b5356-e839-421f-91ea-f6ac5c1350ce tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:47.092307 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5c6b5356-e839-421f-91ea-f6ac5c1350ce tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:47.092723 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5c6b5356-e839-421f-91ea-f6ac5c1350ce tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:47.093439 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5c6b5356-e839-421f-91ea-f6ac5c1350ce tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:47.094032 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5c6b5356-e839-421f-91ea-f6ac5c1350ce tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:47.094491 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5c6b5356-e839-421f-91ea-f6ac5c1350ce tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:47.176129 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5c6b5356-e839-421f-91ea-f6ac5c1350ce tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a6c4a5e3f94f1c932fd3210ae9bf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0cbe1cb0974454a2c4c7cbde3681e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:47.189062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5c6b5356-e839-421f-91ea-f6ac5c1350ce tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 200 len: 1218 microversion: 2.1 time: 0.108279 Oct 11 06:44:47.189954 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 233/516] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:47 2022] GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 1218 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:47.483045 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f1b2a3fb-6050-40f7-88be-ffd56de8c65a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:47.483642 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f1b2a3fb-6050-40f7-88be-ffd56de8c65a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:47.491771 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1b2a3fb-6050-40f7-88be-ffd56de8c65a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:47.492264 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1b2a3fb-6050-40f7-88be-ffd56de8c65a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:47.492708 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1b2a3fb-6050-40f7-88be-ffd56de8c65a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:47.493421 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1b2a3fb-6050-40f7-88be-ffd56de8c65a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:47.493902 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1b2a3fb-6050-40f7-88be-ffd56de8c65a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:47.494295 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1b2a3fb-6050-40f7-88be-ffd56de8c65a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:47.632360 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-12641424-18a1-41a3-9c15-fa3f3d04272f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:47.632968 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-12641424-18a1-41a3-9c15-fa3f3d04272f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:47.643102 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f1b2a3fb-6050-40f7-88be-ffd56de8c65a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:47.649346 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-12641424-18a1-41a3-9c15-fa3f3d04272f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:47.649853 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-12641424-18a1-41a3-9c15-fa3f3d04272f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:47.650285 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-12641424-18a1-41a3-9c15-fa3f3d04272f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:47.651000 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-12641424-18a1-41a3-9c15-fa3f3d04272f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:47.651543 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-12641424-18a1-41a3-9c15-fa3f3d04272f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:47.651890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-12641424-18a1-41a3-9c15-fa3f3d04272f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:47.654210 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f1b2a3fb-6050-40f7-88be-ffd56de8c65a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:47.656060 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f1b2a3fb-6050-40f7-88be-ffd56de8c65a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:47.657542 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f1b2a3fb-6050-40f7-88be-ffd56de8c65a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1808 microversion: 2.20 time: 0.178319 Oct 11 06:44:47.659770 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 284/517] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:47 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:44:47.805474 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-12641424-18a1-41a3-9c15-fa3f3d04272f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:47.814310 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-12641424-18a1-41a3-9c15-fa3f3d04272f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1369 microversion: 2.1 time: 0.186152 Oct 11 06:44:47.815341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 234/518] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:47 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1369 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:48.213372 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-05bf0de6-1baa-47fe-8ef2-f9576d167048 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:48.214186 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-05bf0de6-1baa-47fe-8ef2-f9576d167048 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:48.221480 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05bf0de6-1baa-47fe-8ef2-f9576d167048 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:48.222063 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05bf0de6-1baa-47fe-8ef2-f9576d167048 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:48.226706 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05bf0de6-1baa-47fe-8ef2-f9576d167048 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:48.227518 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05bf0de6-1baa-47fe-8ef2-f9576d167048 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:48.227984 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05bf0de6-1baa-47fe-8ef2-f9576d167048 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:48.228409 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05bf0de6-1baa-47fe-8ef2-f9576d167048 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:48.301910 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-05bf0de6-1baa-47fe-8ef2-f9576d167048 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a6c4a5e3f94f1c932fd3210ae9bf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0cbe1cb0974454a2c4c7cbde3681e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:48.310127 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-05bf0de6-1baa-47fe-8ef2-f9576d167048 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 200 len: 1218 microversion: 2.1 time: 0.101508 Oct 11 06:44:48.310679 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 285/519] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:48 2022] GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:48.684978 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1f74b4b6-6179-4afc-b782-691afcbd3fae tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:48.686472 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1f74b4b6-6179-4afc-b782-691afcbd3fae tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:48.694700 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1f74b4b6-6179-4afc-b782-691afcbd3fae tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:48.695185 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1f74b4b6-6179-4afc-b782-691afcbd3fae tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:48.695646 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1f74b4b6-6179-4afc-b782-691afcbd3fae tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:48.696351 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1f74b4b6-6179-4afc-b782-691afcbd3fae tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:48.696804 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1f74b4b6-6179-4afc-b782-691afcbd3fae tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:48.701088 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1f74b4b6-6179-4afc-b782-691afcbd3fae tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:48.837834 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1d1e9bc1-d1b3-4709-8a0b-71a524587196 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:48.838460 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1d1e9bc1-d1b3-4709-8a0b-71a524587196 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:48.846659 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1d1e9bc1-d1b3-4709-8a0b-71a524587196 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:48.847408 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1d1e9bc1-d1b3-4709-8a0b-71a524587196 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:48.848031 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1d1e9bc1-d1b3-4709-8a0b-71a524587196 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:48.849078 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1d1e9bc1-d1b3-4709-8a0b-71a524587196 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:48.849684 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1d1e9bc1-d1b3-4709-8a0b-71a524587196 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:48.850257 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1d1e9bc1-d1b3-4709-8a0b-71a524587196 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:48.866334 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1f74b4b6-6179-4afc-b782-691afcbd3fae tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:48.877035 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1f74b4b6-6179-4afc-b782-691afcbd3fae tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:48.878878 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1f74b4b6-6179-4afc-b782-691afcbd3fae tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:48.880430 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1f74b4b6-6179-4afc-b782-691afcbd3fae tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1808 microversion: 2.20 time: 0.199559 Oct 11 06:44:48.892091 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 235/520] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:48 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1808 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:44:48.995055 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1d1e9bc1-d1b3-4709-8a0b-71a524587196 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:49.002569 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1d1e9bc1-d1b3-4709-8a0b-71a524587196 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1369 microversion: 2.1 time: 0.169070 Oct 11 06:44:49.003127 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 286/521] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:48 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1369 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:49.331866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-38c0a306-81a0-4979-b9b4-6138f2878b50 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:49.332472 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-38c0a306-81a0-4979-b9b4-6138f2878b50 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:49.338533 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38c0a306-81a0-4979-b9b4-6138f2878b50 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:49.339003 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38c0a306-81a0-4979-b9b4-6138f2878b50 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:49.339443 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38c0a306-81a0-4979-b9b4-6138f2878b50 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:49.340236 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38c0a306-81a0-4979-b9b4-6138f2878b50 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:49.340684 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38c0a306-81a0-4979-b9b4-6138f2878b50 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:49.341160 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38c0a306-81a0-4979-b9b4-6138f2878b50 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:49.421157 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-38c0a306-81a0-4979-b9b4-6138f2878b50 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a6c4a5e3f94f1c932fd3210ae9bf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0cbe1cb0974454a2c4c7cbde3681e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:49.436615 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-38c0a306-81a0-4979-b9b4-6138f2878b50 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 200 len: 1218 microversion: 2.1 time: 0.104071 Oct 11 06:44:49.437634 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 236/522] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:49 2022] GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 1218 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:49.907090 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7f45c394-94c5-4251-93ad-0a11e838b9bf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:49.907724 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7f45c394-94c5-4251-93ad-0a11e838b9bf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:49.914649 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7f45c394-94c5-4251-93ad-0a11e838b9bf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:49.915129 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7f45c394-94c5-4251-93ad-0a11e838b9bf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:49.915590 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7f45c394-94c5-4251-93ad-0a11e838b9bf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:49.916286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7f45c394-94c5-4251-93ad-0a11e838b9bf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:49.916728 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7f45c394-94c5-4251-93ad-0a11e838b9bf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:49.917142 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7f45c394-94c5-4251-93ad-0a11e838b9bf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:50.027982 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2a064a3f-bdd0-450a-8775-3d174d6a11e5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:50.028705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2a064a3f-bdd0-450a-8775-3d174d6a11e5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:50.035624 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2a064a3f-bdd0-450a-8775-3d174d6a11e5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:50.036103 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2a064a3f-bdd0-450a-8775-3d174d6a11e5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:50.036730 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2a064a3f-bdd0-450a-8775-3d174d6a11e5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:50.037704 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2a064a3f-bdd0-450a-8775-3d174d6a11e5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:50.038991 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2a064a3f-bdd0-450a-8775-3d174d6a11e5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:50.039751 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2a064a3f-bdd0-450a-8775-3d174d6a11e5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:50.063349 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7f45c394-94c5-4251-93ad-0a11e838b9bf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:50.076092 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7f45c394-94c5-4251-93ad-0a11e838b9bf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:50.079401 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7f45c394-94c5-4251-93ad-0a11e838b9bf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:50.080649 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7f45c394-94c5-4251-93ad-0a11e838b9bf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1808 microversion: 2.20 time: 0.177866 Oct 11 06:44:50.081206 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 287/523] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:49 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:44:50.180316 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2a064a3f-bdd0-450a-8775-3d174d6a11e5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:50.187852 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2a064a3f-bdd0-450a-8775-3d174d6a11e5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1369 microversion: 2.1 time: 0.167108 Oct 11 06:44:50.188418 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 237/524] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:50 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1369 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:50.459088 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bc4cf043-ec3a-4829-9db7-69fa7ad0b0d2 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:50.459721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bc4cf043-ec3a-4829-9db7-69fa7ad0b0d2 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:50.466403 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc4cf043-ec3a-4829-9db7-69fa7ad0b0d2 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:50.466875 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc4cf043-ec3a-4829-9db7-69fa7ad0b0d2 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:50.467302 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc4cf043-ec3a-4829-9db7-69fa7ad0b0d2 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:50.468021 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc4cf043-ec3a-4829-9db7-69fa7ad0b0d2 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:50.468469 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc4cf043-ec3a-4829-9db7-69fa7ad0b0d2 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:50.468885 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc4cf043-ec3a-4829-9db7-69fa7ad0b0d2 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:50.532877 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bc4cf043-ec3a-4829-9db7-69fa7ad0b0d2 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a6c4a5e3f94f1c932fd3210ae9bf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0cbe1cb0974454a2c4c7cbde3681e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:50.541055 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bc4cf043-ec3a-4829-9db7-69fa7ad0b0d2 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 200 len: 1218 microversion: 2.1 time: 0.085963 Oct 11 06:44:50.541616 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 288/525] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:50 2022] GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:51.105498 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1587f25a-0f7c-4619-b8d3-f218ea360f36 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:51.106102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1587f25a-0f7c-4619-b8d3-f218ea360f36 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:51.112555 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1587f25a-0f7c-4619-b8d3-f218ea360f36 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:51.113041 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1587f25a-0f7c-4619-b8d3-f218ea360f36 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:51.113480 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1587f25a-0f7c-4619-b8d3-f218ea360f36 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:51.114170 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1587f25a-0f7c-4619-b8d3-f218ea360f36 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:51.114619 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1587f25a-0f7c-4619-b8d3-f218ea360f36 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:51.115038 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1587f25a-0f7c-4619-b8d3-f218ea360f36 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:51.212686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e17fc93e-2630-412c-bc33-5121689c6a66 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:51.213345 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e17fc93e-2630-412c-bc33-5121689c6a66 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:51.215463 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:51.223437 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e17fc93e-2630-412c-bc33-5121689c6a66 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:51.224349 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e17fc93e-2630-412c-bc33-5121689c6a66 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:51.225045 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e17fc93e-2630-412c-bc33-5121689c6a66 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:51.226087 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e17fc93e-2630-412c-bc33-5121689c6a66 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:51.226918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e17fc93e-2630-412c-bc33-5121689c6a66 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:51.227591 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e17fc93e-2630-412c-bc33-5121689c6a66 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:51.275302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1587f25a-0f7c-4619-b8d3-f218ea360f36 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:51.284234 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1587f25a-0f7c-4619-b8d3-f218ea360f36 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:51.285699 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1587f25a-0f7c-4619-b8d3-f218ea360f36 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:51.286850 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1587f25a-0f7c-4619-b8d3-f218ea360f36 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1808 microversion: 2.20 time: 0.185283 Oct 11 06:44:51.287404 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 238/526] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:51 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:44:51.386248 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e17fc93e-2630-412c-bc33-5121689c6a66 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:51.394439 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e17fc93e-2630-412c-bc33-5121689c6a66 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1369 microversion: 2.1 time: 0.186618 Oct 11 06:44:51.395199 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 289/527] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:51 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1369 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:51.565248 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1acf408d-e9b7-4ec2-ba1e-55ef6a3315ea tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:51.566080 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1acf408d-e9b7-4ec2-ba1e-55ef6a3315ea tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:51.571151 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=2 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:51.573904 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1acf408d-e9b7-4ec2-ba1e-55ef6a3315ea tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:51.574645 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1acf408d-e9b7-4ec2-ba1e-55ef6a3315ea tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:51.575314 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1acf408d-e9b7-4ec2-ba1e-55ef6a3315ea tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:51.576320 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1acf408d-e9b7-4ec2-ba1e-55ef6a3315ea tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:51.576985 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1acf408d-e9b7-4ec2-ba1e-55ef6a3315ea tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:51.577618 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1acf408d-e9b7-4ec2-ba1e-55ef6a3315ea tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:51.594111 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=8 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:51.647288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1acf408d-e9b7-4ec2-ba1e-55ef6a3315ea tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a6c4a5e3f94f1c932fd3210ae9bf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0cbe1cb0974454a2c4c7cbde3681e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:51.655498 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1acf408d-e9b7-4ec2-ba1e-55ef6a3315ea tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 200 len: 1218 microversion: 2.1 time: 0.093983 Oct 11 06:44:51.656127 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 239/528] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:51 2022] GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:52.314653 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-691e7f83-3b3f-4c05-8202-4a0c1f7461df tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:52.316010 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-691e7f83-3b3f-4c05-8202-4a0c1f7461df tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:52.323441 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-691e7f83-3b3f-4c05-8202-4a0c1f7461df tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:52.324101 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-691e7f83-3b3f-4c05-8202-4a0c1f7461df tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:52.324535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-691e7f83-3b3f-4c05-8202-4a0c1f7461df tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:52.325243 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-691e7f83-3b3f-4c05-8202-4a0c1f7461df tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:52.325689 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-691e7f83-3b3f-4c05-8202-4a0c1f7461df tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:52.326102 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-691e7f83-3b3f-4c05-8202-4a0c1f7461df tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:52.417241 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-80c6ec44-871c-443c-bf48-2e29d944e97c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:52.417851 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-80c6ec44-871c-443c-bf48-2e29d944e97c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:52.424369 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-80c6ec44-871c-443c-bf48-2e29d944e97c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:52.424922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-80c6ec44-871c-443c-bf48-2e29d944e97c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:52.425308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-80c6ec44-871c-443c-bf48-2e29d944e97c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:52.426029 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-80c6ec44-871c-443c-bf48-2e29d944e97c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:52.426480 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-80c6ec44-871c-443c-bf48-2e29d944e97c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:52.427671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-80c6ec44-871c-443c-bf48-2e29d944e97c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:52.477284 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-691e7f83-3b3f-4c05-8202-4a0c1f7461df tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:52.485881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-691e7f83-3b3f-4c05-8202-4a0c1f7461df tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:52.487327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-691e7f83-3b3f-4c05-8202-4a0c1f7461df tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:52.488666 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-691e7f83-3b3f-4c05-8202-4a0c1f7461df tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1808 microversion: 2.20 time: 0.178094 Oct 11 06:44:52.489231 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 290/529] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:52 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:44:52.572881 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-80c6ec44-871c-443c-bf48-2e29d944e97c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:52.580883 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-80c6ec44-871c-443c-bf48-2e29d944e97c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1369 microversion: 2.1 time: 0.167408 Oct 11 06:44:52.581450 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 240/530] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:52 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1369 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:52.677942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-23a52927-a137-491d-b783-d1325631ba24 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:52.678555 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-23a52927-a137-491d-b783-d1325631ba24 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:52.684944 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-23a52927-a137-491d-b783-d1325631ba24 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:52.685433 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-23a52927-a137-491d-b783-d1325631ba24 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:52.685970 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-23a52927-a137-491d-b783-d1325631ba24 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:52.686678 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-23a52927-a137-491d-b783-d1325631ba24 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:52.687134 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-23a52927-a137-491d-b783-d1325631ba24 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:52.687685 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-23a52927-a137-491d-b783-d1325631ba24 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:52.756860 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-23a52927-a137-491d-b783-d1325631ba24 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a6c4a5e3f94f1c932fd3210ae9bf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0cbe1cb0974454a2c4c7cbde3681e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:52.760381 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:52.767407 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-23a52927-a137-491d-b783-d1325631ba24 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 200 len: 1218 microversion: 2.1 time: 0.093192 Oct 11 06:44:52.768392 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 291/531] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:52 2022] GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:53.516411 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9aae47dd-9639-44a9-9fb6-050862bf56fb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:53.517874 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9aae47dd-9639-44a9-9fb6-050862bf56fb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:53.524448 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9aae47dd-9639-44a9-9fb6-050862bf56fb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:53.524955 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9aae47dd-9639-44a9-9fb6-050862bf56fb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:53.525381 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9aae47dd-9639-44a9-9fb6-050862bf56fb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:53.526067 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9aae47dd-9639-44a9-9fb6-050862bf56fb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:53.526508 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9aae47dd-9639-44a9-9fb6-050862bf56fb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:53.526926 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9aae47dd-9639-44a9-9fb6-050862bf56fb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:53.603818 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d2b7d87c-6d31-4c76-a302-4dedcf170c31 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:53.604434 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d2b7d87c-6d31-4c76-a302-4dedcf170c31 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:53.610821 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d2b7d87c-6d31-4c76-a302-4dedcf170c31 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:53.611297 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d2b7d87c-6d31-4c76-a302-4dedcf170c31 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:53.611762 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d2b7d87c-6d31-4c76-a302-4dedcf170c31 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:53.612455 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d2b7d87c-6d31-4c76-a302-4dedcf170c31 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:53.612904 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d2b7d87c-6d31-4c76-a302-4dedcf170c31 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:53.613326 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d2b7d87c-6d31-4c76-a302-4dedcf170c31 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:53.681483 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9aae47dd-9639-44a9-9fb6-050862bf56fb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:53.691788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9aae47dd-9639-44a9-9fb6-050862bf56fb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:53.693413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9aae47dd-9639-44a9-9fb6-050862bf56fb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:53.695310 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9aae47dd-9639-44a9-9fb6-050862bf56fb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1808 microversion: 2.20 time: 0.182614 Oct 11 06:44:53.697847 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 241/532] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:53 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:44:53.776938 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d2b7d87c-6d31-4c76-a302-4dedcf170c31 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:53.785101 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d2b7d87c-6d31-4c76-a302-4dedcf170c31 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1369 microversion: 2.1 time: 0.184826 Oct 11 06:44:53.785670 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 292/533] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:53 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1369 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:53.790442 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c483434e-01da-4725-880f-a5351fdb5090 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:53.791060 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c483434e-01da-4725-880f-a5351fdb5090 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:53.797083 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c483434e-01da-4725-880f-a5351fdb5090 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:53.797569 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c483434e-01da-4725-880f-a5351fdb5090 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:53.798004 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c483434e-01da-4725-880f-a5351fdb5090 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:53.798694 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c483434e-01da-4725-880f-a5351fdb5090 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:53.799147 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c483434e-01da-4725-880f-a5351fdb5090 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:53.799607 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c483434e-01da-4725-880f-a5351fdb5090 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:53.803501 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:53.862857 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c483434e-01da-4725-880f-a5351fdb5090 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a6c4a5e3f94f1c932fd3210ae9bf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0cbe1cb0974454a2c4c7cbde3681e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:53.871209 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c483434e-01da-4725-880f-a5351fdb5090 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 200 len: 1218 microversion: 2.1 time: 0.085023 Oct 11 06:44:53.871978 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 242/534] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:53 2022] GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:54.721403 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a3d3a7f4-af74-440c-846f-9608e9b6a40e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:54.721962 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a3d3a7f4-af74-440c-846f-9608e9b6a40e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:54.728843 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a3d3a7f4-af74-440c-846f-9608e9b6a40e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:54.729622 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a3d3a7f4-af74-440c-846f-9608e9b6a40e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:54.729735 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a3d3a7f4-af74-440c-846f-9608e9b6a40e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:54.730417 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a3d3a7f4-af74-440c-846f-9608e9b6a40e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:54.730868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a3d3a7f4-af74-440c-846f-9608e9b6a40e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:54.731316 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a3d3a7f4-af74-440c-846f-9608e9b6a40e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:54.809463 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-99671f91-daa0-4a5d-89d6-6155f5b44e19 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:54.809889 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-99671f91-daa0-4a5d-89d6-6155f5b44e19 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:54.816125 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99671f91-daa0-4a5d-89d6-6155f5b44e19 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:54.816604 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99671f91-daa0-4a5d-89d6-6155f5b44e19 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:54.817027 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99671f91-daa0-4a5d-89d6-6155f5b44e19 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:54.817714 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99671f91-daa0-4a5d-89d6-6155f5b44e19 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:54.818160 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99671f91-daa0-4a5d-89d6-6155f5b44e19 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:54.818572 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99671f91-daa0-4a5d-89d6-6155f5b44e19 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:54.860929 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a3d3a7f4-af74-440c-846f-9608e9b6a40e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:54.870364 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a3d3a7f4-af74-440c-846f-9608e9b6a40e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:54.871824 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a3d3a7f4-af74-440c-846f-9608e9b6a40e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:54.872979 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a3d3a7f4-af74-440c-846f-9608e9b6a40e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1808 microversion: 2.20 time: 0.155527 Oct 11 06:44:54.873535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 293/535] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:54 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:44:54.904886 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bd3573e1-9296-4be9-be7f-f7f9da05fd1a tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:54.906051 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bd3573e1-9296-4be9-be7f-f7f9da05fd1a tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:54.916317 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bd3573e1-9296-4be9-be7f-f7f9da05fd1a tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:54.918912 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bd3573e1-9296-4be9-be7f-f7f9da05fd1a tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:54.919586 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bd3573e1-9296-4be9-be7f-f7f9da05fd1a tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:54.925032 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bd3573e1-9296-4be9-be7f-f7f9da05fd1a tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:54.931903 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bd3573e1-9296-4be9-be7f-f7f9da05fd1a tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:54.932593 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bd3573e1-9296-4be9-be7f-f7f9da05fd1a tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:54.973904 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-99671f91-daa0-4a5d-89d6-6155f5b44e19 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:54.983896 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-99671f91-daa0-4a5d-89d6-6155f5b44e19 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1369 microversion: 2.1 time: 0.178444 Oct 11 06:44:54.985202 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 243/536] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:54 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1369 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:55.033516 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bd3573e1-9296-4be9-be7f-f7f9da05fd1a tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a6c4a5e3f94f1c932fd3210ae9bf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0cbe1cb0974454a2c4c7cbde3681e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:55.042109 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bd3573e1-9296-4be9-be7f-f7f9da05fd1a tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 200 len: 1218 microversion: 2.1 time: 0.149469 Oct 11 06:44:55.042868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 294/537] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:54 2022] GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 1218 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:55.899050 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7b877d90-a642-4f7e-a5b8-f6d0e37f7f3e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:55.899752 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7b877d90-a642-4f7e-a5b8-f6d0e37f7f3e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:55.906382 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b877d90-a642-4f7e-a5b8-f6d0e37f7f3e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:55.906892 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b877d90-a642-4f7e-a5b8-f6d0e37f7f3e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:55.907555 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b877d90-a642-4f7e-a5b8-f6d0e37f7f3e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:55.908257 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b877d90-a642-4f7e-a5b8-f6d0e37f7f3e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:55.908712 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b877d90-a642-4f7e-a5b8-f6d0e37f7f3e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:55.909131 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b877d90-a642-4f7e-a5b8-f6d0e37f7f3e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:56.007205 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-992d5ced-09bc-4d25-bba7-582707f42a18 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:56.009745 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-992d5ced-09bc-4d25-bba7-582707f42a18 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:56.016731 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-992d5ced-09bc-4d25-bba7-582707f42a18 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:56.017177 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-992d5ced-09bc-4d25-bba7-582707f42a18 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:56.017606 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-992d5ced-09bc-4d25-bba7-582707f42a18 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:56.018474 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-992d5ced-09bc-4d25-bba7-582707f42a18 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:56.018922 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-992d5ced-09bc-4d25-bba7-582707f42a18 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:56.019543 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-992d5ced-09bc-4d25-bba7-582707f42a18 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:56.050454 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7b877d90-a642-4f7e-a5b8-f6d0e37f7f3e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:56.059211 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7b877d90-a642-4f7e-a5b8-f6d0e37f7f3e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:56.060735 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7b877d90-a642-4f7e-a5b8-f6d0e37f7f3e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:56.061907 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7b877d90-a642-4f7e-a5b8-f6d0e37f7f3e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1808 microversion: 2.20 time: 0.167387 Oct 11 06:44:56.062467 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 244/538] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:55 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:44:56.066927 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f525ed5b-244e-413a-8cd1-6034a3fbac09 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:56.067561 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f525ed5b-244e-413a-8cd1-6034a3fbac09 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:56.073992 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f525ed5b-244e-413a-8cd1-6034a3fbac09 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:56.074481 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f525ed5b-244e-413a-8cd1-6034a3fbac09 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:56.074919 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f525ed5b-244e-413a-8cd1-6034a3fbac09 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:56.076018 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f525ed5b-244e-413a-8cd1-6034a3fbac09 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:56.076476 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f525ed5b-244e-413a-8cd1-6034a3fbac09 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:56.076906 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f525ed5b-244e-413a-8cd1-6034a3fbac09 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:56.140714 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f525ed5b-244e-413a-8cd1-6034a3fbac09 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a6c4a5e3f94f1c932fd3210ae9bf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0cbe1cb0974454a2c4c7cbde3681e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:56.149166 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f525ed5b-244e-413a-8cd1-6034a3fbac09 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 200 len: 1266 microversion: 2.1 time: 0.085730 Oct 11 06:44:56.149734 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 245/539] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:56 2022] GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:56.155717 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-992d5ced-09bc-4d25-bba7-582707f42a18 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:56.163311 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-992d5ced-09bc-4d25-bba7-582707f42a18 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1369 microversion: 2.1 time: 0.160682 Oct 11 06:44:56.163879 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 295/540] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:56 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1369 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:57.087874 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9ecf302b-f5da-4ab8-a0fb-0b5f9c544962 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:57.088488 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9ecf302b-f5da-4ab8-a0fb-0b5f9c544962 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:57.095071 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9ecf302b-f5da-4ab8-a0fb-0b5f9c544962 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:57.095594 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9ecf302b-f5da-4ab8-a0fb-0b5f9c544962 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:57.096273 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9ecf302b-f5da-4ab8-a0fb-0b5f9c544962 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:57.096705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9ecf302b-f5da-4ab8-a0fb-0b5f9c544962 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:57.097149 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9ecf302b-f5da-4ab8-a0fb-0b5f9c544962 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:57.097564 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9ecf302b-f5da-4ab8-a0fb-0b5f9c544962 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:57.174010 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-73402f8c-0b0e-4dc8-8d16-71a5745d6837 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:57.174867 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-73402f8c-0b0e-4dc8-8d16-71a5745d6837 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:57.182625 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-73402f8c-0b0e-4dc8-8d16-71a5745d6837 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:57.183762 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-73402f8c-0b0e-4dc8-8d16-71a5745d6837 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:57.184447 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-73402f8c-0b0e-4dc8-8d16-71a5745d6837 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:57.185502 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-73402f8c-0b0e-4dc8-8d16-71a5745d6837 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:57.186357 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-73402f8c-0b0e-4dc8-8d16-71a5745d6837 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:57.187623 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-73402f8c-0b0e-4dc8-8d16-71a5745d6837 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:57.246741 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9ecf302b-f5da-4ab8-a0fb-0b5f9c544962 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:57.255921 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9ecf302b-f5da-4ab8-a0fb-0b5f9c544962 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:57.257469 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9ecf302b-f5da-4ab8-a0fb-0b5f9c544962 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:57.258641 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9ecf302b-f5da-4ab8-a0fb-0b5f9c544962 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1808 microversion: 2.20 time: 0.174714 Oct 11 06:44:57.259196 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 246/541] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:57 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:44:57.263747 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-936a2138-ec4d-4f0a-96f8-341a9bc7176c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:57.264541 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-936a2138-ec4d-4f0a-96f8-341a9bc7176c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:57.269990 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-73402f8c-0b0e-4dc8-8d16-71a5745d6837 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a6c4a5e3f94f1c932fd3210ae9bf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0cbe1cb0974454a2c4c7cbde3681e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:57.271064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-936a2138-ec4d-4f0a-96f8-341a9bc7176c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:57.271791 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-936a2138-ec4d-4f0a-96f8-341a9bc7176c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:57.272941 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-936a2138-ec4d-4f0a-96f8-341a9bc7176c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:57.273834 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-936a2138-ec4d-4f0a-96f8-341a9bc7176c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:57.274434 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-936a2138-ec4d-4f0a-96f8-341a9bc7176c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:57.275003 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-936a2138-ec4d-4f0a-96f8-341a9bc7176c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:57.282324 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-73402f8c-0b0e-4dc8-8d16-71a5745d6837 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 200 len: 1266 microversion: 2.1 time: 0.112790 Oct 11 06:44:57.283118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 296/542] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:57 2022] GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 1266 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:44:57.406320 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-936a2138-ec4d-4f0a-96f8-341a9bc7176c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:57.414649 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-936a2138-ec4d-4f0a-96f8-341a9bc7176c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1369 microversion: 2.1 time: 0.154410 Oct 11 06:44:57.415214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 247/543] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:57 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:57.952727 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-08d37bb5-5f82-4219-8208-cbd521c65f7e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf807148-2095-4017-a5f8-84014925eb82", "device": "/dev/sdb"}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:44:57.955801 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-08d37bb5-5f82-4219-8208-cbd521c65f7e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:57.961829 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-08d37bb5-5f82-4219-8208-cbd521c65f7e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:57.962252 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-08d37bb5-5f82-4219-8208-cbd521c65f7e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:57.962684 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-08d37bb5-5f82-4219-8208-cbd521c65f7e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:57.963376 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-08d37bb5-5f82-4219-8208-cbd521c65f7e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:57.963849 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-08d37bb5-5f82-4219-8208-cbd521c65f7e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:57.964287 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-08d37bb5-5f82-4219-8208-cbd521c65f7e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:58.286243 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-df6f58ae-ee6d-45d7-bf2e-dc37a5d61293 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:58.286922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-df6f58ae-ee6d-45d7-bf2e-dc37a5d61293 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:58.294724 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-df6f58ae-ee6d-45d7-bf2e-dc37a5d61293 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:58.295199 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-df6f58ae-ee6d-45d7-bf2e-dc37a5d61293 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:58.295652 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-df6f58ae-ee6d-45d7-bf2e-dc37a5d61293 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:58.296549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-df6f58ae-ee6d-45d7-bf2e-dc37a5d61293 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:58.296776 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-df6f58ae-ee6d-45d7-bf2e-dc37a5d61293 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:58.297720 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-df6f58ae-ee6d-45d7-bf2e-dc37a5d61293 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:58.444949 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-df6f58ae-ee6d-45d7-bf2e-dc37a5d61293 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:58.454764 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-df6f58ae-ee6d-45d7-bf2e-dc37a5d61293 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:58.456211 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-df6f58ae-ee6d-45d7-bf2e-dc37a5d61293 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:58.457641 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-df6f58ae-ee6d-45d7-bf2e-dc37a5d61293 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1808 microversion: 2.20 time: 0.175952 Oct 11 06:44:58.458334 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 248/544] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:58 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:44:58.463026 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-94f2274f-52c3-4c45-b26a-5443aeb9d11f tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:58.463903 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-94f2274f-52c3-4c45-b26a-5443aeb9d11f tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:58.470473 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-94f2274f-52c3-4c45-b26a-5443aeb9d11f tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:58.471051 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-94f2274f-52c3-4c45-b26a-5443aeb9d11f tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:58.471580 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-94f2274f-52c3-4c45-b26a-5443aeb9d11f tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:58.472343 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-94f2274f-52c3-4c45-b26a-5443aeb9d11f tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:58.472859 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-94f2274f-52c3-4c45-b26a-5443aeb9d11f tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:58.473446 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-94f2274f-52c3-4c45-b26a-5443aeb9d11f tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:58.542734 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-94f2274f-52c3-4c45-b26a-5443aeb9d11f tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a6c4a5e3f94f1c932fd3210ae9bf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0cbe1cb0974454a2c4c7cbde3681e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:58.549767 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-08d37bb5-5f82-4219-8208-cbd521c65f7e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "POST /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.600779 Oct 11 06:44:58.550338 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-94f2274f-52c3-4c45-b26a-5443aeb9d11f tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 200 len: 1266 microversion: 2.1 time: 0.090797 Oct 11 06:44:58.550647 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 297/545] 10.222.0.39 () {60 vars in 1323 bytes} [Tue Oct 11 06:44:57 2022] POST /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c/os-volume_attachments => generated 194 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:44:58.551138 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 249/546] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:58 2022] GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:58.556124 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-97daf09e-e339-4167-ae41-12b4f7e2a7cd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:58.557013 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-97daf09e-e339-4167-ae41-12b4f7e2a7cd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:58.563633 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-97daf09e-e339-4167-ae41-12b4f7e2a7cd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:58.564117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-97daf09e-e339-4167-ae41-12b4f7e2a7cd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:58.564554 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-97daf09e-e339-4167-ae41-12b4f7e2a7cd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:58.565248 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-97daf09e-e339-4167-ae41-12b4f7e2a7cd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:58.565694 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-97daf09e-e339-4167-ae41-12b4f7e2a7cd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:58.566117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-97daf09e-e339-4167-ae41-12b4f7e2a7cd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:58.694214 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-97daf09e-e339-4167-ae41-12b4f7e2a7cd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:58.701795 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-97daf09e-e339-4167-ae41-12b4f7e2a7cd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1563 microversion: 2.1 time: 0.150133 Oct 11 06:44:58.702351 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 298/547] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:58 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1563 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:58.724407 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-75994dbb-8645-4b2a-8938-a15568fa4d5f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:58.724895 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-75994dbb-8645-4b2a-8938-a15568fa4d5f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:58.731548 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-75994dbb-8645-4b2a-8938-a15568fa4d5f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:58.732028 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-75994dbb-8645-4b2a-8938-a15568fa4d5f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:58.732466 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-75994dbb-8645-4b2a-8938-a15568fa4d5f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:58.733157 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-75994dbb-8645-4b2a-8938-a15568fa4d5f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:58.733607 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-75994dbb-8645-4b2a-8938-a15568fa4d5f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:58.734028 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-75994dbb-8645-4b2a-8938-a15568fa4d5f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:58.809075 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-75994dbb-8645-4b2a-8938-a15568fa4d5f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088514 Oct 11 06:44:58.809664 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 250/548] 10.222.0.39 () {58 vars in 1275 bytes} [Tue Oct 11 06:44:58 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:44:59.485396 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0b8cde82-1bc3-4ba4-99c8-f0e113420378 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:59.486002 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0b8cde82-1bc3-4ba4-99c8-f0e113420378 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:59.492894 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b8cde82-1bc3-4ba4-99c8-f0e113420378 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:59.493369 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b8cde82-1bc3-4ba4-99c8-f0e113420378 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:59.493801 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b8cde82-1bc3-4ba4-99c8-f0e113420378 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:59.494487 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b8cde82-1bc3-4ba4-99c8-f0e113420378 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:59.495037 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b8cde82-1bc3-4ba4-99c8-f0e113420378 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:59.495485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b8cde82-1bc3-4ba4-99c8-f0e113420378 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:59.575099 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b8fff513-227e-4a26-b161-71849c2ee9a6 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:44:59.575840 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b8fff513-227e-4a26-b161-71849c2ee9a6 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:44:59.588736 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8fff513-227e-4a26-b161-71849c2ee9a6 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:59.589623 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8fff513-227e-4a26-b161-71849c2ee9a6 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:59.590290 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8fff513-227e-4a26-b161-71849c2ee9a6 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:59.600285 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8fff513-227e-4a26-b161-71849c2ee9a6 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:59.601230 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8fff513-227e-4a26-b161-71849c2ee9a6 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:59.601821 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8fff513-227e-4a26-b161-71849c2ee9a6 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:59.723587 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0b8cde82-1bc3-4ba4-99c8-f0e113420378 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:59.732485 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b8fff513-227e-4a26-b161-71849c2ee9a6 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a6c4a5e3f94f1c932fd3210ae9bf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0cbe1cb0974454a2c4c7cbde3681e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:59.733402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0b8cde82-1bc3-4ba4-99c8-f0e113420378 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:59.734844 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0b8cde82-1bc3-4ba4-99c8-f0e113420378 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:44:59.736038 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0b8cde82-1bc3-4ba4-99c8-f0e113420378 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1808 microversion: 2.20 time: 0.254545 Oct 11 06:44:59.736781 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 299/549] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:44:59 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1808 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:44:59.741437 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b8fff513-227e-4a26-b161-71849c2ee9a6 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 200 len: 1274 microversion: 2.1 time: 0.170180 Oct 11 06:44:59.741980 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 251/550] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:44:59 2022] GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 1274 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:44:59.801598 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-0ab3f1f2-a5e6-4d0f-8370-446108e1e2eb req-09de4000-6146-451f-80c6-f103e2b09ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70f4927d-5233-4d2b-a109-a1739feef2eb", "tag": "d3558897-9eb2-44a5-8c6f-5fcac13e4072"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:44:59.813496 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-0ab3f1f2-a5e6-4d0f-8370-446108e1e2eb req-09de4000-6146-451f-80c6-f103e2b09ed2 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:44:59.814489 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-0ab3f1f2-a5e6-4d0f-8370-446108e1e2eb req-09de4000-6146-451f-80c6-f103e2b09ed2 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:44:59.815101 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-0ab3f1f2-a5e6-4d0f-8370-446108e1e2eb req-09de4000-6146-451f-80c6-f103e2b09ed2 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:44:59.827946 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-0ab3f1f2-a5e6-4d0f-8370-446108e1e2eb req-09de4000-6146-451f-80c6-f103e2b09ed2 service nova] Creating event network-changed:d3558897-9eb2-44a5-8c6f-5fcac13e4072 for instance 70f4927d-5233-4d2b-a109-a1739feef2eb on hv-cinder-85495 Oct 11 06:44:59.837233 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-0ab3f1f2-a5e6-4d0f-8370-446108e1e2eb req-09de4000-6146-451f-80c6-f103e2b09ed2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040163 Oct 11 06:44:59.838872 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 300/551] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:00.762348 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c8572078-b980-43e4-bd54-9e516eab6ca0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:00.762931 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c8572078-b980-43e4-bd54-9e516eab6ca0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:00.767134 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-041a8a70-5ac0-47d9-8fb5-237ac4b9abfd tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:00.767980 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-041a8a70-5ac0-47d9-8fb5-237ac4b9abfd tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:00.772287 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8572078-b980-43e4-bd54-9e516eab6ca0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:00.772788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8572078-b980-43e4-bd54-9e516eab6ca0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:00.773206 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8572078-b980-43e4-bd54-9e516eab6ca0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:00.774115 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8572078-b980-43e4-bd54-9e516eab6ca0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:00.774566 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8572078-b980-43e4-bd54-9e516eab6ca0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:00.774987 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8572078-b980-43e4-bd54-9e516eab6ca0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:00.777987 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-041a8a70-5ac0-47d9-8fb5-237ac4b9abfd tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:00.780675 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-041a8a70-5ac0-47d9-8fb5-237ac4b9abfd tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:00.781114 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-041a8a70-5ac0-47d9-8fb5-237ac4b9abfd tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:00.781815 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-041a8a70-5ac0-47d9-8fb5-237ac4b9abfd tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:00.785741 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-041a8a70-5ac0-47d9-8fb5-237ac4b9abfd tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:00.786409 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-041a8a70-5ac0-47d9-8fb5-237ac4b9abfd tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:00.890437 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-041a8a70-5ac0-47d9-8fb5-237ac4b9abfd tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a6c4a5e3f94f1c932fd3210ae9bf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0cbe1cb0974454a2c4c7cbde3681e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:00.899901 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-041a8a70-5ac0-47d9-8fb5-237ac4b9abfd tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 200 len: 1272 microversion: 2.1 time: 0.136918 Oct 11 06:45:00.901128 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 301/552] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:45:00 2022] GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 1272 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:45:00.953456 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c8572078-b980-43e4-bd54-9e516eab6ca0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:00.962597 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c8572078-b980-43e4-bd54-9e516eab6ca0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:00.964075 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c8572078-b980-43e4-bd54-9e516eab6ca0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:00.965551 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c8572078-b980-43e4-bd54-9e516eab6ca0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1808 microversion: 2.20 time: 0.207276 Oct 11 06:45:00.979846 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 252/553] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:45:00 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1808 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:45:01.923803 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bc1f7356-1763-4062-8093-bcb3a03825e9 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:01.924409 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bc1f7356-1763-4062-8093-bcb3a03825e9 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:01.931158 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc1f7356-1763-4062-8093-bcb3a03825e9 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:01.931669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc1f7356-1763-4062-8093-bcb3a03825e9 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:01.932093 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc1f7356-1763-4062-8093-bcb3a03825e9 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:01.932773 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc1f7356-1763-4062-8093-bcb3a03825e9 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:01.933213 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc1f7356-1763-4062-8093-bcb3a03825e9 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:01.933630 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bc1f7356-1763-4062-8093-bcb3a03825e9 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:01.978895 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-34a37bc2-2094-41cb-b576-5d3c1bd1582f req-e18e662e-7626-4a92-8487-55ec3280f0a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0345c1d0-58f8-4679-a1a9-b988bf99ca8e", "tag": "5a48b8cc-ea4e-4438-b38a-c18676c05888"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:45:01.989939 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-34a37bc2-2094-41cb-b576-5d3c1bd1582f req-e18e662e-7626-4a92-8487-55ec3280f0a1 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:01.990416 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-34a37bc2-2094-41cb-b576-5d3c1bd1582f req-e18e662e-7626-4a92-8487-55ec3280f0a1 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:01.991355 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-34a37bc2-2094-41cb-b576-5d3c1bd1582f req-e18e662e-7626-4a92-8487-55ec3280f0a1 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:02.001872 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-34a37bc2-2094-41cb-b576-5d3c1bd1582f req-e18e662e-7626-4a92-8487-55ec3280f0a1 service nova] Creating event network-changed:5a48b8cc-ea4e-4438-b38a-c18676c05888 for instance 0345c1d0-58f8-4679-a1a9-b988bf99ca8e on hv-cinder-85495 Oct 11 06:45:02.007617 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-34a37bc2-2094-41cb-b576-5d3c1bd1582f req-e18e662e-7626-4a92-8487-55ec3280f0a1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031993 Oct 11 06:45:02.008213 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 253/554] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:02.013367 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-318ca34d-3498-488d-8de1-11bf6406036f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:02.014046 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-318ca34d-3498-488d-8de1-11bf6406036f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:02.020153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-318ca34d-3498-488d-8de1-11bf6406036f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:02.020632 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-318ca34d-3498-488d-8de1-11bf6406036f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:02.021073 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-318ca34d-3498-488d-8de1-11bf6406036f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:02.021767 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-318ca34d-3498-488d-8de1-11bf6406036f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:02.022226 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-318ca34d-3498-488d-8de1-11bf6406036f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:02.022702 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-318ca34d-3498-488d-8de1-11bf6406036f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:02.110490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bc1f7356-1763-4062-8093-bcb3a03825e9 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a6c4a5e3f94f1c932fd3210ae9bf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0cbe1cb0974454a2c4c7cbde3681e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:02.119004 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bc1f7356-1763-4062-8093-bcb3a03825e9 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 200 len: 1314 microversion: 2.1 time: 0.198971 Oct 11 06:45:02.119753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 302/555] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:45:01 2022] GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:45:02.153130 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-318ca34d-3498-488d-8de1-11bf6406036f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:02.161659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-318ca34d-3498-488d-8de1-11bf6406036f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:02.163620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-318ca34d-3498-488d-8de1-11bf6406036f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:02.164776 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-318ca34d-3498-488d-8de1-11bf6406036f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1808 microversion: 2.20 time: 0.155325 Oct 11 06:45:02.165320 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 254/556] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:45:02 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:45:03.142191 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-dfba02d1-45c2-43fa-89d9-542b9e405830 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:03.142806 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-dfba02d1-45c2-43fa-89d9-542b9e405830 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:03.149478 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dfba02d1-45c2-43fa-89d9-542b9e405830 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:03.149958 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dfba02d1-45c2-43fa-89d9-542b9e405830 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:03.150390 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dfba02d1-45c2-43fa-89d9-542b9e405830 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:03.151083 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dfba02d1-45c2-43fa-89d9-542b9e405830 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:03.151568 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dfba02d1-45c2-43fa-89d9-542b9e405830 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:03.151991 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dfba02d1-45c2-43fa-89d9-542b9e405830 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:03.190191 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ddcf9345-172b-4f32-976d-5e542012815b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:03.190887 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ddcf9345-172b-4f32-976d-5e542012815b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:03.200326 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ddcf9345-172b-4f32-976d-5e542012815b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:03.201144 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ddcf9345-172b-4f32-976d-5e542012815b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:03.201729 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ddcf9345-172b-4f32-976d-5e542012815b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:03.202462 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ddcf9345-172b-4f32-976d-5e542012815b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:03.202915 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ddcf9345-172b-4f32-976d-5e542012815b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:03.203339 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ddcf9345-172b-4f32-976d-5e542012815b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:03.344446 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ddcf9345-172b-4f32-976d-5e542012815b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:03.353342 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ddcf9345-172b-4f32-976d-5e542012815b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:03.354766 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ddcf9345-172b-4f32-976d-5e542012815b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:03.355953 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ddcf9345-172b-4f32-976d-5e542012815b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1808 microversion: 2.20 time: 0.169702 Oct 11 06:45:03.356505 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 255/557] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:45:03 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:45:03.574618 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-dfba02d1-45c2-43fa-89d9-542b9e405830 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a6c4a5e3f94f1c932fd3210ae9bf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0cbe1cb0974454a2c4c7cbde3681e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:03.582233 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-dfba02d1-45c2-43fa-89d9-542b9e405830 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 200 len: 1314 microversion: 2.1 time: 0.443970 Oct 11 06:45:03.582788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 303/558] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:45:03 2022] GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:45:04.382110 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-efdf8660-bccd-4991-a8d9-18abb162dd19 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:04.382803 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-efdf8660-bccd-4991-a8d9-18abb162dd19 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:04.385389 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:45:04.390495 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-efdf8660-bccd-4991-a8d9-18abb162dd19 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:04.390968 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-efdf8660-bccd-4991-a8d9-18abb162dd19 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:04.391598 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-efdf8660-bccd-4991-a8d9-18abb162dd19 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:04.392292 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-efdf8660-bccd-4991-a8d9-18abb162dd19 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:04.392738 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-efdf8660-bccd-4991-a8d9-18abb162dd19 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:04.393152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-efdf8660-bccd-4991-a8d9-18abb162dd19 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:04.525062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-efdf8660-bccd-4991-a8d9-18abb162dd19 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:04.534153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-efdf8660-bccd-4991-a8d9-18abb162dd19 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:04.535614 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-efdf8660-bccd-4991-a8d9-18abb162dd19 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:04.536748 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-efdf8660-bccd-4991-a8d9-18abb162dd19 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1808 microversion: 2.20 time: 0.158604 Oct 11 06:45:04.537286 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 256/559] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:45:04 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:45:04.605693 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e395d534-d78c-4845-88fa-d52273eb44ad tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:04.606422 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e395d534-d78c-4845-88fa-d52273eb44ad tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:04.612800 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e395d534-d78c-4845-88fa-d52273eb44ad tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:04.613273 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e395d534-d78c-4845-88fa-d52273eb44ad tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:04.613702 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e395d534-d78c-4845-88fa-d52273eb44ad tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:04.614389 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e395d534-d78c-4845-88fa-d52273eb44ad tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:04.614863 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e395d534-d78c-4845-88fa-d52273eb44ad tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:04.615279 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e395d534-d78c-4845-88fa-d52273eb44ad tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:04.739802 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e395d534-d78c-4845-88fa-d52273eb44ad tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a6c4a5e3f94f1c932fd3210ae9bf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0cbe1cb0974454a2c4c7cbde3681e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:04.747436 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e395d534-d78c-4845-88fa-d52273eb44ad tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 200 len: 1314 microversion: 2.1 time: 0.145538 Oct 11 06:45:04.747992 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 304/560] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:45:04 2022] GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:45:05.563042 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ba7075ee-c8c6-41d4-ac2f-e4ef1b223533 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:05.563671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ba7075ee-c8c6-41d4-ac2f-e4ef1b223533 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:05.570681 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba7075ee-c8c6-41d4-ac2f-e4ef1b223533 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:05.571160 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba7075ee-c8c6-41d4-ac2f-e4ef1b223533 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:05.571622 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba7075ee-c8c6-41d4-ac2f-e4ef1b223533 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:05.572315 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba7075ee-c8c6-41d4-ac2f-e4ef1b223533 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:05.572761 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba7075ee-c8c6-41d4-ac2f-e4ef1b223533 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:05.573181 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba7075ee-c8c6-41d4-ac2f-e4ef1b223533 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:05.704656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ba7075ee-c8c6-41d4-ac2f-e4ef1b223533 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:05.713387 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ba7075ee-c8c6-41d4-ac2f-e4ef1b223533 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:05.714898 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ba7075ee-c8c6-41d4-ac2f-e4ef1b223533 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:05.716078 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ba7075ee-c8c6-41d4-ac2f-e4ef1b223533 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1808 microversion: 2.20 time: 0.156918 Oct 11 06:45:05.716625 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 257/561] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:45:05 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:45:05.769694 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-398a211b-9fc6-4bb2-b2cd-fd5c24637503 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:05.770299 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-398a211b-9fc6-4bb2-b2cd-fd5c24637503 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:05.776723 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-398a211b-9fc6-4bb2-b2cd-fd5c24637503 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:05.777209 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-398a211b-9fc6-4bb2-b2cd-fd5c24637503 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:05.777889 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-398a211b-9fc6-4bb2-b2cd-fd5c24637503 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:05.778573 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-398a211b-9fc6-4bb2-b2cd-fd5c24637503 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:05.779016 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-398a211b-9fc6-4bb2-b2cd-fd5c24637503 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:05.779448 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-398a211b-9fc6-4bb2-b2cd-fd5c24637503 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:05.905032 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-398a211b-9fc6-4bb2-b2cd-fd5c24637503 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a6c4a5e3f94f1c932fd3210ae9bf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0cbe1cb0974454a2c4c7cbde3681e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:05.913104 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-398a211b-9fc6-4bb2-b2cd-fd5c24637503 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 200 len: 1314 microversion: 2.1 time: 0.146620 Oct 11 06:45:05.913659 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 305/562] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:45:05 2022] GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:45:06.180643 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d5e44fba-80e4-4ba7-978b-1ff7a10a8cfc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:06.181134 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d5e44fba-80e4-4ba7-978b-1ff7a10a8cfc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: fe4c25ff-9873-41dc-8396-d4af6cecd1f8] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:06.187049 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d5e44fba-80e4-4ba7-978b-1ff7a10a8cfc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:06.187566 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d5e44fba-80e4-4ba7-978b-1ff7a10a8cfc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:06.187997 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d5e44fba-80e4-4ba7-978b-1ff7a10a8cfc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:06.188683 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d5e44fba-80e4-4ba7-978b-1ff7a10a8cfc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:06.189132 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d5e44fba-80e4-4ba7-978b-1ff7a10a8cfc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:06.189550 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d5e44fba-80e4-4ba7-978b-1ff7a10a8cfc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:06.214377 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d5e44fba-80e4-4ba7-978b-1ff7a10a8cfc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8/ips" status: 200 len: 149 microversion: 2.1 time: 0.037631 Oct 11 06:45:06.214927 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 258/563] 10.222.0.39 () {58 vars in 1248 bytes} [Tue Oct 11 06:45:06 2022] GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:06.226878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-63ca64b5-e4aa-4473-b145-4c0132f22d03 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f0cf8e2-9a0e-4e89-a630-1b108c7ea64f"}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:45:06.229197 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-63ca64b5-e4aa-4473-b145-4c0132f22d03 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: fe4c25ff-9873-41dc-8396-d4af6cecd1f8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:06.235270 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-63ca64b5-e4aa-4473-b145-4c0132f22d03 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:06.235776 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-63ca64b5-e4aa-4473-b145-4c0132f22d03 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:06.236212 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-63ca64b5-e4aa-4473-b145-4c0132f22d03 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:06.236934 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-63ca64b5-e4aa-4473-b145-4c0132f22d03 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:06.237384 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-63ca64b5-e4aa-4473-b145-4c0132f22d03 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:06.237805 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-63ca64b5-e4aa-4473-b145-4c0132f22d03 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:06.315095 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-63ca64b5-e4aa-4473-b145-4c0132f22d03 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] HTTP exception thrown: Invalid volume: volume 1f0cf8e2-9a0e-4e89-a630-1b108c7ea64f is already attached to instances: a2ce136a-30ab-4986-931e-5af38b37875e Oct 11 06:45:06.316855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-63ca64b5-e4aa-4473-b145-4c0132f22d03 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Request method failure captured: Oct 11 06:45:06.316855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: request: POST /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8/os-volume_attachments HTTP/1.1 Oct 11 06:45:06.316855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept: application/json Oct 11 06:45:06.316855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Oct 11 06:45:06.316855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Connection: close Oct 11 06:45:06.316855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Length: 74 Oct 11 06:45:06.316855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Type: application/json Oct 11 06:45:06.316855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Host: 10.222.0.39 Oct 11 06:45:06.316855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Oct 11 06:45:06.316855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.12 Oct 11 06:45:06.316855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABjRRAxy4G3-Dozw6PdtI-WxnLtOJo2tV5OYxcxBy_217a4UmcYLPs6ReKc-RB_X0BHPCFHNcEeuRkAY-tzsCezmhAkP9Vj61rIl09eudAdIM1Me8KUnbI8OUgzhSO-abAb7LBVYvrD1IB-9qK1fM9G-MUZhv8Y32eWPbrO9FZ3pwby7Y8 Oct 11 06:45:06.316855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Oct 11 06:45:06.316855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Oct 11 06:45:06.316855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Oct 11 06:45:06.316855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Oct 11 06:45:06.316855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Oct 11 06:45:06.316855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Oct 11 06:45:06.316855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Id: 5af47e2321de4d299ff3a7fb3d3d9e3c Oct 11 06:45:06.316855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-AttachVolumeNegativeTest-1386971692 Oct 11 06:45:06.316855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Role: reader,member Oct 11 06:45:06.316855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Oct 11 06:45:06.318380 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 06:45:06.318380 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-AttachVolumeNegativeTest-1386971692 Oct 11 06:45:06.318380 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 5af47e2321de4d299ff3a7fb3d3d9e3c Oct 11 06:45:06.318380 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1386971692 Oct 11 06:45:06.318380 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User: tempest-AttachVolumeNegativeTest-1386971692-project Oct 11 06:45:06.318380 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Oct 11 06:45:06.318380 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Oct 11 06:45:06.318380 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Id: 2e63c3f83f3d41018e6330f26ed7b8a0 Oct 11 06:45:06.318380 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-AttachVolumeNegativeTest-1386971692-project Oct 11 06:45:06.318380 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Oct 11 06:45:06.318380 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: {"volumeAttachment": {"volumeId": "1f0cf8e2-9a0e-4e89-a630-1b108c7ea64f"}} Oct 11 06:45:06.318380 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: method: > Oct 11 06:45:06.319262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: exception: Invalid volume: volume 1f0cf8e2-9a0e-4e89-a630-1b108c7ea64f is already attached to instances: a2ce136a-30ab-4986-931e-5af38b37875e Oct 11 06:45:06.319262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: action_args: {'server_id': 'fe4c25ff-9873-41dc-8396-d4af6cecd1f8', 'body': {'volumeAttachment': {'volumeId': '1f0cf8e2-9a0e-4e89-a630-1b108c7ea64f'}}} Oct 11 06:45:06.319262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 06:45:06.319262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:45:06.319262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 11 06:45:06.319262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 11 06:45:06.319262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 06:45:06.319262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 06:45:06.319262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 11 06:45:06.319262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 06:45:06.319262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 11 06:45:06.319262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 11 06:45:06.319262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 11 06:45:06.319262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 11 06:45:06.319262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1f0cf8e2-9a0e-4e89-a630-1b108c7ea64f is already attached to instances: a2ce136a-30ab-4986-931e-5af38b37875e Oct 11 06:45:06.319262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:45:06.319262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:45:06.319262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:45:06.319262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:45:06.320868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:45:06.320868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:45:06.320868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 06:45:06.320868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 06:45:06.320868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 06:45:06.320868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 06:45:06.320868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 06:45:06.320868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 06:45:06.320868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 06:45:06.320868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 06:45:06.320868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 06:45:06.320868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 06:45:06.320868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 11 06:45:06.320868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 11 06:45:06.320868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1f0cf8e2-9a0e-4e89-a630-1b108c7ea64f is already attached to instances: a2ce136a-30ab-4986-931e-5af38b37875e Oct 11 06:45:06.320868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:45:06.320868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:45:06.320868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:45:06.320868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:45:06.320868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:45:06.322205 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:45:06.322205 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 06:45:06.322205 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 06:45:06.322205 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1f0cf8e2-9a0e-4e89-a630-1b108c7ea64f is already attached to instances: a2ce136a-30ab-4986-931e-5af38b37875e Oct 11 06:45:06.322205 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 06:45:06.322205 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-63ca64b5-e4aa-4473-b145-4c0132f22d03 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Returning 400 to user: Invalid volume: volume 1f0cf8e2-9a0e-4e89-a630-1b108c7ea64f is already attached to instances: a2ce136a-30ab-4986-931e-5af38b37875e {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 06:45:06.322205 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-63ca64b5-e4aa-4473-b145-4c0132f22d03 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "POST /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095932 Oct 11 06:45:06.322205 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 306/564] 10.222.0.39 () {60 vars in 1323 bytes} [Tue Oct 11 06:45:06 2022] POST /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 06:45:06.327079 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-db2a0276-707c-4a32-8da5-d3a71761c412 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:06.327599 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-db2a0276-707c-4a32-8da5-d3a71761c412 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: fe4c25ff-9873-41dc-8396-d4af6cecd1f8] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:06.333429 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db2a0276-707c-4a32-8da5-d3a71761c412 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:06.333906 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db2a0276-707c-4a32-8da5-d3a71761c412 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:06.334845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db2a0276-707c-4a32-8da5-d3a71761c412 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:06.335558 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db2a0276-707c-4a32-8da5-d3a71761c412 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:06.336007 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db2a0276-707c-4a32-8da5-d3a71761c412 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:06.336417 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db2a0276-707c-4a32-8da5-d3a71761c412 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:06.360929 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-db2a0276-707c-4a32-8da5-d3a71761c412 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: fe4c25ff-9873-41dc-8396-d4af6cecd1f8] Going to try to terminate instance {{(pid=125267) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 06:45:06.375163 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:45:06.441865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-db2a0276-707c-4a32-8da5-d3a71761c412 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "DELETE /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8" status: 204 len: 0 microversion: 2.1 time: 0.118090 Oct 11 06:45:06.443308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 259/565] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Oct 11 06:45:06 2022] DELETE /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 06:45:06.451459 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-04b3b94b-8ab4-4c14-8e6c-4dc41b8fd5cb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:06.452277 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-04b3b94b-8ab4-4c14-8e6c-4dc41b8fd5cb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: fe4c25ff-9873-41dc-8396-d4af6cecd1f8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:06.458525 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04b3b94b-8ab4-4c14-8e6c-4dc41b8fd5cb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:06.459012 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04b3b94b-8ab4-4c14-8e6c-4dc41b8fd5cb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:06.460075 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04b3b94b-8ab4-4c14-8e6c-4dc41b8fd5cb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:06.460783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04b3b94b-8ab4-4c14-8e6c-4dc41b8fd5cb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:06.461239 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04b3b94b-8ab4-4c14-8e6c-4dc41b8fd5cb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:06.461658 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04b3b94b-8ab4-4c14-8e6c-4dc41b8fd5cb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:06.465805 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-61d91c8f-1bc4-4eb8-9e42-d26287d01eeb req-706e7bff-5ea8-4852-9e8f-b98658600b8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43d48211-8dab-4abd-8c95-e850b83382ff", "name": "network-vif-plugged", "status": "completed", "tag": "f963366d-bbf2-4aff-84d1-f61c69977089"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:45:06.476954 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-61d91c8f-1bc4-4eb8-9e42-d26287d01eeb req-706e7bff-5ea8-4852-9e8f-b98658600b8c service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:06.477191 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-61d91c8f-1bc4-4eb8-9e42-d26287d01eeb req-706e7bff-5ea8-4852-9e8f-b98658600b8c service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:06.477620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-61d91c8f-1bc4-4eb8-9e42-d26287d01eeb req-706e7bff-5ea8-4852-9e8f-b98658600b8c service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:06.490297 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-61d91c8f-1bc4-4eb8-9e42-d26287d01eeb req-706e7bff-5ea8-4852-9e8f-b98658600b8c service nova] Creating event network-vif-plugged:f963366d-bbf2-4aff-84d1-f61c69977089 for instance 43d48211-8dab-4abd-8c95-e850b83382ff on hv-cinder-85495 Oct 11 06:45:06.495228 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-61d91c8f-1bc4-4eb8-9e42-d26287d01eeb req-706e7bff-5ea8-4852-9e8f-b98658600b8c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033626 Oct 11 06:45:06.496334 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 260/566] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:06.597545 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-04b3b94b-8ab4-4c14-8e6c-4dc41b8fd5cb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:06.601214 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:45:06.606200 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-04b3b94b-8ab4-4c14-8e6c-4dc41b8fd5cb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8" status: 200 len: 1681 microversion: 2.1 time: 0.158547 Oct 11 06:45:06.606756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 307/567] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:45:06 2022] GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:45:06.742152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7b226a9c-4de1-4f3f-ad78-a1b08a545345 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:06.742849 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7b226a9c-4de1-4f3f-ad78-a1b08a545345 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:06.748946 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b226a9c-4de1-4f3f-ad78-a1b08a545345 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:06.749428 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b226a9c-4de1-4f3f-ad78-a1b08a545345 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:06.749861 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b226a9c-4de1-4f3f-ad78-a1b08a545345 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:06.750555 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b226a9c-4de1-4f3f-ad78-a1b08a545345 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:06.751009 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b226a9c-4de1-4f3f-ad78-a1b08a545345 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:06.751493 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b226a9c-4de1-4f3f-ad78-a1b08a545345 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:06.878414 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7b226a9c-4de1-4f3f-ad78-a1b08a545345 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:06.887765 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7b226a9c-4de1-4f3f-ad78-a1b08a545345 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:06.889200 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7b226a9c-4de1-4f3f-ad78-a1b08a545345 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:06.890385 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7b226a9c-4de1-4f3f-ad78-a1b08a545345 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1808 microversion: 2.20 time: 0.152921 Oct 11 06:45:06.890934 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 261/568] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:45:06 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:45:06.935497 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-87ddcddf-d2ee-4efd-834e-0a5ce2783266 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:06.936055 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-87ddcddf-d2ee-4efd-834e-0a5ce2783266 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:06.942943 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-87ddcddf-d2ee-4efd-834e-0a5ce2783266 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:06.943428 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-87ddcddf-d2ee-4efd-834e-0a5ce2783266 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:06.944477 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-87ddcddf-d2ee-4efd-834e-0a5ce2783266 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:06.945159 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-87ddcddf-d2ee-4efd-834e-0a5ce2783266 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:06.945604 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-87ddcddf-d2ee-4efd-834e-0a5ce2783266 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:06.946022 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-87ddcddf-d2ee-4efd-834e-0a5ce2783266 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:07.070655 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-87ddcddf-d2ee-4efd-834e-0a5ce2783266 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a6c4a5e3f94f1c932fd3210ae9bf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0cbe1cb0974454a2c4c7cbde3681e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:07.078490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-87ddcddf-d2ee-4efd-834e-0a5ce2783266 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 200 len: 1314 microversion: 2.1 time: 0.147334 Oct 11 06:45:07.078984 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 308/569] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:45:06 2022] GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:45:07.630359 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2546afc3-409d-41ea-a50d-0925a9b6afa5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:07.630958 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2546afc3-409d-41ea-a50d-0925a9b6afa5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: fe4c25ff-9873-41dc-8396-d4af6cecd1f8] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:07.636997 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2546afc3-409d-41ea-a50d-0925a9b6afa5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:07.637469 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2546afc3-409d-41ea-a50d-0925a9b6afa5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:07.637893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2546afc3-409d-41ea-a50d-0925a9b6afa5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:07.638572 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2546afc3-409d-41ea-a50d-0925a9b6afa5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:07.639016 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2546afc3-409d-41ea-a50d-0925a9b6afa5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:07.639455 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2546afc3-409d-41ea-a50d-0925a9b6afa5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:07.762692 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2546afc3-409d-41ea-a50d-0925a9b6afa5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:07.770270 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2546afc3-409d-41ea-a50d-0925a9b6afa5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8" status: 200 len: 1681 microversion: 2.1 time: 0.143772 Oct 11 06:45:07.770852 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 262/570] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:45:07 2022] GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8 => generated 1681 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:45:07.915623 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3267b55a-09c8-4625-83b9-2fc5bc50f809 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:07.916281 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3267b55a-09c8-4625-83b9-2fc5bc50f809 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:07.922104 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3267b55a-09c8-4625-83b9-2fc5bc50f809 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:07.922571 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3267b55a-09c8-4625-83b9-2fc5bc50f809 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:07.922991 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3267b55a-09c8-4625-83b9-2fc5bc50f809 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:07.923698 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3267b55a-09c8-4625-83b9-2fc5bc50f809 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:07.924141 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3267b55a-09c8-4625-83b9-2fc5bc50f809 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:07.924554 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3267b55a-09c8-4625-83b9-2fc5bc50f809 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:08.054164 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3267b55a-09c8-4625-83b9-2fc5bc50f809 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:08.062711 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3267b55a-09c8-4625-83b9-2fc5bc50f809 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:08.064199 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3267b55a-09c8-4625-83b9-2fc5bc50f809 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:08.065349 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3267b55a-09c8-4625-83b9-2fc5bc50f809 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1808 microversion: 2.20 time: 0.154339 Oct 11 06:45:08.065905 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 309/571] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:45:07 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:45:08.100386 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cb508bdb-b4b6-4117-bcc8-f121d1a7ce27 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:08.100984 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cb508bdb-b4b6-4117-bcc8-f121d1a7ce27 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:08.106866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb508bdb-b4b6-4117-bcc8-f121d1a7ce27 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:08.107336 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb508bdb-b4b6-4117-bcc8-f121d1a7ce27 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:08.107800 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb508bdb-b4b6-4117-bcc8-f121d1a7ce27 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:08.108482 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb508bdb-b4b6-4117-bcc8-f121d1a7ce27 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:08.108929 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb508bdb-b4b6-4117-bcc8-f121d1a7ce27 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:08.109345 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb508bdb-b4b6-4117-bcc8-f121d1a7ce27 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:08.240169 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cb508bdb-b4b6-4117-bcc8-f121d1a7ce27 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a6c4a5e3f94f1c932fd3210ae9bf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0cbe1cb0974454a2c4c7cbde3681e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:08.247717 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cb508bdb-b4b6-4117-bcc8-f121d1a7ce27 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 200 len: 1314 microversion: 2.1 time: 0.151049 Oct 11 06:45:08.248277 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 263/572] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:45:08 2022] GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:45:08.794534 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8234fc35-d391-4840-bd3e-2ccf2d5bf74e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:08.795145 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8234fc35-d391-4840-bd3e-2ccf2d5bf74e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: fe4c25ff-9873-41dc-8396-d4af6cecd1f8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:08.801272 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8234fc35-d391-4840-bd3e-2ccf2d5bf74e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:08.801754 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8234fc35-d391-4840-bd3e-2ccf2d5bf74e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:08.802190 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8234fc35-d391-4840-bd3e-2ccf2d5bf74e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:08.802883 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8234fc35-d391-4840-bd3e-2ccf2d5bf74e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:08.803961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8234fc35-d391-4840-bd3e-2ccf2d5bf74e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:08.804382 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8234fc35-d391-4840-bd3e-2ccf2d5bf74e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:08.930780 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8234fc35-d391-4840-bd3e-2ccf2d5bf74e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:08.938390 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8234fc35-d391-4840-bd3e-2ccf2d5bf74e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8" status: 200 len: 1681 microversion: 2.1 time: 0.147929 Oct 11 06:45:08.942253 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 310/573] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:45:08 2022] GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:45:09.090328 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ece47697-0b8b-4952-8adc-6b861c859a56 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:09.090840 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ece47697-0b8b-4952-8adc-6b861c859a56 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:09.097273 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ece47697-0b8b-4952-8adc-6b861c859a56 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:09.097758 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ece47697-0b8b-4952-8adc-6b861c859a56 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:09.098193 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ece47697-0b8b-4952-8adc-6b861c859a56 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:09.098923 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ece47697-0b8b-4952-8adc-6b861c859a56 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:09.099379 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ece47697-0b8b-4952-8adc-6b861c859a56 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:09.100339 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ece47697-0b8b-4952-8adc-6b861c859a56 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:09.242239 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ece47697-0b8b-4952-8adc-6b861c859a56 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:09.255577 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ece47697-0b8b-4952-8adc-6b861c859a56 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:09.257029 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ece47697-0b8b-4952-8adc-6b861c859a56 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:09.258931 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ece47697-0b8b-4952-8adc-6b861c859a56 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1808 microversion: 2.20 time: 0.172230 Oct 11 06:45:09.260183 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 264/574] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:45:09 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:45:09.270513 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-25c51819-67a1-4509-8d0f-b10fa0f7847a tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:09.272291 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-25c51819-67a1-4509-8d0f-b10fa0f7847a tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:09.279657 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25c51819-67a1-4509-8d0f-b10fa0f7847a tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:09.280302 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25c51819-67a1-4509-8d0f-b10fa0f7847a tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:09.281011 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25c51819-67a1-4509-8d0f-b10fa0f7847a tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:09.282001 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25c51819-67a1-4509-8d0f-b10fa0f7847a tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:09.282338 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25c51819-67a1-4509-8d0f-b10fa0f7847a tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:09.282823 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25c51819-67a1-4509-8d0f-b10fa0f7847a tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:09.512838 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-25c51819-67a1-4509-8d0f-b10fa0f7847a tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a6c4a5e3f94f1c932fd3210ae9bf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0cbe1cb0974454a2c4c7cbde3681e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:09.520764 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-25c51819-67a1-4509-8d0f-b10fa0f7847a tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 200 len: 1314 microversion: 2.1 time: 0.253966 Oct 11 06:45:09.521329 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 311/575] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:45:09 2022] GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:45:09.961858 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4bb151fb-b5f3-4f06-951f-590b9c43e7a3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:09.962566 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4bb151fb-b5f3-4f06-951f-590b9c43e7a3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: fe4c25ff-9873-41dc-8396-d4af6cecd1f8] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:09.968486 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4bb151fb-b5f3-4f06-951f-590b9c43e7a3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:09.968965 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4bb151fb-b5f3-4f06-951f-590b9c43e7a3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:09.969449 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4bb151fb-b5f3-4f06-951f-590b9c43e7a3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:09.970130 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4bb151fb-b5f3-4f06-951f-590b9c43e7a3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:09.970721 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4bb151fb-b5f3-4f06-951f-590b9c43e7a3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:09.970992 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4bb151fb-b5f3-4f06-951f-590b9c43e7a3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:10.045071 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4bb151fb-b5f3-4f06-951f-590b9c43e7a3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:10.052877 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4bb151fb-b5f3-4f06-951f-590b9c43e7a3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8" status: 200 len: 1613 microversion: 2.1 time: 0.095325 Oct 11 06:45:10.053442 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 265/576] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:45:09 2022] GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8 => generated 1613 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:45:10.252581 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-c864b937-4648-4721-acc2-505682e898f1 req-fc3c5ad8-d3d6-4461-9f10-507250882481 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe4c25ff-9873-41dc-8396-d4af6cecd1f8", "name": "network-vif-deleted", "tag": "78c2e971-09ba-4d80-94d5-26027dd14435"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:45:10.262631 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-c864b937-4648-4721-acc2-505682e898f1 req-fc3c5ad8-d3d6-4461-9f10-507250882481 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:10.263109 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-c864b937-4648-4721-acc2-505682e898f1 req-fc3c5ad8-d3d6-4461-9f10-507250882481 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:10.263571 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-c864b937-4648-4721-acc2-505682e898f1 req-fc3c5ad8-d3d6-4461-9f10-507250882481 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:10.274546 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-c864b937-4648-4721-acc2-505682e898f1 req-fc3c5ad8-d3d6-4461-9f10-507250882481 service nova] Creating event network-vif-deleted:78c2e971-09ba-4d80-94d5-26027dd14435 for instance fe4c25ff-9873-41dc-8396-d4af6cecd1f8 on hv-cinder-85495 Oct 11 06:45:10.279757 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-c864b937-4648-4721-acc2-505682e898f1 req-fc3c5ad8-d3d6-4461-9f10-507250882481 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030759 Oct 11 06:45:10.280334 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 312/577] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:10.291023 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2bd0cb19-1b6b-4e59-b45e-66853224897b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:10.291901 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2bd0cb19-1b6b-4e59-b45e-66853224897b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:10.301031 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2bd0cb19-1b6b-4e59-b45e-66853224897b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:10.301578 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2bd0cb19-1b6b-4e59-b45e-66853224897b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:10.302446 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2bd0cb19-1b6b-4e59-b45e-66853224897b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:10.303967 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2bd0cb19-1b6b-4e59-b45e-66853224897b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:10.304888 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2bd0cb19-1b6b-4e59-b45e-66853224897b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:10.305486 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2bd0cb19-1b6b-4e59-b45e-66853224897b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:10.473593 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2bd0cb19-1b6b-4e59-b45e-66853224897b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:10.482410 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2bd0cb19-1b6b-4e59-b45e-66853224897b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:10.483876 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2bd0cb19-1b6b-4e59-b45e-66853224897b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:10.485042 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2bd0cb19-1b6b-4e59-b45e-66853224897b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1808 microversion: 2.20 time: 0.199711 Oct 11 06:45:10.485759 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 266/578] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:45:10 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:45:10.544449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-aa62f71c-e061-4103-b958-975d8774c4b0 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:10.545142 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-aa62f71c-e061-4103-b958-975d8774c4b0 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:10.552918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aa62f71c-e061-4103-b958-975d8774c4b0 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:10.553398 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aa62f71c-e061-4103-b958-975d8774c4b0 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:10.554187 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aa62f71c-e061-4103-b958-975d8774c4b0 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:10.554888 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aa62f71c-e061-4103-b958-975d8774c4b0 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:10.555336 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aa62f71c-e061-4103-b958-975d8774c4b0 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:10.555903 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aa62f71c-e061-4103-b958-975d8774c4b0 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:10.769875 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-aa62f71c-e061-4103-b958-975d8774c4b0 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a6c4a5e3f94f1c932fd3210ae9bf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0cbe1cb0974454a2c4c7cbde3681e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:10.779224 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-aa62f71c-e061-4103-b958-975d8774c4b0 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 200 len: 1314 microversion: 2.1 time: 0.239247 Oct 11 06:45:10.779867 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 313/579] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:45:10 2022] GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:45:10.919509 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-248e541c-81bf-40c4-97fd-f67af05d34f5 req-ecbecd53-89dd-4dca-acc3-e3f9fcaacf40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0345c1d0-58f8-4679-a1a9-b988bf99ca8e", "name": "network-vif-plugged", "status": "completed", "tag": "5a48b8cc-ea4e-4438-b38a-c18676c05888"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:45:10.933081 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-248e541c-81bf-40c4-97fd-f67af05d34f5 req-ecbecd53-89dd-4dca-acc3-e3f9fcaacf40 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:10.933944 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-248e541c-81bf-40c4-97fd-f67af05d34f5 req-ecbecd53-89dd-4dca-acc3-e3f9fcaacf40 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:10.934533 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-248e541c-81bf-40c4-97fd-f67af05d34f5 req-ecbecd53-89dd-4dca-acc3-e3f9fcaacf40 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:10.948647 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-248e541c-81bf-40c4-97fd-f67af05d34f5 req-ecbecd53-89dd-4dca-acc3-e3f9fcaacf40 service nova] Creating event network-vif-plugged:5a48b8cc-ea4e-4438-b38a-c18676c05888 for instance 0345c1d0-58f8-4679-a1a9-b988bf99ca8e on hv-cinder-85495 Oct 11 06:45:10.953981 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-248e541c-81bf-40c4-97fd-f67af05d34f5 req-ecbecd53-89dd-4dca-acc3-e3f9fcaacf40 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039683 Oct 11 06:45:10.954633 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 267/580] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:11.076496 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ec40ec1f-8f9e-49f7-9cd5-3bb024e83824 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:11.077951 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ec40ec1f-8f9e-49f7-9cd5-3bb024e83824 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: fe4c25ff-9873-41dc-8396-d4af6cecd1f8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:11.084858 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec40ec1f-8f9e-49f7-9cd5-3bb024e83824 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:11.085415 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec40ec1f-8f9e-49f7-9cd5-3bb024e83824 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:11.085912 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec40ec1f-8f9e-49f7-9cd5-3bb024e83824 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:11.086680 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec40ec1f-8f9e-49f7-9cd5-3bb024e83824 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:11.087200 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec40ec1f-8f9e-49f7-9cd5-3bb024e83824 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:11.087708 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec40ec1f-8f9e-49f7-9cd5-3bb024e83824 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:11.118086 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec40ec1f-8f9e-49f7-9cd5-3bb024e83824 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:11.118556 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec40ec1f-8f9e-49f7-9cd5-3bb024e83824 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:11.118985 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec40ec1f-8f9e-49f7-9cd5-3bb024e83824 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:11.119442 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.objects.instance [None req-ec40ec1f-8f9e-49f7-9cd5-3bb024e83824 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lazy-loading 'fault' on Instance uuid fe4c25ff-9873-41dc-8396-d4af6cecd1f8 {{(pid=125266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 06:45:11.162761 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ec40ec1f-8f9e-49f7-9cd5-3bb024e83824 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:11.171050 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ec40ec1f-8f9e-49f7-9cd5-3bb024e83824 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8" status: 200 len: 1331 microversion: 2.1 time: 0.098575 Oct 11 06:45:11.171871 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 314/581] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:45:11 2022] GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:45:11.513428 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-36f85890-4cbb-477f-8229-ea7dacf43444 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:11.514121 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-36f85890-4cbb-477f-8229-ea7dacf43444 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:11.520606 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-36f85890-4cbb-477f-8229-ea7dacf43444 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:11.521087 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-36f85890-4cbb-477f-8229-ea7dacf43444 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:11.521549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-36f85890-4cbb-477f-8229-ea7dacf43444 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:11.522255 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-36f85890-4cbb-477f-8229-ea7dacf43444 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:11.522704 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-36f85890-4cbb-477f-8229-ea7dacf43444 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:11.523165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-36f85890-4cbb-477f-8229-ea7dacf43444 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:11.663224 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-36f85890-4cbb-477f-8229-ea7dacf43444 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:11.673270 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-36f85890-4cbb-477f-8229-ea7dacf43444 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:11.674703 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-36f85890-4cbb-477f-8229-ea7dacf43444 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:11.675995 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-36f85890-4cbb-477f-8229-ea7dacf43444 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1808 microversion: 2.20 time: 0.167540 Oct 11 06:45:11.676972 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 268/582] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:45:11 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:45:11.801618 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6b35ea6d-46f1-4ce6-9da2-c62d0da71af7 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:11.802224 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6b35ea6d-46f1-4ce6-9da2-c62d0da71af7 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:11.809223 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6b35ea6d-46f1-4ce6-9da2-c62d0da71af7 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:11.809703 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6b35ea6d-46f1-4ce6-9da2-c62d0da71af7 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:11.810136 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6b35ea6d-46f1-4ce6-9da2-c62d0da71af7 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:11.810826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6b35ea6d-46f1-4ce6-9da2-c62d0da71af7 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:11.811273 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6b35ea6d-46f1-4ce6-9da2-c62d0da71af7 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:11.811724 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6b35ea6d-46f1-4ce6-9da2-c62d0da71af7 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:11.939130 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6b35ea6d-46f1-4ce6-9da2-c62d0da71af7 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a6c4a5e3f94f1c932fd3210ae9bf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0cbe1cb0974454a2c4c7cbde3681e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:11.946952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6b35ea6d-46f1-4ce6-9da2-c62d0da71af7 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 200 len: 1314 microversion: 2.1 time: 0.149106 Oct 11 06:45:11.947538 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 315/583] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:45:11 2022] GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:45:12.194502 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a56bbbf7-d4d1-4528-99ce-9f43bd3c13fe tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:12.195062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a56bbbf7-d4d1-4528-99ce-9f43bd3c13fe tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: fe4c25ff-9873-41dc-8396-d4af6cecd1f8] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:12.201756 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a56bbbf7-d4d1-4528-99ce-9f43bd3c13fe tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:12.202398 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a56bbbf7-d4d1-4528-99ce-9f43bd3c13fe tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:12.202851 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a56bbbf7-d4d1-4528-99ce-9f43bd3c13fe tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:12.203648 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a56bbbf7-d4d1-4528-99ce-9f43bd3c13fe tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:12.204131 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a56bbbf7-d4d1-4528-99ce-9f43bd3c13fe tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:12.204549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a56bbbf7-d4d1-4528-99ce-9f43bd3c13fe tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:12.237464 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a56bbbf7-d4d1-4528-99ce-9f43bd3c13fe tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:12.237939 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a56bbbf7-d4d1-4528-99ce-9f43bd3c13fe tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:12.238366 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a56bbbf7-d4d1-4528-99ce-9f43bd3c13fe tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:12.238823 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-a56bbbf7-d4d1-4528-99ce-9f43bd3c13fe tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lazy-loading 'fault' on Instance uuid fe4c25ff-9873-41dc-8396-d4af6cecd1f8 {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 06:45:12.283490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a56bbbf7-d4d1-4528-99ce-9f43bd3c13fe tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:12.291930 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a56bbbf7-d4d1-4528-99ce-9f43bd3c13fe tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8" status: 200 len: 1331 microversion: 2.1 time: 0.101357 Oct 11 06:45:12.292494 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 269/584] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:45:12 2022] GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8 => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:45:12.702365 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5844937f-100e-4155-ac29-e4f9688b5c9d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:12.702989 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5844937f-100e-4155-ac29-e4f9688b5c9d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:12.708833 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5844937f-100e-4155-ac29-e4f9688b5c9d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:12.710614 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5844937f-100e-4155-ac29-e4f9688b5c9d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:12.711123 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5844937f-100e-4155-ac29-e4f9688b5c9d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:12.711895 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5844937f-100e-4155-ac29-e4f9688b5c9d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:12.712351 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5844937f-100e-4155-ac29-e4f9688b5c9d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:12.712773 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5844937f-100e-4155-ac29-e4f9688b5c9d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:12.843150 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5844937f-100e-4155-ac29-e4f9688b5c9d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:12.852260 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5844937f-100e-4155-ac29-e4f9688b5c9d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:12.853702 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5844937f-100e-4155-ac29-e4f9688b5c9d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:12.854848 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5844937f-100e-4155-ac29-e4f9688b5c9d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1808 microversion: 2.20 time: 0.156385 Oct 11 06:45:12.855405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 316/585] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:45:12 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:45:12.969424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-10d4e4b9-0da7-48f1-bfcb-6e5a1f4f8548 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:12.970154 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-10d4e4b9-0da7-48f1-bfcb-6e5a1f4f8548 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:12.977464 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-10d4e4b9-0da7-48f1-bfcb-6e5a1f4f8548 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:12.978041 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-10d4e4b9-0da7-48f1-bfcb-6e5a1f4f8548 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:12.978540 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-10d4e4b9-0da7-48f1-bfcb-6e5a1f4f8548 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:12.979315 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-10d4e4b9-0da7-48f1-bfcb-6e5a1f4f8548 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:12.979929 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-10d4e4b9-0da7-48f1-bfcb-6e5a1f4f8548 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:12.980359 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-10d4e4b9-0da7-48f1-bfcb-6e5a1f4f8548 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:13.000743 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c368c013-ae0e-4cc9-9341-6b3cc0ced3d0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:13.001332 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c368c013-ae0e-4cc9-9341-6b3cc0ced3d0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:13.007616 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c368c013-ae0e-4cc9-9341-6b3cc0ced3d0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:13.008094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c368c013-ae0e-4cc9-9341-6b3cc0ced3d0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:13.008578 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c368c013-ae0e-4cc9-9341-6b3cc0ced3d0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:13.009272 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c368c013-ae0e-4cc9-9341-6b3cc0ced3d0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:13.009718 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c368c013-ae0e-4cc9-9341-6b3cc0ced3d0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:13.010136 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c368c013-ae0e-4cc9-9341-6b3cc0ced3d0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:13.110808 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-10d4e4b9-0da7-48f1-bfcb-6e5a1f4f8548 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a6c4a5e3f94f1c932fd3210ae9bf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0cbe1cb0974454a2c4c7cbde3681e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:13.118870 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-10d4e4b9-0da7-48f1-bfcb-6e5a1f4f8548 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 200 len: 1314 microversion: 2.1 time: 0.153254 Oct 11 06:45:13.119466 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 270/586] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:45:12 2022] GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:45:13.133593 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.objects.instance [None req-c368c013-ae0e-4cc9-9341-6b3cc0ced3d0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lazy-loading 'services' on Instance uuid 9c76b29e-08a3-4b53-9b36-82980a19493d {{(pid=125266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 06:45:13.249353 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c368c013-ae0e-4cc9-9341-6b3cc0ced3d0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments/8e5e70f5-98d8-41a7-a98e-a665c3b44a19" status: 202 len: 0 microversion: 2.1 time: 0.254975 Oct 11 06:45:13.249932 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 317/587] 10.222.0.39 () {58 vars in 1416 bytes} [Tue Oct 11 06:45:12 2022] DELETE /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments/8e5e70f5-98d8-41a7-a98e-a665c3b44a19 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 06:45:13.313789 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7c84d77f-16b4-4c31-9c53-86d33c7a90f3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:13.314329 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7c84d77f-16b4-4c31-9c53-86d33c7a90f3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: fe4c25ff-9873-41dc-8396-d4af6cecd1f8] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:13.320863 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7c84d77f-16b4-4c31-9c53-86d33c7a90f3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:13.321338 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7c84d77f-16b4-4c31-9c53-86d33c7a90f3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:13.321763 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7c84d77f-16b4-4c31-9c53-86d33c7a90f3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:13.322440 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7c84d77f-16b4-4c31-9c53-86d33c7a90f3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:13.322883 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7c84d77f-16b4-4c31-9c53-86d33c7a90f3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:13.323295 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7c84d77f-16b4-4c31-9c53-86d33c7a90f3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:13.353220 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7c84d77f-16b4-4c31-9c53-86d33c7a90f3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:13.353691 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7c84d77f-16b4-4c31-9c53-86d33c7a90f3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:13.354113 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7c84d77f-16b4-4c31-9c53-86d33c7a90f3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:13.354547 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-7c84d77f-16b4-4c31-9c53-86d33c7a90f3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lazy-loading 'fault' on Instance uuid fe4c25ff-9873-41dc-8396-d4af6cecd1f8 {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 06:45:13.393544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7c84d77f-16b4-4c31-9c53-86d33c7a90f3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:13.401618 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7c84d77f-16b4-4c31-9c53-86d33c7a90f3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8" status: 200 len: 1331 microversion: 2.1 time: 0.091599 Oct 11 06:45:13.402177 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 271/588] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:45:13 2022] GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8 => generated 1331 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:45:13.881232 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8ea2c391-6741-42a3-90ef-aaee96e92060 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:13.881949 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8ea2c391-6741-42a3-90ef-aaee96e92060 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:13.889017 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ea2c391-6741-42a3-90ef-aaee96e92060 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:13.889505 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ea2c391-6741-42a3-90ef-aaee96e92060 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:13.889943 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ea2c391-6741-42a3-90ef-aaee96e92060 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:13.890655 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ea2c391-6741-42a3-90ef-aaee96e92060 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:13.891109 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ea2c391-6741-42a3-90ef-aaee96e92060 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:13.891579 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ea2c391-6741-42a3-90ef-aaee96e92060 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:14.024730 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8ea2c391-6741-42a3-90ef-aaee96e92060 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:14.033599 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8ea2c391-6741-42a3-90ef-aaee96e92060 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:14.035026 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8ea2c391-6741-42a3-90ef-aaee96e92060 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:14.036216 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8ea2c391-6741-42a3-90ef-aaee96e92060 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1808 microversion: 2.20 time: 0.159407 Oct 11 06:45:14.036762 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 318/589] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:45:13 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:45:14.141145 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5daf3880-01d2-4802-88aa-2b22a3668715 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:14.141662 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5daf3880-01d2-4802-88aa-2b22a3668715 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:14.148109 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5daf3880-01d2-4802-88aa-2b22a3668715 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:14.148580 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5daf3880-01d2-4802-88aa-2b22a3668715 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:14.149003 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5daf3880-01d2-4802-88aa-2b22a3668715 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:14.149679 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5daf3880-01d2-4802-88aa-2b22a3668715 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:14.150124 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5daf3880-01d2-4802-88aa-2b22a3668715 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:14.150539 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5daf3880-01d2-4802-88aa-2b22a3668715 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:14.282317 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5daf3880-01d2-4802-88aa-2b22a3668715 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a6c4a5e3f94f1c932fd3210ae9bf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0cbe1cb0974454a2c4c7cbde3681e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:14.290007 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5daf3880-01d2-4802-88aa-2b22a3668715 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 200 len: 1314 microversion: 2.1 time: 0.152743 Oct 11 06:45:14.290592 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 272/590] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:45:14 2022] GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:45:14.424908 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7ce13ab5-1d07-408b-9233-66692008bf85 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:14.425510 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7ce13ab5-1d07-408b-9233-66692008bf85 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: fe4c25ff-9873-41dc-8396-d4af6cecd1f8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:14.432025 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7ce13ab5-1d07-408b-9233-66692008bf85 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:14.432491 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7ce13ab5-1d07-408b-9233-66692008bf85 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:14.432915 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7ce13ab5-1d07-408b-9233-66692008bf85 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:14.433590 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7ce13ab5-1d07-408b-9233-66692008bf85 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:14.434030 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7ce13ab5-1d07-408b-9233-66692008bf85 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:14.434443 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7ce13ab5-1d07-408b-9233-66692008bf85 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:14.464122 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7ce13ab5-1d07-408b-9233-66692008bf85 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:14.464579 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7ce13ab5-1d07-408b-9233-66692008bf85 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:14.465002 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7ce13ab5-1d07-408b-9233-66692008bf85 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:14.465429 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.objects.instance [None req-7ce13ab5-1d07-408b-9233-66692008bf85 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lazy-loading 'fault' on Instance uuid fe4c25ff-9873-41dc-8396-d4af6cecd1f8 {{(pid=125266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 06:45:14.504524 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7ce13ab5-1d07-408b-9233-66692008bf85 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:14.512592 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7ce13ab5-1d07-408b-9233-66692008bf85 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8" status: 200 len: 1331 microversion: 2.1 time: 0.091504 Oct 11 06:45:14.513147 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 319/591] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:45:14 2022] GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8 => generated 1331 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:45:15.060951 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-36a1ff02-f548-48a7-9750-45a5a0f7f51f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:15.061553 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-36a1ff02-f548-48a7-9750-45a5a0f7f51f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:15.067345 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-36a1ff02-f548-48a7-9750-45a5a0f7f51f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:15.067846 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-36a1ff02-f548-48a7-9750-45a5a0f7f51f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:15.068411 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-36a1ff02-f548-48a7-9750-45a5a0f7f51f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:15.069096 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-36a1ff02-f548-48a7-9750-45a5a0f7f51f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:15.069545 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-36a1ff02-f548-48a7-9750-45a5a0f7f51f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:15.069959 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-36a1ff02-f548-48a7-9750-45a5a0f7f51f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:15.204208 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-36a1ff02-f548-48a7-9750-45a5a0f7f51f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:15.216879 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-36a1ff02-f548-48a7-9750-45a5a0f7f51f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:15.218572 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-36a1ff02-f548-48a7-9750-45a5a0f7f51f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:15.219954 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-36a1ff02-f548-48a7-9750-45a5a0f7f51f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1808 microversion: 2.20 time: 0.162712 Oct 11 06:45:15.220611 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 273/592] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:45:15 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:45:15.312263 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-477eef57-b916-465c-911f-1a857c8f3e02 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:15.313000 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-477eef57-b916-465c-911f-1a857c8f3e02 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:15.321282 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-477eef57-b916-465c-911f-1a857c8f3e02 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:15.321768 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-477eef57-b916-465c-911f-1a857c8f3e02 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:15.322207 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-477eef57-b916-465c-911f-1a857c8f3e02 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:15.323472 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-477eef57-b916-465c-911f-1a857c8f3e02 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:15.324033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-477eef57-b916-465c-911f-1a857c8f3e02 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:15.324595 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-477eef57-b916-465c-911f-1a857c8f3e02 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:15.496364 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-477eef57-b916-465c-911f-1a857c8f3e02 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a6c4a5e3f94f1c932fd3210ae9bf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0cbe1cb0974454a2c4c7cbde3681e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:15.504131 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-477eef57-b916-465c-911f-1a857c8f3e02 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 200 len: 1314 microversion: 2.1 time: 0.195442 Oct 11 06:45:15.521059 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 320/593] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:45:15 2022] GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:45:15.534844 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cb83635c-c64e-41e7-904e-056714e90164 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:15.535762 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cb83635c-c64e-41e7-904e-056714e90164 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: fe4c25ff-9873-41dc-8396-d4af6cecd1f8] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:15.543991 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb83635c-c64e-41e7-904e-056714e90164 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:15.544752 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb83635c-c64e-41e7-904e-056714e90164 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:15.545333 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb83635c-c64e-41e7-904e-056714e90164 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:15.546110 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb83635c-c64e-41e7-904e-056714e90164 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:15.546642 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb83635c-c64e-41e7-904e-056714e90164 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:15.547195 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb83635c-c64e-41e7-904e-056714e90164 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:15.597490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb83635c-c64e-41e7-904e-056714e90164 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:15.598517 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb83635c-c64e-41e7-904e-056714e90164 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:15.598965 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb83635c-c64e-41e7-904e-056714e90164 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:15.599867 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-cb83635c-c64e-41e7-904e-056714e90164 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lazy-loading 'fault' on Instance uuid fe4c25ff-9873-41dc-8396-d4af6cecd1f8 {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 06:45:15.648432 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cb83635c-c64e-41e7-904e-056714e90164 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:15.657638 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cb83635c-c64e-41e7-904e-056714e90164 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8" status: 200 len: 1331 microversion: 2.1 time: 0.126799 Oct 11 06:45:15.658367 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 274/594] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:45:15 2022] GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8 => generated 1331 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:45:16.247136 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e228db0e-e50d-4361-a5f8-f6fbece9cba8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:16.247764 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e228db0e-e50d-4361-a5f8-f6fbece9cba8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:16.253716 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e228db0e-e50d-4361-a5f8-f6fbece9cba8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:16.254183 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e228db0e-e50d-4361-a5f8-f6fbece9cba8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:16.254607 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e228db0e-e50d-4361-a5f8-f6fbece9cba8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:16.255279 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e228db0e-e50d-4361-a5f8-f6fbece9cba8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:16.256373 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e228db0e-e50d-4361-a5f8-f6fbece9cba8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:16.256792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e228db0e-e50d-4361-a5f8-f6fbece9cba8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:16.386719 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e228db0e-e50d-4361-a5f8-f6fbece9cba8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:16.397450 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e228db0e-e50d-4361-a5f8-f6fbece9cba8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:16.399311 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e228db0e-e50d-4361-a5f8-f6fbece9cba8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:16.400690 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e228db0e-e50d-4361-a5f8-f6fbece9cba8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1808 microversion: 2.20 time: 0.157362 Oct 11 06:45:16.416047 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 321/595] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:45:16 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:45:16.527820 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-420fb851-e06d-4f7e-b424-d66b8c0c8016 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:16.528463 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-420fb851-e06d-4f7e-b424-d66b8c0c8016 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:16.534832 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-420fb851-e06d-4f7e-b424-d66b8c0c8016 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:16.535314 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-420fb851-e06d-4f7e-b424-d66b8c0c8016 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:16.535783 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-420fb851-e06d-4f7e-b424-d66b8c0c8016 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:16.536476 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-420fb851-e06d-4f7e-b424-d66b8c0c8016 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:16.537442 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-420fb851-e06d-4f7e-b424-d66b8c0c8016 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:16.537865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-420fb851-e06d-4f7e-b424-d66b8c0c8016 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:16.556066 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:45:16.668812 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-420fb851-e06d-4f7e-b424-d66b8c0c8016 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a6c4a5e3f94f1c932fd3210ae9bf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0cbe1cb0974454a2c4c7cbde3681e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:16.676385 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-420fb851-e06d-4f7e-b424-d66b8c0c8016 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 200 len: 1314 microversion: 2.1 time: 0.152706 Oct 11 06:45:16.676940 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 275/596] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:45:16 2022] GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:45:16.680356 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9c288bd2-9fc1-43b4-8d95-ecfa8eff25fb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:16.680994 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9c288bd2-9fc1-43b4-8d95-ecfa8eff25fb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: fe4c25ff-9873-41dc-8396-d4af6cecd1f8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:16.686913 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c288bd2-9fc1-43b4-8d95-ecfa8eff25fb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:16.687393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c288bd2-9fc1-43b4-8d95-ecfa8eff25fb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:16.687854 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c288bd2-9fc1-43b4-8d95-ecfa8eff25fb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:16.688540 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c288bd2-9fc1-43b4-8d95-ecfa8eff25fb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:16.688988 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c288bd2-9fc1-43b4-8d95-ecfa8eff25fb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:16.689583 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c288bd2-9fc1-43b4-8d95-ecfa8eff25fb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:16.721556 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c288bd2-9fc1-43b4-8d95-ecfa8eff25fb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:16.722029 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c288bd2-9fc1-43b4-8d95-ecfa8eff25fb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:16.722464 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c288bd2-9fc1-43b4-8d95-ecfa8eff25fb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:16.722908 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.objects.instance [None req-9c288bd2-9fc1-43b4-8d95-ecfa8eff25fb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lazy-loading 'fault' on Instance uuid fe4c25ff-9873-41dc-8396-d4af6cecd1f8 {{(pid=125266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 06:45:16.762485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9c288bd2-9fc1-43b4-8d95-ecfa8eff25fb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:16.770036 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9c288bd2-9fc1-43b4-8d95-ecfa8eff25fb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8" status: 200 len: 1331 microversion: 2.1 time: 0.093509 Oct 11 06:45:16.770588 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 322/597] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:45:16 2022] GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8 => generated 1331 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:45:17.428951 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-72ef8f0d-309d-4c1b-ad8c-4bdfbfabb603 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:17.429577 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-72ef8f0d-309d-4c1b-ad8c-4bdfbfabb603 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:17.435661 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-72ef8f0d-309d-4c1b-ad8c-4bdfbfabb603 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:17.436147 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-72ef8f0d-309d-4c1b-ad8c-4bdfbfabb603 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:17.436557 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-72ef8f0d-309d-4c1b-ad8c-4bdfbfabb603 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:17.437233 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-72ef8f0d-309d-4c1b-ad8c-4bdfbfabb603 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:17.437674 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-72ef8f0d-309d-4c1b-ad8c-4bdfbfabb603 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:17.438085 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-72ef8f0d-309d-4c1b-ad8c-4bdfbfabb603 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:17.592850 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-72ef8f0d-309d-4c1b-ad8c-4bdfbfabb603 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:17.602003 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-72ef8f0d-309d-4c1b-ad8c-4bdfbfabb603 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:17.603448 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-72ef8f0d-309d-4c1b-ad8c-4bdfbfabb603 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:17.604584 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-72ef8f0d-309d-4c1b-ad8c-4bdfbfabb603 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1795 microversion: 2.20 time: 0.180354 Oct 11 06:45:17.605201 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 276/598] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:45:17 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1795 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:45:17.698499 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bbb581d9-787a-4c27-99d4-2a4f523cc1f9 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:17.699098 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bbb581d9-787a-4c27-99d4-2a4f523cc1f9 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:17.705499 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bbb581d9-787a-4c27-99d4-2a4f523cc1f9 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:17.705971 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bbb581d9-787a-4c27-99d4-2a4f523cc1f9 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:17.706397 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bbb581d9-787a-4c27-99d4-2a4f523cc1f9 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:17.707068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bbb581d9-787a-4c27-99d4-2a4f523cc1f9 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:17.707537 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bbb581d9-787a-4c27-99d4-2a4f523cc1f9 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:17.707952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bbb581d9-787a-4c27-99d4-2a4f523cc1f9 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:17.727942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:45:17.794377 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-034f093b-dc86-479f-b125-e9d81d565dce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:17.794995 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-034f093b-dc86-479f-b125-e9d81d565dce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: fe4c25ff-9873-41dc-8396-d4af6cecd1f8] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:17.800953 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-034f093b-dc86-479f-b125-e9d81d565dce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:17.801434 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-034f093b-dc86-479f-b125-e9d81d565dce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:17.801877 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-034f093b-dc86-479f-b125-e9d81d565dce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:17.802568 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-034f093b-dc86-479f-b125-e9d81d565dce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:17.803020 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-034f093b-dc86-479f-b125-e9d81d565dce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:17.804013 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-034f093b-dc86-479f-b125-e9d81d565dce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:17.817682 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-034f093b-dc86-479f-b125-e9d81d565dce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] HTTP exception thrown: Instance fe4c25ff-9873-41dc-8396-d4af6cecd1f8 could not be found. Oct 11 06:45:17.819373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-034f093b-dc86-479f-b125-e9d81d565dce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Request method failure captured: Oct 11 06:45:17.819373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: request: GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8 HTTP/1.1 Oct 11 06:45:17.819373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept: application/json Oct 11 06:45:17.819373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Oct 11 06:45:17.819373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Connection: close Oct 11 06:45:17.819373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Length: 0 Oct 11 06:45:17.819373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Type: application/json Oct 11 06:45:17.819373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Host: 10.222.0.39 Oct 11 06:45:17.819373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Oct 11 06:45:17.819373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.12 Oct 11 06:45:17.819373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABjRRAxy4G3-Dozw6PdtI-WxnLtOJo2tV5OYxcxBy_217a4UmcYLPs6ReKc-RB_X0BHPCFHNcEeuRkAY-tzsCezmhAkP9Vj61rIl09eudAdIM1Me8KUnbI8OUgzhSO-abAb7LBVYvrD1IB-9qK1fM9G-MUZhv8Y32eWPbrO9FZ3pwby7Y8 Oct 11 06:45:17.819373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Oct 11 06:45:17.819373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Oct 11 06:45:17.819373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Oct 11 06:45:17.819373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Oct 11 06:45:17.819373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Oct 11 06:45:17.819373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Oct 11 06:45:17.819373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Id: 5af47e2321de4d299ff3a7fb3d3d9e3c Oct 11 06:45:17.819373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-AttachVolumeNegativeTest-1386971692 Oct 11 06:45:17.819373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Role: reader,member Oct 11 06:45:17.819373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Oct 11 06:45:17.820641 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 06:45:17.820641 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-AttachVolumeNegativeTest-1386971692 Oct 11 06:45:17.820641 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 5af47e2321de4d299ff3a7fb3d3d9e3c Oct 11 06:45:17.820641 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1386971692 Oct 11 06:45:17.820641 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User: tempest-AttachVolumeNegativeTest-1386971692-project Oct 11 06:45:17.820641 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Oct 11 06:45:17.820641 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Oct 11 06:45:17.820641 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Id: 2e63c3f83f3d41018e6330f26ed7b8a0 Oct 11 06:45:17.820641 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-AttachVolumeNegativeTest-1386971692-project Oct 11 06:45:17.820641 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: method: > Oct 11 06:45:17.820641 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: exception: Instance fe4c25ff-9873-41dc-8396-d4af6cecd1f8 could not be found. Oct 11 06:45:17.820641 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: action_args: {'id': 'fe4c25ff-9873-41dc-8396-d4af6cecd1f8'} Oct 11 06:45:17.821341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 06:45:17.821341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:45:17.821341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 06:45:17.821341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 06:45:17.821341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 06:45:17.821341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 06:45:17.821341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 06:45:17.821341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 06:45:17.821341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 06:45:17.821341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 06:45:17.821341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe4c25ff-9873-41dc-8396-d4af6cecd1f8 could not be found. Oct 11 06:45:17.821341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 06:45:17.821341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:45:17.821341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 06:45:17.821341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:45:17.821341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:45:17.821341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:45:17.821341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 06:45:17.821341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 06:45:17.821341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 06:45:17.822827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 06:45:17.822827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 06:45:17.822827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 06:45:17.822827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 06:45:17.822827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 06:45:17.822827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 06:45:17.822827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 06:45:17.822827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe4c25ff-9873-41dc-8396-d4af6cecd1f8 could not be found. Oct 11 06:45:17.822827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 06:45:17.822827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:45:17.822827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 06:45:17.822827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:45:17.822827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:45:17.822827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:45:17.822827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 06:45:17.822827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 06:45:17.822827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe4c25ff-9873-41dc-8396-d4af6cecd1f8 could not be found. Oct 11 06:45:17.822827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 06:45:17.823862 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-034f093b-dc86-479f-b125-e9d81d565dce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Returning 404 to user: Instance fe4c25ff-9873-41dc-8396-d4af6cecd1f8 could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 06:45:17.823862 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-034f093b-dc86-479f-b125-e9d81d565dce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8" status: 404 len: 111 microversion: 2.1 time: 0.030185 Oct 11 06:45:17.823862 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 277/599] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:45:17 2022] GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 06:45:17.829679 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-012f11ce-1be1-4150-9973-3d30aa865580 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '.version_select at 0x7f8e26d81f70>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:17.839134 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bbb581d9-787a-4c27-99d4-2a4f523cc1f9 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a6c4a5e3f94f1c932fd3210ae9bf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0cbe1cb0974454a2c4c7cbde3681e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:17.846971 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bbb581d9-787a-4c27-99d4-2a4f523cc1f9 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 200 len: 1464 microversion: 2.1 time: 0.152843 Oct 11 06:45:17.847710 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 323/600] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:45:17 2022] GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 1464 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:45:17.850988 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-012f11ce-1be1-4150-9973-3d30aa865580 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-379756893" status: 202 len: 0 microversion: 2.1 time: 0.024452 Oct 11 06:45:17.851723 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 278/601] 10.222.0.39 () {58 vars in 1218 bytes} [Tue Oct 11 06:45:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-379756893 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 06:45:17.894439 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-540d142f-8728-40c0-984e-ea70e929ec43 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:17.894847 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-540d142f-8728-40c0-984e-ea70e929ec43 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:17.901620 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-540d142f-8728-40c0-984e-ea70e929ec43 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:17.902112 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-540d142f-8728-40c0-984e-ea70e929ec43 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:17.902796 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-540d142f-8728-40c0-984e-ea70e929ec43 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:17.903529 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-540d142f-8728-40c0-984e-ea70e929ec43 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:17.904004 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-540d142f-8728-40c0-984e-ea70e929ec43 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:17.904417 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-540d142f-8728-40c0-984e-ea70e929ec43 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:17.931776 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-540d142f-8728-40c0-984e-ea70e929ec43 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Going to try to terminate instance {{(pid=125266) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 06:45:18.008276 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-540d142f-8728-40c0-984e-ea70e929ec43 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 204 len: 0 microversion: 2.1 time: 0.118012 Oct 11 06:45:18.009472 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 324/602] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Oct 11 06:45:17 2022] DELETE /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 06:45:18.020424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7e073eeb-224f-43ec-af1a-fbcfe2607014 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:18.020424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7e073eeb-224f-43ec-af1a-fbcfe2607014 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:18.027833 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7e073eeb-224f-43ec-af1a-fbcfe2607014 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:18.028330 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7e073eeb-224f-43ec-af1a-fbcfe2607014 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:18.028826 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7e073eeb-224f-43ec-af1a-fbcfe2607014 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:18.029538 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7e073eeb-224f-43ec-af1a-fbcfe2607014 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:18.030042 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7e073eeb-224f-43ec-af1a-fbcfe2607014 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:18.030471 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7e073eeb-224f-43ec-af1a-fbcfe2607014 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:18.167045 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7e073eeb-224f-43ec-af1a-fbcfe2607014 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a6c4a5e3f94f1c932fd3210ae9bf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0cbe1cb0974454a2c4c7cbde3681e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:18.175049 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7e073eeb-224f-43ec-af1a-fbcfe2607014 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 200 len: 1470 microversion: 2.1 time: 0.161434 Oct 11 06:45:18.175634 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 279/603] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:45:18 2022] GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 1470 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:45:18.519722 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-34bc9be4-344a-42b1-bcee-e62d2f67d12c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:18.520301 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-34bc9be4-344a-42b1-bcee-e62d2f67d12c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:18.526691 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-34bc9be4-344a-42b1-bcee-e62d2f67d12c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:18.527438 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-34bc9be4-344a-42b1-bcee-e62d2f67d12c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:18.528053 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-34bc9be4-344a-42b1-bcee-e62d2f67d12c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:18.528740 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-34bc9be4-344a-42b1-bcee-e62d2f67d12c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:18.529190 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-34bc9be4-344a-42b1-bcee-e62d2f67d12c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:18.529611 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-34bc9be4-344a-42b1-bcee-e62d2f67d12c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:18.634838 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.objects.instance [None req-34bc9be4-344a-42b1-bcee-e62d2f67d12c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lazy-loading 'services' on Instance uuid a2ce136a-30ab-4986-931e-5af38b37875e {{(pid=125266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 06:45:18.703465 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-34bc9be4-344a-42b1-bcee-e62d2f67d12c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments/1f0cf8e2-9a0e-4e89-a630-1b108c7ea64f" status: 202 len: 0 microversion: 2.1 time: 0.187911 Oct 11 06:45:18.704091 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 325/604] 10.222.0.39 () {58 vars in 1416 bytes} [Tue Oct 11 06:45:18 2022] DELETE /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments/1f0cf8e2-9a0e-4e89-a630-1b108c7ea64f => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 06:45:18.712855 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ed6aaf4a-d3c0-40c4-8cba-06d4648c68a1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:18.714993 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ed6aaf4a-d3c0-40c4-8cba-06d4648c68a1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:18.721336 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ed6aaf4a-d3c0-40c4-8cba-06d4648c68a1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:18.721807 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ed6aaf4a-d3c0-40c4-8cba-06d4648c68a1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:18.722239 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ed6aaf4a-d3c0-40c4-8cba-06d4648c68a1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:18.722918 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ed6aaf4a-d3c0-40c4-8cba-06d4648c68a1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:18.723400 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ed6aaf4a-d3c0-40c4-8cba-06d4648c68a1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:18.723838 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ed6aaf4a-d3c0-40c4-8cba-06d4648c68a1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:18.751984 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ed6aaf4a-d3c0-40c4-8cba-06d4648c68a1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043617 Oct 11 06:45:18.752519 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 280/605] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:18 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:19.198931 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-19b38074-6851-4e10-a3b2-897530607b7f tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:19.199580 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-19b38074-6851-4e10-a3b2-897530607b7f tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:19.205977 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-19b38074-6851-4e10-a3b2-897530607b7f tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:19.206447 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-19b38074-6851-4e10-a3b2-897530607b7f tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:19.206868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-19b38074-6851-4e10-a3b2-897530607b7f tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:19.207585 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-19b38074-6851-4e10-a3b2-897530607b7f tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:19.208027 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-19b38074-6851-4e10-a3b2-897530607b7f tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:19.208439 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-19b38074-6851-4e10-a3b2-897530607b7f tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:19.337259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-19b38074-6851-4e10-a3b2-897530607b7f tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a6c4a5e3f94f1c932fd3210ae9bf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0cbe1cb0974454a2c4c7cbde3681e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:19.344999 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-19b38074-6851-4e10-a3b2-897530607b7f tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 200 len: 1470 microversion: 2.1 time: 0.150888 Oct 11 06:45:19.345549 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 326/606] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:45:19 2022] GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:45:19.765123 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d9063817-85e5-4898-a8e3-15ca7223d512 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:19.767155 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d9063817-85e5-4898-a8e3-15ca7223d512 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:19.773999 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d9063817-85e5-4898-a8e3-15ca7223d512 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:19.774470 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d9063817-85e5-4898-a8e3-15ca7223d512 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:19.774895 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d9063817-85e5-4898-a8e3-15ca7223d512 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:19.775633 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d9063817-85e5-4898-a8e3-15ca7223d512 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:19.776076 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d9063817-85e5-4898-a8e3-15ca7223d512 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:19.776514 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d9063817-85e5-4898-a8e3-15ca7223d512 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:19.805661 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d9063817-85e5-4898-a8e3-15ca7223d512 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044582 Oct 11 06:45:19.806192 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 281/607] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:19 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:20.262657 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-2a07a850-d3c7-4374-889d-1f49563ecece req-711cbaba-da4f-4b26-8c94-53972bbea134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0345c1d0-58f8-4679-a1a9-b988bf99ca8e", "name": "network-vif-deleted", "tag": "5a48b8cc-ea4e-4438-b38a-c18676c05888"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:45:20.276468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-2a07a850-d3c7-4374-889d-1f49563ecece req-711cbaba-da4f-4b26-8c94-53972bbea134 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:20.277011 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-2a07a850-d3c7-4374-889d-1f49563ecece req-711cbaba-da4f-4b26-8c94-53972bbea134 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:20.277771 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-2a07a850-d3c7-4374-889d-1f49563ecece req-711cbaba-da4f-4b26-8c94-53972bbea134 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:20.292253 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-2a07a850-d3c7-4374-889d-1f49563ecece req-711cbaba-da4f-4b26-8c94-53972bbea134 service nova] Creating event network-vif-deleted:5a48b8cc-ea4e-4438-b38a-c18676c05888 for instance 0345c1d0-58f8-4679-a1a9-b988bf99ca8e on hv-cinder-85495 Oct 11 06:45:20.298407 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-2a07a850-d3c7-4374-889d-1f49563ecece req-711cbaba-da4f-4b26-8c94-53972bbea134 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038685 Oct 11 06:45:20.299240 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 327/608] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:20.369130 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-78adfb0b-a243-4e10-a3f4-21d55eafea27 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:20.369908 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-78adfb0b-a243-4e10-a3f4-21d55eafea27 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:20.376825 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78adfb0b-a243-4e10-a3f4-21d55eafea27 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:20.377521 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78adfb0b-a243-4e10-a3f4-21d55eafea27 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:20.378184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78adfb0b-a243-4e10-a3f4-21d55eafea27 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:20.379490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78adfb0b-a243-4e10-a3f4-21d55eafea27 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:20.379935 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78adfb0b-a243-4e10-a3f4-21d55eafea27 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:20.380320 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78adfb0b-a243-4e10-a3f4-21d55eafea27 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:20.411610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78adfb0b-a243-4e10-a3f4-21d55eafea27 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:20.412099 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78adfb0b-a243-4e10-a3f4-21d55eafea27 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:20.412562 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78adfb0b-a243-4e10-a3f4-21d55eafea27 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:20.413003 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-78adfb0b-a243-4e10-a3f4-21d55eafea27 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lazy-loading 'fault' on Instance uuid 0345c1d0-58f8-4679-a1a9-b988bf99ca8e {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 06:45:20.454809 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-78adfb0b-a243-4e10-a3f4-21d55eafea27 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a6c4a5e3f94f1c932fd3210ae9bf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0cbe1cb0974454a2c4c7cbde3681e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:45:20.462581 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-78adfb0b-a243-4e10-a3f4-21d55eafea27 tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 200 len: 1304 microversion: 2.1 time: 0.098056 Oct 11 06:45:20.463137 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 282/609] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:45:20 2022] GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:45:20.818742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-02942b52-8e43-4941-909f-4d7347286a0d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:20.821008 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-02942b52-8e43-4941-909f-4d7347286a0d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:20.827167 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02942b52-8e43-4941-909f-4d7347286a0d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:20.827678 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02942b52-8e43-4941-909f-4d7347286a0d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:20.828103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02942b52-8e43-4941-909f-4d7347286a0d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:20.828783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02942b52-8e43-4941-909f-4d7347286a0d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:20.829220 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02942b52-8e43-4941-909f-4d7347286a0d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:20.829632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02942b52-8e43-4941-909f-4d7347286a0d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:20.858087 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-02942b52-8e43-4941-909f-4d7347286a0d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043949 Oct 11 06:45:20.858612 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 328/610] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:20 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:21.485772 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e8a7eab4-2caa-4106-a600-0c3a904da0bb tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:21.486308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e8a7eab4-2caa-4106-a600-0c3a904da0bb tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] [instance: 0345c1d0-58f8-4679-a1a9-b988bf99ca8e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:21.492706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e8a7eab4-2caa-4106-a600-0c3a904da0bb tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:21.493180 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e8a7eab4-2caa-4106-a600-0c3a904da0bb tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:21.493608 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e8a7eab4-2caa-4106-a600-0c3a904da0bb tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:21.494305 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e8a7eab4-2caa-4106-a600-0c3a904da0bb tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:21.494753 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e8a7eab4-2caa-4106-a600-0c3a904da0bb tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:21.495172 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e8a7eab4-2caa-4106-a600-0c3a904da0bb tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:21.508787 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-e8a7eab4-2caa-4106-a600-0c3a904da0bb tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] HTTP exception thrown: Instance 0345c1d0-58f8-4679-a1a9-b988bf99ca8e could not be found. Oct 11 06:45:21.510308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e8a7eab4-2caa-4106-a600-0c3a904da0bb tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Request method failure captured: Oct 11 06:45:21.510308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: request: GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e HTTP/1.1 Oct 11 06:45:21.510308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept: application/json Oct 11 06:45:21.510308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Oct 11 06:45:21.510308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Connection: close Oct 11 06:45:21.510308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Length: 0 Oct 11 06:45:21.510308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Type: application/json Oct 11 06:45:21.510308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Host: 10.222.0.39 Oct 11 06:45:21.510308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Oct 11 06:45:21.510308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.12 Oct 11 06:45:21.510308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABjRRDXgYOmsI-3tIA_mHRKPV99HKPMNow8Di2AQWy9v-VznuhvrqVr09YETStLlssxdI4E9JKguAM_aprbncHu2MhR3sxDue2qb94r5siYzkpO6FihE1claU6Ee6rFg7adFg4dbNZYPIxpAO6GzWOhysu01w6Elzb8vjvg5Py_n7UJNqI Oct 11 06:45:21.510308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Oct 11 06:45:21.510308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Oct 11 06:45:21.510308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Oct 11 06:45:21.510308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Oct 11 06:45:21.510308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Oct 11 06:45:21.510308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Oct 11 06:45:21.510308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Id: 8c0cbe1cb0974454a2c4c7cbde3681e8 Oct 11 06:45:21.510308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-VolumesNegativeTest-1399112846 Oct 11 06:45:21.510308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Role: reader,member Oct 11 06:45:21.510308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Oct 11 06:45:21.511807 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8c0cbe1cb0974454a2c4c7cbde3681e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8c0cbe1cb0974454a2c4c7cbde3681e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8c0cbe1cb0974454a2c4c7cbde3681e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8c0cbe1cb0974454a2c4c7cbde3681e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 06:45:21.511807 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-VolumesNegativeTest-1399112846 Oct 11 06:45:21.511807 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 8c0cbe1cb0974454a2c4c7cbde3681e8 Oct 11 06:45:21.511807 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-VolumesNegativeTest-1399112846 Oct 11 06:45:21.511807 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User: tempest-VolumesNegativeTest-1399112846-project Oct 11 06:45:21.511807 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Oct 11 06:45:21.511807 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Oct 11 06:45:21.511807 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Id: 66a6c4a5e3f94f1c932fd3210ae9bf05 Oct 11 06:45:21.511807 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-VolumesNegativeTest-1399112846-project Oct 11 06:45:21.511807 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: method: > Oct 11 06:45:21.511807 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: exception: Instance 0345c1d0-58f8-4679-a1a9-b988bf99ca8e could not be found. Oct 11 06:45:21.511807 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: action_args: {'id': '0345c1d0-58f8-4679-a1a9-b988bf99ca8e'} Oct 11 06:45:21.512865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 06:45:21.512865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:45:21.512865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 06:45:21.512865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 06:45:21.512865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 06:45:21.512865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 06:45:21.512865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 06:45:21.512865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 06:45:21.512865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 06:45:21.512865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 06:45:21.512865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0345c1d0-58f8-4679-a1a9-b988bf99ca8e could not be found. Oct 11 06:45:21.512865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 06:45:21.512865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:45:21.512865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 06:45:21.512865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:45:21.512865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:45:21.512865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:45:21.512865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 06:45:21.512865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 06:45:21.512865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 06:45:21.514296 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 06:45:21.514296 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 06:45:21.514296 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 06:45:21.514296 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 06:45:21.514296 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 06:45:21.514296 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 06:45:21.514296 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 06:45:21.514296 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0345c1d0-58f8-4679-a1a9-b988bf99ca8e could not be found. Oct 11 06:45:21.514296 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 06:45:21.514296 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:45:21.514296 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 06:45:21.514296 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:45:21.514296 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:45:21.514296 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:45:21.514296 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 06:45:21.514296 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 06:45:21.514296 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0345c1d0-58f8-4679-a1a9-b988bf99ca8e could not be found. Oct 11 06:45:21.514296 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 06:45:21.515738 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e8a7eab4-2caa-4106-a600-0c3a904da0bb tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] Returning 404 to user: Instance 0345c1d0-58f8-4679-a1a9-b988bf99ca8e could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 06:45:21.515738 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e8a7eab4-2caa-4106-a600-0c3a904da0bb tempest-VolumesNegativeTest-1399112846 tempest-VolumesNegativeTest-1399112846-project] 10.222.0.39 "GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e" status: 404 len: 111 microversion: 2.1 time: 0.029906 Oct 11 06:45:21.515738 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 283/611] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:45:21 2022] GET /compute/v2.1/servers/0345c1d0-58f8-4679-a1a9-b988bf99ca8e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 06:45:21.870597 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f711c557-27d1-4b07-8089-02e1b5bda4d7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:21.873314 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f711c557-27d1-4b07-8089-02e1b5bda4d7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:21.875809 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:45:21.880993 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f711c557-27d1-4b07-8089-02e1b5bda4d7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:21.882064 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f711c557-27d1-4b07-8089-02e1b5bda4d7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:21.882836 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f711c557-27d1-4b07-8089-02e1b5bda4d7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:21.883550 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f711c557-27d1-4b07-8089-02e1b5bda4d7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:21.883992 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f711c557-27d1-4b07-8089-02e1b5bda4d7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:21.884403 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f711c557-27d1-4b07-8089-02e1b5bda4d7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:21.915663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f711c557-27d1-4b07-8089-02e1b5bda4d7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048632 Oct 11 06:45:21.916289 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 329/612] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:21 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:22.929097 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6a671df4-b35d-4c49-b9ec-f970bdba0383 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:22.932080 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6a671df4-b35d-4c49-b9ec-f970bdba0383 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:22.939018 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6a671df4-b35d-4c49-b9ec-f970bdba0383 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:22.939716 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6a671df4-b35d-4c49-b9ec-f970bdba0383 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:22.940315 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6a671df4-b35d-4c49-b9ec-f970bdba0383 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:22.942059 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6a671df4-b35d-4c49-b9ec-f970bdba0383 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:22.946476 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6a671df4-b35d-4c49-b9ec-f970bdba0383 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:22.947907 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6a671df4-b35d-4c49-b9ec-f970bdba0383 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:22.980639 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6a671df4-b35d-4c49-b9ec-f970bdba0383 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056517 Oct 11 06:45:22.981188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 284/613] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:22 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:23.993386 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d7426dd3-70b5-4262-a74c-d7f476baf836 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:23.995688 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d7426dd3-70b5-4262-a74c-d7f476baf836 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:24.002271 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7426dd3-70b5-4262-a74c-d7f476baf836 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:24.002875 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7426dd3-70b5-4262-a74c-d7f476baf836 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:24.003320 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7426dd3-70b5-4262-a74c-d7f476baf836 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:24.004126 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7426dd3-70b5-4262-a74c-d7f476baf836 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:24.004714 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7426dd3-70b5-4262-a74c-d7f476baf836 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:24.005176 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7426dd3-70b5-4262-a74c-d7f476baf836 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:24.052127 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d7426dd3-70b5-4262-a74c-d7f476baf836 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063775 Oct 11 06:45:24.052682 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 330/614] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:23 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:25.064389 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d5cabc60-3e47-4219-91ee-6b724a311732 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:25.066603 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d5cabc60-3e47-4219-91ee-6b724a311732 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:25.073082 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d5cabc60-3e47-4219-91ee-6b724a311732 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:25.073875 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d5cabc60-3e47-4219-91ee-6b724a311732 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:25.074005 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d5cabc60-3e47-4219-91ee-6b724a311732 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:25.074651 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d5cabc60-3e47-4219-91ee-6b724a311732 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:25.075097 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d5cabc60-3e47-4219-91ee-6b724a311732 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:25.075536 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d5cabc60-3e47-4219-91ee-6b724a311732 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:25.106561 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d5cabc60-3e47-4219-91ee-6b724a311732 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046038 Oct 11 06:45:25.107122 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 285/615] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:25 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:26.119132 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cf27f3f0-dce1-4b5d-b2f0-6f17f06a67c5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:26.121283 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cf27f3f0-dce1-4b5d-b2f0-6f17f06a67c5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:26.127727 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf27f3f0-dce1-4b5d-b2f0-6f17f06a67c5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:26.128200 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf27f3f0-dce1-4b5d-b2f0-6f17f06a67c5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:26.128625 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf27f3f0-dce1-4b5d-b2f0-6f17f06a67c5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:26.129308 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf27f3f0-dce1-4b5d-b2f0-6f17f06a67c5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:26.129745 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf27f3f0-dce1-4b5d-b2f0-6f17f06a67c5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:26.130159 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf27f3f0-dce1-4b5d-b2f0-6f17f06a67c5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:26.160266 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cf27f3f0-dce1-4b5d-b2f0-6f17f06a67c5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045539 Oct 11 06:45:26.160821 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 331/616] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:26 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:27.173145 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5e1c1e4a-0c02-40bf-9a2a-4ca5e94498af tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:27.175283 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5e1c1e4a-0c02-40bf-9a2a-4ca5e94498af tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:27.182139 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5e1c1e4a-0c02-40bf-9a2a-4ca5e94498af tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:27.182621 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5e1c1e4a-0c02-40bf-9a2a-4ca5e94498af tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:27.183049 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5e1c1e4a-0c02-40bf-9a2a-4ca5e94498af tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:27.183768 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5e1c1e4a-0c02-40bf-9a2a-4ca5e94498af tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:27.184215 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5e1c1e4a-0c02-40bf-9a2a-4ca5e94498af tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:27.184638 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5e1c1e4a-0c02-40bf-9a2a-4ca5e94498af tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:27.216268 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5e1c1e4a-0c02-40bf-9a2a-4ca5e94498af tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047047 Oct 11 06:45:27.216982 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 286/617] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:27 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:28.229070 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-53ba556c-84ec-498e-9722-41b2d510db71 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:28.231749 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-53ba556c-84ec-498e-9722-41b2d510db71 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:28.238138 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-53ba556c-84ec-498e-9722-41b2d510db71 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:28.238630 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-53ba556c-84ec-498e-9722-41b2d510db71 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:28.239042 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-53ba556c-84ec-498e-9722-41b2d510db71 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:28.239857 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-53ba556c-84ec-498e-9722-41b2d510db71 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:28.240219 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-53ba556c-84ec-498e-9722-41b2d510db71 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:28.240634 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-53ba556c-84ec-498e-9722-41b2d510db71 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:28.276622 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-53ba556c-84ec-498e-9722-41b2d510db71 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051735 Oct 11 06:45:28.277618 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 332/618] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:28 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:29.289075 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6f99d1d0-db4f-404e-af43-c817d230d2b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:29.291220 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6f99d1d0-db4f-404e-af43-c817d230d2b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:29.297609 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6f99d1d0-db4f-404e-af43-c817d230d2b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:29.298084 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6f99d1d0-db4f-404e-af43-c817d230d2b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:29.298511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6f99d1d0-db4f-404e-af43-c817d230d2b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:29.299198 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6f99d1d0-db4f-404e-af43-c817d230d2b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:29.299746 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6f99d1d0-db4f-404e-af43-c817d230d2b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:29.300078 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6f99d1d0-db4f-404e-af43-c817d230d2b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:29.337961 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6f99d1d0-db4f-404e-af43-c817d230d2b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052729 Oct 11 06:45:29.338695 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 287/619] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:29 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:30.350105 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-37b074b1-d8d9-471a-9794-f6b137825d40 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:30.352269 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-37b074b1-d8d9-471a-9794-f6b137825d40 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:30.358831 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-37b074b1-d8d9-471a-9794-f6b137825d40 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:30.359315 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-37b074b1-d8d9-471a-9794-f6b137825d40 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:30.359805 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-37b074b1-d8d9-471a-9794-f6b137825d40 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:30.360453 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-37b074b1-d8d9-471a-9794-f6b137825d40 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:30.360907 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-37b074b1-d8d9-471a-9794-f6b137825d40 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:30.361326 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-37b074b1-d8d9-471a-9794-f6b137825d40 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:30.391473 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-37b074b1-d8d9-471a-9794-f6b137825d40 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045237 Oct 11 06:45:30.392030 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 333/620] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:30 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:31.405576 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6c8a7c37-3030-4a86-959e-c979ea1d724d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:31.407826 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6c8a7c37-3030-4a86-959e-c979ea1d724d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:31.415137 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c8a7c37-3030-4a86-959e-c979ea1d724d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:31.415772 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c8a7c37-3030-4a86-959e-c979ea1d724d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:31.416095 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c8a7c37-3030-4a86-959e-c979ea1d724d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:31.416798 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c8a7c37-3030-4a86-959e-c979ea1d724d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:31.417257 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c8a7c37-3030-4a86-959e-c979ea1d724d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:31.417681 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c8a7c37-3030-4a86-959e-c979ea1d724d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:31.448403 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6c8a7c37-3030-4a86-959e-c979ea1d724d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048767 Oct 11 06:45:31.449116 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 288/621] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:31 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:32.460943 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-036f45bd-8a3a-4590-8316-177ca5cce518 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:32.463246 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-036f45bd-8a3a-4590-8316-177ca5cce518 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:32.469177 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-036f45bd-8a3a-4590-8316-177ca5cce518 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:32.469652 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-036f45bd-8a3a-4590-8316-177ca5cce518 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:32.470085 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-036f45bd-8a3a-4590-8316-177ca5cce518 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:32.470773 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-036f45bd-8a3a-4590-8316-177ca5cce518 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:32.471227 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-036f45bd-8a3a-4590-8316-177ca5cce518 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:32.471674 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-036f45bd-8a3a-4590-8316-177ca5cce518 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:32.511824 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-036f45bd-8a3a-4590-8316-177ca5cce518 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044857 Oct 11 06:45:32.511824 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 334/622] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:32 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:33.514076 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6b4c6d53-380b-4a74-a741-45be126d2c0a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:33.516226 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6b4c6d53-380b-4a74-a741-45be126d2c0a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:33.523143 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6b4c6d53-380b-4a74-a741-45be126d2c0a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:33.523660 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6b4c6d53-380b-4a74-a741-45be126d2c0a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:33.524090 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6b4c6d53-380b-4a74-a741-45be126d2c0a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:33.524786 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6b4c6d53-380b-4a74-a741-45be126d2c0a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:33.525235 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6b4c6d53-380b-4a74-a741-45be126d2c0a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:33.525659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6b4c6d53-380b-4a74-a741-45be126d2c0a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:33.555946 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6b4c6d53-380b-4a74-a741-45be126d2c0a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045799 Oct 11 06:45:33.560373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 289/623] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:33 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:34.568391 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8563779e-a05d-45ad-b6a0-bceecfeca833 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:34.570596 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8563779e-a05d-45ad-b6a0-bceecfeca833 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:34.577041 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8563779e-a05d-45ad-b6a0-bceecfeca833 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:34.577552 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8563779e-a05d-45ad-b6a0-bceecfeca833 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:34.577974 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8563779e-a05d-45ad-b6a0-bceecfeca833 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:34.578659 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8563779e-a05d-45ad-b6a0-bceecfeca833 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:34.579108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8563779e-a05d-45ad-b6a0-bceecfeca833 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:34.579553 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8563779e-a05d-45ad-b6a0-bceecfeca833 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:34.609706 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8563779e-a05d-45ad-b6a0-bceecfeca833 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045797 Oct 11 06:45:34.610275 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 335/624] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:34 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:35.623942 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8787baae-b111-4122-a0ac-3be5196dc307 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:35.626058 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8787baae-b111-4122-a0ac-3be5196dc307 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:35.628645 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:45:35.635770 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8787baae-b111-4122-a0ac-3be5196dc307 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:35.636261 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8787baae-b111-4122-a0ac-3be5196dc307 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:35.636970 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8787baae-b111-4122-a0ac-3be5196dc307 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:35.637379 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8787baae-b111-4122-a0ac-3be5196dc307 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:35.637828 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8787baae-b111-4122-a0ac-3be5196dc307 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:35.638248 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8787baae-b111-4122-a0ac-3be5196dc307 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:35.669597 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8787baae-b111-4122-a0ac-3be5196dc307 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049552 Oct 11 06:45:35.670167 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 290/625] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:35 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:36.682021 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a94d8625-5a53-4ade-8709-478d98828d9d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:36.684103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a94d8625-5a53-4ade-8709-478d98828d9d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:36.690752 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a94d8625-5a53-4ade-8709-478d98828d9d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:36.690938 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a94d8625-5a53-4ade-8709-478d98828d9d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:36.691360 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a94d8625-5a53-4ade-8709-478d98828d9d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:36.692066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a94d8625-5a53-4ade-8709-478d98828d9d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:36.693432 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a94d8625-5a53-4ade-8709-478d98828d9d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:36.693432 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a94d8625-5a53-4ade-8709-478d98828d9d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:36.722934 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a94d8625-5a53-4ade-8709-478d98828d9d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044877 Oct 11 06:45:36.723505 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 336/626] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:36 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:37.734954 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4804cd22-e58b-4aa4-b0e2-30b7a7deed1d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:37.737073 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4804cd22-e58b-4aa4-b0e2-30b7a7deed1d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:37.743994 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4804cd22-e58b-4aa4-b0e2-30b7a7deed1d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:37.744495 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4804cd22-e58b-4aa4-b0e2-30b7a7deed1d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:37.744922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4804cd22-e58b-4aa4-b0e2-30b7a7deed1d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:37.745604 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4804cd22-e58b-4aa4-b0e2-30b7a7deed1d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:37.746047 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4804cd22-e58b-4aa4-b0e2-30b7a7deed1d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:37.746461 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4804cd22-e58b-4aa4-b0e2-30b7a7deed1d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:37.775697 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4804cd22-e58b-4aa4-b0e2-30b7a7deed1d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044721 Oct 11 06:45:37.776244 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 291/627] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:37 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:38.788313 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b0dac28c-2d7e-4068-9927-98f9988cc597 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:38.790345 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b0dac28c-2d7e-4068-9927-98f9988cc597 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:38.796925 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b0dac28c-2d7e-4068-9927-98f9988cc597 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:38.797403 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b0dac28c-2d7e-4068-9927-98f9988cc597 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:38.797834 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b0dac28c-2d7e-4068-9927-98f9988cc597 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:38.798524 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b0dac28c-2d7e-4068-9927-98f9988cc597 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:38.798972 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b0dac28c-2d7e-4068-9927-98f9988cc597 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:38.799396 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b0dac28c-2d7e-4068-9927-98f9988cc597 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:38.829015 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b0dac28c-2d7e-4068-9927-98f9988cc597 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044665 Oct 11 06:45:38.829577 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 337/628] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:38 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:39.842299 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5392865a-a10a-4b67-8735-335ddc97b7c9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:39.844464 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5392865a-a10a-4b67-8735-335ddc97b7c9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:39.851386 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5392865a-a10a-4b67-8735-335ddc97b7c9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:39.851894 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5392865a-a10a-4b67-8735-335ddc97b7c9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:39.852323 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5392865a-a10a-4b67-8735-335ddc97b7c9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:39.853011 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5392865a-a10a-4b67-8735-335ddc97b7c9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:39.853461 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5392865a-a10a-4b67-8735-335ddc97b7c9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:39.853876 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5392865a-a10a-4b67-8735-335ddc97b7c9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:39.882645 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5392865a-a10a-4b67-8735-335ddc97b7c9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044454 Oct 11 06:45:39.883192 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 292/629] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:39 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:40.894994 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-42f67a2c-fb21-40da-a519-14e2f8ca43b0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:40.897213 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-42f67a2c-fb21-40da-a519-14e2f8ca43b0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:40.904018 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42f67a2c-fb21-40da-a519-14e2f8ca43b0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:40.904498 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42f67a2c-fb21-40da-a519-14e2f8ca43b0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:40.904934 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42f67a2c-fb21-40da-a519-14e2f8ca43b0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:40.905617 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42f67a2c-fb21-40da-a519-14e2f8ca43b0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:40.906065 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42f67a2c-fb21-40da-a519-14e2f8ca43b0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:40.906484 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42f67a2c-fb21-40da-a519-14e2f8ca43b0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:40.923362 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:45:40.938977 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-42f67a2c-fb21-40da-a519-14e2f8ca43b0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047952 Oct 11 06:45:40.939558 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 338/630] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:40 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:41.952122 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d7ab70fc-deae-4b29-a6c7-330716220e88 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:41.954241 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d7ab70fc-deae-4b29-a6c7-330716220e88 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:41.961152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d7ab70fc-deae-4b29-a6c7-330716220e88 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:41.961630 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d7ab70fc-deae-4b29-a6c7-330716220e88 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:41.962067 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d7ab70fc-deae-4b29-a6c7-330716220e88 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:41.962760 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d7ab70fc-deae-4b29-a6c7-330716220e88 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:41.963209 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d7ab70fc-deae-4b29-a6c7-330716220e88 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:41.963659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d7ab70fc-deae-4b29-a6c7-330716220e88 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:41.993058 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d7ab70fc-deae-4b29-a6c7-330716220e88 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044949 Oct 11 06:45:41.993798 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 293/631] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:41 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:43.005766 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a05bf879-b326-42ee-a551-e812ff35c9ca tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:43.007968 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a05bf879-b326-42ee-a551-e812ff35c9ca tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:43.014406 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a05bf879-b326-42ee-a551-e812ff35c9ca tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:43.014878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a05bf879-b326-42ee-a551-e812ff35c9ca tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:43.015308 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a05bf879-b326-42ee-a551-e812ff35c9ca tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:43.016022 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a05bf879-b326-42ee-a551-e812ff35c9ca tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:43.016466 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a05bf879-b326-42ee-a551-e812ff35c9ca tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:43.016881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a05bf879-b326-42ee-a551-e812ff35c9ca tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:43.046374 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a05bf879-b326-42ee-a551-e812ff35c9ca tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044757 Oct 11 06:45:43.046932 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 339/632] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:43 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:44.058091 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1bad6a5b-e11b-4278-99a2-7e2f058df980 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:44.060285 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1bad6a5b-e11b-4278-99a2-7e2f058df980 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:44.066760 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1bad6a5b-e11b-4278-99a2-7e2f058df980 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:44.067234 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1bad6a5b-e11b-4278-99a2-7e2f058df980 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:44.067699 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1bad6a5b-e11b-4278-99a2-7e2f058df980 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:44.068889 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1bad6a5b-e11b-4278-99a2-7e2f058df980 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:44.069330 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1bad6a5b-e11b-4278-99a2-7e2f058df980 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:44.069743 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1bad6a5b-e11b-4278-99a2-7e2f058df980 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:44.073338 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:45:44.098654 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1bad6a5b-e11b-4278-99a2-7e2f058df980 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044534 Oct 11 06:45:44.099196 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 294/633] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:44 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:45.110767 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5c537439-5fe5-4241-8399-9f0e073f445e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:45.112937 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5c537439-5fe5-4241-8399-9f0e073f445e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:45.119323 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5c537439-5fe5-4241-8399-9f0e073f445e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:45.119828 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5c537439-5fe5-4241-8399-9f0e073f445e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:45.120257 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5c537439-5fe5-4241-8399-9f0e073f445e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:45.120943 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5c537439-5fe5-4241-8399-9f0e073f445e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:45.121387 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5c537439-5fe5-4241-8399-9f0e073f445e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:45.121804 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5c537439-5fe5-4241-8399-9f0e073f445e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:45.150486 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5c537439-5fe5-4241-8399-9f0e073f445e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043602 Oct 11 06:45:45.151020 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 340/634] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:45 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:46.162519 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c7960609-93a8-451e-b194-65010b075c42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:46.164675 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c7960609-93a8-451e-b194-65010b075c42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:46.171247 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c7960609-93a8-451e-b194-65010b075c42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:46.171761 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c7960609-93a8-451e-b194-65010b075c42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:46.172187 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c7960609-93a8-451e-b194-65010b075c42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:46.172875 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c7960609-93a8-451e-b194-65010b075c42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:46.173326 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c7960609-93a8-451e-b194-65010b075c42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:46.173748 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c7960609-93a8-451e-b194-65010b075c42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:46.203696 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c7960609-93a8-451e-b194-65010b075c42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045075 Oct 11 06:45:46.204270 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 295/635] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:46 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:46.726773 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0f52c58c-4cca-4443-9936-57193dec00e4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "394a7ca1-32a2-42b7-9c73-f103fcdc9bb7"}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:45:46.729090 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0f52c58c-4cca-4443-9936-57193dec00e4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:46.735682 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0f52c58c-4cca-4443-9936-57193dec00e4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:46.736196 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0f52c58c-4cca-4443-9936-57193dec00e4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:46.736633 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0f52c58c-4cca-4443-9936-57193dec00e4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:46.737324 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0f52c58c-4cca-4443-9936-57193dec00e4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:46.737776 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0f52c58c-4cca-4443-9936-57193dec00e4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:46.738200 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0f52c58c-4cca-4443-9936-57193dec00e4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:46.994820 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0f52c58c-4cca-4443-9936-57193dec00e4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "POST /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272344 Oct 11 06:45:46.995440 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 341/636] 10.222.0.39 () {60 vars in 1323 bytes} [Tue Oct 11 06:45:46 2022] POST /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:47.216261 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4f39afe2-fb40-4aa5-84f2-7bfd6b81e649 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:47.218371 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4f39afe2-fb40-4aa5-84f2-7bfd6b81e649 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:47.225258 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4f39afe2-fb40-4aa5-84f2-7bfd6b81e649 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:47.225739 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4f39afe2-fb40-4aa5-84f2-7bfd6b81e649 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:47.226167 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4f39afe2-fb40-4aa5-84f2-7bfd6b81e649 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:47.226860 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4f39afe2-fb40-4aa5-84f2-7bfd6b81e649 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:47.227316 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4f39afe2-fb40-4aa5-84f2-7bfd6b81e649 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:47.227754 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4f39afe2-fb40-4aa5-84f2-7bfd6b81e649 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:47.258600 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4f39afe2-fb40-4aa5-84f2-7bfd6b81e649 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046195 Oct 11 06:45:47.259108 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 296/637] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:47 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:48.271079 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-20808889-1895-469c-ac08-d7fa7a41624c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:48.273488 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-20808889-1895-469c-ac08-d7fa7a41624c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:48.279853 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20808889-1895-469c-ac08-d7fa7a41624c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:48.280336 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20808889-1895-469c-ac08-d7fa7a41624c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:48.280769 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20808889-1895-469c-ac08-d7fa7a41624c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:48.281457 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20808889-1895-469c-ac08-d7fa7a41624c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:48.281942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20808889-1895-469c-ac08-d7fa7a41624c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:48.282361 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20808889-1895-469c-ac08-d7fa7a41624c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:48.311473 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-20808889-1895-469c-ac08-d7fa7a41624c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045202 Oct 11 06:45:48.312068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 342/638] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:48 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:49.324451 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-259b6929-6ad7-48fd-96a6-340f9ec02893 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:49.326494 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-259b6929-6ad7-48fd-96a6-340f9ec02893 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:49.332568 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-259b6929-6ad7-48fd-96a6-340f9ec02893 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:49.333042 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-259b6929-6ad7-48fd-96a6-340f9ec02893 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:49.333471 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-259b6929-6ad7-48fd-96a6-340f9ec02893 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:49.334156 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-259b6929-6ad7-48fd-96a6-340f9ec02893 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:49.334603 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-259b6929-6ad7-48fd-96a6-340f9ec02893 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:49.335022 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-259b6929-6ad7-48fd-96a6-340f9ec02893 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:49.365639 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-259b6929-6ad7-48fd-96a6-340f9ec02893 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045734 Oct 11 06:45:49.366179 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 297/639] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:49 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:50.377975 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-96b7ad5d-a6b4-4a05-9aed-69dbe013822b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:50.380162 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-96b7ad5d-a6b4-4a05-9aed-69dbe013822b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:50.386529 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96b7ad5d-a6b4-4a05-9aed-69dbe013822b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:50.387004 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96b7ad5d-a6b4-4a05-9aed-69dbe013822b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:50.387451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96b7ad5d-a6b4-4a05-9aed-69dbe013822b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:50.388151 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96b7ad5d-a6b4-4a05-9aed-69dbe013822b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:50.388580 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96b7ad5d-a6b4-4a05-9aed-69dbe013822b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:50.388995 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96b7ad5d-a6b4-4a05-9aed-69dbe013822b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:50.419213 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-96b7ad5d-a6b4-4a05-9aed-69dbe013822b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045156 Oct 11 06:45:50.419793 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 343/640] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:50 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:50.644736 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-14e83838-95ea-4043-a227-4a789591e5c7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:50.645276 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-14e83838-95ea-4043-a227-4a789591e5c7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:50.652986 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14e83838-95ea-4043-a227-4a789591e5c7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:50.653458 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14e83838-95ea-4043-a227-4a789591e5c7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:50.653915 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14e83838-95ea-4043-a227-4a789591e5c7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:50.654597 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14e83838-95ea-4043-a227-4a789591e5c7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:50.655046 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14e83838-95ea-4043-a227-4a789591e5c7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:50.655519 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14e83838-95ea-4043-a227-4a789591e5c7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:50.686264 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-14e83838-95ea-4043-a227-4a789591e5c7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments/373addf3-b094-4b57-b450-5dc4773b3774" status: 200 len: 194 microversion: 2.20 time: 0.045557 Oct 11 06:45:50.686833 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 298/641] 10.222.0.39 () {60 vars in 1454 bytes} [Tue Oct 11 06:45:50 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments/373addf3-b094-4b57-b450-5dc4773b3774 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:45:50.755612 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4bcef8dd-ce48-4f91-b479-c907c8929e83 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:50.756093 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4bcef8dd-ce48-4f91-b479-c907c8929e83 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:50.762840 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4bcef8dd-ce48-4f91-b479-c907c8929e83 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:50.763308 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4bcef8dd-ce48-4f91-b479-c907c8929e83 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:50.763762 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4bcef8dd-ce48-4f91-b479-c907c8929e83 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:50.764437 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4bcef8dd-ce48-4f91-b479-c907c8929e83 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:50.764877 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4bcef8dd-ce48-4f91-b479-c907c8929e83 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:50.765299 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4bcef8dd-ce48-4f91-b479-c907c8929e83 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:50.843863 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.objects.instance [None req-4bcef8dd-ce48-4f91-b479-c907c8929e83 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lazy-loading 'services' on Instance uuid 43d48211-8dab-4abd-8c95-e850b83382ff {{(pid=125266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 06:45:50.912619 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4bcef8dd-ce48-4f91-b479-c907c8929e83 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "DELETE /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments/373addf3-b094-4b57-b450-5dc4773b3774" status: 202 len: 0 microversion: 2.20 time: 0.161103 Oct 11 06:45:50.913193 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 344/642] 10.222.0.39 () {60 vars in 1457 bytes} [Tue Oct 11 06:45:50 2022] DELETE /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments/373addf3-b094-4b57-b450-5dc4773b3774 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 06:45:50.921578 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bb8a5754-bbec-4f55-876d-7c4d53db8cc1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:50.923811 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bb8a5754-bbec-4f55-876d-7c4d53db8cc1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:50.929679 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb8a5754-bbec-4f55-876d-7c4d53db8cc1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:50.930161 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb8a5754-bbec-4f55-876d-7c4d53db8cc1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:50.930588 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb8a5754-bbec-4f55-876d-7c4d53db8cc1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:50.931287 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb8a5754-bbec-4f55-876d-7c4d53db8cc1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:50.931797 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb8a5754-bbec-4f55-876d-7c4d53db8cc1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:50.932273 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb8a5754-bbec-4f55-876d-7c4d53db8cc1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:50.963341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bb8a5754-bbec-4f55-876d-7c4d53db8cc1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045761 Oct 11 06:45:50.963931 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 299/643] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:45:50 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 06:45:51.433336 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-899b6db6-7cdd-498f-82bc-f4a43484f52a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:51.435568 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-899b6db6-7cdd-498f-82bc-f4a43484f52a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:51.441754 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-899b6db6-7cdd-498f-82bc-f4a43484f52a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:51.442258 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-899b6db6-7cdd-498f-82bc-f4a43484f52a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:51.442693 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-899b6db6-7cdd-498f-82bc-f4a43484f52a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:51.443380 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-899b6db6-7cdd-498f-82bc-f4a43484f52a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:51.443856 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-899b6db6-7cdd-498f-82bc-f4a43484f52a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:51.444276 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-899b6db6-7cdd-498f-82bc-f4a43484f52a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:51.472390 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-899b6db6-7cdd-498f-82bc-f4a43484f52a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044559 Oct 11 06:45:51.472925 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 345/644] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:51 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:51.975971 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b35cae9a-e084-4be3-97a0-61c77c36276a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:51.978647 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b35cae9a-e084-4be3-97a0-61c77c36276a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:51.984985 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b35cae9a-e084-4be3-97a0-61c77c36276a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:51.985458 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b35cae9a-e084-4be3-97a0-61c77c36276a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:51.985884 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b35cae9a-e084-4be3-97a0-61c77c36276a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:51.986560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b35cae9a-e084-4be3-97a0-61c77c36276a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:51.987004 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b35cae9a-e084-4be3-97a0-61c77c36276a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:51.987434 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b35cae9a-e084-4be3-97a0-61c77c36276a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:52.015664 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b35cae9a-e084-4be3-97a0-61c77c36276a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043559 Oct 11 06:45:52.016213 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 300/645] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:45:51 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:45:52.485312 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f2ad4faf-4998-4cf1-a9e9-14f3177edc72 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:52.487435 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f2ad4faf-4998-4cf1-a9e9-14f3177edc72 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:52.489824 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=34 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:45:52.495073 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f2ad4faf-4998-4cf1-a9e9-14f3177edc72 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:52.495581 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f2ad4faf-4998-4cf1-a9e9-14f3177edc72 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:52.496013 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f2ad4faf-4998-4cf1-a9e9-14f3177edc72 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:52.496699 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f2ad4faf-4998-4cf1-a9e9-14f3177edc72 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:52.497144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f2ad4faf-4998-4cf1-a9e9-14f3177edc72 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:52.497562 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f2ad4faf-4998-4cf1-a9e9-14f3177edc72 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:52.527122 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f2ad4faf-4998-4cf1-a9e9-14f3177edc72 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045702 Oct 11 06:45:52.527696 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 346/646] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:52 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:53.028628 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1c360d56-101a-4068-8dd0-4b26991a36d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:53.030763 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1c360d56-101a-4068-8dd0-4b26991a36d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:53.037092 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c360d56-101a-4068-8dd0-4b26991a36d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:53.037560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c360d56-101a-4068-8dd0-4b26991a36d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:53.037980 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c360d56-101a-4068-8dd0-4b26991a36d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:53.039200 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c360d56-101a-4068-8dd0-4b26991a36d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:53.039674 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c360d56-101a-4068-8dd0-4b26991a36d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:53.040089 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c360d56-101a-4068-8dd0-4b26991a36d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:53.068925 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1c360d56-101a-4068-8dd0-4b26991a36d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044575 Oct 11 06:45:53.069455 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 301/647] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:45:53 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:45:53.538557 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5c8a8197-d7cd-4e80-9723-fcd7b7f7d5e2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:53.541258 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5c8a8197-d7cd-4e80-9723-fcd7b7f7d5e2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:53.547610 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5c8a8197-d7cd-4e80-9723-fcd7b7f7d5e2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:53.548090 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5c8a8197-d7cd-4e80-9723-fcd7b7f7d5e2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:53.548519 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5c8a8197-d7cd-4e80-9723-fcd7b7f7d5e2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:53.549202 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5c8a8197-d7cd-4e80-9723-fcd7b7f7d5e2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:53.549645 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5c8a8197-d7cd-4e80-9723-fcd7b7f7d5e2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:53.550063 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5c8a8197-d7cd-4e80-9723-fcd7b7f7d5e2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:53.578256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5c8a8197-d7cd-4e80-9723-fcd7b7f7d5e2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043635 Oct 11 06:45:53.578784 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 347/648] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:53 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:54.081388 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d32e0611-036b-4ef2-b2f5-04af1b4fbf4d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:54.083406 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d32e0611-036b-4ef2-b2f5-04af1b4fbf4d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:54.089850 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d32e0611-036b-4ef2-b2f5-04af1b4fbf4d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:54.090322 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d32e0611-036b-4ef2-b2f5-04af1b4fbf4d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:54.090751 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d32e0611-036b-4ef2-b2f5-04af1b4fbf4d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:54.091440 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d32e0611-036b-4ef2-b2f5-04af1b4fbf4d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:54.091899 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d32e0611-036b-4ef2-b2f5-04af1b4fbf4d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:54.092312 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d32e0611-036b-4ef2-b2f5-04af1b4fbf4d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:54.120736 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d32e0611-036b-4ef2-b2f5-04af1b4fbf4d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043394 Oct 11 06:45:54.121275 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 302/649] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:45:54 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:45:54.590841 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-56746b33-c8cf-41f4-aa19-d6f06e2cb27a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:54.593013 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-56746b33-c8cf-41f4-aa19-d6f06e2cb27a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:54.599310 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-56746b33-c8cf-41f4-aa19-d6f06e2cb27a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:54.599816 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-56746b33-c8cf-41f4-aa19-d6f06e2cb27a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:54.600247 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-56746b33-c8cf-41f4-aa19-d6f06e2cb27a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:54.600929 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-56746b33-c8cf-41f4-aa19-d6f06e2cb27a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:54.601977 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-56746b33-c8cf-41f4-aa19-d6f06e2cb27a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:54.602400 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-56746b33-c8cf-41f4-aa19-d6f06e2cb27a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:54.631458 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-56746b33-c8cf-41f4-aa19-d6f06e2cb27a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044409 Oct 11 06:45:54.631999 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 348/650] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:54 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:55.133445 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-dc2aa5db-5d83-49da-8f7b-cf474f62a7e8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:55.135653 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-dc2aa5db-5d83-49da-8f7b-cf474f62a7e8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:55.141905 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dc2aa5db-5d83-49da-8f7b-cf474f62a7e8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:55.142385 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dc2aa5db-5d83-49da-8f7b-cf474f62a7e8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:55.142814 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dc2aa5db-5d83-49da-8f7b-cf474f62a7e8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:55.143529 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dc2aa5db-5d83-49da-8f7b-cf474f62a7e8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:55.143983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dc2aa5db-5d83-49da-8f7b-cf474f62a7e8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:55.144394 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dc2aa5db-5d83-49da-8f7b-cf474f62a7e8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:55.175116 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-dc2aa5db-5d83-49da-8f7b-cf474f62a7e8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045661 Oct 11 06:45:55.179935 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 303/651] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:45:55 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:45:55.643841 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ffbc6ec6-81f8-474f-b753-64aa6f5cfd9a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:55.645978 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ffbc6ec6-81f8-474f-b753-64aa6f5cfd9a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:55.652591 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ffbc6ec6-81f8-474f-b753-64aa6f5cfd9a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:55.653061 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ffbc6ec6-81f8-474f-b753-64aa6f5cfd9a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:55.653486 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ffbc6ec6-81f8-474f-b753-64aa6f5cfd9a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:55.654160 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ffbc6ec6-81f8-474f-b753-64aa6f5cfd9a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:55.654598 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ffbc6ec6-81f8-474f-b753-64aa6f5cfd9a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:55.655008 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ffbc6ec6-81f8-474f-b753-64aa6f5cfd9a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:55.685282 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ffbc6ec6-81f8-474f-b753-64aa6f5cfd9a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044982 Oct 11 06:45:55.685462 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 349/652] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:55 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:56.187813 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-26fab15f-4b21-4557-8349-621de115f61f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:56.189936 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-26fab15f-4b21-4557-8349-621de115f61f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:56.196213 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26fab15f-4b21-4557-8349-621de115f61f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:56.196755 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26fab15f-4b21-4557-8349-621de115f61f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:56.197158 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26fab15f-4b21-4557-8349-621de115f61f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:56.197910 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26fab15f-4b21-4557-8349-621de115f61f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:56.198422 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26fab15f-4b21-4557-8349-621de115f61f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:56.198845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26fab15f-4b21-4557-8349-621de115f61f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:56.230771 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-26fab15f-4b21-4557-8349-621de115f61f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046892 Oct 11 06:45:56.231318 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 304/653] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:45:56 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:45:56.697457 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-40088532-bbd1-435d-bd95-a141ecc21a11 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:56.699509 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-40088532-bbd1-435d-bd95-a141ecc21a11 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:56.705731 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-40088532-bbd1-435d-bd95-a141ecc21a11 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:56.706204 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-40088532-bbd1-435d-bd95-a141ecc21a11 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:56.706629 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-40088532-bbd1-435d-bd95-a141ecc21a11 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:56.707298 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-40088532-bbd1-435d-bd95-a141ecc21a11 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:56.707762 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-40088532-bbd1-435d-bd95-a141ecc21a11 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:56.708175 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-40088532-bbd1-435d-bd95-a141ecc21a11 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:56.736813 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-40088532-bbd1-435d-bd95-a141ecc21a11 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043822 Oct 11 06:45:56.737343 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 350/654] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:56 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:57.244042 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0cfa5e34-ad6b-454a-bf23-51af6716cbee tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:57.246124 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0cfa5e34-ad6b-454a-bf23-51af6716cbee tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:57.252615 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0cfa5e34-ad6b-454a-bf23-51af6716cbee tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:57.253100 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0cfa5e34-ad6b-454a-bf23-51af6716cbee tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:57.253531 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0cfa5e34-ad6b-454a-bf23-51af6716cbee tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:57.254223 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0cfa5e34-ad6b-454a-bf23-51af6716cbee tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:57.254674 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0cfa5e34-ad6b-454a-bf23-51af6716cbee tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:57.255174 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0cfa5e34-ad6b-454a-bf23-51af6716cbee tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:57.284454 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0cfa5e34-ad6b-454a-bf23-51af6716cbee tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045014 Oct 11 06:45:57.285001 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 305/655] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:45:57 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:45:57.749014 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3afced10-7d82-4979-be01-875868df450c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:57.751114 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3afced10-7d82-4979-be01-875868df450c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:57.757455 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3afced10-7d82-4979-be01-875868df450c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:57.757920 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3afced10-7d82-4979-be01-875868df450c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:57.758342 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3afced10-7d82-4979-be01-875868df450c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:57.759017 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3afced10-7d82-4979-be01-875868df450c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:57.759489 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3afced10-7d82-4979-be01-875868df450c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:57.759905 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3afced10-7d82-4979-be01-875868df450c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:57.788830 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3afced10-7d82-4979-be01-875868df450c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043766 Oct 11 06:45:57.789372 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 351/656] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:57 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:58.297145 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2445ee15-b593-465c-a832-d72ed393cc40 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:58.299259 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2445ee15-b593-465c-a832-d72ed393cc40 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:58.305732 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2445ee15-b593-465c-a832-d72ed393cc40 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:58.306211 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2445ee15-b593-465c-a832-d72ed393cc40 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:58.306645 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2445ee15-b593-465c-a832-d72ed393cc40 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:58.307332 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2445ee15-b593-465c-a832-d72ed393cc40 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:58.307810 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2445ee15-b593-465c-a832-d72ed393cc40 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:58.308226 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2445ee15-b593-465c-a832-d72ed393cc40 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:58.337342 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2445ee15-b593-465c-a832-d72ed393cc40 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043591 Oct 11 06:45:58.337870 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 306/657] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:45:58 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:45:58.801817 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3ce3348f-5204-4129-968a-b7693e2beddd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:58.803971 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3ce3348f-5204-4129-968a-b7693e2beddd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:58.810797 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3ce3348f-5204-4129-968a-b7693e2beddd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:58.811270 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3ce3348f-5204-4129-968a-b7693e2beddd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:58.811750 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3ce3348f-5204-4129-968a-b7693e2beddd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:58.812435 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3ce3348f-5204-4129-968a-b7693e2beddd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:58.812884 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3ce3348f-5204-4129-968a-b7693e2beddd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:58.813304 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3ce3348f-5204-4129-968a-b7693e2beddd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:58.842539 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3ce3348f-5204-4129-968a-b7693e2beddd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044675 Oct 11 06:45:58.843076 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 352/658] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:58 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:45:59.349966 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a2053d03-8e8b-4e0e-ad3b-298fddeea3d1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:59.352172 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a2053d03-8e8b-4e0e-ad3b-298fddeea3d1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:59.358511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2053d03-8e8b-4e0e-ad3b-298fddeea3d1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:59.358990 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2053d03-8e8b-4e0e-ad3b-298fddeea3d1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:59.359436 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2053d03-8e8b-4e0e-ad3b-298fddeea3d1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:59.360127 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2053d03-8e8b-4e0e-ad3b-298fddeea3d1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:59.360578 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2053d03-8e8b-4e0e-ad3b-298fddeea3d1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:59.360998 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2053d03-8e8b-4e0e-ad3b-298fddeea3d1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:59.391210 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a2053d03-8e8b-4e0e-ad3b-298fddeea3d1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045189 Oct 11 06:45:59.391784 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 307/659] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:45:59 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:45:59.855238 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-859d3670-aa13-4c68-9101-6cb1e1790104 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:45:59.857403 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-859d3670-aa13-4c68-9101-6cb1e1790104 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:45:59.863766 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-859d3670-aa13-4c68-9101-6cb1e1790104 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:59.864236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-859d3670-aa13-4c68-9101-6cb1e1790104 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:59.864658 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-859d3670-aa13-4c68-9101-6cb1e1790104 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:59.865333 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-859d3670-aa13-4c68-9101-6cb1e1790104 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:45:59.865776 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-859d3670-aa13-4c68-9101-6cb1e1790104 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:45:59.866190 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-859d3670-aa13-4c68-9101-6cb1e1790104 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:45:59.870343 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:45:59.896694 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-859d3670-aa13-4c68-9101-6cb1e1790104 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045851 Oct 11 06:45:59.897260 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 353/660] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:45:59 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:00.403791 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7598847c-9b7f-4dda-8963-5380574eb7f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:00.405905 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7598847c-9b7f-4dda-8963-5380574eb7f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:00.412762 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7598847c-9b7f-4dda-8963-5380574eb7f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:00.413238 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7598847c-9b7f-4dda-8963-5380574eb7f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:00.413667 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7598847c-9b7f-4dda-8963-5380574eb7f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:00.414357 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7598847c-9b7f-4dda-8963-5380574eb7f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:00.414855 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7598847c-9b7f-4dda-8963-5380574eb7f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:00.415270 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7598847c-9b7f-4dda-8963-5380574eb7f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:00.444331 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7598847c-9b7f-4dda-8963-5380574eb7f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045385 Oct 11 06:46:00.444881 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 308/661] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:00 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:00.909178 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8525fb8e-55cd-4c7f-a691-6d36ff5e70d9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:00.911278 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8525fb8e-55cd-4c7f-a691-6d36ff5e70d9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:00.917555 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8525fb8e-55cd-4c7f-a691-6d36ff5e70d9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:00.918023 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8525fb8e-55cd-4c7f-a691-6d36ff5e70d9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:00.918447 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8525fb8e-55cd-4c7f-a691-6d36ff5e70d9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:00.919119 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8525fb8e-55cd-4c7f-a691-6d36ff5e70d9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:00.919587 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8525fb8e-55cd-4c7f-a691-6d36ff5e70d9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:00.919999 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8525fb8e-55cd-4c7f-a691-6d36ff5e70d9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:00.950691 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8525fb8e-55cd-4c7f-a691-6d36ff5e70d9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045376 Oct 11 06:46:00.951225 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 354/662] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:00 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:01.457377 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a861190a-2098-4c76-97ed-a9f0fae19989 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:01.459523 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a861190a-2098-4c76-97ed-a9f0fae19989 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:01.465891 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a861190a-2098-4c76-97ed-a9f0fae19989 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:01.466362 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a861190a-2098-4c76-97ed-a9f0fae19989 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:01.466807 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a861190a-2098-4c76-97ed-a9f0fae19989 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:01.467498 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a861190a-2098-4c76-97ed-a9f0fae19989 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:01.467954 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a861190a-2098-4c76-97ed-a9f0fae19989 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:01.468371 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a861190a-2098-4c76-97ed-a9f0fae19989 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:01.497541 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a861190a-2098-4c76-97ed-a9f0fae19989 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044179 Oct 11 06:46:01.498079 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 309/663] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:01 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:01.962717 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-81d15126-1664-4a87-a440-a9c366b4756d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:01.964850 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-81d15126-1664-4a87-a440-a9c366b4756d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:01.971366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-81d15126-1664-4a87-a440-a9c366b4756d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:01.971884 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-81d15126-1664-4a87-a440-a9c366b4756d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:01.972314 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-81d15126-1664-4a87-a440-a9c366b4756d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:01.973028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-81d15126-1664-4a87-a440-a9c366b4756d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:01.973473 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-81d15126-1664-4a87-a440-a9c366b4756d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:01.973890 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-81d15126-1664-4a87-a440-a9c366b4756d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:02.001992 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-81d15126-1664-4a87-a440-a9c366b4756d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043766 Oct 11 06:46:02.002525 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 355/664] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:01 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:02.510516 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e70dca65-8986-4350-8bfc-6a97fc3d9b57 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:02.512711 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e70dca65-8986-4350-8bfc-6a97fc3d9b57 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:02.519033 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e70dca65-8986-4350-8bfc-6a97fc3d9b57 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:02.519549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e70dca65-8986-4350-8bfc-6a97fc3d9b57 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:02.519985 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e70dca65-8986-4350-8bfc-6a97fc3d9b57 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:02.520674 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e70dca65-8986-4350-8bfc-6a97fc3d9b57 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:02.521122 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e70dca65-8986-4350-8bfc-6a97fc3d9b57 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:02.521540 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e70dca65-8986-4350-8bfc-6a97fc3d9b57 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:02.545739 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:46:02.550772 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e70dca65-8986-4350-8bfc-6a97fc3d9b57 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044797 Oct 11 06:46:02.551314 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 310/665] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:02 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:03.014128 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7882ba7a-0b34-4796-8eef-63c8233ab7df tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:03.016294 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7882ba7a-0b34-4796-8eef-63c8233ab7df tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:03.022640 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7882ba7a-0b34-4796-8eef-63c8233ab7df tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:03.023116 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7882ba7a-0b34-4796-8eef-63c8233ab7df tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:03.023577 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7882ba7a-0b34-4796-8eef-63c8233ab7df tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:03.024816 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7882ba7a-0b34-4796-8eef-63c8233ab7df tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:03.025252 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7882ba7a-0b34-4796-8eef-63c8233ab7df tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:03.025664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7882ba7a-0b34-4796-8eef-63c8233ab7df tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:03.054651 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7882ba7a-0b34-4796-8eef-63c8233ab7df tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044470 Oct 11 06:46:03.055209 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 356/666] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:03 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:03.563958 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f3c29b1b-744c-42bc-9ffd-a5f5d9eb2d1d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:03.566088 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f3c29b1b-744c-42bc-9ffd-a5f5d9eb2d1d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:03.572935 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3c29b1b-744c-42bc-9ffd-a5f5d9eb2d1d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:03.573408 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3c29b1b-744c-42bc-9ffd-a5f5d9eb2d1d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:03.573840 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3c29b1b-744c-42bc-9ffd-a5f5d9eb2d1d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:03.574527 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3c29b1b-744c-42bc-9ffd-a5f5d9eb2d1d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:03.574980 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3c29b1b-744c-42bc-9ffd-a5f5d9eb2d1d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:03.575406 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3c29b1b-744c-42bc-9ffd-a5f5d9eb2d1d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:03.603965 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f3c29b1b-744c-42bc-9ffd-a5f5d9eb2d1d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044281 Oct 11 06:46:03.604506 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 311/667] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:03 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:04.066461 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bef57735-17fa-4de7-9178-c4a8c6a613e8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:04.068658 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bef57735-17fa-4de7-9178-c4a8c6a613e8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:04.075773 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bef57735-17fa-4de7-9178-c4a8c6a613e8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:04.076258 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bef57735-17fa-4de7-9178-c4a8c6a613e8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:04.076699 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bef57735-17fa-4de7-9178-c4a8c6a613e8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:04.077403 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bef57735-17fa-4de7-9178-c4a8c6a613e8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:04.077852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bef57735-17fa-4de7-9178-c4a8c6a613e8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:04.078273 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bef57735-17fa-4de7-9178-c4a8c6a613e8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:04.107969 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bef57735-17fa-4de7-9178-c4a8c6a613e8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045551 Oct 11 06:46:04.108519 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 357/668] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:04 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:04.616392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4b733da1-f273-4b93-beab-fdfac0a31866 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:04.619009 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4b733da1-f273-4b93-beab-fdfac0a31866 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:04.625495 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b733da1-f273-4b93-beab-fdfac0a31866 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:04.625968 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b733da1-f273-4b93-beab-fdfac0a31866 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:04.626392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b733da1-f273-4b93-beab-fdfac0a31866 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:04.627338 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b733da1-f273-4b93-beab-fdfac0a31866 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:04.627816 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b733da1-f273-4b93-beab-fdfac0a31866 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:04.628234 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b733da1-f273-4b93-beab-fdfac0a31866 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:04.657318 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4b733da1-f273-4b93-beab-fdfac0a31866 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044934 Oct 11 06:46:04.657847 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 312/669] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:04 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:05.120241 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d8e90eee-9efe-497c-8208-9693767a7393 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:05.122367 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d8e90eee-9efe-497c-8208-9693767a7393 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:05.128920 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8e90eee-9efe-497c-8208-9693767a7393 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:05.129407 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8e90eee-9efe-497c-8208-9693767a7393 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:05.129839 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8e90eee-9efe-497c-8208-9693767a7393 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:05.130539 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8e90eee-9efe-497c-8208-9693767a7393 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:05.130984 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8e90eee-9efe-497c-8208-9693767a7393 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:05.131404 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8e90eee-9efe-497c-8208-9693767a7393 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:05.160948 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d8e90eee-9efe-497c-8208-9693767a7393 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045378 Oct 11 06:46:05.161503 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 358/670] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:05 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:05.670834 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-99e52b52-a541-42d5-b195-f95a34725566 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:05.673053 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-99e52b52-a541-42d5-b195-f95a34725566 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:05.675331 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=46 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:46:05.680582 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99e52b52-a541-42d5-b195-f95a34725566 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:05.681236 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99e52b52-a541-42d5-b195-f95a34725566 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:05.681799 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99e52b52-a541-42d5-b195-f95a34725566 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:05.682654 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99e52b52-a541-42d5-b195-f95a34725566 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:05.683162 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99e52b52-a541-42d5-b195-f95a34725566 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:05.683766 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99e52b52-a541-42d5-b195-f95a34725566 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:05.715077 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-99e52b52-a541-42d5-b195-f95a34725566 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049234 Oct 11 06:46:05.715686 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 313/671] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:05 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:06.173537 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3cf4de92-f888-4681-a45e-cde889a41cef tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:06.175847 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3cf4de92-f888-4681-a45e-cde889a41cef tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:06.182928 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3cf4de92-f888-4681-a45e-cde889a41cef tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:06.183405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3cf4de92-f888-4681-a45e-cde889a41cef tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:06.183866 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3cf4de92-f888-4681-a45e-cde889a41cef tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:06.184558 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3cf4de92-f888-4681-a45e-cde889a41cef tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:06.185008 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3cf4de92-f888-4681-a45e-cde889a41cef tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:06.185428 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3cf4de92-f888-4681-a45e-cde889a41cef tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:06.216302 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3cf4de92-f888-4681-a45e-cde889a41cef tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046519 Oct 11 06:46:06.220959 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 359/672] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:06 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:06.726725 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a59b0a4c-d7ef-4237-beb2-74b187cbbea5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:06.729361 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a59b0a4c-d7ef-4237-beb2-74b187cbbea5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:06.735692 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a59b0a4c-d7ef-4237-beb2-74b187cbbea5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:06.736163 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a59b0a4c-d7ef-4237-beb2-74b187cbbea5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:06.736589 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a59b0a4c-d7ef-4237-beb2-74b187cbbea5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:06.737266 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a59b0a4c-d7ef-4237-beb2-74b187cbbea5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:06.737716 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a59b0a4c-d7ef-4237-beb2-74b187cbbea5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:06.738128 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a59b0a4c-d7ef-4237-beb2-74b187cbbea5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:06.766836 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a59b0a4c-d7ef-4237-beb2-74b187cbbea5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044088 Oct 11 06:46:06.767370 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 314/673] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:06 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:07.229142 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-61ab4bf5-c676-4190-9d8a-3879bbce8c2d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:07.231257 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-61ab4bf5-c676-4190-9d8a-3879bbce8c2d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:07.237765 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-61ab4bf5-c676-4190-9d8a-3879bbce8c2d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:07.238235 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-61ab4bf5-c676-4190-9d8a-3879bbce8c2d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:07.238662 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-61ab4bf5-c676-4190-9d8a-3879bbce8c2d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:07.239341 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-61ab4bf5-c676-4190-9d8a-3879bbce8c2d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:07.239815 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-61ab4bf5-c676-4190-9d8a-3879bbce8c2d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:07.240329 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-61ab4bf5-c676-4190-9d8a-3879bbce8c2d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:07.269416 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-61ab4bf5-c676-4190-9d8a-3879bbce8c2d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044715 Oct 11 06:46:07.270153 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 360/674] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:07 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:07.781425 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-38713d91-6b15-4da6-bbe0-fde0d12b0455 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:07.783569 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-38713d91-6b15-4da6-bbe0-fde0d12b0455 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:07.789604 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38713d91-6b15-4da6-bbe0-fde0d12b0455 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:07.790587 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38713d91-6b15-4da6-bbe0-fde0d12b0455 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:07.791023 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38713d91-6b15-4da6-bbe0-fde0d12b0455 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:07.791749 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38713d91-6b15-4da6-bbe0-fde0d12b0455 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:07.792198 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38713d91-6b15-4da6-bbe0-fde0d12b0455 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:07.792620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38713d91-6b15-4da6-bbe0-fde0d12b0455 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:07.820987 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-38713d91-6b15-4da6-bbe0-fde0d12b0455 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045259 Oct 11 06:46:07.821534 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 315/675] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:07 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:08.282331 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-af2a7caf-0902-4219-8a9e-68075826f274 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:08.284465 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-af2a7caf-0902-4219-8a9e-68075826f274 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:08.290518 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af2a7caf-0902-4219-8a9e-68075826f274 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:08.290995 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af2a7caf-0902-4219-8a9e-68075826f274 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:08.291440 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af2a7caf-0902-4219-8a9e-68075826f274 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:08.292133 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af2a7caf-0902-4219-8a9e-68075826f274 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:08.292578 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af2a7caf-0902-4219-8a9e-68075826f274 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:08.292994 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af2a7caf-0902-4219-8a9e-68075826f274 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:08.324002 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-af2a7caf-0902-4219-8a9e-68075826f274 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045589 Oct 11 06:46:08.324592 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 361/676] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:08 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:08.833953 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-15988cc3-8380-422d-b57c-6fe73569d682 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:08.836139 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-15988cc3-8380-422d-b57c-6fe73569d682 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:08.842532 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15988cc3-8380-422d-b57c-6fe73569d682 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:08.843011 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15988cc3-8380-422d-b57c-6fe73569d682 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:08.843469 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15988cc3-8380-422d-b57c-6fe73569d682 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:08.844161 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15988cc3-8380-422d-b57c-6fe73569d682 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:08.844614 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15988cc3-8380-422d-b57c-6fe73569d682 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:08.845036 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15988cc3-8380-422d-b57c-6fe73569d682 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:08.874499 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-15988cc3-8380-422d-b57c-6fe73569d682 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044574 Oct 11 06:46:08.875042 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 316/677] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:08 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:09.337014 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c7baadc7-73f6-4dea-8da4-ba50806c2796 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:09.339159 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c7baadc7-73f6-4dea-8da4-ba50806c2796 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:09.345586 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c7baadc7-73f6-4dea-8da4-ba50806c2796 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:09.346054 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c7baadc7-73f6-4dea-8da4-ba50806c2796 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:09.346483 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c7baadc7-73f6-4dea-8da4-ba50806c2796 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:09.347241 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c7baadc7-73f6-4dea-8da4-ba50806c2796 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:09.347730 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c7baadc7-73f6-4dea-8da4-ba50806c2796 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:09.348148 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c7baadc7-73f6-4dea-8da4-ba50806c2796 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:09.377307 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c7baadc7-73f6-4dea-8da4-ba50806c2796 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044766 Oct 11 06:46:09.377856 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 362/678] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:09 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:09.888430 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4fc530af-2bb9-452b-942c-ebe4c2692f04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:09.890562 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4fc530af-2bb9-452b-942c-ebe4c2692f04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:09.897307 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4fc530af-2bb9-452b-942c-ebe4c2692f04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:09.897781 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4fc530af-2bb9-452b-942c-ebe4c2692f04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:09.898210 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4fc530af-2bb9-452b-942c-ebe4c2692f04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:09.898898 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4fc530af-2bb9-452b-942c-ebe4c2692f04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:09.899346 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4fc530af-2bb9-452b-942c-ebe4c2692f04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:09.899790 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4fc530af-2bb9-452b-942c-ebe4c2692f04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:09.928951 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4fc530af-2bb9-452b-942c-ebe4c2692f04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045615 Oct 11 06:46:09.929807 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 317/679] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:09 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:10.389396 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-106f7dd5-f4e9-444d-8752-0100464f3551 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:10.391633 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-106f7dd5-f4e9-444d-8752-0100464f3551 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:10.398028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-106f7dd5-f4e9-444d-8752-0100464f3551 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:10.398506 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-106f7dd5-f4e9-444d-8752-0100464f3551 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:10.398938 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-106f7dd5-f4e9-444d-8752-0100464f3551 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:10.399661 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-106f7dd5-f4e9-444d-8752-0100464f3551 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:10.400113 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-106f7dd5-f4e9-444d-8752-0100464f3551 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:10.400535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-106f7dd5-f4e9-444d-8752-0100464f3551 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:10.431553 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-106f7dd5-f4e9-444d-8752-0100464f3551 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045990 Oct 11 06:46:10.432098 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 363/680] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:10 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:10.942330 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-14ed229e-129f-455b-8037-bc1ad61f6af8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:10.944513 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-14ed229e-129f-455b-8037-bc1ad61f6af8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:10.951369 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14ed229e-129f-455b-8037-bc1ad61f6af8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:10.951881 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14ed229e-129f-455b-8037-bc1ad61f6af8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:10.952309 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14ed229e-129f-455b-8037-bc1ad61f6af8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:10.952997 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14ed229e-129f-455b-8037-bc1ad61f6af8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:10.953447 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14ed229e-129f-455b-8037-bc1ad61f6af8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:10.953867 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14ed229e-129f-455b-8037-bc1ad61f6af8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:10.983082 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-14ed229e-129f-455b-8037-bc1ad61f6af8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044780 Oct 11 06:46:10.983666 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 318/681] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:10 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:11.443885 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-73e72453-de77-4fad-abea-a09c375ce632 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:11.446714 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-73e72453-de77-4fad-abea-a09c375ce632 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:11.455551 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-73e72453-de77-4fad-abea-a09c375ce632 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:11.456029 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-73e72453-de77-4fad-abea-a09c375ce632 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:11.456457 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-73e72453-de77-4fad-abea-a09c375ce632 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:11.457151 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-73e72453-de77-4fad-abea-a09c375ce632 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:11.457602 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-73e72453-de77-4fad-abea-a09c375ce632 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:11.458019 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-73e72453-de77-4fad-abea-a09c375ce632 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:11.487971 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-73e72453-de77-4fad-abea-a09c375ce632 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047954 Oct 11 06:46:11.488528 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 364/682] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:11 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:11.996392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-24ba1fd1-21bd-4bd3-b7fc-8a3da395a602 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:11.998435 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-24ba1fd1-21bd-4bd3-b7fc-8a3da395a602 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:12.004758 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-24ba1fd1-21bd-4bd3-b7fc-8a3da395a602 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:12.005231 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-24ba1fd1-21bd-4bd3-b7fc-8a3da395a602 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:12.005657 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-24ba1fd1-21bd-4bd3-b7fc-8a3da395a602 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:12.006369 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-24ba1fd1-21bd-4bd3-b7fc-8a3da395a602 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:12.006812 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-24ba1fd1-21bd-4bd3-b7fc-8a3da395a602 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:12.007224 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-24ba1fd1-21bd-4bd3-b7fc-8a3da395a602 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:12.035959 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-24ba1fd1-21bd-4bd3-b7fc-8a3da395a602 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044315 Oct 11 06:46:12.036494 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 319/683] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:11 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:12.500850 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-96a98e73-baec-4ef5-af17-8f9197a1ec69 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:12.503030 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-96a98e73-baec-4ef5-af17-8f9197a1ec69 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:12.509995 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96a98e73-baec-4ef5-af17-8f9197a1ec69 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:12.510467 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96a98e73-baec-4ef5-af17-8f9197a1ec69 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:12.510895 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96a98e73-baec-4ef5-af17-8f9197a1ec69 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:12.511613 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96a98e73-baec-4ef5-af17-8f9197a1ec69 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:12.512065 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96a98e73-baec-4ef5-af17-8f9197a1ec69 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:12.512481 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96a98e73-baec-4ef5-af17-8f9197a1ec69 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:12.542082 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-96a98e73-baec-4ef5-af17-8f9197a1ec69 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045190 Oct 11 06:46:12.542642 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 365/684] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:12 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:13.048794 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1939e41d-4af0-4cae-8439-c113fb1e0899 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:13.051084 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1939e41d-4af0-4cae-8439-c113fb1e0899 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:13.057951 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1939e41d-4af0-4cae-8439-c113fb1e0899 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:13.058423 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1939e41d-4af0-4cae-8439-c113fb1e0899 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:13.058849 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1939e41d-4af0-4cae-8439-c113fb1e0899 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:13.059590 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1939e41d-4af0-4cae-8439-c113fb1e0899 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:13.060038 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1939e41d-4af0-4cae-8439-c113fb1e0899 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:13.060452 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1939e41d-4af0-4cae-8439-c113fb1e0899 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:13.089988 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1939e41d-4af0-4cae-8439-c113fb1e0899 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045159 Oct 11 06:46:13.090532 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 320/685] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:13 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:13.554194 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d5b48bd9-7ce4-4f66-92f1-7651acbd33d7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:13.556354 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d5b48bd9-7ce4-4f66-92f1-7651acbd33d7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:13.562749 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d5b48bd9-7ce4-4f66-92f1-7651acbd33d7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:13.563223 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d5b48bd9-7ce4-4f66-92f1-7651acbd33d7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:13.563682 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d5b48bd9-7ce4-4f66-92f1-7651acbd33d7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:13.564367 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d5b48bd9-7ce4-4f66-92f1-7651acbd33d7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:13.564812 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d5b48bd9-7ce4-4f66-92f1-7651acbd33d7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:13.565228 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d5b48bd9-7ce4-4f66-92f1-7651acbd33d7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:13.594841 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d5b48bd9-7ce4-4f66-92f1-7651acbd33d7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044585 Oct 11 06:46:13.595403 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 366/686] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:13 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:14.102613 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-768589df-efd4-4904-8557-2cdc522824ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:14.104744 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-768589df-efd4-4904-8557-2cdc522824ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:14.111046 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-768589df-efd4-4904-8557-2cdc522824ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:14.111557 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-768589df-efd4-4904-8557-2cdc522824ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:14.111986 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-768589df-efd4-4904-8557-2cdc522824ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:14.112663 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-768589df-efd4-4904-8557-2cdc522824ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:14.113106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-768589df-efd4-4904-8557-2cdc522824ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:14.113518 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-768589df-efd4-4904-8557-2cdc522824ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:14.142959 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-768589df-efd4-4904-8557-2cdc522824ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044738 Oct 11 06:46:14.143553 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 321/687] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:14 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:14.607737 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1b22059f-a030-478d-92db-685258240b77 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:14.609853 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1b22059f-a030-478d-92db-685258240b77 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:14.616221 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b22059f-a030-478d-92db-685258240b77 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:14.616693 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b22059f-a030-478d-92db-685258240b77 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:14.617121 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b22059f-a030-478d-92db-685258240b77 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:14.618444 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b22059f-a030-478d-92db-685258240b77 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:14.618888 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b22059f-a030-478d-92db-685258240b77 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:14.619302 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b22059f-a030-478d-92db-685258240b77 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:14.648542 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1b22059f-a030-478d-92db-685258240b77 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044744 Oct 11 06:46:14.649105 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 367/688] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:14 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:15.155974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-35975022-ebc0-49f1-b042-8230a932a446 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:15.158102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-35975022-ebc0-49f1-b042-8230a932a446 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:15.165269 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-35975022-ebc0-49f1-b042-8230a932a446 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:15.165748 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-35975022-ebc0-49f1-b042-8230a932a446 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:15.166181 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-35975022-ebc0-49f1-b042-8230a932a446 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:15.166872 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-35975022-ebc0-49f1-b042-8230a932a446 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:15.167326 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-35975022-ebc0-49f1-b042-8230a932a446 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:15.167774 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-35975022-ebc0-49f1-b042-8230a932a446 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:15.196322 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-35975022-ebc0-49f1-b042-8230a932a446 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044263 Oct 11 06:46:15.196884 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 322/689] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:15 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:15.661562 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-55edcd8f-3204-4e58-bf34-fdf04d33d05d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:15.663675 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-55edcd8f-3204-4e58-bf34-fdf04d33d05d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:15.669942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-55edcd8f-3204-4e58-bf34-fdf04d33d05d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:15.670414 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-55edcd8f-3204-4e58-bf34-fdf04d33d05d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:15.670837 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-55edcd8f-3204-4e58-bf34-fdf04d33d05d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:15.671545 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-55edcd8f-3204-4e58-bf34-fdf04d33d05d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:15.672020 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-55edcd8f-3204-4e58-bf34-fdf04d33d05d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:15.672389 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-55edcd8f-3204-4e58-bf34-fdf04d33d05d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:15.703068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-55edcd8f-3204-4e58-bf34-fdf04d33d05d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045491 Oct 11 06:46:15.703648 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 368/690] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:15 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:16.208912 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-55b3bcd7-62a8-4c76-aed6-19e7a9991c66 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:16.211048 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-55b3bcd7-62a8-4c76-aed6-19e7a9991c66 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:16.217378 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-55b3bcd7-62a8-4c76-aed6-19e7a9991c66 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:16.217851 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-55b3bcd7-62a8-4c76-aed6-19e7a9991c66 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:16.218283 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-55b3bcd7-62a8-4c76-aed6-19e7a9991c66 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:16.218961 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-55b3bcd7-62a8-4c76-aed6-19e7a9991c66 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:16.219404 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-55b3bcd7-62a8-4c76-aed6-19e7a9991c66 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:16.219961 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-55b3bcd7-62a8-4c76-aed6-19e7a9991c66 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:16.249129 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-55b3bcd7-62a8-4c76-aed6-19e7a9991c66 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044221 Oct 11 06:46:16.249663 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 323/691] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:16 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:16.715958 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-64f7365d-fbeb-44ca-bc5b-41ed41325cf6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:16.718117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-64f7365d-fbeb-44ca-bc5b-41ed41325cf6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:16.724465 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-64f7365d-fbeb-44ca-bc5b-41ed41325cf6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:16.724935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-64f7365d-fbeb-44ca-bc5b-41ed41325cf6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:16.725358 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-64f7365d-fbeb-44ca-bc5b-41ed41325cf6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:16.726030 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-64f7365d-fbeb-44ca-bc5b-41ed41325cf6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:16.726471 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-64f7365d-fbeb-44ca-bc5b-41ed41325cf6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:16.727564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-64f7365d-fbeb-44ca-bc5b-41ed41325cf6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:16.751257 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:46:16.756216 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-64f7365d-fbeb-44ca-bc5b-41ed41325cf6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044151 Oct 11 06:46:16.756752 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 369/692] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:16 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:17.262617 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1c5b7cfa-c1c9-43f0-85da-7fe52920c499 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:17.264801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1c5b7cfa-c1c9-43f0-85da-7fe52920c499 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:17.271140 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c5b7cfa-c1c9-43f0-85da-7fe52920c499 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:17.271668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c5b7cfa-c1c9-43f0-85da-7fe52920c499 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:17.272104 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c5b7cfa-c1c9-43f0-85da-7fe52920c499 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:17.272802 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c5b7cfa-c1c9-43f0-85da-7fe52920c499 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:17.273255 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c5b7cfa-c1c9-43f0-85da-7fe52920c499 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:17.273718 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c5b7cfa-c1c9-43f0-85da-7fe52920c499 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:17.302712 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1c5b7cfa-c1c9-43f0-85da-7fe52920c499 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044949 Oct 11 06:46:17.303269 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 324/693] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:17 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:17.768765 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e85cc2f0-78e8-4db3-a36b-32ae5925b896 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:17.770878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e85cc2f0-78e8-4db3-a36b-32ae5925b896 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:17.777471 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e85cc2f0-78e8-4db3-a36b-32ae5925b896 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:17.777944 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e85cc2f0-78e8-4db3-a36b-32ae5925b896 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:17.778372 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e85cc2f0-78e8-4db3-a36b-32ae5925b896 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:17.779053 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e85cc2f0-78e8-4db3-a36b-32ae5925b896 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:17.779527 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e85cc2f0-78e8-4db3-a36b-32ae5925b896 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:17.779949 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e85cc2f0-78e8-4db3-a36b-32ae5925b896 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:17.809248 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e85cc2f0-78e8-4db3-a36b-32ae5925b896 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044663 Oct 11 06:46:17.809787 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 370/694] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:17 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:18.315727 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7567251e-37eb-4b56-a08b-52401e0466d2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:18.317885 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7567251e-37eb-4b56-a08b-52401e0466d2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:18.323764 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7567251e-37eb-4b56-a08b-52401e0466d2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:18.324241 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7567251e-37eb-4b56-a08b-52401e0466d2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:18.324671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7567251e-37eb-4b56-a08b-52401e0466d2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:18.325355 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7567251e-37eb-4b56-a08b-52401e0466d2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:18.325803 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7567251e-37eb-4b56-a08b-52401e0466d2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:18.326221 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7567251e-37eb-4b56-a08b-52401e0466d2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:18.355489 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7567251e-37eb-4b56-a08b-52401e0466d2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043950 Oct 11 06:46:18.356024 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 325/695] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:18 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:18.821569 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9b887aaa-90aa-498c-95d1-5a0fde25420a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:18.823726 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9b887aaa-90aa-498c-95d1-5a0fde25420a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:18.830238 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9b887aaa-90aa-498c-95d1-5a0fde25420a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:18.830706 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9b887aaa-90aa-498c-95d1-5a0fde25420a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:18.831131 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9b887aaa-90aa-498c-95d1-5a0fde25420a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:18.831846 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9b887aaa-90aa-498c-95d1-5a0fde25420a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:18.832282 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9b887aaa-90aa-498c-95d1-5a0fde25420a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:18.832694 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9b887aaa-90aa-498c-95d1-5a0fde25420a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:18.862060 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9b887aaa-90aa-498c-95d1-5a0fde25420a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044432 Oct 11 06:46:18.862591 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 371/696] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:18 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:19.368064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c4630fa7-9fb9-42f4-8a4e-38a63bff651d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:19.370243 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c4630fa7-9fb9-42f4-8a4e-38a63bff651d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:19.376587 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4630fa7-9fb9-42f4-8a4e-38a63bff651d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:19.377069 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4630fa7-9fb9-42f4-8a4e-38a63bff651d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:19.377502 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4630fa7-9fb9-42f4-8a4e-38a63bff651d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:19.378190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4630fa7-9fb9-42f4-8a4e-38a63bff651d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:19.378640 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4630fa7-9fb9-42f4-8a4e-38a63bff651d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:19.379062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4630fa7-9fb9-42f4-8a4e-38a63bff651d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:19.410072 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c4630fa7-9fb9-42f4-8a4e-38a63bff651d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045767 Oct 11 06:46:19.413760 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 326/697] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:19 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:19.874248 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ec1c6fdd-7574-4337-b9af-61e952c39470 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:19.876427 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ec1c6fdd-7574-4337-b9af-61e952c39470 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:19.882664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec1c6fdd-7574-4337-b9af-61e952c39470 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:19.883135 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec1c6fdd-7574-4337-b9af-61e952c39470 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:19.883601 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec1c6fdd-7574-4337-b9af-61e952c39470 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:19.884278 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec1c6fdd-7574-4337-b9af-61e952c39470 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:19.884718 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec1c6fdd-7574-4337-b9af-61e952c39470 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:19.885131 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec1c6fdd-7574-4337-b9af-61e952c39470 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:19.913419 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ec1c6fdd-7574-4337-b9af-61e952c39470 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043192 Oct 11 06:46:19.914454 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 372/698] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:19 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:20.422330 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-948b7df4-91b1-4266-8286-ce1eff3c9e09 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:20.424603 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-948b7df4-91b1-4266-8286-ce1eff3c9e09 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:20.431008 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-948b7df4-91b1-4266-8286-ce1eff3c9e09 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:20.431521 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-948b7df4-91b1-4266-8286-ce1eff3c9e09 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:20.431962 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-948b7df4-91b1-4266-8286-ce1eff3c9e09 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:20.432659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-948b7df4-91b1-4266-8286-ce1eff3c9e09 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:20.433114 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-948b7df4-91b1-4266-8286-ce1eff3c9e09 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:20.433538 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-948b7df4-91b1-4266-8286-ce1eff3c9e09 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:20.449678 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:46:20.463370 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-948b7df4-91b1-4266-8286-ce1eff3c9e09 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045118 Oct 11 06:46:20.463947 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 327/699] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:20 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:20.926281 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7d4d1cfd-3483-4fa4-96c0-f697d7670e94 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:20.928450 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7d4d1cfd-3483-4fa4-96c0-f697d7670e94 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:20.934500 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d4d1cfd-3483-4fa4-96c0-f697d7670e94 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:20.934974 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d4d1cfd-3483-4fa4-96c0-f697d7670e94 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:20.935403 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d4d1cfd-3483-4fa4-96c0-f697d7670e94 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:20.936107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d4d1cfd-3483-4fa4-96c0-f697d7670e94 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:20.936553 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d4d1cfd-3483-4fa4-96c0-f697d7670e94 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:20.936974 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d4d1cfd-3483-4fa4-96c0-f697d7670e94 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:20.967554 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7d4d1cfd-3483-4fa4-96c0-f697d7670e94 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045171 Oct 11 06:46:20.968034 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 373/700] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:20 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:21.475990 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-56e4314f-0306-4a3f-ba3f-b7b4f1a62dbd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:21.478671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-56e4314f-0306-4a3f-ba3f-b7b4f1a62dbd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:21.488957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-56e4314f-0306-4a3f-ba3f-b7b4f1a62dbd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:21.489443 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-56e4314f-0306-4a3f-ba3f-b7b4f1a62dbd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:21.490027 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-56e4314f-0306-4a3f-ba3f-b7b4f1a62dbd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:21.490724 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-56e4314f-0306-4a3f-ba3f-b7b4f1a62dbd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:21.491180 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-56e4314f-0306-4a3f-ba3f-b7b4f1a62dbd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:21.491636 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-56e4314f-0306-4a3f-ba3f-b7b4f1a62dbd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:21.521130 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-56e4314f-0306-4a3f-ba3f-b7b4f1a62dbd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049181 Oct 11 06:46:21.521681 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 328/701] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:21 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:21.980606 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-242ff608-fb23-4070-87b8-e8d795b84dba tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:21.982694 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-242ff608-fb23-4070-87b8-e8d795b84dba tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:21.988948 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-242ff608-fb23-4070-87b8-e8d795b84dba tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:21.989421 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-242ff608-fb23-4070-87b8-e8d795b84dba tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:21.989843 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-242ff608-fb23-4070-87b8-e8d795b84dba tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:21.990518 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-242ff608-fb23-4070-87b8-e8d795b84dba tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:21.990954 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-242ff608-fb23-4070-87b8-e8d795b84dba tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:21.991366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-242ff608-fb23-4070-87b8-e8d795b84dba tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:22.019290 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-242ff608-fb23-4070-87b8-e8d795b84dba tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043264 Oct 11 06:46:22.019844 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 374/702] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:21 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:22.534018 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1182f67f-5792-4ce2-aa06-172f7b1a5c41 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:22.536110 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1182f67f-5792-4ce2-aa06-172f7b1a5c41 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:22.542485 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1182f67f-5792-4ce2-aa06-172f7b1a5c41 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:22.542964 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1182f67f-5792-4ce2-aa06-172f7b1a5c41 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:22.543399 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1182f67f-5792-4ce2-aa06-172f7b1a5c41 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:22.544114 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1182f67f-5792-4ce2-aa06-172f7b1a5c41 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:22.544567 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1182f67f-5792-4ce2-aa06-172f7b1a5c41 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:22.544991 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1182f67f-5792-4ce2-aa06-172f7b1a5c41 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:22.574365 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1182f67f-5792-4ce2-aa06-172f7b1a5c41 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044380 Oct 11 06:46:22.574901 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 329/703] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:22 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:23.031846 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9eb4ad09-46d3-4db2-b510-20f0e0b5c795 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:23.033967 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9eb4ad09-46d3-4db2-b510-20f0e0b5c795 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:23.036258 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=58 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:46:23.042238 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9eb4ad09-46d3-4db2-b510-20f0e0b5c795 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:23.042715 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9eb4ad09-46d3-4db2-b510-20f0e0b5c795 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:23.043145 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9eb4ad09-46d3-4db2-b510-20f0e0b5c795 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:23.043863 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9eb4ad09-46d3-4db2-b510-20f0e0b5c795 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:23.044308 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9eb4ad09-46d3-4db2-b510-20f0e0b5c795 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:23.044728 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9eb4ad09-46d3-4db2-b510-20f0e0b5c795 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:23.073640 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9eb4ad09-46d3-4db2-b510-20f0e0b5c795 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045758 Oct 11 06:46:23.074177 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 375/704] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:23 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:23.587513 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e92dadac-efef-4d9b-8460-f5c8ec41915d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:23.589545 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e92dadac-efef-4d9b-8460-f5c8ec41915d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:23.595978 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e92dadac-efef-4d9b-8460-f5c8ec41915d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:23.596451 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e92dadac-efef-4d9b-8460-f5c8ec41915d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:23.596875 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e92dadac-efef-4d9b-8460-f5c8ec41915d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:23.597556 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e92dadac-efef-4d9b-8460-f5c8ec41915d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:23.598027 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e92dadac-efef-4d9b-8460-f5c8ec41915d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:23.598442 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e92dadac-efef-4d9b-8460-f5c8ec41915d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:23.626309 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e92dadac-efef-4d9b-8460-f5c8ec41915d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043487 Oct 11 06:46:23.626844 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 330/705] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:23 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:24.085954 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9a06e45e-797c-46bb-a4b6-964bef8a3adf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:24.088148 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9a06e45e-797c-46bb-a4b6-964bef8a3adf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:24.094466 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9a06e45e-797c-46bb-a4b6-964bef8a3adf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:24.094938 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9a06e45e-797c-46bb-a4b6-964bef8a3adf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:24.095369 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9a06e45e-797c-46bb-a4b6-964bef8a3adf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:24.096082 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9a06e45e-797c-46bb-a4b6-964bef8a3adf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:24.096552 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9a06e45e-797c-46bb-a4b6-964bef8a3adf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:24.096970 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9a06e45e-797c-46bb-a4b6-964bef8a3adf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:24.125683 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9a06e45e-797c-46bb-a4b6-964bef8a3adf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043719 Oct 11 06:46:24.126214 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 376/706] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:24 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:24.639239 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f06cf0de-f592-4e73-bda9-a7264eb7d6fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:24.641371 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f06cf0de-f592-4e73-bda9-a7264eb7d6fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:24.647714 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f06cf0de-f592-4e73-bda9-a7264eb7d6fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:24.648183 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f06cf0de-f592-4e73-bda9-a7264eb7d6fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:24.648609 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f06cf0de-f592-4e73-bda9-a7264eb7d6fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:24.649873 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f06cf0de-f592-4e73-bda9-a7264eb7d6fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:24.650318 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f06cf0de-f592-4e73-bda9-a7264eb7d6fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:24.650987 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f06cf0de-f592-4e73-bda9-a7264eb7d6fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:24.678897 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f06cf0de-f592-4e73-bda9-a7264eb7d6fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043644 Oct 11 06:46:24.679453 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 331/707] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:24 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:25.137870 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0f877ca2-171a-47dc-89a0-f2f9d959e2da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:25.140029 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0f877ca2-171a-47dc-89a0-f2f9d959e2da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:25.146402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0f877ca2-171a-47dc-89a0-f2f9d959e2da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:25.146876 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0f877ca2-171a-47dc-89a0-f2f9d959e2da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:25.147309 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0f877ca2-171a-47dc-89a0-f2f9d959e2da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:25.148019 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0f877ca2-171a-47dc-89a0-f2f9d959e2da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:25.148471 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0f877ca2-171a-47dc-89a0-f2f9d959e2da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:25.148890 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0f877ca2-171a-47dc-89a0-f2f9d959e2da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:25.177997 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0f877ca2-171a-47dc-89a0-f2f9d959e2da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044086 Oct 11 06:46:25.178544 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 377/708] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:25 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:25.691203 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c334b748-4995-480c-94c9-5d1e9b334f8c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:25.693389 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c334b748-4995-480c-94c9-5d1e9b334f8c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:25.700497 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c334b748-4995-480c-94c9-5d1e9b334f8c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:25.700973 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c334b748-4995-480c-94c9-5d1e9b334f8c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:25.701404 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c334b748-4995-480c-94c9-5d1e9b334f8c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:25.702090 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c334b748-4995-480c-94c9-5d1e9b334f8c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:25.702540 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c334b748-4995-480c-94c9-5d1e9b334f8c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:25.702962 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c334b748-4995-480c-94c9-5d1e9b334f8c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:25.731744 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c334b748-4995-480c-94c9-5d1e9b334f8c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044488 Oct 11 06:46:25.732296 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 332/709] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:25 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:26.190077 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a6382bda-fbe8-4e87-8d68-e23756040821 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:26.192278 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a6382bda-fbe8-4e87-8d68-e23756040821 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:26.198612 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6382bda-fbe8-4e87-8d68-e23756040821 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:26.199087 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6382bda-fbe8-4e87-8d68-e23756040821 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:26.199556 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6382bda-fbe8-4e87-8d68-e23756040821 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:26.200238 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6382bda-fbe8-4e87-8d68-e23756040821 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:26.200682 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6382bda-fbe8-4e87-8d68-e23756040821 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:26.201097 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6382bda-fbe8-4e87-8d68-e23756040821 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:26.230577 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a6382bda-fbe8-4e87-8d68-e23756040821 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044443 Oct 11 06:46:26.231248 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 378/710] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:26 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:26.744546 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cd05ca00-a4ad-4fcd-93c4-7531f52500ad tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:26.746614 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cd05ca00-a4ad-4fcd-93c4-7531f52500ad tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:26.753052 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cd05ca00-a4ad-4fcd-93c4-7531f52500ad tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:26.753532 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cd05ca00-a4ad-4fcd-93c4-7531f52500ad tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:26.753966 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cd05ca00-a4ad-4fcd-93c4-7531f52500ad tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:26.754663 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cd05ca00-a4ad-4fcd-93c4-7531f52500ad tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:26.755116 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cd05ca00-a4ad-4fcd-93c4-7531f52500ad tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:26.755571 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cd05ca00-a4ad-4fcd-93c4-7531f52500ad tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:26.785247 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cd05ca00-a4ad-4fcd-93c4-7531f52500ad tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044804 Oct 11 06:46:26.785799 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 333/711] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:26 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:27.242235 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b8e1a899-8b55-4933-861f-df80860b1b6c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:27.244904 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b8e1a899-8b55-4933-861f-df80860b1b6c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:27.251266 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b8e1a899-8b55-4933-861f-df80860b1b6c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:27.251773 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b8e1a899-8b55-4933-861f-df80860b1b6c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:27.252201 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b8e1a899-8b55-4933-861f-df80860b1b6c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:27.252887 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b8e1a899-8b55-4933-861f-df80860b1b6c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:27.253332 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b8e1a899-8b55-4933-861f-df80860b1b6c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:27.253750 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b8e1a899-8b55-4933-861f-df80860b1b6c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:27.283079 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b8e1a899-8b55-4933-861f-df80860b1b6c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044819 Oct 11 06:46:27.283653 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 379/712] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:27 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:27.797634 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-75925e40-c459-44ae-b213-1fd10de082e4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:27.799769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-75925e40-c459-44ae-b213-1fd10de082e4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:27.806664 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-75925e40-c459-44ae-b213-1fd10de082e4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:27.807142 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-75925e40-c459-44ae-b213-1fd10de082e4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:27.807607 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-75925e40-c459-44ae-b213-1fd10de082e4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:27.808301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-75925e40-c459-44ae-b213-1fd10de082e4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:27.808750 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-75925e40-c459-44ae-b213-1fd10de082e4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:27.809170 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-75925e40-c459-44ae-b213-1fd10de082e4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:27.838506 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-75925e40-c459-44ae-b213-1fd10de082e4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044895 Oct 11 06:46:27.839055 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 334/713] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:27 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:28.296047 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-daaa979f-3618-4ff0-b4b7-0648cf4d6946 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:28.298165 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-daaa979f-3618-4ff0-b4b7-0648cf4d6946 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:28.304558 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-daaa979f-3618-4ff0-b4b7-0648cf4d6946 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:28.305667 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-daaa979f-3618-4ff0-b4b7-0648cf4d6946 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:28.306107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-daaa979f-3618-4ff0-b4b7-0648cf4d6946 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:28.306791 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-daaa979f-3618-4ff0-b4b7-0648cf4d6946 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:28.307234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-daaa979f-3618-4ff0-b4b7-0648cf4d6946 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:28.307678 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-daaa979f-3618-4ff0-b4b7-0648cf4d6946 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:28.335603 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-daaa979f-3618-4ff0-b4b7-0648cf4d6946 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043509 Oct 11 06:46:28.336130 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 380/714] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:28 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:28.850895 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0d2398a2-ac44-431e-86ee-2d3d44c0eff0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:28.853023 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0d2398a2-ac44-431e-86ee-2d3d44c0eff0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:28.859299 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0d2398a2-ac44-431e-86ee-2d3d44c0eff0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:28.859804 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0d2398a2-ac44-431e-86ee-2d3d44c0eff0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:28.860267 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0d2398a2-ac44-431e-86ee-2d3d44c0eff0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:28.860947 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0d2398a2-ac44-431e-86ee-2d3d44c0eff0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:28.861391 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0d2398a2-ac44-431e-86ee-2d3d44c0eff0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:28.861805 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0d2398a2-ac44-431e-86ee-2d3d44c0eff0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:28.890306 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0d2398a2-ac44-431e-86ee-2d3d44c0eff0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043375 Oct 11 06:46:28.890832 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 335/715] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:28 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:29.348205 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4911a90b-deef-4148-9d18-23148107e28d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:29.350250 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4911a90b-deef-4148-9d18-23148107e28d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:29.356593 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4911a90b-deef-4148-9d18-23148107e28d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:29.357069 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4911a90b-deef-4148-9d18-23148107e28d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:29.357492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4911a90b-deef-4148-9d18-23148107e28d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:29.358170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4911a90b-deef-4148-9d18-23148107e28d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:29.358615 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4911a90b-deef-4148-9d18-23148107e28d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:29.359030 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4911a90b-deef-4148-9d18-23148107e28d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:29.388606 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4911a90b-deef-4148-9d18-23148107e28d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044456 Oct 11 06:46:29.389142 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 381/716] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:29 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:29.903437 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-578a9c88-a3f0-43ad-a63a-85301dfa6290 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:29.905493 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-578a9c88-a3f0-43ad-a63a-85301dfa6290 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:29.911927 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-578a9c88-a3f0-43ad-a63a-85301dfa6290 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:29.912406 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-578a9c88-a3f0-43ad-a63a-85301dfa6290 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:29.912840 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-578a9c88-a3f0-43ad-a63a-85301dfa6290 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:29.913529 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-578a9c88-a3f0-43ad-a63a-85301dfa6290 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:29.913976 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-578a9c88-a3f0-43ad-a63a-85301dfa6290 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:29.914896 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-578a9c88-a3f0-43ad-a63a-85301dfa6290 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:29.943586 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-578a9c88-a3f0-43ad-a63a-85301dfa6290 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044458 Oct 11 06:46:29.944124 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 336/717] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:29 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:30.401848 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8c3def4b-e914-46fc-b0ff-3484cc517a4f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:30.404003 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8c3def4b-e914-46fc-b0ff-3484cc517a4f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:30.410388 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c3def4b-e914-46fc-b0ff-3484cc517a4f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:30.410868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c3def4b-e914-46fc-b0ff-3484cc517a4f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:30.411291 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c3def4b-e914-46fc-b0ff-3484cc517a4f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:30.412023 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c3def4b-e914-46fc-b0ff-3484cc517a4f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:30.412464 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c3def4b-e914-46fc-b0ff-3484cc517a4f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:30.412876 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c3def4b-e914-46fc-b0ff-3484cc517a4f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:30.441058 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8c3def4b-e914-46fc-b0ff-3484cc517a4f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044057 Oct 11 06:46:30.441594 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 382/718] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:30 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:30.956132 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-07e7a225-065c-4f60-8832-cf8c0fdedc4a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:30.958194 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-07e7a225-065c-4f60-8832-cf8c0fdedc4a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:30.964540 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-07e7a225-065c-4f60-8832-cf8c0fdedc4a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:30.965010 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-07e7a225-065c-4f60-8832-cf8c0fdedc4a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:30.965435 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-07e7a225-065c-4f60-8832-cf8c0fdedc4a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:30.966111 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-07e7a225-065c-4f60-8832-cf8c0fdedc4a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:30.966555 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-07e7a225-065c-4f60-8832-cf8c0fdedc4a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:30.966969 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-07e7a225-065c-4f60-8832-cf8c0fdedc4a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:30.995745 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-07e7a225-065c-4f60-8832-cf8c0fdedc4a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043635 Oct 11 06:46:30.996278 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 337/719] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:30 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:31.453877 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b98b5db4-fb85-4e6e-a661-2a63bee2b7f7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:31.456083 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b98b5db4-fb85-4e6e-a661-2a63bee2b7f7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:31.462977 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b98b5db4-fb85-4e6e-a661-2a63bee2b7f7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:31.463470 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b98b5db4-fb85-4e6e-a661-2a63bee2b7f7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:31.463905 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b98b5db4-fb85-4e6e-a661-2a63bee2b7f7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:31.464585 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b98b5db4-fb85-4e6e-a661-2a63bee2b7f7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:31.465029 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b98b5db4-fb85-4e6e-a661-2a63bee2b7f7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:31.465446 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b98b5db4-fb85-4e6e-a661-2a63bee2b7f7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:31.493908 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b98b5db4-fb85-4e6e-a661-2a63bee2b7f7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043981 Oct 11 06:46:31.494442 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 383/720] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:31 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:32.008402 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ab106d50-bb79-4a1f-9111-0088782c0154 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:32.010434 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ab106d50-bb79-4a1f-9111-0088782c0154 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:32.016853 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ab106d50-bb79-4a1f-9111-0088782c0154 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:32.017325 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ab106d50-bb79-4a1f-9111-0088782c0154 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:32.017755 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ab106d50-bb79-4a1f-9111-0088782c0154 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:32.018438 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ab106d50-bb79-4a1f-9111-0088782c0154 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:32.018883 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ab106d50-bb79-4a1f-9111-0088782c0154 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:32.019300 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ab106d50-bb79-4a1f-9111-0088782c0154 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:32.047933 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ab106d50-bb79-4a1f-9111-0088782c0154 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043621 Oct 11 06:46:32.048461 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 338/721] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:32 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:32.506063 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7e638e16-9bb8-4b36-8b2e-3ad7045958b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:32.508229 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7e638e16-9bb8-4b36-8b2e-3ad7045958b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:32.514505 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e638e16-9bb8-4b36-8b2e-3ad7045958b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:32.514986 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e638e16-9bb8-4b36-8b2e-3ad7045958b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:32.515433 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e638e16-9bb8-4b36-8b2e-3ad7045958b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:32.516123 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e638e16-9bb8-4b36-8b2e-3ad7045958b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:32.516572 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e638e16-9bb8-4b36-8b2e-3ad7045958b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:32.516991 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e638e16-9bb8-4b36-8b2e-3ad7045958b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:32.546831 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7e638e16-9bb8-4b36-8b2e-3ad7045958b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044677 Oct 11 06:46:32.547366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 384/722] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:32 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:33.061004 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-51432506-02fc-4ebb-8c2d-74d2ef141d24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:33.063144 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-51432506-02fc-4ebb-8c2d-74d2ef141d24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:33.069518 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-51432506-02fc-4ebb-8c2d-74d2ef141d24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:33.069989 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-51432506-02fc-4ebb-8c2d-74d2ef141d24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:33.070496 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-51432506-02fc-4ebb-8c2d-74d2ef141d24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:33.071709 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-51432506-02fc-4ebb-8c2d-74d2ef141d24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:33.072158 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-51432506-02fc-4ebb-8c2d-74d2ef141d24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:33.072572 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-51432506-02fc-4ebb-8c2d-74d2ef141d24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:33.100536 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-51432506-02fc-4ebb-8c2d-74d2ef141d24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043483 Oct 11 06:46:33.101060 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 339/723] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:33 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:33.559567 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-affa2265-7619-4492-aa94-97dd734d5fb2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:33.561728 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-affa2265-7619-4492-aa94-97dd734d5fb2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:33.568106 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-affa2265-7619-4492-aa94-97dd734d5fb2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:33.568585 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-affa2265-7619-4492-aa94-97dd734d5fb2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:33.569016 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-affa2265-7619-4492-aa94-97dd734d5fb2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:33.569694 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-affa2265-7619-4492-aa94-97dd734d5fb2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:33.570137 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-affa2265-7619-4492-aa94-97dd734d5fb2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:33.570553 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-affa2265-7619-4492-aa94-97dd734d5fb2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:33.599442 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-affa2265-7619-4492-aa94-97dd734d5fb2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044421 Oct 11 06:46:33.599999 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 385/724] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:33 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:34.112661 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-31ffcb2d-592f-408a-a708-401f29d5ee27 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:34.114849 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-31ffcb2d-592f-408a-a708-401f29d5ee27 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:34.121868 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-31ffcb2d-592f-408a-a708-401f29d5ee27 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:34.122347 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-31ffcb2d-592f-408a-a708-401f29d5ee27 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:34.122808 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-31ffcb2d-592f-408a-a708-401f29d5ee27 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:34.123527 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-31ffcb2d-592f-408a-a708-401f29d5ee27 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:34.123983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-31ffcb2d-592f-408a-a708-401f29d5ee27 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:34.124406 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-31ffcb2d-592f-408a-a708-401f29d5ee27 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:34.153069 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-31ffcb2d-592f-408a-a708-401f29d5ee27 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044367 Oct 11 06:46:34.153611 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 340/725] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:34 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:34.612628 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d8454121-401e-486f-8965-74b38ab01bc0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:34.614823 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d8454121-401e-486f-8965-74b38ab01bc0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:34.621653 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8454121-401e-486f-8965-74b38ab01bc0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:34.622134 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8454121-401e-486f-8965-74b38ab01bc0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:34.622557 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8454121-401e-486f-8965-74b38ab01bc0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:34.623247 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8454121-401e-486f-8965-74b38ab01bc0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:34.623802 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8454121-401e-486f-8965-74b38ab01bc0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:34.624217 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8454121-401e-486f-8965-74b38ab01bc0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:34.640828 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:46:34.654375 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d8454121-401e-486f-8965-74b38ab01bc0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045777 Oct 11 06:46:34.654902 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 386/726] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:34 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:46:35.166285 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f077feae-86f5-413e-917c-38b46b493b52 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:35.168571 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f077feae-86f5-413e-917c-38b46b493b52 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:35.174920 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f077feae-86f5-413e-917c-38b46b493b52 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:35.175403 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f077feae-86f5-413e-917c-38b46b493b52 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:35.175872 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f077feae-86f5-413e-917c-38b46b493b52 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:35.176554 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f077feae-86f5-413e-917c-38b46b493b52 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:35.177000 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f077feae-86f5-413e-917c-38b46b493b52 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:35.177412 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f077feae-86f5-413e-917c-38b46b493b52 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:35.207193 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f077feae-86f5-413e-917c-38b46b493b52 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045345 Oct 11 06:46:35.207940 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 341/727] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:35 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:35.666766 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2def575e-7768-44fd-8a4f-45067d3cdb9a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:35.668868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2def575e-7768-44fd-8a4f-45067d3cdb9a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:35.675211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2def575e-7768-44fd-8a4f-45067d3cdb9a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:35.675746 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2def575e-7768-44fd-8a4f-45067d3cdb9a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:35.676175 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2def575e-7768-44fd-8a4f-45067d3cdb9a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:35.676866 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2def575e-7768-44fd-8a4f-45067d3cdb9a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:35.677312 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2def575e-7768-44fd-8a4f-45067d3cdb9a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:35.677750 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2def575e-7768-44fd-8a4f-45067d3cdb9a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:35.708111 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2def575e-7768-44fd-8a4f-45067d3cdb9a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045319 Oct 11 06:46:35.708666 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 387/728] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:35 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:36.220553 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6bb394d1-f193-40fa-b2bc-f8923382aa9d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:36.222624 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6bb394d1-f193-40fa-b2bc-f8923382aa9d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:36.225042 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=58 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:46:36.230153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6bb394d1-f193-40fa-b2bc-f8923382aa9d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:36.230630 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6bb394d1-f193-40fa-b2bc-f8923382aa9d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:36.231064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6bb394d1-f193-40fa-b2bc-f8923382aa9d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:36.231780 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6bb394d1-f193-40fa-b2bc-f8923382aa9d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:36.232230 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6bb394d1-f193-40fa-b2bc-f8923382aa9d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:36.232647 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6bb394d1-f193-40fa-b2bc-f8923382aa9d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:36.262012 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6bb394d1-f193-40fa-b2bc-f8923382aa9d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045456 Oct 11 06:46:36.262549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 342/729] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:36 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:36.720280 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2f7c635f-a84f-4727-8e0a-84cf2e84a466 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:36.722397 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2f7c635f-a84f-4727-8e0a-84cf2e84a466 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:36.729251 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f7c635f-a84f-4727-8e0a-84cf2e84a466 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:36.729717 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f7c635f-a84f-4727-8e0a-84cf2e84a466 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:36.730139 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f7c635f-a84f-4727-8e0a-84cf2e84a466 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:36.730817 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f7c635f-a84f-4727-8e0a-84cf2e84a466 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:36.731257 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f7c635f-a84f-4727-8e0a-84cf2e84a466 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:36.731706 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f7c635f-a84f-4727-8e0a-84cf2e84a466 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:36.759549 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2f7c635f-a84f-4727-8e0a-84cf2e84a466 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043167 Oct 11 06:46:36.760080 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 388/730] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:36 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:37.274874 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ffe5d31d-e5dd-449a-a949-4566e6b295b0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:37.277222 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ffe5d31d-e5dd-449a-a949-4566e6b295b0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:37.283597 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ffe5d31d-e5dd-449a-a949-4566e6b295b0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:37.284076 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ffe5d31d-e5dd-449a-a949-4566e6b295b0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:37.284511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ffe5d31d-e5dd-449a-a949-4566e6b295b0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:37.285199 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ffe5d31d-e5dd-449a-a949-4566e6b295b0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:37.285646 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ffe5d31d-e5dd-449a-a949-4566e6b295b0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:37.286064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ffe5d31d-e5dd-449a-a949-4566e6b295b0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:37.314188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ffe5d31d-e5dd-449a-a949-4566e6b295b0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043973 Oct 11 06:46:37.314726 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 343/731] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:37 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:37.771898 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a6ae3e6d-bfe1-4281-a7ee-3f82587411da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:37.774540 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a6ae3e6d-bfe1-4281-a7ee-3f82587411da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:37.781205 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6ae3e6d-bfe1-4281-a7ee-3f82587411da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:37.781714 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6ae3e6d-bfe1-4281-a7ee-3f82587411da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:37.782147 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6ae3e6d-bfe1-4281-a7ee-3f82587411da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:37.782841 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6ae3e6d-bfe1-4281-a7ee-3f82587411da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:37.783287 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6ae3e6d-bfe1-4281-a7ee-3f82587411da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:37.783750 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6ae3e6d-bfe1-4281-a7ee-3f82587411da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:37.812847 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a6ae3e6d-bfe1-4281-a7ee-3f82587411da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044840 Oct 11 06:46:37.813319 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 389/732] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:37 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:38.327071 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-02c7f9ef-67be-4af2-bdbc-9963f95a2b70 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:38.329196 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-02c7f9ef-67be-4af2-bdbc-9963f95a2b70 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:38.335609 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-02c7f9ef-67be-4af2-bdbc-9963f95a2b70 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:38.336083 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-02c7f9ef-67be-4af2-bdbc-9963f95a2b70 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:38.336511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-02c7f9ef-67be-4af2-bdbc-9963f95a2b70 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:38.337191 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-02c7f9ef-67be-4af2-bdbc-9963f95a2b70 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:38.337634 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-02c7f9ef-67be-4af2-bdbc-9963f95a2b70 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:38.338044 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-02c7f9ef-67be-4af2-bdbc-9963f95a2b70 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:38.341543 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:46:38.366903 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-02c7f9ef-67be-4af2-bdbc-9963f95a2b70 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043810 Oct 11 06:46:38.367999 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 344/733] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:38 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:38.824890 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0688c1ab-c466-40d6-9169-7173a1d8a67d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:38.827000 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0688c1ab-c466-40d6-9169-7173a1d8a67d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:38.833406 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0688c1ab-c466-40d6-9169-7173a1d8a67d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:38.833881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0688c1ab-c466-40d6-9169-7173a1d8a67d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:38.834314 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0688c1ab-c466-40d6-9169-7173a1d8a67d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:38.835032 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0688c1ab-c466-40d6-9169-7173a1d8a67d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:38.835508 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0688c1ab-c466-40d6-9169-7173a1d8a67d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:38.835954 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0688c1ab-c466-40d6-9169-7173a1d8a67d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:38.864691 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0688c1ab-c466-40d6-9169-7173a1d8a67d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043720 Oct 11 06:46:38.865221 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 390/734] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:38 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:39.380083 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5680e4d2-89e0-43bf-9ffc-e760812c7470 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:39.382251 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5680e4d2-89e0-43bf-9ffc-e760812c7470 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:39.389160 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5680e4d2-89e0-43bf-9ffc-e760812c7470 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:39.389637 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5680e4d2-89e0-43bf-9ffc-e760812c7470 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:39.390072 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5680e4d2-89e0-43bf-9ffc-e760812c7470 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:39.390760 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5680e4d2-89e0-43bf-9ffc-e760812c7470 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:39.391213 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5680e4d2-89e0-43bf-9ffc-e760812c7470 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:39.391659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5680e4d2-89e0-43bf-9ffc-e760812c7470 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:39.422773 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5680e4d2-89e0-43bf-9ffc-e760812c7470 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046596 Oct 11 06:46:39.423331 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 345/735] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:39 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:39.877347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f304dc09-f5d5-4059-996b-2d3ea7e6bf38 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:39.879481 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f304dc09-f5d5-4059-996b-2d3ea7e6bf38 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:39.886335 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f304dc09-f5d5-4059-996b-2d3ea7e6bf38 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:39.886799 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f304dc09-f5d5-4059-996b-2d3ea7e6bf38 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:39.887223 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f304dc09-f5d5-4059-996b-2d3ea7e6bf38 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:39.887927 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f304dc09-f5d5-4059-996b-2d3ea7e6bf38 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:39.888370 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f304dc09-f5d5-4059-996b-2d3ea7e6bf38 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:39.888780 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f304dc09-f5d5-4059-996b-2d3ea7e6bf38 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:39.917272 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f304dc09-f5d5-4059-996b-2d3ea7e6bf38 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043857 Oct 11 06:46:39.917800 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 391/736] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:39 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:40.435778 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a7c3daa3-1fe2-4afd-937a-92404a856ffe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:40.437918 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a7c3daa3-1fe2-4afd-937a-92404a856ffe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:40.444230 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a7c3daa3-1fe2-4afd-937a-92404a856ffe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:40.444700 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a7c3daa3-1fe2-4afd-937a-92404a856ffe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:40.445124 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a7c3daa3-1fe2-4afd-937a-92404a856ffe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:40.445805 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a7c3daa3-1fe2-4afd-937a-92404a856ffe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:40.446247 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a7c3daa3-1fe2-4afd-937a-92404a856ffe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:40.446665 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a7c3daa3-1fe2-4afd-937a-92404a856ffe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:40.474797 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a7c3daa3-1fe2-4afd-937a-92404a856ffe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043004 Oct 11 06:46:40.475321 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 346/737] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:40 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:40.929633 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-11e004e3-e75e-4e3d-b950-358aebf68a68 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:40.932297 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-11e004e3-e75e-4e3d-b950-358aebf68a68 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:40.938611 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-11e004e3-e75e-4e3d-b950-358aebf68a68 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:40.939082 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-11e004e3-e75e-4e3d-b950-358aebf68a68 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:40.939544 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-11e004e3-e75e-4e3d-b950-358aebf68a68 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:40.940222 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-11e004e3-e75e-4e3d-b950-358aebf68a68 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:40.940663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-11e004e3-e75e-4e3d-b950-358aebf68a68 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:40.941084 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-11e004e3-e75e-4e3d-b950-358aebf68a68 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:40.969503 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-11e004e3-e75e-4e3d-b950-358aebf68a68 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043904 Oct 11 06:46:40.970036 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 392/738] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:40 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:41.487937 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-097ca0c1-b54a-4d2d-a8c7-5fc15ef43991 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:41.489989 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-097ca0c1-b54a-4d2d-a8c7-5fc15ef43991 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:41.496839 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-097ca0c1-b54a-4d2d-a8c7-5fc15ef43991 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:41.497312 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-097ca0c1-b54a-4d2d-a8c7-5fc15ef43991 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:41.497744 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-097ca0c1-b54a-4d2d-a8c7-5fc15ef43991 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:41.498428 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-097ca0c1-b54a-4d2d-a8c7-5fc15ef43991 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:41.498875 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-097ca0c1-b54a-4d2d-a8c7-5fc15ef43991 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:41.499323 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-097ca0c1-b54a-4d2d-a8c7-5fc15ef43991 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:41.528365 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-097ca0c1-b54a-4d2d-a8c7-5fc15ef43991 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044513 Oct 11 06:46:41.528896 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 347/739] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:41 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:41.982584 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8ded4bf9-c495-4847-b067-56fdc0ea3124 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:41.984798 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8ded4bf9-c495-4847-b067-56fdc0ea3124 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:41.991085 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ded4bf9-c495-4847-b067-56fdc0ea3124 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:41.991611 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ded4bf9-c495-4847-b067-56fdc0ea3124 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:41.992039 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ded4bf9-c495-4847-b067-56fdc0ea3124 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:41.992721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ded4bf9-c495-4847-b067-56fdc0ea3124 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:41.993161 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ded4bf9-c495-4847-b067-56fdc0ea3124 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:41.993573 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ded4bf9-c495-4847-b067-56fdc0ea3124 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:42.021520 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8ded4bf9-c495-4847-b067-56fdc0ea3124 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042903 Oct 11 06:46:42.022055 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 393/740] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:41 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:42.540929 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-51170644-9e9f-4ebc-b720-2128a1974471 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:42.542990 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-51170644-9e9f-4ebc-b720-2128a1974471 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:42.549398 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-51170644-9e9f-4ebc-b720-2128a1974471 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:42.549875 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-51170644-9e9f-4ebc-b720-2128a1974471 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:42.550305 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-51170644-9e9f-4ebc-b720-2128a1974471 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:42.550998 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-51170644-9e9f-4ebc-b720-2128a1974471 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:42.551469 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-51170644-9e9f-4ebc-b720-2128a1974471 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:42.551889 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-51170644-9e9f-4ebc-b720-2128a1974471 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:42.581543 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-51170644-9e9f-4ebc-b720-2128a1974471 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044623 Oct 11 06:46:42.582090 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 348/741] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:42 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:43.034589 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-68dfacbb-84db-44a7-a2eb-30b0e60ea1e1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:43.036754 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-68dfacbb-84db-44a7-a2eb-30b0e60ea1e1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:43.043389 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-68dfacbb-84db-44a7-a2eb-30b0e60ea1e1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:43.043890 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-68dfacbb-84db-44a7-a2eb-30b0e60ea1e1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:43.044312 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-68dfacbb-84db-44a7-a2eb-30b0e60ea1e1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:43.044985 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-68dfacbb-84db-44a7-a2eb-30b0e60ea1e1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:43.045526 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-68dfacbb-84db-44a7-a2eb-30b0e60ea1e1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:43.045942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-68dfacbb-84db-44a7-a2eb-30b0e60ea1e1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:43.075251 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-68dfacbb-84db-44a7-a2eb-30b0e60ea1e1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044632 Oct 11 06:46:43.075817 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 394/742] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:43 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:43.595052 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5deb6bbd-e1c2-45a3-a85d-79e4fffa0217 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:43.597139 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5deb6bbd-e1c2-45a3-a85d-79e4fffa0217 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:43.604240 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5deb6bbd-e1c2-45a3-a85d-79e4fffa0217 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:43.604717 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5deb6bbd-e1c2-45a3-a85d-79e4fffa0217 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:43.605148 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5deb6bbd-e1c2-45a3-a85d-79e4fffa0217 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:43.605834 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5deb6bbd-e1c2-45a3-a85d-79e4fffa0217 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:43.606282 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5deb6bbd-e1c2-45a3-a85d-79e4fffa0217 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:43.606702 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5deb6bbd-e1c2-45a3-a85d-79e4fffa0217 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:43.634974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5deb6bbd-e1c2-45a3-a85d-79e4fffa0217 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044009 Oct 11 06:46:43.635741 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 349/743] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:43 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:44.088311 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ad3810ab-d941-44e7-a758-3c3f1dc88f3a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:44.090422 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ad3810ab-d941-44e7-a758-3c3f1dc88f3a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:44.096683 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ad3810ab-d941-44e7-a758-3c3f1dc88f3a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:44.097158 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ad3810ab-d941-44e7-a758-3c3f1dc88f3a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:44.097580 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ad3810ab-d941-44e7-a758-3c3f1dc88f3a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:44.098257 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ad3810ab-d941-44e7-a758-3c3f1dc88f3a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:44.098727 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ad3810ab-d941-44e7-a758-3c3f1dc88f3a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:44.099139 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ad3810ab-d941-44e7-a758-3c3f1dc88f3a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:44.127076 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ad3810ab-d941-44e7-a758-3c3f1dc88f3a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043424 Oct 11 06:46:44.127707 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 395/744] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:44 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:44.648025 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d388aa2e-cf02-4975-955f-cac92e656748 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:44.650332 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d388aa2e-cf02-4975-955f-cac92e656748 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:44.656647 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d388aa2e-cf02-4975-955f-cac92e656748 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:44.657128 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d388aa2e-cf02-4975-955f-cac92e656748 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:44.657557 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d388aa2e-cf02-4975-955f-cac92e656748 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:44.658247 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d388aa2e-cf02-4975-955f-cac92e656748 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:44.658696 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d388aa2e-cf02-4975-955f-cac92e656748 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:44.659116 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d388aa2e-cf02-4975-955f-cac92e656748 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:44.688374 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d388aa2e-cf02-4975-955f-cac92e656748 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044370 Oct 11 06:46:44.688906 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 350/745] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:44 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:45.138952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1194f026-9e9e-40ca-9be1-ff6ebf5e40db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:45.141096 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1194f026-9e9e-40ca-9be1-ff6ebf5e40db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:45.147374 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1194f026-9e9e-40ca-9be1-ff6ebf5e40db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:45.147877 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1194f026-9e9e-40ca-9be1-ff6ebf5e40db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:45.148818 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1194f026-9e9e-40ca-9be1-ff6ebf5e40db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:45.149492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1194f026-9e9e-40ca-9be1-ff6ebf5e40db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:45.149931 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1194f026-9e9e-40ca-9be1-ff6ebf5e40db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:45.150596 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1194f026-9e9e-40ca-9be1-ff6ebf5e40db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:45.179255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1194f026-9e9e-40ca-9be1-ff6ebf5e40db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044236 Oct 11 06:46:45.179818 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 396/746] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:45 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:45.701447 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c9587b13-c704-48e3-bcfc-8e1c25ea5572 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:45.703673 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c9587b13-c704-48e3-bcfc-8e1c25ea5572 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:45.710037 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c9587b13-c704-48e3-bcfc-8e1c25ea5572 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:45.710515 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c9587b13-c704-48e3-bcfc-8e1c25ea5572 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:45.711546 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c9587b13-c704-48e3-bcfc-8e1c25ea5572 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:45.712238 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c9587b13-c704-48e3-bcfc-8e1c25ea5572 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:45.712689 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c9587b13-c704-48e3-bcfc-8e1c25ea5572 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:45.713110 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c9587b13-c704-48e3-bcfc-8e1c25ea5572 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:45.741423 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c9587b13-c704-48e3-bcfc-8e1c25ea5572 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043901 Oct 11 06:46:45.742479 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 351/747] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:45 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:46.191559 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2ab3348e-3206-45a1-9d90-5354c332690d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:46.193677 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2ab3348e-3206-45a1-9d90-5354c332690d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:46.200070 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ab3348e-3206-45a1-9d90-5354c332690d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:46.200552 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ab3348e-3206-45a1-9d90-5354c332690d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:46.200985 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ab3348e-3206-45a1-9d90-5354c332690d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:46.201671 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ab3348e-3206-45a1-9d90-5354c332690d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:46.202121 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ab3348e-3206-45a1-9d90-5354c332690d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:46.202576 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ab3348e-3206-45a1-9d90-5354c332690d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:46.232874 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2ab3348e-3206-45a1-9d90-5354c332690d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045304 Oct 11 06:46:46.233435 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 397/748] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:46 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:46.754547 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-db0ad6f4-de7e-4991-9ca5-c58b8268a96a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:46.756654 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-db0ad6f4-de7e-4991-9ca5-c58b8268a96a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:46.763121 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db0ad6f4-de7e-4991-9ca5-c58b8268a96a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:46.763640 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db0ad6f4-de7e-4991-9ca5-c58b8268a96a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:46.764071 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db0ad6f4-de7e-4991-9ca5-c58b8268a96a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:46.764755 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db0ad6f4-de7e-4991-9ca5-c58b8268a96a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:46.765204 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db0ad6f4-de7e-4991-9ca5-c58b8268a96a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:46.765623 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db0ad6f4-de7e-4991-9ca5-c58b8268a96a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:46.795287 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-db0ad6f4-de7e-4991-9ca5-c58b8268a96a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044849 Oct 11 06:46:46.795852 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 352/749] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:46 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 06:46:47.245262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-49c33a28-bd4f-485d-8d17-1fe840c77bb2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:47.247402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-49c33a28-bd4f-485d-8d17-1fe840c77bb2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:47.253881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49c33a28-bd4f-485d-8d17-1fe840c77bb2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:47.254353 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49c33a28-bd4f-485d-8d17-1fe840c77bb2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:47.254781 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49c33a28-bd4f-485d-8d17-1fe840c77bb2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:47.255509 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49c33a28-bd4f-485d-8d17-1fe840c77bb2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:47.255956 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49c33a28-bd4f-485d-8d17-1fe840c77bb2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:47.256372 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49c33a28-bd4f-485d-8d17-1fe840c77bb2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:47.286958 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-49c33a28-bd4f-485d-8d17-1fe840c77bb2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045604 Oct 11 06:46:47.287522 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 398/750] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:47 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:47.808762 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ceca5ac4-2690-416a-aa93-937fae874578 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:47.810826 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ceca5ac4-2690-416a-aa93-937fae874578 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:47.816816 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ceca5ac4-2690-416a-aa93-937fae874578 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:47.817295 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ceca5ac4-2690-416a-aa93-937fae874578 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:47.817729 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ceca5ac4-2690-416a-aa93-937fae874578 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:47.818418 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ceca5ac4-2690-416a-aa93-937fae874578 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:47.818866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ceca5ac4-2690-416a-aa93-937fae874578 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:47.819285 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ceca5ac4-2690-416a-aa93-937fae874578 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:47.847663 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ceca5ac4-2690-416a-aa93-937fae874578 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043822 Oct 11 06:46:47.848208 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 353/751] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:47 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:48.299219 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fa452211-595f-47c9-85a9-2e9ead31d226 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:48.301360 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fa452211-595f-47c9-85a9-2e9ead31d226 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:48.308108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa452211-595f-47c9-85a9-2e9ead31d226 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:48.308575 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa452211-595f-47c9-85a9-2e9ead31d226 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:48.309000 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa452211-595f-47c9-85a9-2e9ead31d226 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:48.309679 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa452211-595f-47c9-85a9-2e9ead31d226 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:48.310123 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa452211-595f-47c9-85a9-2e9ead31d226 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:48.310532 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa452211-595f-47c9-85a9-2e9ead31d226 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:48.341066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fa452211-595f-47c9-85a9-2e9ead31d226 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045439 Oct 11 06:46:48.341852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 399/752] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:48 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:48.861006 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-615c69ab-3fb0-4635-a943-2f19e275c794 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:48.863193 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-615c69ab-3fb0-4635-a943-2f19e275c794 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:48.869562 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-615c69ab-3fb0-4635-a943-2f19e275c794 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:48.870044 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-615c69ab-3fb0-4635-a943-2f19e275c794 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:48.870477 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-615c69ab-3fb0-4635-a943-2f19e275c794 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:48.871173 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-615c69ab-3fb0-4635-a943-2f19e275c794 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:48.871663 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-615c69ab-3fb0-4635-a943-2f19e275c794 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:48.872090 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-615c69ab-3fb0-4635-a943-2f19e275c794 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:48.900872 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-615c69ab-3fb0-4635-a943-2f19e275c794 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043829 Oct 11 06:46:48.901415 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 354/753] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:48 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:49.353775 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-790d52f7-0afd-4516-9627-9f16668073d4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:49.355991 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-790d52f7-0afd-4516-9627-9f16668073d4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:49.362307 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-790d52f7-0afd-4516-9627-9f16668073d4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:49.362783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-790d52f7-0afd-4516-9627-9f16668073d4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:49.363216 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-790d52f7-0afd-4516-9627-9f16668073d4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:49.363937 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-790d52f7-0afd-4516-9627-9f16668073d4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:49.364384 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-790d52f7-0afd-4516-9627-9f16668073d4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:49.364804 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-790d52f7-0afd-4516-9627-9f16668073d4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:49.393429 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-790d52f7-0afd-4516-9627-9f16668073d4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043664 Oct 11 06:46:49.393959 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 400/754] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:49 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:49.912528 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-62e7c100-7466-442d-9463-a80de54dc029 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:49.915114 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-62e7c100-7466-442d-9463-a80de54dc029 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:49.921518 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62e7c100-7466-442d-9463-a80de54dc029 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:49.922004 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62e7c100-7466-442d-9463-a80de54dc029 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:49.922438 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62e7c100-7466-442d-9463-a80de54dc029 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:49.923163 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62e7c100-7466-442d-9463-a80de54dc029 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:49.923646 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62e7c100-7466-442d-9463-a80de54dc029 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:49.924125 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62e7c100-7466-442d-9463-a80de54dc029 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:49.953139 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-62e7c100-7466-442d-9463-a80de54dc029 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044617 Oct 11 06:46:49.953679 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 355/755] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:49 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:50.406842 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-42f8dba0-657c-4cea-80b6-1127fbff38f7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:50.409043 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-42f8dba0-657c-4cea-80b6-1127fbff38f7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:50.411322 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 06:46:50.411490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Tue Oct 11 06:46:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments (ip 10.222.0.39) !!! Oct 11 06:46:50.419333 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42f8dba0-657c-4cea-80b6-1127fbff38f7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:50.419843 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42f8dba0-657c-4cea-80b6-1127fbff38f7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:50.420275 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42f8dba0-657c-4cea-80b6-1127fbff38f7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:50.420969 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42f8dba0-657c-4cea-80b6-1127fbff38f7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:50.421416 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42f8dba0-657c-4cea-80b6-1127fbff38f7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:50.421838 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42f8dba0-657c-4cea-80b6-1127fbff38f7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:50.450668 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-42f8dba0-657c-4cea-80b6-1127fbff38f7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047864 Oct 11 06:46:50.451217 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 401/756] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:50 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:50.964795 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-24827dea-c28c-4c61-ba7d-fabaaff035c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:50.967140 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-24827dea-c28c-4c61-ba7d-fabaaff035c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:50.973540 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-24827dea-c28c-4c61-ba7d-fabaaff035c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:50.974023 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-24827dea-c28c-4c61-ba7d-fabaaff035c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:50.974455 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-24827dea-c28c-4c61-ba7d-fabaaff035c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:50.975180 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-24827dea-c28c-4c61-ba7d-fabaaff035c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:50.975657 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-24827dea-c28c-4c61-ba7d-fabaaff035c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:50.976079 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-24827dea-c28c-4c61-ba7d-fabaaff035c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:51.006744 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-24827dea-c28c-4c61-ba7d-fabaaff035c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045945 Oct 11 06:46:51.007301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 356/757] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:50 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:51.463745 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d1339620-4370-4a2b-9454-c2f8994a0958 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:51.465873 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d1339620-4370-4a2b-9454-c2f8994a0958 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:51.471717 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d1339620-4370-4a2b-9454-c2f8994a0958 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:51.472184 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d1339620-4370-4a2b-9454-c2f8994a0958 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:51.472609 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d1339620-4370-4a2b-9454-c2f8994a0958 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:51.473282 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d1339620-4370-4a2b-9454-c2f8994a0958 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:51.473718 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d1339620-4370-4a2b-9454-c2f8994a0958 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:51.474128 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d1339620-4370-4a2b-9454-c2f8994a0958 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:51.501999 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d1339620-4370-4a2b-9454-c2f8994a0958 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042969 Oct 11 06:46:51.502533 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 402/758] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:51 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:52.175496 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-13fb2509-2b2a-46db-93f9-2b2264f6cbcd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:52.177696 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-13fb2509-2b2a-46db-93f9-2b2264f6cbcd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:52.184184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13fb2509-2b2a-46db-93f9-2b2264f6cbcd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:52.184667 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13fb2509-2b2a-46db-93f9-2b2264f6cbcd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:52.185100 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13fb2509-2b2a-46db-93f9-2b2264f6cbcd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:52.185788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13fb2509-2b2a-46db-93f9-2b2264f6cbcd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:52.186237 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13fb2509-2b2a-46db-93f9-2b2264f6cbcd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:52.186655 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13fb2509-2b2a-46db-93f9-2b2264f6cbcd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:52.215995 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-13fb2509-2b2a-46db-93f9-2b2264f6cbcd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.200407 Oct 11 06:46:52.216551 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 357/759] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:52 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:52.513659 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cae9de13-4ee3-49bc-be3a-9891e71c064c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:52.515800 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cae9de13-4ee3-49bc-be3a-9891e71c064c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:52.522048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cae9de13-4ee3-49bc-be3a-9891e71c064c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:52.522519 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cae9de13-4ee3-49bc-be3a-9891e71c064c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:52.522944 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cae9de13-4ee3-49bc-be3a-9891e71c064c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:52.523672 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cae9de13-4ee3-49bc-be3a-9891e71c064c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:52.524601 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cae9de13-4ee3-49bc-be3a-9891e71c064c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:52.525274 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cae9de13-4ee3-49bc-be3a-9891e71c064c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:52.528850 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:46:52.554236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cae9de13-4ee3-49bc-be3a-9891e71c064c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044554 Oct 11 06:46:52.554862 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 403/760] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:52 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:53.228771 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9741c064-92a8-49f1-8c62-1fdf31208290 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:53.230804 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9741c064-92a8-49f1-8c62-1fdf31208290 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:53.237140 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9741c064-92a8-49f1-8c62-1fdf31208290 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:53.237614 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9741c064-92a8-49f1-8c62-1fdf31208290 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:53.238040 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9741c064-92a8-49f1-8c62-1fdf31208290 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:53.238718 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9741c064-92a8-49f1-8c62-1fdf31208290 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:53.239160 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9741c064-92a8-49f1-8c62-1fdf31208290 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:53.239604 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9741c064-92a8-49f1-8c62-1fdf31208290 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:53.268582 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9741c064-92a8-49f1-8c62-1fdf31208290 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043973 Oct 11 06:46:53.269114 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 358/761] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:53 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 06:46:53.669143 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0286fd47-bd5c-4be4-aaf8-d56d009a9d5d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:53.671352 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0286fd47-bd5c-4be4-aaf8-d56d009a9d5d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:53.673198 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=58 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:46:53.678358 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0286fd47-bd5c-4be4-aaf8-d56d009a9d5d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:53.678832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0286fd47-bd5c-4be4-aaf8-d56d009a9d5d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:53.679262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0286fd47-bd5c-4be4-aaf8-d56d009a9d5d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:53.679990 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0286fd47-bd5c-4be4-aaf8-d56d009a9d5d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:53.680466 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0286fd47-bd5c-4be4-aaf8-d56d009a9d5d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:53.680882 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0286fd47-bd5c-4be4-aaf8-d56d009a9d5d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:53.709848 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0286fd47-bd5c-4be4-aaf8-d56d009a9d5d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147619 Oct 11 06:46:53.710395 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 404/762] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:53 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:54.280662 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6caa9093-64a7-42ce-900b-0462ff8c5971 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:54.282698 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6caa9093-64a7-42ce-900b-0462ff8c5971 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:54.289301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6caa9093-64a7-42ce-900b-0462ff8c5971 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:54.290293 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6caa9093-64a7-42ce-900b-0462ff8c5971 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:54.290717 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6caa9093-64a7-42ce-900b-0462ff8c5971 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:54.291398 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6caa9093-64a7-42ce-900b-0462ff8c5971 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:54.291862 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6caa9093-64a7-42ce-900b-0462ff8c5971 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:54.292272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6caa9093-64a7-42ce-900b-0462ff8c5971 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:54.320882 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6caa9093-64a7-42ce-900b-0462ff8c5971 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044291 Oct 11 06:46:54.321415 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 359/763] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:54 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:54.723099 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f8c7336b-a2f8-492b-9872-762a7def4cfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:54.725264 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f8c7336b-a2f8-492b-9872-762a7def4cfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:54.731642 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f8c7336b-a2f8-492b-9872-762a7def4cfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:54.732125 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f8c7336b-a2f8-492b-9872-762a7def4cfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:54.732556 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f8c7336b-a2f8-492b-9872-762a7def4cfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:54.733241 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f8c7336b-a2f8-492b-9872-762a7def4cfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:54.733686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f8c7336b-a2f8-492b-9872-762a7def4cfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:54.734100 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f8c7336b-a2f8-492b-9872-762a7def4cfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:54.763615 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f8c7336b-a2f8-492b-9872-762a7def4cfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044357 Oct 11 06:46:54.764170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 405/764] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:54 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:55.333011 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d767717b-1bd4-444a-a746-11de7ff9f032 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:55.335103 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d767717b-1bd4-444a-a746-11de7ff9f032 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:55.341443 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d767717b-1bd4-444a-a746-11de7ff9f032 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:55.341917 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d767717b-1bd4-444a-a746-11de7ff9f032 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:55.342342 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d767717b-1bd4-444a-a746-11de7ff9f032 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:55.343021 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d767717b-1bd4-444a-a746-11de7ff9f032 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:55.343487 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d767717b-1bd4-444a-a746-11de7ff9f032 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:55.343902 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d767717b-1bd4-444a-a746-11de7ff9f032 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:55.368731 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:46:55.373968 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d767717b-1bd4-444a-a746-11de7ff9f032 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045091 Oct 11 06:46:55.374503 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 360/765] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:55 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:55.776852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-572c5312-01e6-4871-9b93-5b96fce74537 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:55.778983 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-572c5312-01e6-4871-9b93-5b96fce74537 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:55.786201 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-572c5312-01e6-4871-9b93-5b96fce74537 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:55.786689 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-572c5312-01e6-4871-9b93-5b96fce74537 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:55.787131 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-572c5312-01e6-4871-9b93-5b96fce74537 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:55.787889 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-572c5312-01e6-4871-9b93-5b96fce74537 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:55.788337 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-572c5312-01e6-4871-9b93-5b96fce74537 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:55.788756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-572c5312-01e6-4871-9b93-5b96fce74537 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:55.817777 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-572c5312-01e6-4871-9b93-5b96fce74537 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045737 Oct 11 06:46:55.818322 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 406/766] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:55 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:56.387223 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4dd7f0c2-396c-4880-a7d1-b8569d23f9f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:56.389375 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4dd7f0c2-396c-4880-a7d1-b8569d23f9f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:56.395798 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4dd7f0c2-396c-4880-a7d1-b8569d23f9f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:56.396447 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4dd7f0c2-396c-4880-a7d1-b8569d23f9f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:56.396876 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4dd7f0c2-396c-4880-a7d1-b8569d23f9f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:56.397558 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4dd7f0c2-396c-4880-a7d1-b8569d23f9f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:56.398004 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4dd7f0c2-396c-4880-a7d1-b8569d23f9f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:56.398417 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4dd7f0c2-396c-4880-a7d1-b8569d23f9f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:56.427540 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4dd7f0c2-396c-4880-a7d1-b8569d23f9f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045082 Oct 11 06:46:56.428082 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 361/767] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:56 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:56.830775 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ed4e986b-1a7b-4dc7-b22a-89565a0ed420 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:56.832901 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ed4e986b-1a7b-4dc7-b22a-89565a0ed420 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:56.839464 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ed4e986b-1a7b-4dc7-b22a-89565a0ed420 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:56.839944 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ed4e986b-1a7b-4dc7-b22a-89565a0ed420 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:56.840375 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ed4e986b-1a7b-4dc7-b22a-89565a0ed420 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:56.841054 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ed4e986b-1a7b-4dc7-b22a-89565a0ed420 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:56.841495 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ed4e986b-1a7b-4dc7-b22a-89565a0ed420 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:56.841908 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ed4e986b-1a7b-4dc7-b22a-89565a0ed420 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:56.871237 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ed4e986b-1a7b-4dc7-b22a-89565a0ed420 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044484 Oct 11 06:46:56.871799 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 407/768] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:56 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:57.440444 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-41901f71-ff45-4ac6-9478-df3847814120 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:57.442627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-41901f71-ff45-4ac6-9478-df3847814120 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:57.449602 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41901f71-ff45-4ac6-9478-df3847814120 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:57.450068 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41901f71-ff45-4ac6-9478-df3847814120 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:57.450492 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41901f71-ff45-4ac6-9478-df3847814120 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:57.451172 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41901f71-ff45-4ac6-9478-df3847814120 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:57.451646 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41901f71-ff45-4ac6-9478-df3847814120 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:57.452057 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41901f71-ff45-4ac6-9478-df3847814120 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:57.480713 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-41901f71-ff45-4ac6-9478-df3847814120 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044200 Oct 11 06:46:57.481241 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 362/769] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:57 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:57.884187 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4baaf566-a238-406e-b0cd-90deefa99f7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:57.886397 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4baaf566-a238-406e-b0cd-90deefa99f7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:57.892705 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4baaf566-a238-406e-b0cd-90deefa99f7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:57.893179 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4baaf566-a238-406e-b0cd-90deefa99f7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:57.894496 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4baaf566-a238-406e-b0cd-90deefa99f7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:57.895228 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4baaf566-a238-406e-b0cd-90deefa99f7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:57.895228 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4baaf566-a238-406e-b0cd-90deefa99f7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:57.895626 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4baaf566-a238-406e-b0cd-90deefa99f7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:57.926147 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4baaf566-a238-406e-b0cd-90deefa99f7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046518 Oct 11 06:46:57.926701 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 408/770] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:57 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:58.493198 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-63e04ba0-77ea-4db0-8d9d-225d3b0507d9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:58.495245 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-63e04ba0-77ea-4db0-8d9d-225d3b0507d9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:58.501705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-63e04ba0-77ea-4db0-8d9d-225d3b0507d9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:58.502179 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-63e04ba0-77ea-4db0-8d9d-225d3b0507d9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:58.502605 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-63e04ba0-77ea-4db0-8d9d-225d3b0507d9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:58.503290 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-63e04ba0-77ea-4db0-8d9d-225d3b0507d9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:58.503766 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-63e04ba0-77ea-4db0-8d9d-225d3b0507d9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:58.504181 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-63e04ba0-77ea-4db0-8d9d-225d3b0507d9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:58.533134 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-63e04ba0-77ea-4db0-8d9d-225d3b0507d9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043962 Oct 11 06:46:58.533667 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 363/771] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:58 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:58.938484 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-17048b16-2af7-4cc2-bb75-34e661f172b5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:58.940706 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-17048b16-2af7-4cc2-bb75-34e661f172b5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:58.947646 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-17048b16-2af7-4cc2-bb75-34e661f172b5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:58.948122 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-17048b16-2af7-4cc2-bb75-34e661f172b5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:58.948550 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-17048b16-2af7-4cc2-bb75-34e661f172b5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:58.949231 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-17048b16-2af7-4cc2-bb75-34e661f172b5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:58.949676 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-17048b16-2af7-4cc2-bb75-34e661f172b5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:58.950093 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-17048b16-2af7-4cc2-bb75-34e661f172b5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:58.978934 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-17048b16-2af7-4cc2-bb75-34e661f172b5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044429 Oct 11 06:46:58.979499 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 409/772] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:58 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:46:59.546068 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-08fdad76-f337-4e72-98cc-a40889869a1c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:59.548192 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-08fdad76-f337-4e72-98cc-a40889869a1c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:59.554401 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-08fdad76-f337-4e72-98cc-a40889869a1c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:59.554873 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-08fdad76-f337-4e72-98cc-a40889869a1c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:59.555975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-08fdad76-f337-4e72-98cc-a40889869a1c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:59.556662 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-08fdad76-f337-4e72-98cc-a40889869a1c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:46:59.557111 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-08fdad76-f337-4e72-98cc-a40889869a1c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:46:59.557527 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-08fdad76-f337-4e72-98cc-a40889869a1c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:46:59.585337 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-08fdad76-f337-4e72-98cc-a40889869a1c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043269 Oct 11 06:46:59.585872 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 364/773] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:46:59 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:46:59.991277 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9be74019-1762-4a5f-8a47-4c73f2b1d1d5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:46:59.993468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9be74019-1762-4a5f-8a47-4c73f2b1d1d5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:46:59.999885 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9be74019-1762-4a5f-8a47-4c73f2b1d1d5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:00.000363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9be74019-1762-4a5f-8a47-4c73f2b1d1d5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:00.000797 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9be74019-1762-4a5f-8a47-4c73f2b1d1d5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:00.001491 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9be74019-1762-4a5f-8a47-4c73f2b1d1d5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:00.001943 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9be74019-1762-4a5f-8a47-4c73f2b1d1d5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:00.002366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9be74019-1762-4a5f-8a47-4c73f2b1d1d5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:00.031652 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9be74019-1762-4a5f-8a47-4c73f2b1d1d5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044271 Oct 11 06:47:00.032178 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 410/774] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:46:59 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:00.597401 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-761415ef-fb61-49ca-b29f-cb0161c33a41 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:00.599501 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-761415ef-fb61-49ca-b29f-cb0161c33a41 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:00.606008 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-761415ef-fb61-49ca-b29f-cb0161c33a41 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:00.606494 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-761415ef-fb61-49ca-b29f-cb0161c33a41 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:00.606928 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-761415ef-fb61-49ca-b29f-cb0161c33a41 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:00.607654 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-761415ef-fb61-49ca-b29f-cb0161c33a41 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:00.608109 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-761415ef-fb61-49ca-b29f-cb0161c33a41 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:00.608540 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-761415ef-fb61-49ca-b29f-cb0161c33a41 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:00.638461 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-761415ef-fb61-49ca-b29f-cb0161c33a41 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044991 Oct 11 06:47:00.639273 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 365/775] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:00 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:01.044710 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ef3dca22-34e8-4a80-87b8-b3492c8f2a0e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:01.046821 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ef3dca22-34e8-4a80-87b8-b3492c8f2a0e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:01.048822 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 06:47:01.048963 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Tue Oct 11 06:47:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments (ip 10.222.0.39) !!! Oct 11 06:47:01.060777 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef3dca22-34e8-4a80-87b8-b3492c8f2a0e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:01.061249 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef3dca22-34e8-4a80-87b8-b3492c8f2a0e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:01.061671 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef3dca22-34e8-4a80-87b8-b3492c8f2a0e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:01.062351 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef3dca22-34e8-4a80-87b8-b3492c8f2a0e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:01.062788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef3dca22-34e8-4a80-87b8-b3492c8f2a0e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:01.063204 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef3dca22-34e8-4a80-87b8-b3492c8f2a0e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:01.091987 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ef3dca22-34e8-4a80-87b8-b3492c8f2a0e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051436 Oct 11 06:47:01.092524 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 411/776] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:01 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:01.651591 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-71209d3a-fd22-4b46-acc6-e9a519159e03 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:01.653695 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-71209d3a-fd22-4b46-acc6-e9a519159e03 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:01.660146 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-71209d3a-fd22-4b46-acc6-e9a519159e03 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:01.660931 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-71209d3a-fd22-4b46-acc6-e9a519159e03 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:01.661357 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-71209d3a-fd22-4b46-acc6-e9a519159e03 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:01.662060 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-71209d3a-fd22-4b46-acc6-e9a519159e03 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:01.662510 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-71209d3a-fd22-4b46-acc6-e9a519159e03 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:01.662933 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-71209d3a-fd22-4b46-acc6-e9a519159e03 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:01.691714 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-71209d3a-fd22-4b46-acc6-e9a519159e03 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044945 Oct 11 06:47:01.692249 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 366/777] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:01 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:02.104256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bdc9f7a8-36c4-4a77-a67f-a4e5359c9ca8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:02.106399 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bdc9f7a8-36c4-4a77-a67f-a4e5359c9ca8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:02.112695 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bdc9f7a8-36c4-4a77-a67f-a4e5359c9ca8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:02.113162 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bdc9f7a8-36c4-4a77-a67f-a4e5359c9ca8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:02.113584 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bdc9f7a8-36c4-4a77-a67f-a4e5359c9ca8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:02.114259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bdc9f7a8-36c4-4a77-a67f-a4e5359c9ca8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:02.114698 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bdc9f7a8-36c4-4a77-a67f-a4e5359c9ca8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:02.115111 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bdc9f7a8-36c4-4a77-a67f-a4e5359c9ca8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:02.144069 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bdc9f7a8-36c4-4a77-a67f-a4e5359c9ca8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043600 Oct 11 06:47:02.144544 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 412/778] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:02 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:02.704141 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1ad316be-d8c7-4f80-95f3-d60dec9a5944 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:02.706243 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1ad316be-d8c7-4f80-95f3-d60dec9a5944 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:02.712698 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1ad316be-d8c7-4f80-95f3-d60dec9a5944 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:02.713178 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1ad316be-d8c7-4f80-95f3-d60dec9a5944 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:02.713614 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1ad316be-d8c7-4f80-95f3-d60dec9a5944 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:02.714300 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1ad316be-d8c7-4f80-95f3-d60dec9a5944 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:02.714801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1ad316be-d8c7-4f80-95f3-d60dec9a5944 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:02.715220 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1ad316be-d8c7-4f80-95f3-d60dec9a5944 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:02.744427 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1ad316be-d8c7-4f80-95f3-d60dec9a5944 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044283 Oct 11 06:47:02.744965 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 367/779] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:02 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:03.156423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-df83e2ab-f85c-4a9a-b659-c19a0d3c974c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:03.158571 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-df83e2ab-f85c-4a9a-b659-c19a0d3c974c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:03.165538 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-df83e2ab-f85c-4a9a-b659-c19a0d3c974c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:03.166005 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-df83e2ab-f85c-4a9a-b659-c19a0d3c974c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:03.166430 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-df83e2ab-f85c-4a9a-b659-c19a0d3c974c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:03.167104 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-df83e2ab-f85c-4a9a-b659-c19a0d3c974c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:03.167575 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-df83e2ab-f85c-4a9a-b659-c19a0d3c974c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:03.167985 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-df83e2ab-f85c-4a9a-b659-c19a0d3c974c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:03.196060 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-df83e2ab-f85c-4a9a-b659-c19a0d3c974c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043466 Oct 11 06:47:03.196628 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 413/780] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:03 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:03.756880 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-42dfa741-ecdd-40f6-ac77-6844d0d7d18a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:03.759567 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-42dfa741-ecdd-40f6-ac77-6844d0d7d18a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:03.761810 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 06:47:03.761962 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Tue Oct 11 06:47:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments (ip 10.222.0.39) !!! Oct 11 06:47:03.770759 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42dfa741-ecdd-40f6-ac77-6844d0d7d18a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:03.771249 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42dfa741-ecdd-40f6-ac77-6844d0d7d18a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:03.771712 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42dfa741-ecdd-40f6-ac77-6844d0d7d18a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:03.772413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42dfa741-ecdd-40f6-ac77-6844d0d7d18a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:03.772865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42dfa741-ecdd-40f6-ac77-6844d0d7d18a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:03.773321 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42dfa741-ecdd-40f6-ac77-6844d0d7d18a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:03.802636 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-42dfa741-ecdd-40f6-ac77-6844d0d7d18a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049821 Oct 11 06:47:03.803236 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 368/781] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:03 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:04.208774 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3b422df4-3b1d-4905-9911-d0bc50db772d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:04.211071 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3b422df4-3b1d-4905-9911-d0bc50db772d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:04.217408 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b422df4-3b1d-4905-9911-d0bc50db772d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:04.217878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b422df4-3b1d-4905-9911-d0bc50db772d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:04.218308 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b422df4-3b1d-4905-9911-d0bc50db772d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:04.218990 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b422df4-3b1d-4905-9911-d0bc50db772d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:04.219455 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b422df4-3b1d-4905-9911-d0bc50db772d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:04.219875 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b422df4-3b1d-4905-9911-d0bc50db772d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:04.250344 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3b422df4-3b1d-4905-9911-d0bc50db772d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045734 Oct 11 06:47:04.250887 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 414/782] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:04 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:47:04.815747 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a91f4b13-83c6-482d-9be9-df088db84299 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:04.817860 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a91f4b13-83c6-482d-9be9-df088db84299 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:04.824761 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a91f4b13-83c6-482d-9be9-df088db84299 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:04.825228 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a91f4b13-83c6-482d-9be9-df088db84299 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:04.825665 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a91f4b13-83c6-482d-9be9-df088db84299 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:04.826356 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a91f4b13-83c6-482d-9be9-df088db84299 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:04.826814 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a91f4b13-83c6-482d-9be9-df088db84299 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:04.827240 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a91f4b13-83c6-482d-9be9-df088db84299 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:04.855868 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a91f4b13-83c6-482d-9be9-df088db84299 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044150 Oct 11 06:47:04.856413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 369/783] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:04 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:05.263318 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b442dcd1-95bf-48d0-8e93-95d1937a3d24 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:05.265510 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b442dcd1-95bf-48d0-8e93-95d1937a3d24 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:05.271822 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b442dcd1-95bf-48d0-8e93-95d1937a3d24 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:05.272294 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b442dcd1-95bf-48d0-8e93-95d1937a3d24 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:05.272720 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b442dcd1-95bf-48d0-8e93-95d1937a3d24 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:05.273401 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b442dcd1-95bf-48d0-8e93-95d1937a3d24 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:05.273850 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b442dcd1-95bf-48d0-8e93-95d1937a3d24 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:05.274260 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b442dcd1-95bf-48d0-8e93-95d1937a3d24 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:05.302633 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b442dcd1-95bf-48d0-8e93-95d1937a3d24 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043311 Oct 11 06:47:05.303174 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 415/784] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:05 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:05.869201 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cc45eb27-19e2-4008-a093-2801e62aaf60 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:05.871333 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cc45eb27-19e2-4008-a093-2801e62aaf60 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:05.877661 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc45eb27-19e2-4008-a093-2801e62aaf60 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:05.878133 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc45eb27-19e2-4008-a093-2801e62aaf60 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:05.878557 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc45eb27-19e2-4008-a093-2801e62aaf60 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:05.879240 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc45eb27-19e2-4008-a093-2801e62aaf60 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:05.879710 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc45eb27-19e2-4008-a093-2801e62aaf60 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:05.880125 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc45eb27-19e2-4008-a093-2801e62aaf60 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:05.908790 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cc45eb27-19e2-4008-a093-2801e62aaf60 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044165 Oct 11 06:47:05.909327 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 370/785] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:05 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:06.315685 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-42def3bd-797d-4ffb-bbc3-76e7b837a71e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:06.317767 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-42def3bd-797d-4ffb-bbc3-76e7b837a71e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:06.324618 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42def3bd-797d-4ffb-bbc3-76e7b837a71e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:06.325094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42def3bd-797d-4ffb-bbc3-76e7b837a71e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:06.325524 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42def3bd-797d-4ffb-bbc3-76e7b837a71e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:06.326208 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42def3bd-797d-4ffb-bbc3-76e7b837a71e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:06.326654 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42def3bd-797d-4ffb-bbc3-76e7b837a71e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:06.327071 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42def3bd-797d-4ffb-bbc3-76e7b837a71e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:06.355700 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-42def3bd-797d-4ffb-bbc3-76e7b837a71e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044035 Oct 11 06:47:06.356233 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 416/786] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:06 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:06.921445 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-164cf233-2486-4e8f-a9c3-bb49e1ab7baf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:06.923517 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-164cf233-2486-4e8f-a9c3-bb49e1ab7baf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:06.925826 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=58 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:47:06.931527 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-164cf233-2486-4e8f-a9c3-bb49e1ab7baf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:06.932006 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-164cf233-2486-4e8f-a9c3-bb49e1ab7baf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:06.932436 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-164cf233-2486-4e8f-a9c3-bb49e1ab7baf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:06.933131 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-164cf233-2486-4e8f-a9c3-bb49e1ab7baf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:06.933580 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-164cf233-2486-4e8f-a9c3-bb49e1ab7baf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:06.933999 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-164cf233-2486-4e8f-a9c3-bb49e1ab7baf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:06.963844 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-164cf233-2486-4e8f-a9c3-bb49e1ab7baf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046337 Oct 11 06:47:06.964403 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 371/787] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:06 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:07.368711 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3bb052c5-1f19-48e2-87b4-f381c516e603 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:07.370827 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3bb052c5-1f19-48e2-87b4-f381c516e603 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:07.377126 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3bb052c5-1f19-48e2-87b4-f381c516e603 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:07.377602 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3bb052c5-1f19-48e2-87b4-f381c516e603 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:07.378037 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3bb052c5-1f19-48e2-87b4-f381c516e603 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:07.378741 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3bb052c5-1f19-48e2-87b4-f381c516e603 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:07.379179 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3bb052c5-1f19-48e2-87b4-f381c516e603 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:07.379628 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3bb052c5-1f19-48e2-87b4-f381c516e603 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:07.408737 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3bb052c5-1f19-48e2-87b4-f381c516e603 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044614 Oct 11 06:47:07.409427 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 417/788] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:07 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:47:07.976464 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-78a00cc4-77b1-4587-ae3a-ef06ddfd27e3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:07.978585 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-78a00cc4-77b1-4587-ae3a-ef06ddfd27e3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:07.985081 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78a00cc4-77b1-4587-ae3a-ef06ddfd27e3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:07.985565 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78a00cc4-77b1-4587-ae3a-ef06ddfd27e3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:07.985993 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78a00cc4-77b1-4587-ae3a-ef06ddfd27e3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:07.986688 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78a00cc4-77b1-4587-ae3a-ef06ddfd27e3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:07.987141 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78a00cc4-77b1-4587-ae3a-ef06ddfd27e3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:07.987615 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78a00cc4-77b1-4587-ae3a-ef06ddfd27e3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:08.016307 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-78a00cc4-77b1-4587-ae3a-ef06ddfd27e3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043828 Oct 11 06:47:08.016851 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 372/789] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:07 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:08.421122 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b0cf0fb8-648b-4bb4-a9d8-fef1f6b34431 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:08.423399 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b0cf0fb8-648b-4bb4-a9d8-fef1f6b34431 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:08.430223 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b0cf0fb8-648b-4bb4-a9d8-fef1f6b34431 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:08.430697 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b0cf0fb8-648b-4bb4-a9d8-fef1f6b34431 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:08.431127 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b0cf0fb8-648b-4bb4-a9d8-fef1f6b34431 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:08.431845 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b0cf0fb8-648b-4bb4-a9d8-fef1f6b34431 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:08.432296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b0cf0fb8-648b-4bb4-a9d8-fef1f6b34431 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:08.432712 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b0cf0fb8-648b-4bb4-a9d8-fef1f6b34431 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:08.461595 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b0cf0fb8-648b-4bb4-a9d8-fef1f6b34431 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044399 Oct 11 06:47:08.462129 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 418/790] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:08 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:09.029530 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2d397a4b-9559-4a03-9eb2-a2ea9b482735 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:09.031694 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2d397a4b-9559-4a03-9eb2-a2ea9b482735 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:09.038393 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d397a4b-9559-4a03-9eb2-a2ea9b482735 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:09.038874 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d397a4b-9559-4a03-9eb2-a2ea9b482735 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:09.039306 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d397a4b-9559-4a03-9eb2-a2ea9b482735 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:09.040022 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d397a4b-9559-4a03-9eb2-a2ea9b482735 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:09.040471 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d397a4b-9559-4a03-9eb2-a2ea9b482735 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:09.041478 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d397a4b-9559-4a03-9eb2-a2ea9b482735 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:09.070068 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2d397a4b-9559-4a03-9eb2-a2ea9b482735 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044971 Oct 11 06:47:09.070605 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 373/791] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:09 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:09.474046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-22ea993a-a5db-466b-8823-b306065e6cba tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:09.476342 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-22ea993a-a5db-466b-8823-b306065e6cba tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:09.482664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-22ea993a-a5db-466b-8823-b306065e6cba tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:09.483128 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-22ea993a-a5db-466b-8823-b306065e6cba tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:09.483587 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-22ea993a-a5db-466b-8823-b306065e6cba tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:09.484259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-22ea993a-a5db-466b-8823-b306065e6cba tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:09.484697 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-22ea993a-a5db-466b-8823-b306065e6cba tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:09.485109 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-22ea993a-a5db-466b-8823-b306065e6cba tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:09.510316 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:47:09.515704 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-22ea993a-a5db-466b-8823-b306065e6cba tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045725 Oct 11 06:47:09.516247 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 419/792] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:09 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:10.082260 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-81aa7aba-b6cc-481e-b6e9-cedf56b7678e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:10.084343 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-81aa7aba-b6cc-481e-b6e9-cedf56b7678e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:10.090601 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81aa7aba-b6cc-481e-b6e9-cedf56b7678e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:10.091075 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81aa7aba-b6cc-481e-b6e9-cedf56b7678e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:10.091534 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81aa7aba-b6cc-481e-b6e9-cedf56b7678e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:10.092228 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81aa7aba-b6cc-481e-b6e9-cedf56b7678e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:10.092669 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81aa7aba-b6cc-481e-b6e9-cedf56b7678e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:10.093082 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81aa7aba-b6cc-481e-b6e9-cedf56b7678e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:10.122144 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-81aa7aba-b6cc-481e-b6e9-cedf56b7678e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043934 Oct 11 06:47:10.122675 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 374/793] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:10 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:10.528936 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fecb6a8c-fba7-4bb6-ac37-e05420d9c0cd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:10.531240 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fecb6a8c-fba7-4bb6-ac37-e05420d9c0cd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:10.537598 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fecb6a8c-fba7-4bb6-ac37-e05420d9c0cd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:10.538076 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fecb6a8c-fba7-4bb6-ac37-e05420d9c0cd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:10.538507 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fecb6a8c-fba7-4bb6-ac37-e05420d9c0cd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:10.539193 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fecb6a8c-fba7-4bb6-ac37-e05420d9c0cd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:10.539662 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fecb6a8c-fba7-4bb6-ac37-e05420d9c0cd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:10.540090 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fecb6a8c-fba7-4bb6-ac37-e05420d9c0cd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:10.568933 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fecb6a8c-fba7-4bb6-ac37-e05420d9c0cd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044715 Oct 11 06:47:10.569468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 420/794] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:10 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:11.134173 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b3416ded-9d4b-4354-8151-18120e2119fb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:11.136885 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b3416ded-9d4b-4354-8151-18120e2119fb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:11.143520 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b3416ded-9d4b-4354-8151-18120e2119fb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:11.143995 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b3416ded-9d4b-4354-8151-18120e2119fb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:11.144422 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b3416ded-9d4b-4354-8151-18120e2119fb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:11.145102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b3416ded-9d4b-4354-8151-18120e2119fb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:11.145546 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b3416ded-9d4b-4354-8151-18120e2119fb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:11.145965 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b3416ded-9d4b-4354-8151-18120e2119fb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:11.174178 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b3416ded-9d4b-4354-8151-18120e2119fb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043962 Oct 11 06:47:11.174996 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 375/795] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:11 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:11.581203 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5fe7c0a7-da1e-4351-9569-243002520164 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:11.583487 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5fe7c0a7-da1e-4351-9569-243002520164 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:11.589809 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5fe7c0a7-da1e-4351-9569-243002520164 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:11.590280 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5fe7c0a7-da1e-4351-9569-243002520164 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:11.590709 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5fe7c0a7-da1e-4351-9569-243002520164 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:11.591388 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5fe7c0a7-da1e-4351-9569-243002520164 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:11.591859 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5fe7c0a7-da1e-4351-9569-243002520164 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:11.592278 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5fe7c0a7-da1e-4351-9569-243002520164 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:11.621298 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5fe7c0a7-da1e-4351-9569-243002520164 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044013 Oct 11 06:47:11.621852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 421/796] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:11 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:12.186194 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-67cd4e4a-72ec-4887-8023-6ad4a050c39c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:12.188361 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-67cd4e4a-72ec-4887-8023-6ad4a050c39c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:12.194778 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-67cd4e4a-72ec-4887-8023-6ad4a050c39c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:12.195247 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-67cd4e4a-72ec-4887-8023-6ad4a050c39c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:12.195707 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-67cd4e4a-72ec-4887-8023-6ad4a050c39c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:12.196388 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-67cd4e4a-72ec-4887-8023-6ad4a050c39c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:12.196832 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-67cd4e4a-72ec-4887-8023-6ad4a050c39c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:12.197247 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-67cd4e4a-72ec-4887-8023-6ad4a050c39c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:12.227159 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-67cd4e4a-72ec-4887-8023-6ad4a050c39c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044903 Oct 11 06:47:12.227734 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 376/797] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:12 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:12.633608 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-04b71062-5d56-437c-88d6-544535cfba63 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:12.636461 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-04b71062-5d56-437c-88d6-544535cfba63 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:12.642760 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04b71062-5d56-437c-88d6-544535cfba63 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:12.643240 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04b71062-5d56-437c-88d6-544535cfba63 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:12.643705 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04b71062-5d56-437c-88d6-544535cfba63 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:12.644390 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04b71062-5d56-437c-88d6-544535cfba63 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:12.644834 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04b71062-5d56-437c-88d6-544535cfba63 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:12.645249 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04b71062-5d56-437c-88d6-544535cfba63 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:12.673534 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-04b71062-5d56-437c-88d6-544535cfba63 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043929 Oct 11 06:47:12.674071 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 422/798] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:12 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:13.240174 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2d166dbc-7c40-4300-a146-0486afc25689 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:13.242221 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2d166dbc-7c40-4300-a146-0486afc25689 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:13.249304 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d166dbc-7c40-4300-a146-0486afc25689 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:13.249781 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d166dbc-7c40-4300-a146-0486afc25689 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:13.250216 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d166dbc-7c40-4300-a146-0486afc25689 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:13.250905 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d166dbc-7c40-4300-a146-0486afc25689 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:13.251357 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d166dbc-7c40-4300-a146-0486afc25689 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:13.251813 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d166dbc-7c40-4300-a146-0486afc25689 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:13.268713 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:47:13.282949 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2d166dbc-7c40-4300-a146-0486afc25689 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046849 Oct 11 06:47:13.283510 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 377/799] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:13 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:13.686387 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bb505bf5-0a52-4e1a-95bb-3a5f90dec657 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:13.688593 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bb505bf5-0a52-4e1a-95bb-3a5f90dec657 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:13.694933 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bb505bf5-0a52-4e1a-95bb-3a5f90dec657 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:13.695409 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bb505bf5-0a52-4e1a-95bb-3a5f90dec657 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:13.695944 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bb505bf5-0a52-4e1a-95bb-3a5f90dec657 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:13.696667 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bb505bf5-0a52-4e1a-95bb-3a5f90dec657 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:13.697678 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bb505bf5-0a52-4e1a-95bb-3a5f90dec657 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:13.698096 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bb505bf5-0a52-4e1a-95bb-3a5f90dec657 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:13.726835 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bb505bf5-0a52-4e1a-95bb-3a5f90dec657 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044453 Oct 11 06:47:13.727380 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 423/800] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:13 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:14.295962 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ca329ec4-2eec-4b08-9a0d-a081ea78113c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:14.298026 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ca329ec4-2eec-4b08-9a0d-a081ea78113c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:14.306255 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca329ec4-2eec-4b08-9a0d-a081ea78113c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:14.306733 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca329ec4-2eec-4b08-9a0d-a081ea78113c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:14.307166 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca329ec4-2eec-4b08-9a0d-a081ea78113c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:14.307890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca329ec4-2eec-4b08-9a0d-a081ea78113c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:14.308345 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca329ec4-2eec-4b08-9a0d-a081ea78113c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:14.308768 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca329ec4-2eec-4b08-9a0d-a081ea78113c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:14.338479 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ca329ec4-2eec-4b08-9a0d-a081ea78113c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046591 Oct 11 06:47:14.339020 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 378/801] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:14 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:14.740174 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fc72111f-a2d3-4524-85c5-cc43a42b817a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:14.742380 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fc72111f-a2d3-4524-85c5-cc43a42b817a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:14.748707 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fc72111f-a2d3-4524-85c5-cc43a42b817a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:14.749186 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fc72111f-a2d3-4524-85c5-cc43a42b817a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:14.749629 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fc72111f-a2d3-4524-85c5-cc43a42b817a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:14.750314 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fc72111f-a2d3-4524-85c5-cc43a42b817a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:14.750762 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fc72111f-a2d3-4524-85c5-cc43a42b817a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:14.751182 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fc72111f-a2d3-4524-85c5-cc43a42b817a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:14.780807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fc72111f-a2d3-4524-85c5-cc43a42b817a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044614 Oct 11 06:47:14.781348 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 424/802] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:14 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:15.350980 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1d394dd5-ba42-4e25-80eb-25ab2482b9bc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:15.353595 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1d394dd5-ba42-4e25-80eb-25ab2482b9bc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:15.359902 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d394dd5-ba42-4e25-80eb-25ab2482b9bc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:15.360374 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d394dd5-ba42-4e25-80eb-25ab2482b9bc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:15.360798 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d394dd5-ba42-4e25-80eb-25ab2482b9bc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:15.361475 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d394dd5-ba42-4e25-80eb-25ab2482b9bc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:15.361920 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d394dd5-ba42-4e25-80eb-25ab2482b9bc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:15.362330 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d394dd5-ba42-4e25-80eb-25ab2482b9bc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:15.391105 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1d394dd5-ba42-4e25-80eb-25ab2482b9bc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044178 Oct 11 06:47:15.391666 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 379/803] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:15 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:15.793686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-81d1e68b-9670-4b86-8d5d-f39c5ec8c94c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:15.796744 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-81d1e68b-9670-4b86-8d5d-f39c5ec8c94c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:15.803087 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-81d1e68b-9670-4b86-8d5d-f39c5ec8c94c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:15.803599 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-81d1e68b-9670-4b86-8d5d-f39c5ec8c94c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:15.804034 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-81d1e68b-9670-4b86-8d5d-f39c5ec8c94c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:15.804752 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-81d1e68b-9670-4b86-8d5d-f39c5ec8c94c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:15.805197 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-81d1e68b-9670-4b86-8d5d-f39c5ec8c94c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:15.805641 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-81d1e68b-9670-4b86-8d5d-f39c5ec8c94c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:15.833968 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-81d1e68b-9670-4b86-8d5d-f39c5ec8c94c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044890 Oct 11 06:47:15.834538 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 425/804] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:15 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:16.403973 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b8efa119-4cb2-4e6c-b5bd-2353038c6597 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:16.406240 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b8efa119-4cb2-4e6c-b5bd-2353038c6597 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:16.412620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8efa119-4cb2-4e6c-b5bd-2353038c6597 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:16.413107 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8efa119-4cb2-4e6c-b5bd-2353038c6597 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:16.413516 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8efa119-4cb2-4e6c-b5bd-2353038c6597 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:16.414202 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8efa119-4cb2-4e6c-b5bd-2353038c6597 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:16.414646 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8efa119-4cb2-4e6c-b5bd-2353038c6597 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:16.415060 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8efa119-4cb2-4e6c-b5bd-2353038c6597 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:16.443981 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b8efa119-4cb2-4e6c-b5bd-2353038c6597 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043980 Oct 11 06:47:16.444553 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 380/805] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:16 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:16.846957 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1cba127f-df10-400d-be93-5518d031607b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:16.849206 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1cba127f-df10-400d-be93-5518d031607b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:16.856040 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1cba127f-df10-400d-be93-5518d031607b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:16.856520 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1cba127f-df10-400d-be93-5518d031607b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:16.856948 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1cba127f-df10-400d-be93-5518d031607b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:16.857631 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1cba127f-df10-400d-be93-5518d031607b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:16.858077 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1cba127f-df10-400d-be93-5518d031607b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:16.858495 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1cba127f-df10-400d-be93-5518d031607b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:16.887350 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1cba127f-df10-400d-be93-5518d031607b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044370 Oct 11 06:47:16.887907 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 426/806] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:16 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:17.457249 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f380c7a1-aaad-40a1-b562-4f056336d5d2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:17.459378 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f380c7a1-aaad-40a1-b562-4f056336d5d2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:17.465901 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f380c7a1-aaad-40a1-b562-4f056336d5d2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:17.466376 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f380c7a1-aaad-40a1-b562-4f056336d5d2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:17.466801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f380c7a1-aaad-40a1-b562-4f056336d5d2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:17.467509 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f380c7a1-aaad-40a1-b562-4f056336d5d2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:17.467961 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f380c7a1-aaad-40a1-b562-4f056336d5d2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:17.468385 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f380c7a1-aaad-40a1-b562-4f056336d5d2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:17.497508 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f380c7a1-aaad-40a1-b562-4f056336d5d2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044430 Oct 11 06:47:17.498057 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 381/807] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:17 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:17.899778 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4280d4d9-f805-4355-8d18-57bb6ac35bcc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:17.902383 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4280d4d9-f805-4355-8d18-57bb6ac35bcc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:17.909039 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4280d4d9-f805-4355-8d18-57bb6ac35bcc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:17.909654 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4280d4d9-f805-4355-8d18-57bb6ac35bcc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:17.910136 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4280d4d9-f805-4355-8d18-57bb6ac35bcc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:17.910841 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4280d4d9-f805-4355-8d18-57bb6ac35bcc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:17.911266 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4280d4d9-f805-4355-8d18-57bb6ac35bcc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:17.911706 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4280d4d9-f805-4355-8d18-57bb6ac35bcc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:17.940687 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4280d4d9-f805-4355-8d18-57bb6ac35bcc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045378 Oct 11 06:47:17.941231 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 427/808] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:17 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:18.510400 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7b26e20d-a574-464b-b799-25005b2241d1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:18.512555 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7b26e20d-a574-464b-b799-25005b2241d1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:18.519019 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b26e20d-a574-464b-b799-25005b2241d1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:18.519526 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b26e20d-a574-464b-b799-25005b2241d1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:18.519962 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b26e20d-a574-464b-b799-25005b2241d1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:18.520652 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b26e20d-a574-464b-b799-25005b2241d1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:18.521099 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b26e20d-a574-464b-b799-25005b2241d1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:18.521517 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b26e20d-a574-464b-b799-25005b2241d1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:18.550351 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7b26e20d-a574-464b-b799-25005b2241d1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044407 Oct 11 06:47:18.550886 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 382/809] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:18 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:18.953500 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-eb312220-b147-44b9-921b-975cd9ea42e7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:18.955783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-eb312220-b147-44b9-921b-975cd9ea42e7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:18.962104 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eb312220-b147-44b9-921b-975cd9ea42e7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:18.962576 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eb312220-b147-44b9-921b-975cd9ea42e7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:18.963006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eb312220-b147-44b9-921b-975cd9ea42e7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:18.963717 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eb312220-b147-44b9-921b-975cd9ea42e7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:18.964163 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eb312220-b147-44b9-921b-975cd9ea42e7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:18.964580 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eb312220-b147-44b9-921b-975cd9ea42e7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:18.993771 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-eb312220-b147-44b9-921b-975cd9ea42e7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043599 Oct 11 06:47:18.994336 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 428/810] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:18 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:19.562357 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f09b0c92-8d3d-4820-9eee-ef7530e88199 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:19.564479 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f09b0c92-8d3d-4820-9eee-ef7530e88199 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:19.570783 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f09b0c92-8d3d-4820-9eee-ef7530e88199 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:19.571282 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f09b0c92-8d3d-4820-9eee-ef7530e88199 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:19.571753 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f09b0c92-8d3d-4820-9eee-ef7530e88199 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:19.572433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f09b0c92-8d3d-4820-9eee-ef7530e88199 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:19.572877 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f09b0c92-8d3d-4820-9eee-ef7530e88199 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:19.573292 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f09b0c92-8d3d-4820-9eee-ef7530e88199 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:19.601914 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f09b0c92-8d3d-4820-9eee-ef7530e88199 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043574 Oct 11 06:47:19.602608 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 383/811] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:19 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:20.006553 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0613535d-c09b-4319-bc82-1c89c77ffe9d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:20.009409 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0613535d-c09b-4319-bc82-1c89c77ffe9d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:20.015826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0613535d-c09b-4319-bc82-1c89c77ffe9d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:20.016313 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0613535d-c09b-4319-bc82-1c89c77ffe9d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:20.016745 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0613535d-c09b-4319-bc82-1c89c77ffe9d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:20.017431 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0613535d-c09b-4319-bc82-1c89c77ffe9d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:20.017880 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0613535d-c09b-4319-bc82-1c89c77ffe9d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:20.018300 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0613535d-c09b-4319-bc82-1c89c77ffe9d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:20.047872 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0613535d-c09b-4319-bc82-1c89c77ffe9d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045228 Oct 11 06:47:20.048411 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 429/812] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:20 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:20.614206 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cb1921ef-ba7e-4b11-8d00-f66c6c916755 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:20.616377 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cb1921ef-ba7e-4b11-8d00-f66c6c916755 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:20.623323 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb1921ef-ba7e-4b11-8d00-f66c6c916755 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:20.623835 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb1921ef-ba7e-4b11-8d00-f66c6c916755 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:20.624264 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb1921ef-ba7e-4b11-8d00-f66c6c916755 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:20.624976 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb1921ef-ba7e-4b11-8d00-f66c6c916755 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:20.625419 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb1921ef-ba7e-4b11-8d00-f66c6c916755 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:20.625836 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb1921ef-ba7e-4b11-8d00-f66c6c916755 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:20.654242 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cb1921ef-ba7e-4b11-8d00-f66c6c916755 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044019 Oct 11 06:47:20.654771 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 384/813] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:20 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:21.060187 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-af26672b-0aca-4644-ade5-fd1e18acb06b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:21.062437 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-af26672b-0aca-4644-ade5-fd1e18acb06b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:21.068386 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af26672b-0aca-4644-ade5-fd1e18acb06b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:21.068856 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af26672b-0aca-4644-ade5-fd1e18acb06b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:21.069281 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af26672b-0aca-4644-ade5-fd1e18acb06b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:21.069959 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af26672b-0aca-4644-ade5-fd1e18acb06b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:21.070399 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af26672b-0aca-4644-ade5-fd1e18acb06b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:21.070815 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af26672b-0aca-4644-ade5-fd1e18acb06b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:21.099455 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-af26672b-0aca-4644-ade5-fd1e18acb06b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043491 Oct 11 06:47:21.099981 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 430/814] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:21 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:21.666446 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e150744e-04c4-49aa-ae52-fc212f5b0332 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:21.668609 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e150744e-04c4-49aa-ae52-fc212f5b0332 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:21.674977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e150744e-04c4-49aa-ae52-fc212f5b0332 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:21.675482 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e150744e-04c4-49aa-ae52-fc212f5b0332 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:21.675915 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e150744e-04c4-49aa-ae52-fc212f5b0332 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:21.676609 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e150744e-04c4-49aa-ae52-fc212f5b0332 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:21.677056 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e150744e-04c4-49aa-ae52-fc212f5b0332 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:21.677474 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e150744e-04c4-49aa-ae52-fc212f5b0332 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:21.706816 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e150744e-04c4-49aa-ae52-fc212f5b0332 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044302 Oct 11 06:47:21.707358 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 385/815] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:21 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:22.112480 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3a892e38-ec45-443b-938c-41f80f83e687 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:22.114690 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3a892e38-ec45-443b-938c-41f80f83e687 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:22.121636 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3a892e38-ec45-443b-938c-41f80f83e687 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:22.122104 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3a892e38-ec45-443b-938c-41f80f83e687 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:22.122527 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3a892e38-ec45-443b-938c-41f80f83e687 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:22.123209 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3a892e38-ec45-443b-938c-41f80f83e687 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:22.123679 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3a892e38-ec45-443b-938c-41f80f83e687 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:22.124094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3a892e38-ec45-443b-938c-41f80f83e687 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:22.153188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3a892e38-ec45-443b-938c-41f80f83e687 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044633 Oct 11 06:47:22.153720 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 431/816] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:22 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:22.718916 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-65d4403d-e33a-4595-ad0f-75ddc0cc43a7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:22.721084 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-65d4403d-e33a-4595-ad0f-75ddc0cc43a7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:22.728042 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65d4403d-e33a-4595-ad0f-75ddc0cc43a7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:22.728518 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65d4403d-e33a-4595-ad0f-75ddc0cc43a7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:22.728942 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65d4403d-e33a-4595-ad0f-75ddc0cc43a7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:22.729619 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65d4403d-e33a-4595-ad0f-75ddc0cc43a7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:22.730063 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65d4403d-e33a-4595-ad0f-75ddc0cc43a7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:22.730476 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65d4403d-e33a-4595-ad0f-75ddc0cc43a7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:22.758429 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-65d4403d-e33a-4595-ad0f-75ddc0cc43a7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043535 Oct 11 06:47:22.759816 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 386/817] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:22 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:23.166297 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-683c9e5c-110a-487f-a1e7-4694aa73ef9f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:23.168766 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-683c9e5c-110a-487f-a1e7-4694aa73ef9f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:23.175342 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-683c9e5c-110a-487f-a1e7-4694aa73ef9f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:23.175842 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-683c9e5c-110a-487f-a1e7-4694aa73ef9f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:23.176265 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-683c9e5c-110a-487f-a1e7-4694aa73ef9f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:23.176957 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-683c9e5c-110a-487f-a1e7-4694aa73ef9f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:23.177403 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-683c9e5c-110a-487f-a1e7-4694aa73ef9f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:23.177824 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-683c9e5c-110a-487f-a1e7-4694aa73ef9f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:23.206576 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-683c9e5c-110a-487f-a1e7-4694aa73ef9f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044897 Oct 11 06:47:23.207117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 432/818] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:23 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:23.771638 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-654048cf-d612-4a7a-bafe-07847d9d17fc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:23.773689 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-654048cf-d612-4a7a-bafe-07847d9d17fc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:23.780967 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-654048cf-d612-4a7a-bafe-07847d9d17fc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:23.781441 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-654048cf-d612-4a7a-bafe-07847d9d17fc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:23.781865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-654048cf-d612-4a7a-bafe-07847d9d17fc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:23.782548 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-654048cf-d612-4a7a-bafe-07847d9d17fc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:23.782992 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-654048cf-d612-4a7a-bafe-07847d9d17fc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:23.783407 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-654048cf-d612-4a7a-bafe-07847d9d17fc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:23.811282 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-654048cf-d612-4a7a-bafe-07847d9d17fc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043792 Oct 11 06:47:23.811859 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 387/819] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:23 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:24.220425 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5636fbed-cdd2-4e49-b66d-b2b4e8d717a6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:24.222716 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5636fbed-cdd2-4e49-b66d-b2b4e8d717a6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:24.225001 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=58 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:47:24.230522 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5636fbed-cdd2-4e49-b66d-b2b4e8d717a6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:24.230994 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5636fbed-cdd2-4e49-b66d-b2b4e8d717a6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:24.231442 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5636fbed-cdd2-4e49-b66d-b2b4e8d717a6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:24.232222 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5636fbed-cdd2-4e49-b66d-b2b4e8d717a6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:24.232667 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5636fbed-cdd2-4e49-b66d-b2b4e8d717a6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:24.233077 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5636fbed-cdd2-4e49-b66d-b2b4e8d717a6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:24.263311 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5636fbed-cdd2-4e49-b66d-b2b4e8d717a6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046836 Oct 11 06:47:24.263887 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 433/820] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:24 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:24.824311 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a8e9060e-71ba-4cf2-930b-ccb872ccfdec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:24.826334 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a8e9060e-71ba-4cf2-930b-ccb872ccfdec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:24.832674 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a8e9060e-71ba-4cf2-930b-ccb872ccfdec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:24.833209 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a8e9060e-71ba-4cf2-930b-ccb872ccfdec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:24.833641 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a8e9060e-71ba-4cf2-930b-ccb872ccfdec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:24.834323 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a8e9060e-71ba-4cf2-930b-ccb872ccfdec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:24.834765 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a8e9060e-71ba-4cf2-930b-ccb872ccfdec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:24.835179 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a8e9060e-71ba-4cf2-930b-ccb872ccfdec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:24.863154 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a8e9060e-71ba-4cf2-930b-ccb872ccfdec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043452 Oct 11 06:47:24.863726 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 388/821] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:24 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:25.275961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bcd8a1b6-3b97-4140-a3e7-302685c9cf39 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:25.278240 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bcd8a1b6-3b97-4140-a3e7-302685c9cf39 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:25.284598 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bcd8a1b6-3b97-4140-a3e7-302685c9cf39 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:25.285074 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bcd8a1b6-3b97-4140-a3e7-302685c9cf39 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:25.285503 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bcd8a1b6-3b97-4140-a3e7-302685c9cf39 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:25.286187 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bcd8a1b6-3b97-4140-a3e7-302685c9cf39 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:25.286632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bcd8a1b6-3b97-4140-a3e7-302685c9cf39 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:25.287049 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bcd8a1b6-3b97-4140-a3e7-302685c9cf39 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:25.316524 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bcd8a1b6-3b97-4140-a3e7-302685c9cf39 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044808 Oct 11 06:47:25.317073 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 434/822] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:25 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:25.876227 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-108c541a-ffec-4cb3-9c73-13d768dccde2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:25.878373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-108c541a-ffec-4cb3-9c73-13d768dccde2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:25.885274 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-108c541a-ffec-4cb3-9c73-13d768dccde2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:25.885748 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-108c541a-ffec-4cb3-9c73-13d768dccde2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:25.886182 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-108c541a-ffec-4cb3-9c73-13d768dccde2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:25.886867 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-108c541a-ffec-4cb3-9c73-13d768dccde2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:25.887323 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-108c541a-ffec-4cb3-9c73-13d768dccde2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:25.887834 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-108c541a-ffec-4cb3-9c73-13d768dccde2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:25.916909 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-108c541a-ffec-4cb3-9c73-13d768dccde2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044754 Oct 11 06:47:25.917438 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 389/823] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:25 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:26.328643 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7b574ee0-07f9-4d89-b22b-d938b53f5cfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:26.330863 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7b574ee0-07f9-4d89-b22b-d938b53f5cfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:26.337314 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7b574ee0-07f9-4d89-b22b-d938b53f5cfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:26.337787 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7b574ee0-07f9-4d89-b22b-d938b53f5cfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:26.338214 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7b574ee0-07f9-4d89-b22b-d938b53f5cfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:26.338894 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7b574ee0-07f9-4d89-b22b-d938b53f5cfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:26.339335 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7b574ee0-07f9-4d89-b22b-d938b53f5cfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:26.339778 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7b574ee0-07f9-4d89-b22b-d938b53f5cfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:26.368291 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7b574ee0-07f9-4d89-b22b-d938b53f5cfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043121 Oct 11 06:47:26.368821 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 435/824] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:26 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:47:26.929331 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b02bd5ab-78a7-4232-8870-d44da27fd87f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:26.931441 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b02bd5ab-78a7-4232-8870-d44da27fd87f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:26.933411 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 06:47:26.933539 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Tue Oct 11 06:47:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments (ip 10.222.0.39) !!! Oct 11 06:47:26.939618 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b02bd5ab-78a7-4232-8870-d44da27fd87f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:26.940111 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b02bd5ab-78a7-4232-8870-d44da27fd87f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:26.940528 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b02bd5ab-78a7-4232-8870-d44da27fd87f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:26.941215 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b02bd5ab-78a7-4232-8870-d44da27fd87f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:26.941670 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b02bd5ab-78a7-4232-8870-d44da27fd87f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:26.942089 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b02bd5ab-78a7-4232-8870-d44da27fd87f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:26.972249 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b02bd5ab-78a7-4232-8870-d44da27fd87f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046951 Oct 11 06:47:26.972800 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 390/825] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:26 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:27.379730 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4467addb-d0d5-4687-913a-dd46ae352fa7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:27.382018 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4467addb-d0d5-4687-913a-dd46ae352fa7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:27.388844 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4467addb-d0d5-4687-913a-dd46ae352fa7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:27.389324 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4467addb-d0d5-4687-913a-dd46ae352fa7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:27.389749 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4467addb-d0d5-4687-913a-dd46ae352fa7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:27.390423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4467addb-d0d5-4687-913a-dd46ae352fa7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:27.390861 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4467addb-d0d5-4687-913a-dd46ae352fa7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:27.391273 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4467addb-d0d5-4687-913a-dd46ae352fa7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:27.408620 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:47:27.422300 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4467addb-d0d5-4687-913a-dd46ae352fa7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046549 Oct 11 06:47:27.422847 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 436/826] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:27 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:27.984835 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e7d6bb3d-f558-4f6b-b786-656c4c544b88 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:27.986965 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e7d6bb3d-f558-4f6b-b786-656c4c544b88 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:27.993320 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7d6bb3d-f558-4f6b-b786-656c4c544b88 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:27.993791 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7d6bb3d-f558-4f6b-b786-656c4c544b88 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:27.994217 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7d6bb3d-f558-4f6b-b786-656c4c544b88 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:27.994896 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7d6bb3d-f558-4f6b-b786-656c4c544b88 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:27.995338 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7d6bb3d-f558-4f6b-b786-656c4c544b88 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:27.995778 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7d6bb3d-f558-4f6b-b786-656c4c544b88 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:28.025166 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e7d6bb3d-f558-4f6b-b786-656c4c544b88 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043763 Oct 11 06:47:28.025697 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 391/827] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:27 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:28.434958 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8c1b4063-b4b3-443d-907f-1c860428d434 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:28.437301 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8c1b4063-b4b3-443d-907f-1c860428d434 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:28.443698 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c1b4063-b4b3-443d-907f-1c860428d434 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:28.444178 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c1b4063-b4b3-443d-907f-1c860428d434 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:28.444614 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c1b4063-b4b3-443d-907f-1c860428d434 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:28.445415 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c1b4063-b4b3-443d-907f-1c860428d434 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:28.446452 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c1b4063-b4b3-443d-907f-1c860428d434 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:28.446881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c1b4063-b4b3-443d-907f-1c860428d434 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:28.475281 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8c1b4063-b4b3-443d-907f-1c860428d434 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044972 Oct 11 06:47:28.475844 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 437/828] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:28 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:29.040198 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-063c8fb2-0070-4c7b-ba7f-07a3fa5e7df0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:29.042381 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-063c8fb2-0070-4c7b-ba7f-07a3fa5e7df0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:29.050728 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-063c8fb2-0070-4c7b-ba7f-07a3fa5e7df0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:29.051208 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-063c8fb2-0070-4c7b-ba7f-07a3fa5e7df0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:29.051811 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-063c8fb2-0070-4c7b-ba7f-07a3fa5e7df0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:29.052505 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-063c8fb2-0070-4c7b-ba7f-07a3fa5e7df0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:29.052951 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-063c8fb2-0070-4c7b-ba7f-07a3fa5e7df0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:29.053372 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-063c8fb2-0070-4c7b-ba7f-07a3fa5e7df0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:29.089343 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-063c8fb2-0070-4c7b-ba7f-07a3fa5e7df0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054830 Oct 11 06:47:29.089892 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 392/829] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:29 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:29.487660 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6f7b3ded-3966-4230-b435-3d59ddb8794d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:29.489852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6f7b3ded-3966-4230-b435-3d59ddb8794d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:29.496216 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f7b3ded-3966-4230-b435-3d59ddb8794d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:29.496690 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f7b3ded-3966-4230-b435-3d59ddb8794d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:29.497123 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f7b3ded-3966-4230-b435-3d59ddb8794d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:29.497806 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f7b3ded-3966-4230-b435-3d59ddb8794d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:29.498248 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f7b3ded-3966-4230-b435-3d59ddb8794d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:29.498664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f7b3ded-3966-4230-b435-3d59ddb8794d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:29.528255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6f7b3ded-3966-4230-b435-3d59ddb8794d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044595 Oct 11 06:47:29.528790 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 438/830] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:29 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:30.103686 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5c985ce6-fd1e-48f3-bfe0-891fc6579878 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:30.105807 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5c985ce6-fd1e-48f3-bfe0-891fc6579878 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:30.112213 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5c985ce6-fd1e-48f3-bfe0-891fc6579878 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:30.112691 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5c985ce6-fd1e-48f3-bfe0-891fc6579878 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:30.113118 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5c985ce6-fd1e-48f3-bfe0-891fc6579878 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:30.113805 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5c985ce6-fd1e-48f3-bfe0-891fc6579878 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:30.114253 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5c985ce6-fd1e-48f3-bfe0-891fc6579878 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:30.114678 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5c985ce6-fd1e-48f3-bfe0-891fc6579878 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:30.144060 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5c985ce6-fd1e-48f3-bfe0-891fc6579878 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044379 Oct 11 06:47:30.144601 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 393/831] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:30 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:30.541041 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b2ff8f4e-57b7-42b2-bb70-ddff66534279 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:30.543181 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b2ff8f4e-57b7-42b2-bb70-ddff66534279 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:30.549664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b2ff8f4e-57b7-42b2-bb70-ddff66534279 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:30.550139 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b2ff8f4e-57b7-42b2-bb70-ddff66534279 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:30.550575 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b2ff8f4e-57b7-42b2-bb70-ddff66534279 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:30.551263 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b2ff8f4e-57b7-42b2-bb70-ddff66534279 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:30.551746 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b2ff8f4e-57b7-42b2-bb70-ddff66534279 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:30.552169 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b2ff8f4e-57b7-42b2-bb70-ddff66534279 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:30.581244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b2ff8f4e-57b7-42b2-bb70-ddff66534279 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044655 Oct 11 06:47:30.581783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 439/832] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:30 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:31.156388 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b6447ba7-50da-4260-a8e8-7d6872daa4cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:31.158540 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b6447ba7-50da-4260-a8e8-7d6872daa4cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:31.165169 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b6447ba7-50da-4260-a8e8-7d6872daa4cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:31.165649 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b6447ba7-50da-4260-a8e8-7d6872daa4cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:31.166073 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b6447ba7-50da-4260-a8e8-7d6872daa4cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:31.166757 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b6447ba7-50da-4260-a8e8-7d6872daa4cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:31.167203 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b6447ba7-50da-4260-a8e8-7d6872daa4cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:31.167669 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b6447ba7-50da-4260-a8e8-7d6872daa4cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:31.171226 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:47:31.197301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b6447ba7-50da-4260-a8e8-7d6872daa4cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044824 Oct 11 06:47:31.197838 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 394/833] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:31 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:31.593873 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3e6670fb-f8f8-479f-95a3-0fa63f16b024 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:31.596006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3e6670fb-f8f8-479f-95a3-0fa63f16b024 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:31.602371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e6670fb-f8f8-479f-95a3-0fa63f16b024 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:31.602840 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e6670fb-f8f8-479f-95a3-0fa63f16b024 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:31.603264 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e6670fb-f8f8-479f-95a3-0fa63f16b024 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:31.603975 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e6670fb-f8f8-479f-95a3-0fa63f16b024 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:31.604416 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e6670fb-f8f8-479f-95a3-0fa63f16b024 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:31.604829 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e6670fb-f8f8-479f-95a3-0fa63f16b024 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:31.634029 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3e6670fb-f8f8-479f-95a3-0fa63f16b024 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043499 Oct 11 06:47:31.634571 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 440/834] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:31 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:32.209840 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-56a3dce6-c287-443f-b3b6-839d5948a2e6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:32.212676 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-56a3dce6-c287-443f-b3b6-839d5948a2e6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:32.219010 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-56a3dce6-c287-443f-b3b6-839d5948a2e6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:32.219515 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-56a3dce6-c287-443f-b3b6-839d5948a2e6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:32.219945 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-56a3dce6-c287-443f-b3b6-839d5948a2e6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:32.220629 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-56a3dce6-c287-443f-b3b6-839d5948a2e6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:32.221073 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-56a3dce6-c287-443f-b3b6-839d5948a2e6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:32.221488 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-56a3dce6-c287-443f-b3b6-839d5948a2e6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:32.250145 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-56a3dce6-c287-443f-b3b6-839d5948a2e6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044486 Oct 11 06:47:32.250681 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 395/835] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:32 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:32.646132 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-090d771f-6404-4c28-b572-2dbbe1b57fc3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:32.648320 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-090d771f-6404-4c28-b572-2dbbe1b57fc3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:32.655615 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-090d771f-6404-4c28-b572-2dbbe1b57fc3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:32.656093 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-090d771f-6404-4c28-b572-2dbbe1b57fc3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:32.656526 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-090d771f-6404-4c28-b572-2dbbe1b57fc3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:32.657212 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-090d771f-6404-4c28-b572-2dbbe1b57fc3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:32.657647 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-090d771f-6404-4c28-b572-2dbbe1b57fc3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:32.658061 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-090d771f-6404-4c28-b572-2dbbe1b57fc3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:32.686063 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-090d771f-6404-4c28-b572-2dbbe1b57fc3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043895 Oct 11 06:47:32.686604 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 441/836] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:32 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:33.262225 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3124d390-1b63-4c33-9c02-2203d56ef546 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:33.264398 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3124d390-1b63-4c33-9c02-2203d56ef546 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:33.270833 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3124d390-1b63-4c33-9c02-2203d56ef546 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:33.271311 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3124d390-1b63-4c33-9c02-2203d56ef546 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:33.271777 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3124d390-1b63-4c33-9c02-2203d56ef546 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:33.272466 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3124d390-1b63-4c33-9c02-2203d56ef546 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:33.272920 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3124d390-1b63-4c33-9c02-2203d56ef546 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:33.273346 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3124d390-1b63-4c33-9c02-2203d56ef546 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:33.302503 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3124d390-1b63-4c33-9c02-2203d56ef546 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044301 Oct 11 06:47:33.303045 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 396/837] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:33 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:33.698344 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6a2733a4-f956-4ab7-b123-755b5e63ae59 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:33.700518 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6a2733a4-f956-4ab7-b123-755b5e63ae59 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:33.706865 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a2733a4-f956-4ab7-b123-755b5e63ae59 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:33.707340 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a2733a4-f956-4ab7-b123-755b5e63ae59 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:33.707807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a2733a4-f956-4ab7-b123-755b5e63ae59 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:33.708533 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a2733a4-f956-4ab7-b123-755b5e63ae59 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:33.709007 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a2733a4-f956-4ab7-b123-755b5e63ae59 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:33.709427 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a2733a4-f956-4ab7-b123-755b5e63ae59 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:33.739010 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6a2733a4-f956-4ab7-b123-755b5e63ae59 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044607 Oct 11 06:47:33.739571 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 442/838] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:33 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:34.315148 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-601fac18-7fee-4938-8658-146b8743a707 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:34.317270 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-601fac18-7fee-4938-8658-146b8743a707 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:34.323688 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-601fac18-7fee-4938-8658-146b8743a707 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:34.324168 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-601fac18-7fee-4938-8658-146b8743a707 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:34.324621 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-601fac18-7fee-4938-8658-146b8743a707 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:34.325297 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-601fac18-7fee-4938-8658-146b8743a707 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:34.325751 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-601fac18-7fee-4938-8658-146b8743a707 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:34.326175 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-601fac18-7fee-4938-8658-146b8743a707 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:34.354835 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-601fac18-7fee-4938-8658-146b8743a707 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043737 Oct 11 06:47:34.355382 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 397/839] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:34 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:34.750902 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-584c1161-7b73-4adc-a2e8-71b40812bf28 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:34.753116 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-584c1161-7b73-4adc-a2e8-71b40812bf28 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:34.759875 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-584c1161-7b73-4adc-a2e8-71b40812bf28 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:34.760346 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-584c1161-7b73-4adc-a2e8-71b40812bf28 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:34.760770 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-584c1161-7b73-4adc-a2e8-71b40812bf28 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:34.761732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-584c1161-7b73-4adc-a2e8-71b40812bf28 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:34.762177 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-584c1161-7b73-4adc-a2e8-71b40812bf28 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:34.762591 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-584c1161-7b73-4adc-a2e8-71b40812bf28 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:34.792671 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-584c1161-7b73-4adc-a2e8-71b40812bf28 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045677 Oct 11 06:47:34.793221 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 443/840] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:34 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:35.367955 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c531e002-eb94-42aa-9f40-776c9035c505 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:35.370088 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c531e002-eb94-42aa-9f40-776c9035c505 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:35.376533 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c531e002-eb94-42aa-9f40-776c9035c505 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:35.377012 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c531e002-eb94-42aa-9f40-776c9035c505 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:35.377447 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c531e002-eb94-42aa-9f40-776c9035c505 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:35.378139 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c531e002-eb94-42aa-9f40-776c9035c505 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:35.378592 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c531e002-eb94-42aa-9f40-776c9035c505 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:35.379015 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c531e002-eb94-42aa-9f40-776c9035c505 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:35.408497 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c531e002-eb94-42aa-9f40-776c9035c505 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045013 Oct 11 06:47:35.409066 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 398/841] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:35 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:35.805397 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f1d7cb64-4a42-4d66-aff2-041c917612aa tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:35.807651 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f1d7cb64-4a42-4d66-aff2-041c917612aa tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:35.813980 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1d7cb64-4a42-4d66-aff2-041c917612aa tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:35.814452 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1d7cb64-4a42-4d66-aff2-041c917612aa tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:35.814880 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1d7cb64-4a42-4d66-aff2-041c917612aa tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:35.815586 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1d7cb64-4a42-4d66-aff2-041c917612aa tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:35.816028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1d7cb64-4a42-4d66-aff2-041c917612aa tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:35.816443 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1d7cb64-4a42-4d66-aff2-041c917612aa tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:35.849218 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f1d7cb64-4a42-4d66-aff2-041c917612aa tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048249 Oct 11 06:47:35.849774 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 444/842] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:35 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:47:36.421000 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0ec04dbd-aa1e-4f7f-9b6a-ed00398a67eb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:36.423181 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0ec04dbd-aa1e-4f7f-9b6a-ed00398a67eb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:36.429634 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0ec04dbd-aa1e-4f7f-9b6a-ed00398a67eb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:36.430113 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0ec04dbd-aa1e-4f7f-9b6a-ed00398a67eb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:36.430546 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0ec04dbd-aa1e-4f7f-9b6a-ed00398a67eb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:36.431232 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0ec04dbd-aa1e-4f7f-9b6a-ed00398a67eb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:36.431715 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0ec04dbd-aa1e-4f7f-9b6a-ed00398a67eb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:36.432137 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0ec04dbd-aa1e-4f7f-9b6a-ed00398a67eb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:36.460758 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0ec04dbd-aa1e-4f7f-9b6a-ed00398a67eb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043745 Oct 11 06:47:36.461866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 399/843] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:36 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:36.862197 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2cebc9dd-a798-400b-9d51-c2e5dd7eab6e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:36.864444 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2cebc9dd-a798-400b-9d51-c2e5dd7eab6e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:36.871281 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2cebc9dd-a798-400b-9d51-c2e5dd7eab6e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:36.871794 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2cebc9dd-a798-400b-9d51-c2e5dd7eab6e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:36.872229 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2cebc9dd-a798-400b-9d51-c2e5dd7eab6e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:36.872917 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2cebc9dd-a798-400b-9d51-c2e5dd7eab6e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:36.873366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2cebc9dd-a798-400b-9d51-c2e5dd7eab6e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:36.873785 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2cebc9dd-a798-400b-9d51-c2e5dd7eab6e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:36.903010 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2cebc9dd-a798-400b-9d51-c2e5dd7eab6e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044761 Oct 11 06:47:36.903568 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 445/844] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:36 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:37.474056 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-432a8a66-5668-416c-b107-d6c11e8fec0d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:37.476138 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-432a8a66-5668-416c-b107-d6c11e8fec0d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:37.479032 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=58 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:47:37.484140 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-432a8a66-5668-416c-b107-d6c11e8fec0d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:37.484615 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-432a8a66-5668-416c-b107-d6c11e8fec0d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:37.485039 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-432a8a66-5668-416c-b107-d6c11e8fec0d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:37.485718 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-432a8a66-5668-416c-b107-d6c11e8fec0d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:37.486163 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-432a8a66-5668-416c-b107-d6c11e8fec0d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:37.486577 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-432a8a66-5668-416c-b107-d6c11e8fec0d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:37.514831 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-432a8a66-5668-416c-b107-d6c11e8fec0d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044938 Oct 11 06:47:37.515369 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 400/845] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:37 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:37.914622 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8c108f47-6425-493a-99cb-16e8a39ec2fc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:37.916834 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8c108f47-6425-493a-99cb-16e8a39ec2fc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:37.923126 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c108f47-6425-493a-99cb-16e8a39ec2fc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:37.923640 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c108f47-6425-493a-99cb-16e8a39ec2fc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:37.924076 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c108f47-6425-493a-99cb-16e8a39ec2fc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:37.924764 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c108f47-6425-493a-99cb-16e8a39ec2fc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:37.925561 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c108f47-6425-493a-99cb-16e8a39ec2fc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:37.925991 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c108f47-6425-493a-99cb-16e8a39ec2fc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:37.955718 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8c108f47-6425-493a-99cb-16e8a39ec2fc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044986 Oct 11 06:47:37.956267 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 446/846] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:37 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:38.527639 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-61e90086-8469-4a73-927a-cccce37f4f8f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:38.529698 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-61e90086-8469-4a73-927a-cccce37f4f8f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:38.536004 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-61e90086-8469-4a73-927a-cccce37f4f8f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:38.536477 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-61e90086-8469-4a73-927a-cccce37f4f8f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:38.536901 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-61e90086-8469-4a73-927a-cccce37f4f8f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:38.537575 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-61e90086-8469-4a73-927a-cccce37f4f8f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:38.538017 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-61e90086-8469-4a73-927a-cccce37f4f8f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:38.538430 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-61e90086-8469-4a73-927a-cccce37f4f8f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:38.568972 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-61e90086-8469-4a73-927a-cccce37f4f8f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045600 Oct 11 06:47:38.569528 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 401/847] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:38 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:38.967931 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6fc6a850-e7f0-4179-a093-c32ee192c619 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:38.970090 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6fc6a850-e7f0-4179-a093-c32ee192c619 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:38.977066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fc6a850-e7f0-4179-a093-c32ee192c619 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:38.977540 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fc6a850-e7f0-4179-a093-c32ee192c619 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:38.977970 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fc6a850-e7f0-4179-a093-c32ee192c619 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:38.978649 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fc6a850-e7f0-4179-a093-c32ee192c619 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:38.979092 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fc6a850-e7f0-4179-a093-c32ee192c619 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:38.979536 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fc6a850-e7f0-4179-a093-c32ee192c619 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:39.007713 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6fc6a850-e7f0-4179-a093-c32ee192c619 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043639 Oct 11 06:47:39.008255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 447/848] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:38 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:39.581025 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-609a4183-2e3f-4713-a34e-c2c9a234d482 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:39.583062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-609a4183-2e3f-4713-a34e-c2c9a234d482 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:39.590133 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-609a4183-2e3f-4713-a34e-c2c9a234d482 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:39.590613 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-609a4183-2e3f-4713-a34e-c2c9a234d482 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:39.591048 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-609a4183-2e3f-4713-a34e-c2c9a234d482 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:39.591762 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-609a4183-2e3f-4713-a34e-c2c9a234d482 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:39.592215 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-609a4183-2e3f-4713-a34e-c2c9a234d482 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:39.592636 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-609a4183-2e3f-4713-a34e-c2c9a234d482 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:39.621299 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-609a4183-2e3f-4713-a34e-c2c9a234d482 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044328 Oct 11 06:47:39.621843 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 402/849] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:39 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:40.019406 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-86eee0ba-d72e-4ef9-a3bd-7d02d8586697 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:40.021587 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-86eee0ba-d72e-4ef9-a3bd-7d02d8586697 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:40.028273 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-86eee0ba-d72e-4ef9-a3bd-7d02d8586697 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:40.028748 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-86eee0ba-d72e-4ef9-a3bd-7d02d8586697 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:40.029180 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-86eee0ba-d72e-4ef9-a3bd-7d02d8586697 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:40.029868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-86eee0ba-d72e-4ef9-a3bd-7d02d8586697 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:40.030310 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-86eee0ba-d72e-4ef9-a3bd-7d02d8586697 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:40.030728 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-86eee0ba-d72e-4ef9-a3bd-7d02d8586697 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:40.060144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-86eee0ba-d72e-4ef9-a3bd-7d02d8586697 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044724 Oct 11 06:47:40.060683 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 448/850] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:40 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:40.633656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1079fcf7-32dc-4e60-9256-07660a823075 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:40.635811 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1079fcf7-32dc-4e60-9256-07660a823075 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:40.642195 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1079fcf7-32dc-4e60-9256-07660a823075 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:40.642669 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1079fcf7-32dc-4e60-9256-07660a823075 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:40.643095 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1079fcf7-32dc-4e60-9256-07660a823075 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:40.643802 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1079fcf7-32dc-4e60-9256-07660a823075 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:40.644244 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1079fcf7-32dc-4e60-9256-07660a823075 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:40.644658 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1079fcf7-32dc-4e60-9256-07660a823075 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:40.675328 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1079fcf7-32dc-4e60-9256-07660a823075 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045506 Oct 11 06:47:40.675908 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 403/851] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:40 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:41.072102 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-97219379-81f9-48a7-b0fd-7d0ecdb99774 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:41.074260 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-97219379-81f9-48a7-b0fd-7d0ecdb99774 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:41.080719 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-97219379-81f9-48a7-b0fd-7d0ecdb99774 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:41.081220 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-97219379-81f9-48a7-b0fd-7d0ecdb99774 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:41.081651 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-97219379-81f9-48a7-b0fd-7d0ecdb99774 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:41.082331 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-97219379-81f9-48a7-b0fd-7d0ecdb99774 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:41.082776 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-97219379-81f9-48a7-b0fd-7d0ecdb99774 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:41.083192 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-97219379-81f9-48a7-b0fd-7d0ecdb99774 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:41.112012 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-97219379-81f9-48a7-b0fd-7d0ecdb99774 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044388 Oct 11 06:47:41.112548 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 449/852] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:41 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:41.687827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-02e7de6d-a71c-4e3b-8104-e9116ef4bf82 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:41.689883 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-02e7de6d-a71c-4e3b-8104-e9116ef4bf82 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:41.696236 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-02e7de6d-a71c-4e3b-8104-e9116ef4bf82 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:41.696718 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-02e7de6d-a71c-4e3b-8104-e9116ef4bf82 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:41.697154 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-02e7de6d-a71c-4e3b-8104-e9116ef4bf82 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:41.697849 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-02e7de6d-a71c-4e3b-8104-e9116ef4bf82 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:41.698300 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-02e7de6d-a71c-4e3b-8104-e9116ef4bf82 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:41.698721 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-02e7de6d-a71c-4e3b-8104-e9116ef4bf82 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:41.727970 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-02e7de6d-a71c-4e3b-8104-e9116ef4bf82 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044020 Oct 11 06:47:41.728517 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 404/853] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:41 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:42.124347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0cff33b0-cd17-48c4-9a42-039cf9a87eec tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:42.126513 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0cff33b0-cd17-48c4-9a42-039cf9a87eec tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:42.132837 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0cff33b0-cd17-48c4-9a42-039cf9a87eec tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:42.133305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0cff33b0-cd17-48c4-9a42-039cf9a87eec tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:42.133730 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0cff33b0-cd17-48c4-9a42-039cf9a87eec tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:42.134405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0cff33b0-cd17-48c4-9a42-039cf9a87eec tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:42.134842 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0cff33b0-cd17-48c4-9a42-039cf9a87eec tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:42.135253 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0cff33b0-cd17-48c4-9a42-039cf9a87eec tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:42.163834 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0cff33b0-cd17-48c4-9a42-039cf9a87eec tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043398 Oct 11 06:47:42.164958 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 450/854] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:42 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:42.740387 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-df6cd393-5817-4943-adfe-3e670daf99f4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:42.742436 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-df6cd393-5817-4943-adfe-3e670daf99f4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:42.748816 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-df6cd393-5817-4943-adfe-3e670daf99f4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:42.749286 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-df6cd393-5817-4943-adfe-3e670daf99f4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:42.749712 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-df6cd393-5817-4943-adfe-3e670daf99f4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:42.750387 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-df6cd393-5817-4943-adfe-3e670daf99f4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:42.750828 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-df6cd393-5817-4943-adfe-3e670daf99f4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:42.751248 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-df6cd393-5817-4943-adfe-3e670daf99f4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:42.780485 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-df6cd393-5817-4943-adfe-3e670daf99f4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044120 Oct 11 06:47:42.781030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 405/855] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:42 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:43.176620 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b60035cd-1934-49be-8f78-b207d080e91f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:43.178790 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b60035cd-1934-49be-8f78-b207d080e91f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:43.185337 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b60035cd-1934-49be-8f78-b207d080e91f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:43.185815 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b60035cd-1934-49be-8f78-b207d080e91f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:43.186272 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b60035cd-1934-49be-8f78-b207d080e91f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:43.186988 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b60035cd-1934-49be-8f78-b207d080e91f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:43.187456 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b60035cd-1934-49be-8f78-b207d080e91f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:43.187884 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b60035cd-1934-49be-8f78-b207d080e91f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:43.217238 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b60035cd-1934-49be-8f78-b207d080e91f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044503 Oct 11 06:47:43.217784 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 451/856] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:43 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:43.793569 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d31ca9e4-b8f0-42db-b67e-e319cfdc7b74 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:43.795749 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d31ca9e4-b8f0-42db-b67e-e319cfdc7b74 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:43.802140 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d31ca9e4-b8f0-42db-b67e-e319cfdc7b74 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:43.802618 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d31ca9e4-b8f0-42db-b67e-e319cfdc7b74 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:43.803052 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d31ca9e4-b8f0-42db-b67e-e319cfdc7b74 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:43.803771 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d31ca9e4-b8f0-42db-b67e-e319cfdc7b74 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:43.804224 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d31ca9e4-b8f0-42db-b67e-e319cfdc7b74 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:43.804643 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d31ca9e4-b8f0-42db-b67e-e319cfdc7b74 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:43.833397 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d31ca9e4-b8f0-42db-b67e-e319cfdc7b74 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044314 Oct 11 06:47:43.833930 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 406/857] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:43 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:44.229767 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d8da743a-03fd-4afa-bc68-1ec6c1d32e2f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:44.232276 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d8da743a-03fd-4afa-bc68-1ec6c1d32e2f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:44.238629 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8da743a-03fd-4afa-bc68-1ec6c1d32e2f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:44.239104 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8da743a-03fd-4afa-bc68-1ec6c1d32e2f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:44.239579 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8da743a-03fd-4afa-bc68-1ec6c1d32e2f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:44.240271 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8da743a-03fd-4afa-bc68-1ec6c1d32e2f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:44.240724 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8da743a-03fd-4afa-bc68-1ec6c1d32e2f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:44.241146 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8da743a-03fd-4afa-bc68-1ec6c1d32e2f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:44.269463 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d8da743a-03fd-4afa-bc68-1ec6c1d32e2f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044327 Oct 11 06:47:44.270010 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 452/858] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:44 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:44.845613 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-14f75902-872f-4747-a67e-d123f549a78e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:44.847709 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-14f75902-872f-4747-a67e-d123f549a78e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:44.854121 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14f75902-872f-4747-a67e-d123f549a78e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:44.854601 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14f75902-872f-4747-a67e-d123f549a78e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:44.855032 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14f75902-872f-4747-a67e-d123f549a78e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:44.855752 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14f75902-872f-4747-a67e-d123f549a78e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:44.856202 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14f75902-872f-4747-a67e-d123f549a78e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:44.856623 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14f75902-872f-4747-a67e-d123f549a78e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:44.886328 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-14f75902-872f-4747-a67e-d123f549a78e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044790 Oct 11 06:47:44.886870 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 407/859] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:44 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:45.282333 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f454140d-8bae-4ec3-ae78-a9a2c58dcc5c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:45.284502 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f454140d-8bae-4ec3-ae78-a9a2c58dcc5c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:45.291335 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f454140d-8bae-4ec3-ae78-a9a2c58dcc5c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:45.291855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f454140d-8bae-4ec3-ae78-a9a2c58dcc5c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:45.292288 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f454140d-8bae-4ec3-ae78-a9a2c58dcc5c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:45.292976 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f454140d-8bae-4ec3-ae78-a9a2c58dcc5c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:45.293423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f454140d-8bae-4ec3-ae78-a9a2c58dcc5c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:45.293842 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f454140d-8bae-4ec3-ae78-a9a2c58dcc5c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:45.297391 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:47:45.323850 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f454140d-8bae-4ec3-ae78-a9a2c58dcc5c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045529 Oct 11 06:47:45.324390 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 453/860] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:45 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:45.899830 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6ff5c222-7b55-44be-ba81-b1aa3f814644 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:45.901868 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6ff5c222-7b55-44be-ba81-b1aa3f814644 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:45.908222 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ff5c222-7b55-44be-ba81-b1aa3f814644 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:45.908700 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ff5c222-7b55-44be-ba81-b1aa3f814644 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:45.909130 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ff5c222-7b55-44be-ba81-b1aa3f814644 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:45.909813 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ff5c222-7b55-44be-ba81-b1aa3f814644 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:45.910257 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ff5c222-7b55-44be-ba81-b1aa3f814644 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:45.910675 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ff5c222-7b55-44be-ba81-b1aa3f814644 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:45.939497 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6ff5c222-7b55-44be-ba81-b1aa3f814644 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044527 Oct 11 06:47:45.940029 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 408/861] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:45 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:46.336296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2c3472f7-fd30-4221-b3e9-0b6a74545e74 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:46.338886 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2c3472f7-fd30-4221-b3e9-0b6a74545e74 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:46.345231 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c3472f7-fd30-4221-b3e9-0b6a74545e74 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:46.345715 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c3472f7-fd30-4221-b3e9-0b6a74545e74 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:46.346146 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c3472f7-fd30-4221-b3e9-0b6a74545e74 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:46.346838 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c3472f7-fd30-4221-b3e9-0b6a74545e74 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:46.347288 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c3472f7-fd30-4221-b3e9-0b6a74545e74 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:46.347737 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c3472f7-fd30-4221-b3e9-0b6a74545e74 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:46.376481 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2c3472f7-fd30-4221-b3e9-0b6a74545e74 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044245 Oct 11 06:47:46.377018 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 454/862] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:46 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:46.952454 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-babaae2f-2cfa-4917-915e-d0204f3b7ec7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:46.954513 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-babaae2f-2cfa-4917-915e-d0204f3b7ec7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:46.960855 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-babaae2f-2cfa-4917-915e-d0204f3b7ec7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:46.961333 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-babaae2f-2cfa-4917-915e-d0204f3b7ec7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:46.962376 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-babaae2f-2cfa-4917-915e-d0204f3b7ec7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:46.963052 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-babaae2f-2cfa-4917-915e-d0204f3b7ec7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:46.963548 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-babaae2f-2cfa-4917-915e-d0204f3b7ec7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:46.963970 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-babaae2f-2cfa-4917-915e-d0204f3b7ec7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:46.992348 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-babaae2f-2cfa-4917-915e-d0204f3b7ec7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043911 Oct 11 06:47:46.992921 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 409/863] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:46 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:47.388769 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-003d7c77-4f1c-4165-afe3-034107a410e1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:47.390906 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-003d7c77-4f1c-4165-afe3-034107a410e1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:47.397266 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-003d7c77-4f1c-4165-afe3-034107a410e1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:47.397736 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-003d7c77-4f1c-4165-afe3-034107a410e1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:47.398160 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-003d7c77-4f1c-4165-afe3-034107a410e1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:47.399093 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-003d7c77-4f1c-4165-afe3-034107a410e1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:47.399562 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-003d7c77-4f1c-4165-afe3-034107a410e1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:47.400517 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-003d7c77-4f1c-4165-afe3-034107a410e1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:47.431275 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-003d7c77-4f1c-4165-afe3-034107a410e1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046468 Oct 11 06:47:47.431861 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 455/864] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:47 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:47:48.004868 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8e0b6e84-02f7-4ff5-ba75-abdeeb7fb69a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:48.006952 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8e0b6e84-02f7-4ff5-ba75-abdeeb7fb69a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:48.013854 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e0b6e84-02f7-4ff5-ba75-abdeeb7fb69a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:48.014335 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e0b6e84-02f7-4ff5-ba75-abdeeb7fb69a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:48.014791 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e0b6e84-02f7-4ff5-ba75-abdeeb7fb69a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:48.015530 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e0b6e84-02f7-4ff5-ba75-abdeeb7fb69a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:48.015977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e0b6e84-02f7-4ff5-ba75-abdeeb7fb69a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:48.016394 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e0b6e84-02f7-4ff5-ba75-abdeeb7fb69a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:48.041049 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:47:48.046121 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8e0b6e84-02f7-4ff5-ba75-abdeeb7fb69a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045342 Oct 11 06:47:48.046666 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 410/865] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:47 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:48.443920 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1117ac29-c5f5-4a1d-8749-cccc3ae80a62 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:48.446042 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1117ac29-c5f5-4a1d-8749-cccc3ae80a62 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:48.452598 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1117ac29-c5f5-4a1d-8749-cccc3ae80a62 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:48.453074 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1117ac29-c5f5-4a1d-8749-cccc3ae80a62 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:48.453537 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1117ac29-c5f5-4a1d-8749-cccc3ae80a62 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:48.454221 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1117ac29-c5f5-4a1d-8749-cccc3ae80a62 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:48.454669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1117ac29-c5f5-4a1d-8749-cccc3ae80a62 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:48.455087 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1117ac29-c5f5-4a1d-8749-cccc3ae80a62 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:48.483608 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1117ac29-c5f5-4a1d-8749-cccc3ae80a62 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043565 Oct 11 06:47:48.484143 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 456/866] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:48 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:49.058393 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4bbf3036-e9c5-46df-a6ab-975548432d24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:49.060491 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4bbf3036-e9c5-46df-a6ab-975548432d24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:49.066775 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4bbf3036-e9c5-46df-a6ab-975548432d24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:49.067251 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4bbf3036-e9c5-46df-a6ab-975548432d24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:49.067712 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4bbf3036-e9c5-46df-a6ab-975548432d24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:49.068398 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4bbf3036-e9c5-46df-a6ab-975548432d24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:49.068846 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4bbf3036-e9c5-46df-a6ab-975548432d24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:49.069265 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4bbf3036-e9c5-46df-a6ab-975548432d24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:49.100497 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4bbf3036-e9c5-46df-a6ab-975548432d24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046295 Oct 11 06:47:49.101049 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 411/867] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:49 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:49.496240 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e8ba721c-c2c5-470d-8ebe-8c686e751f12 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:49.498453 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e8ba721c-c2c5-470d-8ebe-8c686e751f12 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:49.504723 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8ba721c-c2c5-470d-8ebe-8c686e751f12 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:49.505196 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8ba721c-c2c5-470d-8ebe-8c686e751f12 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:49.505630 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8ba721c-c2c5-470d-8ebe-8c686e751f12 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:49.506311 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8ba721c-c2c5-470d-8ebe-8c686e751f12 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:49.506755 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8ba721c-c2c5-470d-8ebe-8c686e751f12 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:49.507172 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8ba721c-c2c5-470d-8ebe-8c686e751f12 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:49.536306 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e8ba721c-c2c5-470d-8ebe-8c686e751f12 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044499 Oct 11 06:47:49.536841 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 457/868] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:49 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:50.112149 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a2922ae2-445a-41c4-8297-9f072c379279 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:50.114275 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a2922ae2-445a-41c4-8297-9f072c379279 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:50.120740 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2922ae2-445a-41c4-8297-9f072c379279 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:50.121217 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2922ae2-445a-41c4-8297-9f072c379279 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:50.121652 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2922ae2-445a-41c4-8297-9f072c379279 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:50.122340 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2922ae2-445a-41c4-8297-9f072c379279 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:50.122816 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2922ae2-445a-41c4-8297-9f072c379279 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:50.123234 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2922ae2-445a-41c4-8297-9f072c379279 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:50.152103 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a2922ae2-445a-41c4-8297-9f072c379279 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043895 Oct 11 06:47:50.152637 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 412/869] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:50 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:50.548558 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-eba3be0b-609a-41a5-b450-ea659dd6dc81 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:50.550679 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-eba3be0b-609a-41a5-b450-ea659dd6dc81 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:50.557036 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eba3be0b-609a-41a5-b450-ea659dd6dc81 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:50.557508 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eba3be0b-609a-41a5-b450-ea659dd6dc81 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:50.557938 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eba3be0b-609a-41a5-b450-ea659dd6dc81 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:50.558626 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eba3be0b-609a-41a5-b450-ea659dd6dc81 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:50.559072 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eba3be0b-609a-41a5-b450-ea659dd6dc81 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:50.559516 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eba3be0b-609a-41a5-b450-ea659dd6dc81 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:50.588131 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-eba3be0b-609a-41a5-b450-ea659dd6dc81 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043509 Oct 11 06:47:50.589284 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 458/870] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:50 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:51.164821 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-32570d62-fef5-413f-9a82-c068c7f493f0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:51.167621 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-32570d62-fef5-413f-9a82-c068c7f493f0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:51.174476 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-32570d62-fef5-413f-9a82-c068c7f493f0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:51.174998 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-32570d62-fef5-413f-9a82-c068c7f493f0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:51.175464 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-32570d62-fef5-413f-9a82-c068c7f493f0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:51.176164 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-32570d62-fef5-413f-9a82-c068c7f493f0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:51.176617 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-32570d62-fef5-413f-9a82-c068c7f493f0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:51.177036 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-32570d62-fef5-413f-9a82-c068c7f493f0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:51.209351 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-32570d62-fef5-413f-9a82-c068c7f493f0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048507 Oct 11 06:47:51.210085 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 413/871] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:51 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:51.602151 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-404fd91b-f64a-4e9c-a99b-da9bed41b6bf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:51.604981 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-404fd91b-f64a-4e9c-a99b-da9bed41b6bf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:51.611399 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-404fd91b-f64a-4e9c-a99b-da9bed41b6bf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:51.611907 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-404fd91b-f64a-4e9c-a99b-da9bed41b6bf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:51.612342 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-404fd91b-f64a-4e9c-a99b-da9bed41b6bf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:51.613075 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-404fd91b-f64a-4e9c-a99b-da9bed41b6bf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:51.613528 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-404fd91b-f64a-4e9c-a99b-da9bed41b6bf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:51.613949 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-404fd91b-f64a-4e9c-a99b-da9bed41b6bf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:51.643503 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-404fd91b-f64a-4e9c-a99b-da9bed41b6bf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045102 Oct 11 06:47:51.643989 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 459/872] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:51 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:52.221401 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-959fe4d0-d5fb-49ef-84e3-a7f2b35102d7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:52.223597 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-959fe4d0-d5fb-49ef-84e3-a7f2b35102d7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:52.229920 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-959fe4d0-d5fb-49ef-84e3-a7f2b35102d7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:52.230400 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-959fe4d0-d5fb-49ef-84e3-a7f2b35102d7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:52.230829 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-959fe4d0-d5fb-49ef-84e3-a7f2b35102d7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:52.231544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-959fe4d0-d5fb-49ef-84e3-a7f2b35102d7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:52.231994 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-959fe4d0-d5fb-49ef-84e3-a7f2b35102d7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:52.232415 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-959fe4d0-d5fb-49ef-84e3-a7f2b35102d7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:52.260983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-959fe4d0-d5fb-49ef-84e3-a7f2b35102d7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043611 Oct 11 06:47:52.261514 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 414/873] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:52 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:52.655857 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6e31602e-a79c-426a-b7cc-e382a6410168 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:52.657995 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6e31602e-a79c-426a-b7cc-e382a6410168 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:52.664353 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6e31602e-a79c-426a-b7cc-e382a6410168 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:52.664826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6e31602e-a79c-426a-b7cc-e382a6410168 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:52.665259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6e31602e-a79c-426a-b7cc-e382a6410168 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:52.665942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6e31602e-a79c-426a-b7cc-e382a6410168 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:52.666934 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6e31602e-a79c-426a-b7cc-e382a6410168 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:52.667362 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6e31602e-a79c-426a-b7cc-e382a6410168 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:52.696169 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6e31602e-a79c-426a-b7cc-e382a6410168 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044317 Oct 11 06:47:52.696704 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 460/874] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:52 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:53.273651 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b09c88a4-ebe0-47ed-8919-2b8a0d431c2e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:53.276344 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b09c88a4-ebe0-47ed-8919-2b8a0d431c2e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:53.282771 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b09c88a4-ebe0-47ed-8919-2b8a0d431c2e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:53.283247 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b09c88a4-ebe0-47ed-8919-2b8a0d431c2e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:53.283710 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b09c88a4-ebe0-47ed-8919-2b8a0d431c2e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:53.284407 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b09c88a4-ebe0-47ed-8919-2b8a0d431c2e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:53.284857 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b09c88a4-ebe0-47ed-8919-2b8a0d431c2e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:53.285278 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b09c88a4-ebe0-47ed-8919-2b8a0d431c2e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:53.314176 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b09c88a4-ebe0-47ed-8919-2b8a0d431c2e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044898 Oct 11 06:47:53.314708 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 415/875] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:53 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:53.708645 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9bf43b7c-6179-40c0-9436-881a3cbb1d3a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:53.710771 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9bf43b7c-6179-40c0-9436-881a3cbb1d3a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:53.717841 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9bf43b7c-6179-40c0-9436-881a3cbb1d3a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:53.718309 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9bf43b7c-6179-40c0-9436-881a3cbb1d3a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:53.718734 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9bf43b7c-6179-40c0-9436-881a3cbb1d3a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:53.719439 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9bf43b7c-6179-40c0-9436-881a3cbb1d3a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:53.719880 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9bf43b7c-6179-40c0-9436-881a3cbb1d3a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:53.720298 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9bf43b7c-6179-40c0-9436-881a3cbb1d3a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:53.748351 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9bf43b7c-6179-40c0-9436-881a3cbb1d3a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043727 Oct 11 06:47:53.748888 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 461/876] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:53 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:54.326088 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9190a732-ac23-4166-9ae9-afa0f8068ffe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:54.328267 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9190a732-ac23-4166-9ae9-afa0f8068ffe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:54.334561 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9190a732-ac23-4166-9ae9-afa0f8068ffe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:54.334976 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9190a732-ac23-4166-9ae9-afa0f8068ffe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:54.335410 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9190a732-ac23-4166-9ae9-afa0f8068ffe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:54.336117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9190a732-ac23-4166-9ae9-afa0f8068ffe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:54.336567 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9190a732-ac23-4166-9ae9-afa0f8068ffe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:54.336987 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9190a732-ac23-4166-9ae9-afa0f8068ffe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:54.365274 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9190a732-ac23-4166-9ae9-afa0f8068ffe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043122 Oct 11 06:47:54.365805 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 416/877] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:54 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:54.761040 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-47edbfa8-d453-4d45-b215-28e8d3a2a642 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:54.763191 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-47edbfa8-d453-4d45-b215-28e8d3a2a642 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:54.765493 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=58 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:47:54.770658 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-47edbfa8-d453-4d45-b215-28e8d3a2a642 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:54.771143 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-47edbfa8-d453-4d45-b215-28e8d3a2a642 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:54.771612 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-47edbfa8-d453-4d45-b215-28e8d3a2a642 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:54.772303 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-47edbfa8-d453-4d45-b215-28e8d3a2a642 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:54.772749 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-47edbfa8-d453-4d45-b215-28e8d3a2a642 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:54.773440 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-47edbfa8-d453-4d45-b215-28e8d3a2a642 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:54.802808 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-47edbfa8-d453-4d45-b215-28e8d3a2a642 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045706 Oct 11 06:47:54.803356 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 462/878] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:54 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:55.378103 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7ff5cac1-81c2-4daf-8470-a54f55d9c4a7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:55.380236 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7ff5cac1-81c2-4daf-8470-a54f55d9c4a7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:55.387194 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7ff5cac1-81c2-4daf-8470-a54f55d9c4a7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:55.387689 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7ff5cac1-81c2-4daf-8470-a54f55d9c4a7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:55.388118 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7ff5cac1-81c2-4daf-8470-a54f55d9c4a7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:55.388794 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7ff5cac1-81c2-4daf-8470-a54f55d9c4a7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:55.389242 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7ff5cac1-81c2-4daf-8470-a54f55d9c4a7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:55.389654 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7ff5cac1-81c2-4daf-8470-a54f55d9c4a7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:55.418798 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7ff5cac1-81c2-4daf-8470-a54f55d9c4a7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044512 Oct 11 06:47:55.419348 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 417/879] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:55 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:55.815223 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9adbec1b-4b56-46aa-938e-eeb31ff3a6b6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:55.817396 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9adbec1b-4b56-46aa-938e-eeb31ff3a6b6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:55.824167 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9adbec1b-4b56-46aa-938e-eeb31ff3a6b6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:55.824646 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9adbec1b-4b56-46aa-938e-eeb31ff3a6b6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:55.825076 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9adbec1b-4b56-46aa-938e-eeb31ff3a6b6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:55.825770 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9adbec1b-4b56-46aa-938e-eeb31ff3a6b6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:55.826217 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9adbec1b-4b56-46aa-938e-eeb31ff3a6b6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:55.826637 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9adbec1b-4b56-46aa-938e-eeb31ff3a6b6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:55.855483 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9adbec1b-4b56-46aa-938e-eeb31ff3a6b6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044228 Oct 11 06:47:55.856045 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 463/880] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:55 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:56.432311 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-db813bdb-4667-4ef8-8f78-0d10cf212f9f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:56.434416 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-db813bdb-4667-4ef8-8f78-0d10cf212f9f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:56.440878 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db813bdb-4667-4ef8-8f78-0d10cf212f9f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:56.441353 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db813bdb-4667-4ef8-8f78-0d10cf212f9f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:56.441780 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db813bdb-4667-4ef8-8f78-0d10cf212f9f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:56.442517 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db813bdb-4667-4ef8-8f78-0d10cf212f9f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:56.442907 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db813bdb-4667-4ef8-8f78-0d10cf212f9f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:56.443322 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db813bdb-4667-4ef8-8f78-0d10cf212f9f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:56.472334 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-db813bdb-4667-4ef8-8f78-0d10cf212f9f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043947 Oct 11 06:47:56.472864 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 418/881] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:56 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:56.867404 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-828c8561-5e85-45b1-a6ed-049e4f712db9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:56.869577 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-828c8561-5e85-45b1-a6ed-049e4f712db9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:56.876446 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-828c8561-5e85-45b1-a6ed-049e4f712db9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:56.876921 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-828c8561-5e85-45b1-a6ed-049e4f712db9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:56.877352 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-828c8561-5e85-45b1-a6ed-049e4f712db9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:56.878033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-828c8561-5e85-45b1-a6ed-049e4f712db9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:56.878474 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-828c8561-5e85-45b1-a6ed-049e4f712db9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:56.878920 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-828c8561-5e85-45b1-a6ed-049e4f712db9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:56.907834 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-828c8561-5e85-45b1-a6ed-049e4f712db9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044318 Oct 11 06:47:56.908365 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 464/882] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:56 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:57.483856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-187bcbd5-7d66-4320-974a-335d383c4b65 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:57.485959 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-187bcbd5-7d66-4320-974a-335d383c4b65 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:57.492267 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-187bcbd5-7d66-4320-974a-335d383c4b65 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:57.492750 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-187bcbd5-7d66-4320-974a-335d383c4b65 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:57.493180 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-187bcbd5-7d66-4320-974a-335d383c4b65 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:57.493855 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-187bcbd5-7d66-4320-974a-335d383c4b65 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:57.494297 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-187bcbd5-7d66-4320-974a-335d383c4b65 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:57.494714 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-187bcbd5-7d66-4320-974a-335d383c4b65 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:57.522783 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-187bcbd5-7d66-4320-974a-335d383c4b65 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042794 Oct 11 06:47:57.523725 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 419/883] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:57 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:57.920756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c592f021-9f78-4809-a345-bb6ed8ebad90 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:57.922868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c592f021-9f78-4809-a345-bb6ed8ebad90 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:57.929207 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c592f021-9f78-4809-a345-bb6ed8ebad90 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:57.929689 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c592f021-9f78-4809-a345-bb6ed8ebad90 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:57.930117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c592f021-9f78-4809-a345-bb6ed8ebad90 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:57.930803 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c592f021-9f78-4809-a345-bb6ed8ebad90 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:57.931247 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c592f021-9f78-4809-a345-bb6ed8ebad90 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:57.931690 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c592f021-9f78-4809-a345-bb6ed8ebad90 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:57.960450 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c592f021-9f78-4809-a345-bb6ed8ebad90 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044219 Oct 11 06:47:57.960989 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 465/884] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:57 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:58.536210 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-87f907ba-e62e-44ba-9f27-645a52c9af50 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:58.538331 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-87f907ba-e62e-44ba-9f27-645a52c9af50 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:58.545330 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87f907ba-e62e-44ba-9f27-645a52c9af50 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:58.545809 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87f907ba-e62e-44ba-9f27-645a52c9af50 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:58.546239 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87f907ba-e62e-44ba-9f27-645a52c9af50 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:58.546936 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87f907ba-e62e-44ba-9f27-645a52c9af50 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:58.547383 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87f907ba-e62e-44ba-9f27-645a52c9af50 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:58.547827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87f907ba-e62e-44ba-9f27-645a52c9af50 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:58.576083 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-87f907ba-e62e-44ba-9f27-645a52c9af50 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043751 Oct 11 06:47:58.576572 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 420/885] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:58 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:47:58.972693 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6f3799e2-b387-410c-8bfe-726f190ac068 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:58.974902 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6f3799e2-b387-410c-8bfe-726f190ac068 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:58.981335 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f3799e2-b387-410c-8bfe-726f190ac068 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:58.981813 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f3799e2-b387-410c-8bfe-726f190ac068 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:58.982243 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f3799e2-b387-410c-8bfe-726f190ac068 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:58.982928 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f3799e2-b387-410c-8bfe-726f190ac068 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:58.983372 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f3799e2-b387-410c-8bfe-726f190ac068 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:58.983815 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f3799e2-b387-410c-8bfe-726f190ac068 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:59.012330 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6f3799e2-b387-410c-8bfe-726f190ac068 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043589 Oct 11 06:47:59.012860 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 466/886] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:47:58 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:47:59.588564 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-da80fe19-f51e-4617-8214-1bce477a4e0a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:47:59.590806 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-da80fe19-f51e-4617-8214-1bce477a4e0a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:47:59.597224 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-da80fe19-f51e-4617-8214-1bce477a4e0a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:59.597706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-da80fe19-f51e-4617-8214-1bce477a4e0a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:59.598144 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-da80fe19-f51e-4617-8214-1bce477a4e0a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:59.598845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-da80fe19-f51e-4617-8214-1bce477a4e0a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:47:59.599298 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-da80fe19-f51e-4617-8214-1bce477a4e0a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:47:59.599752 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-da80fe19-f51e-4617-8214-1bce477a4e0a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:47:59.629096 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-da80fe19-f51e-4617-8214-1bce477a4e0a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044492 Oct 11 06:47:59.629570 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 421/887] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:47:59 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:00.025098 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-21d03bb8-5581-4770-ac06-29a1d32e4a35 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:00.027691 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-21d03bb8-5581-4770-ac06-29a1d32e4a35 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:00.034032 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21d03bb8-5581-4770-ac06-29a1d32e4a35 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:00.034507 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21d03bb8-5581-4770-ac06-29a1d32e4a35 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:00.034938 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21d03bb8-5581-4770-ac06-29a1d32e4a35 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:00.035664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21d03bb8-5581-4770-ac06-29a1d32e4a35 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:00.036115 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21d03bb8-5581-4770-ac06-29a1d32e4a35 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:00.036554 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21d03bb8-5581-4770-ac06-29a1d32e4a35 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:00.065965 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-21d03bb8-5581-4770-ac06-29a1d32e4a35 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045172 Oct 11 06:48:00.066503 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 467/888] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:00 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:00.641519 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d63fa12e-577e-4834-ab7d-989b622714cf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:00.643718 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d63fa12e-577e-4834-ab7d-989b622714cf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:00.650466 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d63fa12e-577e-4834-ab7d-989b622714cf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:00.650972 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d63fa12e-577e-4834-ab7d-989b622714cf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:00.651943 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d63fa12e-577e-4834-ab7d-989b622714cf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:00.652631 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d63fa12e-577e-4834-ab7d-989b622714cf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:00.653078 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d63fa12e-577e-4834-ab7d-989b622714cf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:00.653497 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d63fa12e-577e-4834-ab7d-989b622714cf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:00.683371 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d63fa12e-577e-4834-ab7d-989b622714cf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045859 Oct 11 06:48:00.683887 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 422/889] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:00 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:01.078650 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-10f4ef3d-d8c7-4e1c-901e-6ed0f684f9dc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:01.080862 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-10f4ef3d-d8c7-4e1c-901e-6ed0f684f9dc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:01.087105 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-10f4ef3d-d8c7-4e1c-901e-6ed0f684f9dc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:01.087613 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-10f4ef3d-d8c7-4e1c-901e-6ed0f684f9dc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:01.088045 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-10f4ef3d-d8c7-4e1c-901e-6ed0f684f9dc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:01.089367 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-10f4ef3d-d8c7-4e1c-901e-6ed0f684f9dc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:01.089808 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-10f4ef3d-d8c7-4e1c-901e-6ed0f684f9dc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:01.090219 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-10f4ef3d-d8c7-4e1c-901e-6ed0f684f9dc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:01.118252 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-10f4ef3d-d8c7-4e1c-901e-6ed0f684f9dc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043554 Oct 11 06:48:01.118784 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 468/890] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:01 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:01.695678 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d079a72d-5e68-4d7e-8e14-7b381afd653a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:01.697781 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d079a72d-5e68-4d7e-8e14-7b381afd653a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:01.704071 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d079a72d-5e68-4d7e-8e14-7b381afd653a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:01.704543 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d079a72d-5e68-4d7e-8e14-7b381afd653a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:01.704967 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d079a72d-5e68-4d7e-8e14-7b381afd653a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:01.705651 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d079a72d-5e68-4d7e-8e14-7b381afd653a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:01.706096 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d079a72d-5e68-4d7e-8e14-7b381afd653a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:01.706512 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d079a72d-5e68-4d7e-8e14-7b381afd653a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:01.735111 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d079a72d-5e68-4d7e-8e14-7b381afd653a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043408 Oct 11 06:48:01.735689 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 423/891] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:01 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:02.130464 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fb49e37d-c78b-43db-a7cc-27271cf664e9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:02.132670 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fb49e37d-c78b-43db-a7cc-27271cf664e9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:02.139653 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fb49e37d-c78b-43db-a7cc-27271cf664e9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:02.140126 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fb49e37d-c78b-43db-a7cc-27271cf664e9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:02.140551 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fb49e37d-c78b-43db-a7cc-27271cf664e9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:02.141222 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fb49e37d-c78b-43db-a7cc-27271cf664e9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:02.141660 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fb49e37d-c78b-43db-a7cc-27271cf664e9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:02.142080 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fb49e37d-c78b-43db-a7cc-27271cf664e9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:02.166139 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:02.171158 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fb49e37d-c78b-43db-a7cc-27271cf664e9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044614 Oct 11 06:48:02.171727 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 469/892] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:02 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:02.748280 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ae38f563-97f7-4dbd-8b19-1da88998acb8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:02.750386 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ae38f563-97f7-4dbd-8b19-1da88998acb8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:02.756806 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ae38f563-97f7-4dbd-8b19-1da88998acb8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:02.757275 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ae38f563-97f7-4dbd-8b19-1da88998acb8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:02.757737 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ae38f563-97f7-4dbd-8b19-1da88998acb8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:02.758404 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ae38f563-97f7-4dbd-8b19-1da88998acb8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:02.758845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ae38f563-97f7-4dbd-8b19-1da88998acb8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:02.759259 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ae38f563-97f7-4dbd-8b19-1da88998acb8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:02.788939 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ae38f563-97f7-4dbd-8b19-1da88998acb8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045287 Oct 11 06:48:02.789480 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 424/893] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:02 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:03.183494 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-aacd00e6-8cd9-4904-aa21-0eb0f4e75171 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:03.185630 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-aacd00e6-8cd9-4904-aa21-0eb0f4e75171 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:03.192172 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aacd00e6-8cd9-4904-aa21-0eb0f4e75171 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:03.192725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aacd00e6-8cd9-4904-aa21-0eb0f4e75171 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:03.193162 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aacd00e6-8cd9-4904-aa21-0eb0f4e75171 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:03.193850 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aacd00e6-8cd9-4904-aa21-0eb0f4e75171 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:03.194575 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aacd00e6-8cd9-4904-aa21-0eb0f4e75171 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:03.195005 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aacd00e6-8cd9-4904-aa21-0eb0f4e75171 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:03.226568 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-aacd00e6-8cd9-4904-aa21-0eb0f4e75171 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047026 Oct 11 06:48:03.227118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 470/894] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:03 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:03.802432 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-415f090d-471d-4c76-8174-f7f8e719c8fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:03.804588 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-415f090d-471d-4c76-8174-f7f8e719c8fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:03.815005 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-415f090d-471d-4c76-8174-f7f8e719c8fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:03.815509 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-415f090d-471d-4c76-8174-f7f8e719c8fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:03.815937 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-415f090d-471d-4c76-8174-f7f8e719c8fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:03.816623 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-415f090d-471d-4c76-8174-f7f8e719c8fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:03.817067 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-415f090d-471d-4c76-8174-f7f8e719c8fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:03.817482 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-415f090d-471d-4c76-8174-f7f8e719c8fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:03.848979 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-415f090d-471d-4c76-8174-f7f8e719c8fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050380 Oct 11 06:48:03.849535 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 425/895] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:03 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:04.238156 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6b7ddca4-dd6c-4251-ac81-89f667fe1d82 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:04.240330 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6b7ddca4-dd6c-4251-ac81-89f667fe1d82 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:04.247199 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6b7ddca4-dd6c-4251-ac81-89f667fe1d82 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:04.247696 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6b7ddca4-dd6c-4251-ac81-89f667fe1d82 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:04.248123 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6b7ddca4-dd6c-4251-ac81-89f667fe1d82 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:04.248798 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6b7ddca4-dd6c-4251-ac81-89f667fe1d82 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:04.249237 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6b7ddca4-dd6c-4251-ac81-89f667fe1d82 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:04.249657 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6b7ddca4-dd6c-4251-ac81-89f667fe1d82 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:04.278346 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6b7ddca4-dd6c-4251-ac81-89f667fe1d82 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044117 Oct 11 06:48:04.278878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 471/896] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:04 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:04.861457 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3f2a59c5-acec-464b-8bca-c39285821760 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:04.863595 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3f2a59c5-acec-464b-8bca-c39285821760 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:04.870046 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3f2a59c5-acec-464b-8bca-c39285821760 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:04.870520 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3f2a59c5-acec-464b-8bca-c39285821760 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:04.870948 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3f2a59c5-acec-464b-8bca-c39285821760 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:04.871657 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3f2a59c5-acec-464b-8bca-c39285821760 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:04.872105 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3f2a59c5-acec-464b-8bca-c39285821760 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:04.872526 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3f2a59c5-acec-464b-8bca-c39285821760 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:04.901959 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3f2a59c5-acec-464b-8bca-c39285821760 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043841 Oct 11 06:48:04.902430 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 426/897] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:04 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:05.290743 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bbe519fb-1e63-4628-bc35-75305db9792d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:05.292918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bbe519fb-1e63-4628-bc35-75305db9792d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:05.299182 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bbe519fb-1e63-4628-bc35-75305db9792d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:05.299695 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bbe519fb-1e63-4628-bc35-75305db9792d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:05.300127 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bbe519fb-1e63-4628-bc35-75305db9792d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:05.300812 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bbe519fb-1e63-4628-bc35-75305db9792d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:05.301253 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bbe519fb-1e63-4628-bc35-75305db9792d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:05.301670 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bbe519fb-1e63-4628-bc35-75305db9792d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:05.331805 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bbe519fb-1e63-4628-bc35-75305db9792d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044988 Oct 11 06:48:05.332348 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 472/898] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:05 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:05.914257 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9921fc5b-42fa-4187-af2f-1cec4cf25eb7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:05.916464 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9921fc5b-42fa-4187-af2f-1cec4cf25eb7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:05.923444 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9921fc5b-42fa-4187-af2f-1cec4cf25eb7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:05.923930 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9921fc5b-42fa-4187-af2f-1cec4cf25eb7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:05.924369 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9921fc5b-42fa-4187-af2f-1cec4cf25eb7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:05.925066 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9921fc5b-42fa-4187-af2f-1cec4cf25eb7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:05.925523 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9921fc5b-42fa-4187-af2f-1cec4cf25eb7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:05.925948 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9921fc5b-42fa-4187-af2f-1cec4cf25eb7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:05.942033 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:05.955563 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9921fc5b-42fa-4187-af2f-1cec4cf25eb7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045180 Oct 11 06:48:05.956043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 427/899] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:05 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:06.344560 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-aaf9bac3-8c28-4a9c-b567-6514b3f70320 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:06.346604 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-aaf9bac3-8c28-4a9c-b567-6514b3f70320 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:06.352948 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aaf9bac3-8c28-4a9c-b567-6514b3f70320 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:06.353423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aaf9bac3-8c28-4a9c-b567-6514b3f70320 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:06.353857 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aaf9bac3-8c28-4a9c-b567-6514b3f70320 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:06.354541 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aaf9bac3-8c28-4a9c-b567-6514b3f70320 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:06.354983 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aaf9bac3-8c28-4a9c-b567-6514b3f70320 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:06.355400 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aaf9bac3-8c28-4a9c-b567-6514b3f70320 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:06.383484 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-aaf9bac3-8c28-4a9c-b567-6514b3f70320 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042908 Oct 11 06:48:06.384028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 473/900] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:06 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:06.967887 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cec97663-a636-456c-8c38-9d066b2255b4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:06.970052 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cec97663-a636-456c-8c38-9d066b2255b4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:06.976438 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cec97663-a636-456c-8c38-9d066b2255b4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:06.976918 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cec97663-a636-456c-8c38-9d066b2255b4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:06.977353 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cec97663-a636-456c-8c38-9d066b2255b4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:06.978041 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cec97663-a636-456c-8c38-9d066b2255b4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:06.978493 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cec97663-a636-456c-8c38-9d066b2255b4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:06.978915 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cec97663-a636-456c-8c38-9d066b2255b4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:07.008605 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cec97663-a636-456c-8c38-9d066b2255b4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044378 Oct 11 06:48:07.009148 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 428/901] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:06 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:07.396456 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-649b4dc6-5cea-4eb7-9553-6be731763293 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:07.398899 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-649b4dc6-5cea-4eb7-9553-6be731763293 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:07.405466 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-649b4dc6-5cea-4eb7-9553-6be731763293 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:07.405955 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-649b4dc6-5cea-4eb7-9553-6be731763293 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:07.406393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-649b4dc6-5cea-4eb7-9553-6be731763293 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:07.407092 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-649b4dc6-5cea-4eb7-9553-6be731763293 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:07.407587 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-649b4dc6-5cea-4eb7-9553-6be731763293 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:07.408012 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-649b4dc6-5cea-4eb7-9553-6be731763293 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:07.437453 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-649b4dc6-5cea-4eb7-9553-6be731763293 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044918 Oct 11 06:48:07.438004 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 474/902] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:07 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:08.021229 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3a99d1ad-e3a0-4a9b-8995-2bc4d5bbd2f1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:08.023659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3a99d1ad-e3a0-4a9b-8995-2bc4d5bbd2f1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:08.026423 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=58 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:08.031724 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a99d1ad-e3a0-4a9b-8995-2bc4d5bbd2f1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:08.032204 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a99d1ad-e3a0-4a9b-8995-2bc4d5bbd2f1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:08.032640 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a99d1ad-e3a0-4a9b-8995-2bc4d5bbd2f1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:08.033333 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a99d1ad-e3a0-4a9b-8995-2bc4d5bbd2f1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:08.033786 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a99d1ad-e3a0-4a9b-8995-2bc4d5bbd2f1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:08.034207 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a99d1ad-e3a0-4a9b-8995-2bc4d5bbd2f1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:08.064275 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3a99d1ad-e3a0-4a9b-8995-2bc4d5bbd2f1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047095 Oct 11 06:48:08.064892 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 429/903] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:08 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:08.449413 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6b86e3f8-37a3-440e-ae1f-b2706c97881f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:08.451584 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6b86e3f8-37a3-440e-ae1f-b2706c97881f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:08.457899 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6b86e3f8-37a3-440e-ae1f-b2706c97881f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:08.458369 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6b86e3f8-37a3-440e-ae1f-b2706c97881f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:08.458794 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6b86e3f8-37a3-440e-ae1f-b2706c97881f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:08.459494 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6b86e3f8-37a3-440e-ae1f-b2706c97881f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:08.459937 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6b86e3f8-37a3-440e-ae1f-b2706c97881f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:08.460349 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6b86e3f8-37a3-440e-ae1f-b2706c97881f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:08.488947 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6b86e3f8-37a3-440e-ae1f-b2706c97881f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044000 Oct 11 06:48:08.489479 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 475/904] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:08 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:09.077365 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-61b8ab63-cacf-47fe-9745-1106b8338bcd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:09.079505 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-61b8ab63-cacf-47fe-9745-1106b8338bcd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:09.085886 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-61b8ab63-cacf-47fe-9745-1106b8338bcd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:09.086365 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-61b8ab63-cacf-47fe-9745-1106b8338bcd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:09.086797 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-61b8ab63-cacf-47fe-9745-1106b8338bcd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:09.087518 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-61b8ab63-cacf-47fe-9745-1106b8338bcd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:09.087971 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-61b8ab63-cacf-47fe-9745-1106b8338bcd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:09.088387 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-61b8ab63-cacf-47fe-9745-1106b8338bcd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:09.116914 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-61b8ab63-cacf-47fe-9745-1106b8338bcd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044205 Oct 11 06:48:09.117449 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 430/905] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:09 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:09.501871 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0a7a8cf9-49b0-4d5a-be82-44dd409aa24b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:09.504022 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0a7a8cf9-49b0-4d5a-be82-44dd409aa24b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:09.510275 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0a7a8cf9-49b0-4d5a-be82-44dd409aa24b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:09.510750 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0a7a8cf9-49b0-4d5a-be82-44dd409aa24b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:09.511175 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0a7a8cf9-49b0-4d5a-be82-44dd409aa24b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:09.511888 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0a7a8cf9-49b0-4d5a-be82-44dd409aa24b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:09.512327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0a7a8cf9-49b0-4d5a-be82-44dd409aa24b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:09.512740 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0a7a8cf9-49b0-4d5a-be82-44dd409aa24b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:09.541186 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0a7a8cf9-49b0-4d5a-be82-44dd409aa24b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043284 Oct 11 06:48:09.542369 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 476/906] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:09 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:10.129548 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ac2258eb-b357-4cf0-a815-f853d8616bc6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:10.131820 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ac2258eb-b357-4cf0-a815-f853d8616bc6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:10.138578 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ac2258eb-b357-4cf0-a815-f853d8616bc6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:10.139049 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ac2258eb-b357-4cf0-a815-f853d8616bc6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:10.139502 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ac2258eb-b357-4cf0-a815-f853d8616bc6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:10.140189 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ac2258eb-b357-4cf0-a815-f853d8616bc6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:10.140636 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ac2258eb-b357-4cf0-a815-f853d8616bc6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:10.141048 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ac2258eb-b357-4cf0-a815-f853d8616bc6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:10.169943 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ac2258eb-b357-4cf0-a815-f853d8616bc6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044311 Oct 11 06:48:10.170471 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 431/907] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:10 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:10.553302 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6fe3de85-dd37-42f9-b173-56bb3e4e2871 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:10.555475 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6fe3de85-dd37-42f9-b173-56bb3e4e2871 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:10.561878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fe3de85-dd37-42f9-b173-56bb3e4e2871 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:10.562355 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fe3de85-dd37-42f9-b173-56bb3e4e2871 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:10.562796 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fe3de85-dd37-42f9-b173-56bb3e4e2871 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:10.563525 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fe3de85-dd37-42f9-b173-56bb3e4e2871 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:10.563975 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fe3de85-dd37-42f9-b173-56bb3e4e2871 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:10.564396 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fe3de85-dd37-42f9-b173-56bb3e4e2871 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:10.593278 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6fe3de85-dd37-42f9-b173-56bb3e4e2871 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043981 Oct 11 06:48:10.593824 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 477/908] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:10 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:11.182575 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-595f2b15-b72f-4d55-bb05-fba8c95321e4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:11.184725 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-595f2b15-b72f-4d55-bb05-fba8c95321e4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:11.191224 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-595f2b15-b72f-4d55-bb05-fba8c95321e4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:11.191745 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-595f2b15-b72f-4d55-bb05-fba8c95321e4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:11.192179 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-595f2b15-b72f-4d55-bb05-fba8c95321e4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:11.192869 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-595f2b15-b72f-4d55-bb05-fba8c95321e4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:11.193319 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-595f2b15-b72f-4d55-bb05-fba8c95321e4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:11.193739 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-595f2b15-b72f-4d55-bb05-fba8c95321e4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:11.222971 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-595f2b15-b72f-4d55-bb05-fba8c95321e4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044824 Oct 11 06:48:11.223535 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 432/909] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:11 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:11.606246 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-503f4690-b21c-4d4e-a3c9-e6a6c5a0919b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:11.608432 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-503f4690-b21c-4d4e-a3c9-e6a6c5a0919b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:11.614676 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-503f4690-b21c-4d4e-a3c9-e6a6c5a0919b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:11.615149 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-503f4690-b21c-4d4e-a3c9-e6a6c5a0919b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:11.615623 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-503f4690-b21c-4d4e-a3c9-e6a6c5a0919b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:11.616309 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-503f4690-b21c-4d4e-a3c9-e6a6c5a0919b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:11.616754 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-503f4690-b21c-4d4e-a3c9-e6a6c5a0919b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:11.617178 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-503f4690-b21c-4d4e-a3c9-e6a6c5a0919b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:11.645860 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-503f4690-b21c-4d4e-a3c9-e6a6c5a0919b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044118 Oct 11 06:48:11.646397 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 478/910] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:11 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:12.235470 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a6c60de1-0325-40b9-97aa-d0411723ee7b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:12.237632 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a6c60de1-0325-40b9-97aa-d0411723ee7b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:12.244106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6c60de1-0325-40b9-97aa-d0411723ee7b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:12.244609 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6c60de1-0325-40b9-97aa-d0411723ee7b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:12.245042 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6c60de1-0325-40b9-97aa-d0411723ee7b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:12.245730 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6c60de1-0325-40b9-97aa-d0411723ee7b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:12.246195 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6c60de1-0325-40b9-97aa-d0411723ee7b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:12.246620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6c60de1-0325-40b9-97aa-d0411723ee7b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:12.276355 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a6c60de1-0325-40b9-97aa-d0411723ee7b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044172 Oct 11 06:48:12.276883 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 433/911] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:12 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:12.658061 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3c2a37da-9f80-4ca9-b46e-c9176751cda2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:12.660167 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3c2a37da-9f80-4ca9-b46e-c9176751cda2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:12.666559 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3c2a37da-9f80-4ca9-b46e-c9176751cda2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:12.667039 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3c2a37da-9f80-4ca9-b46e-c9176751cda2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:12.667493 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3c2a37da-9f80-4ca9-b46e-c9176751cda2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:12.668178 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3c2a37da-9f80-4ca9-b46e-c9176751cda2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:12.668623 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3c2a37da-9f80-4ca9-b46e-c9176751cda2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:12.669039 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3c2a37da-9f80-4ca9-b46e-c9176751cda2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:12.699284 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3c2a37da-9f80-4ca9-b46e-c9176751cda2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045247 Oct 11 06:48:12.699860 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 479/912] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:12 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:13.288300 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8dc45668-a20d-4cf0-b921-7fac12087ac2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:13.290338 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8dc45668-a20d-4cf0-b921-7fac12087ac2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:13.297315 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8dc45668-a20d-4cf0-b921-7fac12087ac2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:13.297784 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8dc45668-a20d-4cf0-b921-7fac12087ac2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:13.298211 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8dc45668-a20d-4cf0-b921-7fac12087ac2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:13.298887 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8dc45668-a20d-4cf0-b921-7fac12087ac2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:13.299334 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8dc45668-a20d-4cf0-b921-7fac12087ac2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:13.299779 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8dc45668-a20d-4cf0-b921-7fac12087ac2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:13.327654 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8dc45668-a20d-4cf0-b921-7fac12087ac2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043244 Oct 11 06:48:13.328200 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 434/913] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:13 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:13.711649 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-415eda1e-f334-47cf-9c61-9cbf4dca4fdd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:13.714452 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-415eda1e-f334-47cf-9c61-9cbf4dca4fdd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:13.721808 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-415eda1e-f334-47cf-9c61-9cbf4dca4fdd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:13.722274 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-415eda1e-f334-47cf-9c61-9cbf4dca4fdd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:13.722695 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-415eda1e-f334-47cf-9c61-9cbf4dca4fdd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:13.723369 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-415eda1e-f334-47cf-9c61-9cbf4dca4fdd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:13.723833 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-415eda1e-f334-47cf-9c61-9cbf4dca4fdd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:13.724380 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-415eda1e-f334-47cf-9c61-9cbf4dca4fdd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:13.752628 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-415eda1e-f334-47cf-9c61-9cbf4dca4fdd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044987 Oct 11 06:48:13.753172 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 480/914] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:13 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:14.339899 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d81918f0-7c02-4190-8775-e00e37ddd303 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:14.341999 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d81918f0-7c02-4190-8775-e00e37ddd303 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:14.348332 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d81918f0-7c02-4190-8775-e00e37ddd303 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:14.348804 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d81918f0-7c02-4190-8775-e00e37ddd303 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:14.349258 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d81918f0-7c02-4190-8775-e00e37ddd303 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:14.349966 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d81918f0-7c02-4190-8775-e00e37ddd303 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:14.350406 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d81918f0-7c02-4190-8775-e00e37ddd303 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:14.350825 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d81918f0-7c02-4190-8775-e00e37ddd303 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:14.379287 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d81918f0-7c02-4190-8775-e00e37ddd303 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043310 Oct 11 06:48:14.379885 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 435/915] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:14 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:14.765344 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7e1f7dc3-70e4-410e-9be5-6f91eb991834 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:14.767386 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7e1f7dc3-70e4-410e-9be5-6f91eb991834 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:14.773942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e1f7dc3-70e4-410e-9be5-6f91eb991834 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:14.774409 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e1f7dc3-70e4-410e-9be5-6f91eb991834 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:14.774834 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e1f7dc3-70e4-410e-9be5-6f91eb991834 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:14.776034 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e1f7dc3-70e4-410e-9be5-6f91eb991834 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:14.776477 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e1f7dc3-70e4-410e-9be5-6f91eb991834 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:14.776892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e1f7dc3-70e4-410e-9be5-6f91eb991834 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:14.805890 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7e1f7dc3-70e4-410e-9be5-6f91eb991834 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044665 Oct 11 06:48:14.806421 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 481/916] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:14 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:15.392033 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f8c53e84-601d-4a43-9513-21c55c46a172 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:15.394146 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f8c53e84-601d-4a43-9513-21c55c46a172 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:15.401361 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f8c53e84-601d-4a43-9513-21c55c46a172 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:15.401847 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f8c53e84-601d-4a43-9513-21c55c46a172 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:15.402277 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f8c53e84-601d-4a43-9513-21c55c46a172 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:15.402968 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f8c53e84-601d-4a43-9513-21c55c46a172 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:15.403436 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f8c53e84-601d-4a43-9513-21c55c46a172 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:15.403863 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f8c53e84-601d-4a43-9513-21c55c46a172 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:15.433084 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f8c53e84-601d-4a43-9513-21c55c46a172 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045020 Oct 11 06:48:15.433634 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 436/917] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:15 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:15.818296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-016a25f4-1941-44ed-a904-44c43d5ca2f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:15.820511 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-016a25f4-1941-44ed-a904-44c43d5ca2f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:15.827289 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-016a25f4-1941-44ed-a904-44c43d5ca2f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:15.827800 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-016a25f4-1941-44ed-a904-44c43d5ca2f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:15.828229 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-016a25f4-1941-44ed-a904-44c43d5ca2f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:15.828918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-016a25f4-1941-44ed-a904-44c43d5ca2f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:15.829362 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-016a25f4-1941-44ed-a904-44c43d5ca2f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:15.829782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-016a25f4-1941-44ed-a904-44c43d5ca2f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:15.863463 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-016a25f4-1941-44ed-a904-44c43d5ca2f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049084 Oct 11 06:48:15.864008 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 482/918] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:15 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:16.445391 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5d6f6633-472b-49c2-b1c7-f35ca1e18a8c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:16.448200 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5d6f6633-472b-49c2-b1c7-f35ca1e18a8c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:16.454500 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5d6f6633-472b-49c2-b1c7-f35ca1e18a8c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:16.454970 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5d6f6633-472b-49c2-b1c7-f35ca1e18a8c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:16.455397 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5d6f6633-472b-49c2-b1c7-f35ca1e18a8c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:16.456096 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5d6f6633-472b-49c2-b1c7-f35ca1e18a8c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:16.456541 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5d6f6633-472b-49c2-b1c7-f35ca1e18a8c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:16.456954 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5d6f6633-472b-49c2-b1c7-f35ca1e18a8c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:16.485767 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5d6f6633-472b-49c2-b1c7-f35ca1e18a8c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044333 Oct 11 06:48:16.486312 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 437/919] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:16 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:16.876380 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9ab11b60-4b4a-422c-ba66-d9b971a98584 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:16.878489 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9ab11b60-4b4a-422c-ba66-d9b971a98584 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:16.884773 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9ab11b60-4b4a-422c-ba66-d9b971a98584 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:16.885242 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9ab11b60-4b4a-422c-ba66-d9b971a98584 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:16.885670 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9ab11b60-4b4a-422c-ba66-d9b971a98584 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:16.886345 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9ab11b60-4b4a-422c-ba66-d9b971a98584 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:16.886783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9ab11b60-4b4a-422c-ba66-d9b971a98584 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:16.887193 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9ab11b60-4b4a-422c-ba66-d9b971a98584 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:16.915394 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9ab11b60-4b4a-422c-ba66-d9b971a98584 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042960 Oct 11 06:48:16.916435 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 483/920] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:16 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:17.498156 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a7335a35-01d0-4922-ab4f-0e8ab38e99a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:17.500410 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a7335a35-01d0-4922-ab4f-0e8ab38e99a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:17.506277 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a7335a35-01d0-4922-ab4f-0e8ab38e99a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:17.506756 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a7335a35-01d0-4922-ab4f-0e8ab38e99a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:17.507188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a7335a35-01d0-4922-ab4f-0e8ab38e99a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:17.507909 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a7335a35-01d0-4922-ab4f-0e8ab38e99a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:17.508360 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a7335a35-01d0-4922-ab4f-0e8ab38e99a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:17.508892 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a7335a35-01d0-4922-ab4f-0e8ab38e99a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:17.538392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a7335a35-01d0-4922-ab4f-0e8ab38e99a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044225 Oct 11 06:48:17.538866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 438/921] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:17 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:17.928426 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b884c5fe-4029-4bbc-bfd1-0ff72ef09c84 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:17.930597 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b884c5fe-4029-4bbc-bfd1-0ff72ef09c84 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:17.937426 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b884c5fe-4029-4bbc-bfd1-0ff72ef09c84 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:17.937906 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b884c5fe-4029-4bbc-bfd1-0ff72ef09c84 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:17.938341 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b884c5fe-4029-4bbc-bfd1-0ff72ef09c84 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:17.939025 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b884c5fe-4029-4bbc-bfd1-0ff72ef09c84 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:17.939508 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b884c5fe-4029-4bbc-bfd1-0ff72ef09c84 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:17.939930 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b884c5fe-4029-4bbc-bfd1-0ff72ef09c84 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:17.968724 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b884c5fe-4029-4bbc-bfd1-0ff72ef09c84 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044285 Oct 11 06:48:17.969262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 484/922] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:17 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:18.550113 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-79aa4ee1-3565-40ff-93be-0ab6837687dc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:18.552430 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-79aa4ee1-3565-40ff-93be-0ab6837687dc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:18.558725 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-79aa4ee1-3565-40ff-93be-0ab6837687dc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:18.559196 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-79aa4ee1-3565-40ff-93be-0ab6837687dc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:18.559660 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-79aa4ee1-3565-40ff-93be-0ab6837687dc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:18.560343 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-79aa4ee1-3565-40ff-93be-0ab6837687dc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:18.560791 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-79aa4ee1-3565-40ff-93be-0ab6837687dc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:18.561206 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-79aa4ee1-3565-40ff-93be-0ab6837687dc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:18.590116 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-79aa4ee1-3565-40ff-93be-0ab6837687dc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043994 Oct 11 06:48:18.590649 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 439/923] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:18 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:18.980986 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3e1c35c7-8ee0-43ce-a0ac-b6fe2c8b209f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:18.983156 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3e1c35c7-8ee0-43ce-a0ac-b6fe2c8b209f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:18.989595 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e1c35c7-8ee0-43ce-a0ac-b6fe2c8b209f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:18.990057 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e1c35c7-8ee0-43ce-a0ac-b6fe2c8b209f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:18.990495 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e1c35c7-8ee0-43ce-a0ac-b6fe2c8b209f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:18.991189 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e1c35c7-8ee0-43ce-a0ac-b6fe2c8b209f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:18.991676 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e1c35c7-8ee0-43ce-a0ac-b6fe2c8b209f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:18.992098 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e1c35c7-8ee0-43ce-a0ac-b6fe2c8b209f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:19.020978 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3e1c35c7-8ee0-43ce-a0ac-b6fe2c8b209f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043949 Oct 11 06:48:19.021517 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 485/924] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:18 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:19.602154 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-eff22b01-f879-4991-b1d4-f37b1db996a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:19.604321 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-eff22b01-f879-4991-b1d4-f37b1db996a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:19.610619 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eff22b01-f879-4991-b1d4-f37b1db996a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:19.611094 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eff22b01-f879-4991-b1d4-f37b1db996a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:19.611568 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eff22b01-f879-4991-b1d4-f37b1db996a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:19.612257 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eff22b01-f879-4991-b1d4-f37b1db996a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:19.612703 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eff22b01-f879-4991-b1d4-f37b1db996a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:19.613121 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eff22b01-f879-4991-b1d4-f37b1db996a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:19.642631 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-eff22b01-f879-4991-b1d4-f37b1db996a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044464 Oct 11 06:48:19.643166 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 440/925] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:19 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:20.034144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0277a5c3-df28-416b-a761-4a28105348d6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:20.036337 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0277a5c3-df28-416b-a761-4a28105348d6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:20.043551 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0277a5c3-df28-416b-a761-4a28105348d6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:20.044025 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0277a5c3-df28-416b-a761-4a28105348d6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:20.044451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0277a5c3-df28-416b-a761-4a28105348d6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:20.045130 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0277a5c3-df28-416b-a761-4a28105348d6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:20.045571 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0277a5c3-df28-416b-a761-4a28105348d6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:20.045986 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0277a5c3-df28-416b-a761-4a28105348d6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:20.061999 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:20.075232 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0277a5c3-df28-416b-a761-4a28105348d6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044980 Oct 11 06:48:20.075804 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 486/926] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:20 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:20.656220 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c810dea3-da45-4ff1-b6fc-4fab336a4c04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:20.659313 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c810dea3-da45-4ff1-b6fc-4fab336a4c04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:20.665713 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c810dea3-da45-4ff1-b6fc-4fab336a4c04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:20.666208 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c810dea3-da45-4ff1-b6fc-4fab336a4c04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:20.666642 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c810dea3-da45-4ff1-b6fc-4fab336a4c04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:20.667340 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c810dea3-da45-4ff1-b6fc-4fab336a4c04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:20.667851 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c810dea3-da45-4ff1-b6fc-4fab336a4c04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:20.668270 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c810dea3-da45-4ff1-b6fc-4fab336a4c04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:20.698108 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c810dea3-da45-4ff1-b6fc-4fab336a4c04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046233 Oct 11 06:48:20.698650 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 441/927] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:20 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:21.088908 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-49436692-6b77-4e8d-b727-87a858589f18 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:21.089848 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-49436692-6b77-4e8d-b727-87a858589f18 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:21.096033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49436692-6b77-4e8d-b727-87a858589f18 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:21.096504 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49436692-6b77-4e8d-b727-87a858589f18 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:21.096932 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49436692-6b77-4e8d-b727-87a858589f18 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:21.097626 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49436692-6b77-4e8d-b727-87a858589f18 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:21.098067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49436692-6b77-4e8d-b727-87a858589f18 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:21.098484 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49436692-6b77-4e8d-b727-87a858589f18 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:21.127020 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-49436692-6b77-4e8d-b727-87a858589f18 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043399 Oct 11 06:48:21.127585 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 487/928] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:21 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:21.710461 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4d07c394-3ab0-4232-81b8-03932a923640 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:21.713187 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4d07c394-3ab0-4232-81b8-03932a923640 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:21.719756 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4d07c394-3ab0-4232-81b8-03932a923640 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:21.720232 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4d07c394-3ab0-4232-81b8-03932a923640 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:21.720657 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4d07c394-3ab0-4232-81b8-03932a923640 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:21.721342 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4d07c394-3ab0-4232-81b8-03932a923640 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:21.721789 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4d07c394-3ab0-4232-81b8-03932a923640 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:21.722203 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4d07c394-3ab0-4232-81b8-03932a923640 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:21.750763 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4d07c394-3ab0-4232-81b8-03932a923640 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044334 Oct 11 06:48:21.751304 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 442/929] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:21 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:22.140422 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-20efcf0f-6c40-41ec-88ae-3f54d275825f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:22.142541 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-20efcf0f-6c40-41ec-88ae-3f54d275825f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:22.149258 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20efcf0f-6c40-41ec-88ae-3f54d275825f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:22.149731 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20efcf0f-6c40-41ec-88ae-3f54d275825f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:22.150739 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20efcf0f-6c40-41ec-88ae-3f54d275825f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:22.151448 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20efcf0f-6c40-41ec-88ae-3f54d275825f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:22.151892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20efcf0f-6c40-41ec-88ae-3f54d275825f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:22.152312 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20efcf0f-6c40-41ec-88ae-3f54d275825f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:22.180459 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-20efcf0f-6c40-41ec-88ae-3f54d275825f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044031 Oct 11 06:48:22.180999 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 488/930] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:22 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:22.762534 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-95ea0df1-b1a8-444a-ac4b-21446ea710f3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:22.764928 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-95ea0df1-b1a8-444a-ac4b-21446ea710f3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:22.771568 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-95ea0df1-b1a8-444a-ac4b-21446ea710f3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:22.772091 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-95ea0df1-b1a8-444a-ac4b-21446ea710f3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:22.772790 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-95ea0df1-b1a8-444a-ac4b-21446ea710f3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:22.773491 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-95ea0df1-b1a8-444a-ac4b-21446ea710f3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:22.773942 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-95ea0df1-b1a8-444a-ac4b-21446ea710f3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:22.774360 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-95ea0df1-b1a8-444a-ac4b-21446ea710f3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:22.803603 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-95ea0df1-b1a8-444a-ac4b-21446ea710f3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045048 Oct 11 06:48:22.804144 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 443/931] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:22 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:23.192871 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-66b1acc6-b73f-4a7b-b6f6-fc81049699cc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:23.195033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-66b1acc6-b73f-4a7b-b6f6-fc81049699cc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:23.201558 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-66b1acc6-b73f-4a7b-b6f6-fc81049699cc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:23.202038 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-66b1acc6-b73f-4a7b-b6f6-fc81049699cc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:23.202467 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-66b1acc6-b73f-4a7b-b6f6-fc81049699cc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:23.203156 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-66b1acc6-b73f-4a7b-b6f6-fc81049699cc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:23.203638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-66b1acc6-b73f-4a7b-b6f6-fc81049699cc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:23.204059 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-66b1acc6-b73f-4a7b-b6f6-fc81049699cc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:23.233953 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-66b1acc6-b73f-4a7b-b6f6-fc81049699cc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044979 Oct 11 06:48:23.234423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 489/932] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:23 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:23.816487 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-06cdaa3f-5618-431f-979f-aa294e9c012b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:23.818605 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-06cdaa3f-5618-431f-979f-aa294e9c012b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:23.825706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-06cdaa3f-5618-431f-979f-aa294e9c012b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:23.826194 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-06cdaa3f-5618-431f-979f-aa294e9c012b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:23.826631 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-06cdaa3f-5618-431f-979f-aa294e9c012b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:23.827335 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-06cdaa3f-5618-431f-979f-aa294e9c012b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:23.827818 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-06cdaa3f-5618-431f-979f-aa294e9c012b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:23.828245 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-06cdaa3f-5618-431f-979f-aa294e9c012b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:23.831934 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:23.857273 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-06cdaa3f-5618-431f-979f-aa294e9c012b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044665 Oct 11 06:48:23.857813 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 444/933] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:23 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 06:48:24.246622 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9f5a8fc9-4365-465c-bfc7-b050ddc340df tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:24.248874 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9f5a8fc9-4365-465c-bfc7-b050ddc340df tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:24.255180 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9f5a8fc9-4365-465c-bfc7-b050ddc340df tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:24.255677 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9f5a8fc9-4365-465c-bfc7-b050ddc340df tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:24.256100 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9f5a8fc9-4365-465c-bfc7-b050ddc340df tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:24.256776 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9f5a8fc9-4365-465c-bfc7-b050ddc340df tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:24.257220 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9f5a8fc9-4365-465c-bfc7-b050ddc340df tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:24.257637 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9f5a8fc9-4365-465c-bfc7-b050ddc340df tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:24.285758 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9f5a8fc9-4365-465c-bfc7-b050ddc340df tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043698 Oct 11 06:48:24.286293 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 490/934] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:24 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:24.871275 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-42f36e67-b22b-410c-8bf7-8213d3b6f9ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:24.873477 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-42f36e67-b22b-410c-8bf7-8213d3b6f9ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:24.879848 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42f36e67-b22b-410c-8bf7-8213d3b6f9ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:24.880334 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42f36e67-b22b-410c-8bf7-8213d3b6f9ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:24.880767 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42f36e67-b22b-410c-8bf7-8213d3b6f9ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:24.881494 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42f36e67-b22b-410c-8bf7-8213d3b6f9ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:24.881944 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42f36e67-b22b-410c-8bf7-8213d3b6f9ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:24.882367 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42f36e67-b22b-410c-8bf7-8213d3b6f9ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:24.911752 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-42f36e67-b22b-410c-8bf7-8213d3b6f9ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044966 Oct 11 06:48:24.912294 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 445/935] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:24 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:25.298193 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b67c8cd5-a98b-41f0-9b52-84247eae7759 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:25.300286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b67c8cd5-a98b-41f0-9b52-84247eae7759 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:25.302538 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=58 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:25.307678 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b67c8cd5-a98b-41f0-9b52-84247eae7759 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:25.308160 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b67c8cd5-a98b-41f0-9b52-84247eae7759 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:25.308566 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b67c8cd5-a98b-41f0-9b52-84247eae7759 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:25.309237 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b67c8cd5-a98b-41f0-9b52-84247eae7759 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:25.309671 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b67c8cd5-a98b-41f0-9b52-84247eae7759 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:25.310079 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b67c8cd5-a98b-41f0-9b52-84247eae7759 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:25.339613 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b67c8cd5-a98b-41f0-9b52-84247eae7759 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045392 Oct 11 06:48:25.340167 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 491/936] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:25 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:25.924203 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0e861c83-1593-45cf-a17e-f4a651c908e9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:25.926551 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0e861c83-1593-45cf-a17e-f4a651c908e9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:25.933762 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0e861c83-1593-45cf-a17e-f4a651c908e9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:25.934345 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0e861c83-1593-45cf-a17e-f4a651c908e9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:25.934664 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0e861c83-1593-45cf-a17e-f4a651c908e9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:25.935371 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0e861c83-1593-45cf-a17e-f4a651c908e9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:25.935851 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0e861c83-1593-45cf-a17e-f4a651c908e9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:25.936276 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0e861c83-1593-45cf-a17e-f4a651c908e9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:25.966544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0e861c83-1593-45cf-a17e-f4a651c908e9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046225 Oct 11 06:48:25.967089 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 446/937] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:25 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:26.352097 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ddc208f1-a2bc-4051-ab12-91400510547a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:26.354239 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ddc208f1-a2bc-4051-ab12-91400510547a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:26.360584 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ddc208f1-a2bc-4051-ab12-91400510547a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:26.361058 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ddc208f1-a2bc-4051-ab12-91400510547a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:26.361490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ddc208f1-a2bc-4051-ab12-91400510547a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:26.362170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ddc208f1-a2bc-4051-ab12-91400510547a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:26.362615 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ddc208f1-a2bc-4051-ab12-91400510547a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:26.363034 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ddc208f1-a2bc-4051-ab12-91400510547a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:26.392333 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ddc208f1-a2bc-4051-ab12-91400510547a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044244 Oct 11 06:48:26.392868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 492/938] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:26 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:26.978926 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8de34873-9eda-48d2-b5c6-f0586c25e3dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:26.981066 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8de34873-9eda-48d2-b5c6-f0586c25e3dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:26.987747 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8de34873-9eda-48d2-b5c6-f0586c25e3dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:26.988538 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8de34873-9eda-48d2-b5c6-f0586c25e3dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:26.988974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8de34873-9eda-48d2-b5c6-f0586c25e3dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:26.989682 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8de34873-9eda-48d2-b5c6-f0586c25e3dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:26.990135 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8de34873-9eda-48d2-b5c6-f0586c25e3dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:26.990561 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8de34873-9eda-48d2-b5c6-f0586c25e3dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:27.019516 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8de34873-9eda-48d2-b5c6-f0586c25e3dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045074 Oct 11 06:48:27.020060 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 447/939] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:26 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:27.405488 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a822da31-f4f8-4886-be34-b9a847c923fc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:27.407857 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a822da31-f4f8-4886-be34-b9a847c923fc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:27.414136 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a822da31-f4f8-4886-be34-b9a847c923fc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:27.414646 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a822da31-f4f8-4886-be34-b9a847c923fc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:27.415074 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a822da31-f4f8-4886-be34-b9a847c923fc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:27.415789 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a822da31-f4f8-4886-be34-b9a847c923fc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:27.416236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a822da31-f4f8-4886-be34-b9a847c923fc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:27.416660 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a822da31-f4f8-4886-be34-b9a847c923fc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:27.445330 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a822da31-f4f8-4886-be34-b9a847c923fc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043881 Oct 11 06:48:27.445807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 493/940] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:27 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:28.032404 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-706a592f-b83a-488e-b6d2-41c8832d1df5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:28.034633 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-706a592f-b83a-488e-b6d2-41c8832d1df5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:28.040766 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-706a592f-b83a-488e-b6d2-41c8832d1df5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:28.041249 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-706a592f-b83a-488e-b6d2-41c8832d1df5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:28.041681 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-706a592f-b83a-488e-b6d2-41c8832d1df5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:28.042381 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-706a592f-b83a-488e-b6d2-41c8832d1df5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:28.042835 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-706a592f-b83a-488e-b6d2-41c8832d1df5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:28.043258 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-706a592f-b83a-488e-b6d2-41c8832d1df5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:28.072734 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-706a592f-b83a-488e-b6d2-41c8832d1df5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044246 Oct 11 06:48:28.073274 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 448/941] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:28 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:28.457937 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-04e23680-6121-4817-ae56-ec2a22fd6d2b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:28.460141 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-04e23680-6121-4817-ae56-ec2a22fd6d2b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:28.466976 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04e23680-6121-4817-ae56-ec2a22fd6d2b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:28.467478 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04e23680-6121-4817-ae56-ec2a22fd6d2b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:28.467912 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04e23680-6121-4817-ae56-ec2a22fd6d2b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:28.468599 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04e23680-6121-4817-ae56-ec2a22fd6d2b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:28.469046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04e23680-6121-4817-ae56-ec2a22fd6d2b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:28.469466 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04e23680-6121-4817-ae56-ec2a22fd6d2b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:28.498166 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-04e23680-6121-4817-ae56-ec2a22fd6d2b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044173 Oct 11 06:48:28.498703 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 494/942] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:28 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:29.084526 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9e6ee971-beda-4746-96da-db541d227f01 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:29.086647 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9e6ee971-beda-4746-96da-db541d227f01 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:29.092980 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9e6ee971-beda-4746-96da-db541d227f01 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:29.093455 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9e6ee971-beda-4746-96da-db541d227f01 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:29.093879 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9e6ee971-beda-4746-96da-db541d227f01 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:29.094565 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9e6ee971-beda-4746-96da-db541d227f01 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:29.095011 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9e6ee971-beda-4746-96da-db541d227f01 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:29.095441 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9e6ee971-beda-4746-96da-db541d227f01 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:29.125445 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9e6ee971-beda-4746-96da-db541d227f01 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044736 Oct 11 06:48:29.125999 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 449/943] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:29 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:29.510526 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9469d1d4-d5a3-490d-b380-76a87c08fcdc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:29.512718 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9469d1d4-d5a3-490d-b380-76a87c08fcdc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:29.518996 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9469d1d4-d5a3-490d-b380-76a87c08fcdc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:29.519496 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9469d1d4-d5a3-490d-b380-76a87c08fcdc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:29.519926 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9469d1d4-d5a3-490d-b380-76a87c08fcdc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:29.520601 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9469d1d4-d5a3-490d-b380-76a87c08fcdc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:29.521041 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9469d1d4-d5a3-490d-b380-76a87c08fcdc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:29.521457 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9469d1d4-d5a3-490d-b380-76a87c08fcdc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:29.550209 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9469d1d4-d5a3-490d-b380-76a87c08fcdc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043702 Oct 11 06:48:29.550732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 495/944] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:29 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:30.138473 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-481d58b0-912c-44a3-b10e-3dc6bbeaf185 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:30.140699 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-481d58b0-912c-44a3-b10e-3dc6bbeaf185 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:30.155999 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-481d58b0-912c-44a3-b10e-3dc6bbeaf185 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:30.155999 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-481d58b0-912c-44a3-b10e-3dc6bbeaf185 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:30.155999 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-481d58b0-912c-44a3-b10e-3dc6bbeaf185 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:30.155999 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-481d58b0-912c-44a3-b10e-3dc6bbeaf185 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:30.156351 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-481d58b0-912c-44a3-b10e-3dc6bbeaf185 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:30.156351 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-481d58b0-912c-44a3-b10e-3dc6bbeaf185 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:30.180623 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-481d58b0-912c-44a3-b10e-3dc6bbeaf185 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046520 Oct 11 06:48:30.181162 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 450/945] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:30 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:30.563049 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d3cd3d3c-aa74-4111-ab09-541213d10f38 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:30.565260 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d3cd3d3c-aa74-4111-ab09-541213d10f38 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:30.572567 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d3cd3d3c-aa74-4111-ab09-541213d10f38 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:30.573048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d3cd3d3c-aa74-4111-ab09-541213d10f38 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:30.573465 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d3cd3d3c-aa74-4111-ab09-541213d10f38 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:30.574157 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d3cd3d3c-aa74-4111-ab09-541213d10f38 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:30.574603 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d3cd3d3c-aa74-4111-ab09-541213d10f38 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:30.575022 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d3cd3d3c-aa74-4111-ab09-541213d10f38 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:30.603907 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d3cd3d3c-aa74-4111-ab09-541213d10f38 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044804 Oct 11 06:48:30.604451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 496/946] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:30 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:31.197891 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-af8400cc-f449-423e-90b5-067bbc5298be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:31.200127 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-af8400cc-f449-423e-90b5-067bbc5298be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:31.206482 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-af8400cc-f449-423e-90b5-067bbc5298be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:31.206960 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-af8400cc-f449-423e-90b5-067bbc5298be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:31.207388 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-af8400cc-f449-423e-90b5-067bbc5298be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:31.208099 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-af8400cc-f449-423e-90b5-067bbc5298be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:31.208567 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-af8400cc-f449-423e-90b5-067bbc5298be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:31.208980 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-af8400cc-f449-423e-90b5-067bbc5298be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:31.240141 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-af8400cc-f449-423e-90b5-067bbc5298be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046231 Oct 11 06:48:31.240682 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 451/947] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:31 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:31.616311 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-99de3686-2d04-417c-8b2c-131f4f99a254 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:31.618445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-99de3686-2d04-417c-8b2c-131f4f99a254 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:31.624838 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-99de3686-2d04-417c-8b2c-131f4f99a254 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:31.625316 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-99de3686-2d04-417c-8b2c-131f4f99a254 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:31.625747 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-99de3686-2d04-417c-8b2c-131f4f99a254 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:31.626435 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-99de3686-2d04-417c-8b2c-131f4f99a254 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:31.626881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-99de3686-2d04-417c-8b2c-131f4f99a254 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:31.627301 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-99de3686-2d04-417c-8b2c-131f4f99a254 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:31.657018 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-99de3686-2d04-417c-8b2c-131f4f99a254 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044702 Oct 11 06:48:31.657487 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 497/948] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:31 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:32.253142 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-26ce4f50-bb58-4537-935b-226b692bab6a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:32.255333 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-26ce4f50-bb58-4537-935b-226b692bab6a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:32.262325 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26ce4f50-bb58-4537-935b-226b692bab6a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:32.262812 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26ce4f50-bb58-4537-935b-226b692bab6a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:32.263243 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26ce4f50-bb58-4537-935b-226b692bab6a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:32.264348 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26ce4f50-bb58-4537-935b-226b692bab6a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:32.264809 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26ce4f50-bb58-4537-935b-226b692bab6a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:32.265232 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26ce4f50-bb58-4537-935b-226b692bab6a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:32.295733 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-26ce4f50-bb58-4537-935b-226b692bab6a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046580 Oct 11 06:48:32.296270 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 452/949] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:32 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:32.669769 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b5713d8f-7a89-4eed-8d6c-51fee0d291f1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:32.671933 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b5713d8f-7a89-4eed-8d6c-51fee0d291f1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:32.678257 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b5713d8f-7a89-4eed-8d6c-51fee0d291f1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:32.678727 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b5713d8f-7a89-4eed-8d6c-51fee0d291f1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:32.679156 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b5713d8f-7a89-4eed-8d6c-51fee0d291f1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:32.679865 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b5713d8f-7a89-4eed-8d6c-51fee0d291f1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:32.680311 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b5713d8f-7a89-4eed-8d6c-51fee0d291f1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:32.681360 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b5713d8f-7a89-4eed-8d6c-51fee0d291f1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:32.709456 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b5713d8f-7a89-4eed-8d6c-51fee0d291f1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044175 Oct 11 06:48:32.709996 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 498/950] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:32 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:33.308271 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a31a19dd-f051-498c-aeeb-b38a9d852379 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:33.310377 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a31a19dd-f051-498c-aeeb-b38a9d852379 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:33.316989 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a31a19dd-f051-498c-aeeb-b38a9d852379 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:33.317466 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a31a19dd-f051-498c-aeeb-b38a9d852379 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:33.317898 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a31a19dd-f051-498c-aeeb-b38a9d852379 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:33.318586 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a31a19dd-f051-498c-aeeb-b38a9d852379 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:33.319030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a31a19dd-f051-498c-aeeb-b38a9d852379 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:33.319467 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a31a19dd-f051-498c-aeeb-b38a9d852379 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:33.352378 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a31a19dd-f051-498c-aeeb-b38a9d852379 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048233 Oct 11 06:48:33.352950 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 453/951] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:33 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:33.721770 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-335f3fe5-e11a-4e60-8420-bc9a2ce2cbc6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:33.723921 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-335f3fe5-e11a-4e60-8420-bc9a2ce2cbc6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:33.730847 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-335f3fe5-e11a-4e60-8420-bc9a2ce2cbc6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:33.731321 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-335f3fe5-e11a-4e60-8420-bc9a2ce2cbc6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:33.731780 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-335f3fe5-e11a-4e60-8420-bc9a2ce2cbc6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:33.732472 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-335f3fe5-e11a-4e60-8420-bc9a2ce2cbc6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:33.732914 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-335f3fe5-e11a-4e60-8420-bc9a2ce2cbc6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:33.733331 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-335f3fe5-e11a-4e60-8420-bc9a2ce2cbc6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:33.761701 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-335f3fe5-e11a-4e60-8420-bc9a2ce2cbc6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043965 Oct 11 06:48:33.762235 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 499/952] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:33 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:34.365524 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b35a5948-a053-4eea-88ef-34b9315c7e34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:34.367715 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b35a5948-a053-4eea-88ef-34b9315c7e34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:34.370228 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 06:48:34.370371 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Tue Oct 11 06:48:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments (ip 10.222.0.39) !!! Oct 11 06:48:34.376908 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b35a5948-a053-4eea-88ef-34b9315c7e34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:34.377393 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b35a5948-a053-4eea-88ef-34b9315c7e34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:34.377830 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b35a5948-a053-4eea-88ef-34b9315c7e34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:34.378534 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b35a5948-a053-4eea-88ef-34b9315c7e34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:34.378977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b35a5948-a053-4eea-88ef-34b9315c7e34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:34.379614 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b35a5948-a053-4eea-88ef-34b9315c7e34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:34.410815 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b35a5948-a053-4eea-88ef-34b9315c7e34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049769 Oct 11 06:48:34.411369 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 454/953] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:34 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:34.774400 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-30992ca7-6540-48b7-8921-4022f7e23f8c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:34.776605 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-30992ca7-6540-48b7-8921-4022f7e23f8c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:34.782964 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-30992ca7-6540-48b7-8921-4022f7e23f8c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:34.783597 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-30992ca7-6540-48b7-8921-4022f7e23f8c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:34.784035 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-30992ca7-6540-48b7-8921-4022f7e23f8c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:34.784718 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-30992ca7-6540-48b7-8921-4022f7e23f8c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:34.785159 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-30992ca7-6540-48b7-8921-4022f7e23f8c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:34.785608 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-30992ca7-6540-48b7-8921-4022f7e23f8c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:34.814957 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-30992ca7-6540-48b7-8921-4022f7e23f8c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044851 Oct 11 06:48:34.815512 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 500/954] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:34 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:35.423324 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5749c005-2c15-43e3-aaa3-ad04f666ed2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:35.425559 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5749c005-2c15-43e3-aaa3-ad04f666ed2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:35.432369 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5749c005-2c15-43e3-aaa3-ad04f666ed2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:35.432808 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5749c005-2c15-43e3-aaa3-ad04f666ed2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:35.433158 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5749c005-2c15-43e3-aaa3-ad04f666ed2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:35.433856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5749c005-2c15-43e3-aaa3-ad04f666ed2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:35.434312 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5749c005-2c15-43e3-aaa3-ad04f666ed2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:35.434733 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5749c005-2c15-43e3-aaa3-ad04f666ed2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:35.463222 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5749c005-2c15-43e3-aaa3-ad04f666ed2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043938 Oct 11 06:48:35.463786 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 455/955] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:35 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:35.827268 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-782657cf-2d02-4566-a71b-f7305a3644ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:35.829430 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-782657cf-2d02-4566-a71b-f7305a3644ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:35.835962 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-782657cf-2d02-4566-a71b-f7305a3644ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:35.836447 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-782657cf-2d02-4566-a71b-f7305a3644ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:35.837402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-782657cf-2d02-4566-a71b-f7305a3644ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:35.838095 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-782657cf-2d02-4566-a71b-f7305a3644ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:35.838543 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-782657cf-2d02-4566-a71b-f7305a3644ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:35.838978 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-782657cf-2d02-4566-a71b-f7305a3644ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:35.868453 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-782657cf-2d02-4566-a71b-f7305a3644ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045099 Oct 11 06:48:35.868996 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 501/956] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:35 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:36.475635 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-79608461-e0c1-489f-9d37-f13442e84ac9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:36.478342 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-79608461-e0c1-489f-9d37-f13442e84ac9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:36.484909 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-79608461-e0c1-489f-9d37-f13442e84ac9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:36.485400 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-79608461-e0c1-489f-9d37-f13442e84ac9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:36.485829 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-79608461-e0c1-489f-9d37-f13442e84ac9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:36.486529 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-79608461-e0c1-489f-9d37-f13442e84ac9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:36.486981 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-79608461-e0c1-489f-9d37-f13442e84ac9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:36.487401 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-79608461-e0c1-489f-9d37-f13442e84ac9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:36.517147 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-79608461-e0c1-489f-9d37-f13442e84ac9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045523 Oct 11 06:48:36.517689 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 456/957] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:36 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:36.879833 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-400d859c-93d0-4b69-b72b-311c33f35439 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:36.881954 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-400d859c-93d0-4b69-b72b-311c33f35439 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:36.888865 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-400d859c-93d0-4b69-b72b-311c33f35439 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:36.889333 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-400d859c-93d0-4b69-b72b-311c33f35439 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:36.889759 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-400d859c-93d0-4b69-b72b-311c33f35439 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:36.890433 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-400d859c-93d0-4b69-b72b-311c33f35439 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:36.890871 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-400d859c-93d0-4b69-b72b-311c33f35439 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:36.891284 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-400d859c-93d0-4b69-b72b-311c33f35439 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:36.920009 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-400d859c-93d0-4b69-b72b-311c33f35439 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044106 Oct 11 06:48:36.920556 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 502/958] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:36 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:37.529072 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-91b21457-28db-43cc-980c-3567cdf17036 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:37.531264 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-91b21457-28db-43cc-980c-3567cdf17036 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:37.537587 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-91b21457-28db-43cc-980c-3567cdf17036 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:37.538134 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-91b21457-28db-43cc-980c-3567cdf17036 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:37.538585 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-91b21457-28db-43cc-980c-3567cdf17036 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:37.539263 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-91b21457-28db-43cc-980c-3567cdf17036 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:37.539738 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-91b21457-28db-43cc-980c-3567cdf17036 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:37.541290 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-91b21457-28db-43cc-980c-3567cdf17036 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:37.570922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-91b21457-28db-43cc-980c-3567cdf17036 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045726 Oct 11 06:48:37.571470 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 457/959] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:37 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:37.933402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4d7e589f-da04-4b11-a4bd-9b6710f856a6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:37.935870 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4d7e589f-da04-4b11-a4bd-9b6710f856a6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:37.942885 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4d7e589f-da04-4b11-a4bd-9b6710f856a6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:37.943361 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4d7e589f-da04-4b11-a4bd-9b6710f856a6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:37.943815 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4d7e589f-da04-4b11-a4bd-9b6710f856a6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:37.944504 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4d7e589f-da04-4b11-a4bd-9b6710f856a6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:37.944975 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4d7e589f-da04-4b11-a4bd-9b6710f856a6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:37.945387 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4d7e589f-da04-4b11-a4bd-9b6710f856a6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:37.949568 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:37.976457 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4d7e589f-da04-4b11-a4bd-9b6710f856a6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048053 Oct 11 06:48:37.977015 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 503/960] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:37 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:38.583217 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-808c9dbd-c458-4c60-aeae-17fc9ab22853 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:38.585407 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-808c9dbd-c458-4c60-aeae-17fc9ab22853 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:38.588411 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=58 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:38.593593 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-808c9dbd-c458-4c60-aeae-17fc9ab22853 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:38.594109 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-808c9dbd-c458-4c60-aeae-17fc9ab22853 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:38.594478 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-808c9dbd-c458-4c60-aeae-17fc9ab22853 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:38.595249 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-808c9dbd-c458-4c60-aeae-17fc9ab22853 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:38.595621 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-808c9dbd-c458-4c60-aeae-17fc9ab22853 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:38.596035 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-808c9dbd-c458-4c60-aeae-17fc9ab22853 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:38.625060 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-808c9dbd-c458-4c60-aeae-17fc9ab22853 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045778 Oct 11 06:48:38.625601 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 458/961] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:38 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:38.989215 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9cfa1e0a-57a8-45d5-b26d-8eb108f5b36c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:38.991387 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9cfa1e0a-57a8-45d5-b26d-8eb108f5b36c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:38.997705 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9cfa1e0a-57a8-45d5-b26d-8eb108f5b36c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:38.998179 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9cfa1e0a-57a8-45d5-b26d-8eb108f5b36c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:38.998607 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9cfa1e0a-57a8-45d5-b26d-8eb108f5b36c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:38.999290 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9cfa1e0a-57a8-45d5-b26d-8eb108f5b36c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:38.999762 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9cfa1e0a-57a8-45d5-b26d-8eb108f5b36c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:39.000182 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9cfa1e0a-57a8-45d5-b26d-8eb108f5b36c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:39.029159 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9cfa1e0a-57a8-45d5-b26d-8eb108f5b36c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043922 Oct 11 06:48:39.029695 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 504/962] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:38 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:39.637668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-acbfed4c-6d7c-46aa-8e6c-f1b5234ae3f6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:39.639925 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-acbfed4c-6d7c-46aa-8e6c-f1b5234ae3f6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:39.646019 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-acbfed4c-6d7c-46aa-8e6c-f1b5234ae3f6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:39.646915 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-acbfed4c-6d7c-46aa-8e6c-f1b5234ae3f6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:39.647489 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-acbfed4c-6d7c-46aa-8e6c-f1b5234ae3f6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:39.648196 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-acbfed4c-6d7c-46aa-8e6c-f1b5234ae3f6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:39.648785 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-acbfed4c-6d7c-46aa-8e6c-f1b5234ae3f6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:39.649245 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-acbfed4c-6d7c-46aa-8e6c-f1b5234ae3f6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:39.678330 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-acbfed4c-6d7c-46aa-8e6c-f1b5234ae3f6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045002 Oct 11 06:48:39.678870 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 459/963] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:39 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:40.041618 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2c719919-1310-43bd-97b4-c55f3a375778 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:40.043698 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2c719919-1310-43bd-97b4-c55f3a375778 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:40.050087 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c719919-1310-43bd-97b4-c55f3a375778 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:40.050569 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c719919-1310-43bd-97b4-c55f3a375778 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:40.051004 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c719919-1310-43bd-97b4-c55f3a375778 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:40.051725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c719919-1310-43bd-97b4-c55f3a375778 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:40.052176 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c719919-1310-43bd-97b4-c55f3a375778 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:40.052598 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c719919-1310-43bd-97b4-c55f3a375778 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:40.081755 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2c719919-1310-43bd-97b4-c55f3a375778 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044116 Oct 11 06:48:40.082307 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 505/964] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:40 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:40.690128 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3a2636af-2b1a-47e9-8fe6-6972693ec879 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:40.692381 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3a2636af-2b1a-47e9-8fe6-6972693ec879 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:40.699168 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a2636af-2b1a-47e9-8fe6-6972693ec879 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:40.699873 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a2636af-2b1a-47e9-8fe6-6972693ec879 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:40.700316 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a2636af-2b1a-47e9-8fe6-6972693ec879 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:40.701093 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a2636af-2b1a-47e9-8fe6-6972693ec879 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:40.701761 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a2636af-2b1a-47e9-8fe6-6972693ec879 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:40.702188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a2636af-2b1a-47e9-8fe6-6972693ec879 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:40.737023 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:40.743029 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3a2636af-2b1a-47e9-8fe6-6972693ec879 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056956 Oct 11 06:48:40.743736 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 460/965] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:40 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:41.094224 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b9aefc5b-dbce-4063-a81e-420250128efa tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:41.096440 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b9aefc5b-dbce-4063-a81e-420250128efa tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:41.103127 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b9aefc5b-dbce-4063-a81e-420250128efa tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:41.103654 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b9aefc5b-dbce-4063-a81e-420250128efa tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:41.104086 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b9aefc5b-dbce-4063-a81e-420250128efa tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:41.104777 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b9aefc5b-dbce-4063-a81e-420250128efa tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:41.105223 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b9aefc5b-dbce-4063-a81e-420250128efa tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:41.105644 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b9aefc5b-dbce-4063-a81e-420250128efa tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:41.135113 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b9aefc5b-dbce-4063-a81e-420250128efa tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044875 Oct 11 06:48:41.135681 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 506/966] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:41 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:41.755102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-faea41c2-c80e-4bd3-81d9-ccbd91cbbe8f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:41.757236 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-faea41c2-c80e-4bd3-81d9-ccbd91cbbe8f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:41.763802 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-faea41c2-c80e-4bd3-81d9-ccbd91cbbe8f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:41.764359 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-faea41c2-c80e-4bd3-81d9-ccbd91cbbe8f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:41.764784 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-faea41c2-c80e-4bd3-81d9-ccbd91cbbe8f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:41.765368 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-faea41c2-c80e-4bd3-81d9-ccbd91cbbe8f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:41.765812 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-faea41c2-c80e-4bd3-81d9-ccbd91cbbe8f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:41.766231 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-faea41c2-c80e-4bd3-81d9-ccbd91cbbe8f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:41.797962 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-faea41c2-c80e-4bd3-81d9-ccbd91cbbe8f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046707 Oct 11 06:48:41.798508 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 461/967] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:41 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:42.147776 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5cf17b2b-6ef9-47fa-ad6d-296da33ea46e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:42.149908 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5cf17b2b-6ef9-47fa-ad6d-296da33ea46e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:42.156183 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5cf17b2b-6ef9-47fa-ad6d-296da33ea46e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:42.156659 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5cf17b2b-6ef9-47fa-ad6d-296da33ea46e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:42.157090 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5cf17b2b-6ef9-47fa-ad6d-296da33ea46e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:42.157770 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5cf17b2b-6ef9-47fa-ad6d-296da33ea46e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:42.158209 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5cf17b2b-6ef9-47fa-ad6d-296da33ea46e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:42.158625 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5cf17b2b-6ef9-47fa-ad6d-296da33ea46e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:42.187950 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5cf17b2b-6ef9-47fa-ad6d-296da33ea46e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044491 Oct 11 06:48:42.188490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 507/968] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:42 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:42.809965 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6b8978d9-9da0-446a-9501-8d2fe54465f7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:42.812204 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6b8978d9-9da0-446a-9501-8d2fe54465f7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:42.818667 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6b8978d9-9da0-446a-9501-8d2fe54465f7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:42.819145 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6b8978d9-9da0-446a-9501-8d2fe54465f7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:42.819599 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6b8978d9-9da0-446a-9501-8d2fe54465f7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:42.820285 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6b8978d9-9da0-446a-9501-8d2fe54465f7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:42.820731 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6b8978d9-9da0-446a-9501-8d2fe54465f7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:42.821145 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6b8978d9-9da0-446a-9501-8d2fe54465f7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:42.851079 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6b8978d9-9da0-446a-9501-8d2fe54465f7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044948 Oct 11 06:48:42.851655 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 462/969] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:42 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:43.200782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7398b01c-e4d8-4e0b-8058-883a30f007f9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:43.202971 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7398b01c-e4d8-4e0b-8058-883a30f007f9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:43.209393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7398b01c-e4d8-4e0b-8058-883a30f007f9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:43.209869 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7398b01c-e4d8-4e0b-8058-883a30f007f9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:43.210305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7398b01c-e4d8-4e0b-8058-883a30f007f9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:43.210993 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7398b01c-e4d8-4e0b-8058-883a30f007f9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:43.212081 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7398b01c-e4d8-4e0b-8058-883a30f007f9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:43.212601 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7398b01c-e4d8-4e0b-8058-883a30f007f9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:43.242935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7398b01c-e4d8-4e0b-8058-883a30f007f9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045691 Oct 11 06:48:43.243503 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 508/970] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:43 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:43.864150 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-34b0ffc1-b7c9-4d98-b37d-30c1f15dec86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:43.866343 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-34b0ffc1-b7c9-4d98-b37d-30c1f15dec86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:43.873675 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-34b0ffc1-b7c9-4d98-b37d-30c1f15dec86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:43.874107 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-34b0ffc1-b7c9-4d98-b37d-30c1f15dec86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:43.874543 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-34b0ffc1-b7c9-4d98-b37d-30c1f15dec86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:43.875241 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-34b0ffc1-b7c9-4d98-b37d-30c1f15dec86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:43.875724 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-34b0ffc1-b7c9-4d98-b37d-30c1f15dec86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:43.876145 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-34b0ffc1-b7c9-4d98-b37d-30c1f15dec86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:43.905323 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-34b0ffc1-b7c9-4d98-b37d-30c1f15dec86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045234 Oct 11 06:48:43.905869 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 463/971] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:43 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:44.255227 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-268f7c43-f14e-4da9-b7e2-b5dce0f0782c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:44.257474 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-268f7c43-f14e-4da9-b7e2-b5dce0f0782c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:44.263895 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-268f7c43-f14e-4da9-b7e2-b5dce0f0782c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:44.264373 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-268f7c43-f14e-4da9-b7e2-b5dce0f0782c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:44.264807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-268f7c43-f14e-4da9-b7e2-b5dce0f0782c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:44.265495 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-268f7c43-f14e-4da9-b7e2-b5dce0f0782c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:44.265946 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-268f7c43-f14e-4da9-b7e2-b5dce0f0782c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:44.266365 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-268f7c43-f14e-4da9-b7e2-b5dce0f0782c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:44.296015 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-268f7c43-f14e-4da9-b7e2-b5dce0f0782c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044688 Oct 11 06:48:44.296561 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 509/972] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:44 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:44.917906 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ec5e52fc-55fd-4f8e-a990-241fb05767bc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:44.920115 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ec5e52fc-55fd-4f8e-a990-241fb05767bc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:44.926529 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ec5e52fc-55fd-4f8e-a990-241fb05767bc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:44.927018 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ec5e52fc-55fd-4f8e-a990-241fb05767bc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:44.927611 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ec5e52fc-55fd-4f8e-a990-241fb05767bc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:44.928163 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ec5e52fc-55fd-4f8e-a990-241fb05767bc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:44.928616 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ec5e52fc-55fd-4f8e-a990-241fb05767bc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:44.929036 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ec5e52fc-55fd-4f8e-a990-241fb05767bc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:44.959052 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ec5e52fc-55fd-4f8e-a990-241fb05767bc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045530 Oct 11 06:48:44.959614 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 464/973] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:44 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:45.310855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6e5b715e-2bf4-408b-872b-82ff78e0d610 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:45.312992 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6e5b715e-2bf4-408b-872b-82ff78e0d610 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:45.319464 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6e5b715e-2bf4-408b-872b-82ff78e0d610 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:45.319942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6e5b715e-2bf4-408b-872b-82ff78e0d610 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:45.320371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6e5b715e-2bf4-408b-872b-82ff78e0d610 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:45.321076 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6e5b715e-2bf4-408b-872b-82ff78e0d610 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:45.321516 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6e5b715e-2bf4-408b-872b-82ff78e0d610 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:45.321930 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6e5b715e-2bf4-408b-872b-82ff78e0d610 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:45.350505 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6e5b715e-2bf4-408b-872b-82ff78e0d610 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045346 Oct 11 06:48:45.351046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 510/974] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:45 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:45.971601 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-723fa398-2dd1-4ec2-8eb2-abd33b8eb793 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:45.973728 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-723fa398-2dd1-4ec2-8eb2-abd33b8eb793 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:45.980253 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-723fa398-2dd1-4ec2-8eb2-abd33b8eb793 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:45.980737 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-723fa398-2dd1-4ec2-8eb2-abd33b8eb793 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:45.981172 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-723fa398-2dd1-4ec2-8eb2-abd33b8eb793 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:45.981876 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-723fa398-2dd1-4ec2-8eb2-abd33b8eb793 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:45.982331 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-723fa398-2dd1-4ec2-8eb2-abd33b8eb793 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:45.982772 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-723fa398-2dd1-4ec2-8eb2-abd33b8eb793 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:46.012670 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-723fa398-2dd1-4ec2-8eb2-abd33b8eb793 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045015 Oct 11 06:48:46.013219 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 465/975] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:45 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:46.363394 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-aba09a2b-3e6d-4f96-99d1-83cf96f8bb39 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:46.365527 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-aba09a2b-3e6d-4f96-99d1-83cf96f8bb39 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:46.372466 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aba09a2b-3e6d-4f96-99d1-83cf96f8bb39 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:46.372931 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aba09a2b-3e6d-4f96-99d1-83cf96f8bb39 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:46.373355 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aba09a2b-3e6d-4f96-99d1-83cf96f8bb39 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:46.374029 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aba09a2b-3e6d-4f96-99d1-83cf96f8bb39 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:46.374467 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aba09a2b-3e6d-4f96-99d1-83cf96f8bb39 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:46.374879 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aba09a2b-3e6d-4f96-99d1-83cf96f8bb39 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:46.403972 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-aba09a2b-3e6d-4f96-99d1-83cf96f8bb39 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044494 Oct 11 06:48:46.404521 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 511/976] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:46 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:47.026060 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5573e87a-9476-48b1-b941-7ba43f652175 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:47.028212 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5573e87a-9476-48b1-b941-7ba43f652175 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:47.034498 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5573e87a-9476-48b1-b941-7ba43f652175 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:47.034983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5573e87a-9476-48b1-b941-7ba43f652175 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:47.035436 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5573e87a-9476-48b1-b941-7ba43f652175 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:47.036132 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5573e87a-9476-48b1-b941-7ba43f652175 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:47.036583 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5573e87a-9476-48b1-b941-7ba43f652175 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:47.036998 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5573e87a-9476-48b1-b941-7ba43f652175 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:47.068298 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5573e87a-9476-48b1-b941-7ba43f652175 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046945 Oct 11 06:48:47.068847 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 466/977] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:47 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:47.417111 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-21498066-39b5-48fd-a5d8-f4098413a9a3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:47.419258 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-21498066-39b5-48fd-a5d8-f4098413a9a3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:47.425636 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21498066-39b5-48fd-a5d8-f4098413a9a3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:47.426137 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21498066-39b5-48fd-a5d8-f4098413a9a3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:47.426561 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21498066-39b5-48fd-a5d8-f4098413a9a3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:47.427237 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21498066-39b5-48fd-a5d8-f4098413a9a3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:47.427714 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21498066-39b5-48fd-a5d8-f4098413a9a3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:47.428126 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21498066-39b5-48fd-a5d8-f4098413a9a3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:47.461327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-21498066-39b5-48fd-a5d8-f4098413a9a3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048690 Oct 11 06:48:47.461857 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 512/978] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:47 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:48.081338 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b348300c-7ae7-4052-86bb-a87baba5ffed tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:48.083500 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b348300c-7ae7-4052-86bb-a87baba5ffed tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:48.090851 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b348300c-7ae7-4052-86bb-a87baba5ffed tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:48.103988 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b348300c-7ae7-4052-86bb-a87baba5ffed tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:48.103988 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b348300c-7ae7-4052-86bb-a87baba5ffed tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:48.103988 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b348300c-7ae7-4052-86bb-a87baba5ffed tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:48.103988 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b348300c-7ae7-4052-86bb-a87baba5ffed tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:48.104340 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b348300c-7ae7-4052-86bb-a87baba5ffed tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:48.125113 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b348300c-7ae7-4052-86bb-a87baba5ffed tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048009 Oct 11 06:48:48.125651 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 467/979] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:48 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:48.473152 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6f61ef7c-778d-41de-975b-2debf7a8c031 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:48.475290 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6f61ef7c-778d-41de-975b-2debf7a8c031 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:48.481688 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f61ef7c-778d-41de-975b-2debf7a8c031 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:48.482160 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f61ef7c-778d-41de-975b-2debf7a8c031 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:48.482589 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f61ef7c-778d-41de-975b-2debf7a8c031 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:48.483274 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f61ef7c-778d-41de-975b-2debf7a8c031 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:48.483754 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f61ef7c-778d-41de-975b-2debf7a8c031 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:48.484174 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f61ef7c-778d-41de-975b-2debf7a8c031 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:48.513666 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6f61ef7c-778d-41de-975b-2debf7a8c031 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044453 Oct 11 06:48:48.514206 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 513/980] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:48 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:49.137974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-baa424fd-3a31-4454-8d33-9c1060237288 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:49.140185 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-baa424fd-3a31-4454-8d33-9c1060237288 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:49.146727 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-baa424fd-3a31-4454-8d33-9c1060237288 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:49.147205 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-baa424fd-3a31-4454-8d33-9c1060237288 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:49.147660 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-baa424fd-3a31-4454-8d33-9c1060237288 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:49.148347 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-baa424fd-3a31-4454-8d33-9c1060237288 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:49.149990 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-baa424fd-3a31-4454-8d33-9c1060237288 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:49.150422 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-baa424fd-3a31-4454-8d33-9c1060237288 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:49.179743 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-baa424fd-3a31-4454-8d33-9c1060237288 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045717 Oct 11 06:48:49.180283 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 468/981] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:49 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:49.526416 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-de37a272-89be-4e1a-bbe5-116e89214cea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:49.528668 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-de37a272-89be-4e1a-bbe5-116e89214cea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:49.535279 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-de37a272-89be-4e1a-bbe5-116e89214cea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:49.535797 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-de37a272-89be-4e1a-bbe5-116e89214cea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:49.536226 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-de37a272-89be-4e1a-bbe5-116e89214cea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:49.536913 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-de37a272-89be-4e1a-bbe5-116e89214cea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:49.537357 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-de37a272-89be-4e1a-bbe5-116e89214cea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:49.537774 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-de37a272-89be-4e1a-bbe5-116e89214cea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:49.566388 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-de37a272-89be-4e1a-bbe5-116e89214cea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043986 Oct 11 06:48:49.566927 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 514/982] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:49 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:50.192234 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2f5e3eb0-ea11-4b5a-b8d7-1aed2d303fba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:50.194424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2f5e3eb0-ea11-4b5a-b8d7-1aed2d303fba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:50.201500 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2f5e3eb0-ea11-4b5a-b8d7-1aed2d303fba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:50.202055 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2f5e3eb0-ea11-4b5a-b8d7-1aed2d303fba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:50.202490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2f5e3eb0-ea11-4b5a-b8d7-1aed2d303fba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:50.203188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2f5e3eb0-ea11-4b5a-b8d7-1aed2d303fba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:50.203671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2f5e3eb0-ea11-4b5a-b8d7-1aed2d303fba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:50.204093 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2f5e3eb0-ea11-4b5a-b8d7-1aed2d303fba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:50.235133 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2f5e3eb0-ea11-4b5a-b8d7-1aed2d303fba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047046 Oct 11 06:48:50.235707 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 469/983] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:50 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:50.579516 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-38c17904-de15-49d1-86b0-bde106290205 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:50.581652 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-38c17904-de15-49d1-86b0-bde106290205 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:50.588737 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-38c17904-de15-49d1-86b0-bde106290205 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:50.589213 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-38c17904-de15-49d1-86b0-bde106290205 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:50.589638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-38c17904-de15-49d1-86b0-bde106290205 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:50.590318 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-38c17904-de15-49d1-86b0-bde106290205 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:50.590760 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-38c17904-de15-49d1-86b0-bde106290205 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:50.591176 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-38c17904-de15-49d1-86b0-bde106290205 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:50.620245 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-38c17904-de15-49d1-86b0-bde106290205 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044697 Oct 11 06:48:50.620798 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 515/984] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:50 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:51.248133 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-04dbaf0c-bd78-47a9-86b0-0a83c459804b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:51.250241 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-04dbaf0c-bd78-47a9-86b0-0a83c459804b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:51.256821 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-04dbaf0c-bd78-47a9-86b0-0a83c459804b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:51.257296 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-04dbaf0c-bd78-47a9-86b0-0a83c459804b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:51.257723 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-04dbaf0c-bd78-47a9-86b0-0a83c459804b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:51.258412 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-04dbaf0c-bd78-47a9-86b0-0a83c459804b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:51.258855 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-04dbaf0c-bd78-47a9-86b0-0a83c459804b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:51.259265 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-04dbaf0c-bd78-47a9-86b0-0a83c459804b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:51.291451 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-04dbaf0c-bd78-47a9-86b0-0a83c459804b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047208 Oct 11 06:48:51.292025 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 470/985] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:51 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:51.633190 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cc1d454d-8a5d-460d-932c-45206dee7c90 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:51.635323 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cc1d454d-8a5d-460d-932c-45206dee7c90 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:51.641360 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc1d454d-8a5d-460d-932c-45206dee7c90 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:51.641833 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc1d454d-8a5d-460d-932c-45206dee7c90 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:51.642255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc1d454d-8a5d-460d-932c-45206dee7c90 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:51.642927 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc1d454d-8a5d-460d-932c-45206dee7c90 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:51.643366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc1d454d-8a5d-460d-932c-45206dee7c90 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:51.643801 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc1d454d-8a5d-460d-932c-45206dee7c90 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:51.672151 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cc1d454d-8a5d-460d-932c-45206dee7c90 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043465 Oct 11 06:48:51.672607 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 516/986] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:51 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:52.303875 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-965faa31-677b-4bd1-9f54-2af8b4110739 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:52.306017 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-965faa31-677b-4bd1-9f54-2af8b4110739 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:52.312303 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-965faa31-677b-4bd1-9f54-2af8b4110739 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:52.312780 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-965faa31-677b-4bd1-9f54-2af8b4110739 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:52.313209 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-965faa31-677b-4bd1-9f54-2af8b4110739 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:52.313904 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-965faa31-677b-4bd1-9f54-2af8b4110739 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:52.314980 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-965faa31-677b-4bd1-9f54-2af8b4110739 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:52.315407 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-965faa31-677b-4bd1-9f54-2af8b4110739 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:52.347031 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-965faa31-677b-4bd1-9f54-2af8b4110739 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047029 Oct 11 06:48:52.347619 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 471/987] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:52 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:52.684517 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6f5cae7b-71fa-445d-a1f9-d774ef3a7d0e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:52.686661 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6f5cae7b-71fa-445d-a1f9-d774ef3a7d0e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:52.693008 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f5cae7b-71fa-445d-a1f9-d774ef3a7d0e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:52.693489 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f5cae7b-71fa-445d-a1f9-d774ef3a7d0e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:52.693923 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f5cae7b-71fa-445d-a1f9-d774ef3a7d0e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:52.694612 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f5cae7b-71fa-445d-a1f9-d774ef3a7d0e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:52.695628 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f5cae7b-71fa-445d-a1f9-d774ef3a7d0e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:52.696054 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f5cae7b-71fa-445d-a1f9-d774ef3a7d0e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:52.725364 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6f5cae7b-71fa-445d-a1f9-d774ef3a7d0e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044826 Oct 11 06:48:52.725913 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 517/988] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:52 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:53.360187 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e1d2123e-5ba6-4060-ab93-221dcc49a9c7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:53.362306 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e1d2123e-5ba6-4060-ab93-221dcc49a9c7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:53.369391 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e1d2123e-5ba6-4060-ab93-221dcc49a9c7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:53.369871 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e1d2123e-5ba6-4060-ab93-221dcc49a9c7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:53.370305 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e1d2123e-5ba6-4060-ab93-221dcc49a9c7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:53.370992 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e1d2123e-5ba6-4060-ab93-221dcc49a9c7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:53.371458 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e1d2123e-5ba6-4060-ab93-221dcc49a9c7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:53.371880 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e1d2123e-5ba6-4060-ab93-221dcc49a9c7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:53.403677 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e1d2123e-5ba6-4060-ab93-221dcc49a9c7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047395 Oct 11 06:48:53.408333 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 472/989] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:53 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:53.737750 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ddf38060-1988-4504-8a76-009196b3f11e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:53.739983 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ddf38060-1988-4504-8a76-009196b3f11e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:53.746957 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ddf38060-1988-4504-8a76-009196b3f11e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:53.747466 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ddf38060-1988-4504-8a76-009196b3f11e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:53.747903 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ddf38060-1988-4504-8a76-009196b3f11e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:53.748596 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ddf38060-1988-4504-8a76-009196b3f11e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:53.749045 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ddf38060-1988-4504-8a76-009196b3f11e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:53.749469 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ddf38060-1988-4504-8a76-009196b3f11e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:53.778814 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ddf38060-1988-4504-8a76-009196b3f11e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045079 Oct 11 06:48:53.779353 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 518/990] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:53 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:54.416222 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-db809ed6-9216-4cbf-bc9a-300920c699ce tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:54.418428 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-db809ed6-9216-4cbf-bc9a-300920c699ce tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:54.424899 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db809ed6-9216-4cbf-bc9a-300920c699ce tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:54.425374 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db809ed6-9216-4cbf-bc9a-300920c699ce tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:54.425801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db809ed6-9216-4cbf-bc9a-300920c699ce tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:54.426485 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db809ed6-9216-4cbf-bc9a-300920c699ce tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:54.426927 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db809ed6-9216-4cbf-bc9a-300920c699ce tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:54.427343 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db809ed6-9216-4cbf-bc9a-300920c699ce tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:54.455963 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-db809ed6-9216-4cbf-bc9a-300920c699ce tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043731 Oct 11 06:48:54.456493 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 473/991] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:54 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:54.790121 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-44ab6d77-8a0a-4e22-b7ed-712e9d15e60a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:54.792278 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-44ab6d77-8a0a-4e22-b7ed-712e9d15e60a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:54.798593 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-44ab6d77-8a0a-4e22-b7ed-712e9d15e60a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:54.799072 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-44ab6d77-8a0a-4e22-b7ed-712e9d15e60a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:54.799527 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-44ab6d77-8a0a-4e22-b7ed-712e9d15e60a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:54.800206 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-44ab6d77-8a0a-4e22-b7ed-712e9d15e60a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:54.800649 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-44ab6d77-8a0a-4e22-b7ed-712e9d15e60a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:54.801062 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-44ab6d77-8a0a-4e22-b7ed-712e9d15e60a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:54.825947 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:54.830960 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-44ab6d77-8a0a-4e22-b7ed-712e9d15e60a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044790 Oct 11 06:48:54.831522 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 519/992] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:54 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:55.469229 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-62bedd47-eccf-40c2-a528-4256216c4556 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:55.471477 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-62bedd47-eccf-40c2-a528-4256216c4556 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:55.477736 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62bedd47-eccf-40c2-a528-4256216c4556 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:55.478788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62bedd47-eccf-40c2-a528-4256216c4556 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:55.479218 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62bedd47-eccf-40c2-a528-4256216c4556 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:55.480039 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62bedd47-eccf-40c2-a528-4256216c4556 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:55.480487 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62bedd47-eccf-40c2-a528-4256216c4556 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:55.480900 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62bedd47-eccf-40c2-a528-4256216c4556 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:55.509290 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-62bedd47-eccf-40c2-a528-4256216c4556 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043995 Oct 11 06:48:55.509820 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 474/993] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:55 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:55.843581 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7b62b4c2-bf2d-48c0-a14d-ae42c7dd71f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:55.845713 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7b62b4c2-bf2d-48c0-a14d-ae42c7dd71f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:55.848237 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=58 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:55.854183 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7b62b4c2-bf2d-48c0-a14d-ae42c7dd71f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:55.854664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7b62b4c2-bf2d-48c0-a14d-ae42c7dd71f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:55.855096 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7b62b4c2-bf2d-48c0-a14d-ae42c7dd71f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:55.855812 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7b62b4c2-bf2d-48c0-a14d-ae42c7dd71f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:55.856258 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7b62b4c2-bf2d-48c0-a14d-ae42c7dd71f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:55.856677 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7b62b4c2-bf2d-48c0-a14d-ae42c7dd71f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:55.886134 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7b62b4c2-bf2d-48c0-a14d-ae42c7dd71f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046508 Oct 11 06:48:55.886679 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 520/994] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:55 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:56.521938 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-541e1193-8e09-41ed-8ed0-5282d283e6dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:56.524085 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-541e1193-8e09-41ed-8ed0-5282d283e6dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:56.530917 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-541e1193-8e09-41ed-8ed0-5282d283e6dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:56.531399 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-541e1193-8e09-41ed-8ed0-5282d283e6dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:56.531852 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-541e1193-8e09-41ed-8ed0-5282d283e6dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:56.532547 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-541e1193-8e09-41ed-8ed0-5282d283e6dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:56.533000 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-541e1193-8e09-41ed-8ed0-5282d283e6dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:56.533420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-541e1193-8e09-41ed-8ed0-5282d283e6dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:56.562359 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-541e1193-8e09-41ed-8ed0-5282d283e6dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044730 Oct 11 06:48:56.562924 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 475/995] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:56 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:56.898897 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9d4a13d9-3548-4ab1-b88d-df2fb5f6a565 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:56.901052 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9d4a13d9-3548-4ab1-b88d-df2fb5f6a565 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:56.907318 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9d4a13d9-3548-4ab1-b88d-df2fb5f6a565 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:56.907824 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9d4a13d9-3548-4ab1-b88d-df2fb5f6a565 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:56.908248 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9d4a13d9-3548-4ab1-b88d-df2fb5f6a565 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:56.908928 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9d4a13d9-3548-4ab1-b88d-df2fb5f6a565 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:56.909368 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9d4a13d9-3548-4ab1-b88d-df2fb5f6a565 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:56.909781 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9d4a13d9-3548-4ab1-b88d-df2fb5f6a565 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:56.938328 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9d4a13d9-3548-4ab1-b88d-df2fb5f6a565 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043653 Oct 11 06:48:56.938861 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 521/996] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:56 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:57.574003 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c2bf6298-e0a2-44de-a46e-fd54128afad1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:57.576150 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c2bf6298-e0a2-44de-a46e-fd54128afad1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:57.582813 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c2bf6298-e0a2-44de-a46e-fd54128afad1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:57.583300 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c2bf6298-e0a2-44de-a46e-fd54128afad1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:57.583817 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c2bf6298-e0a2-44de-a46e-fd54128afad1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:57.584573 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c2bf6298-e0a2-44de-a46e-fd54128afad1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:57.585086 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c2bf6298-e0a2-44de-a46e-fd54128afad1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:57.585582 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c2bf6298-e0a2-44de-a46e-fd54128afad1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:57.616591 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c2bf6298-e0a2-44de-a46e-fd54128afad1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046497 Oct 11 06:48:57.617155 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 476/997] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:57 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:57.951229 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-79b52c5a-603b-4f41-b2ea-751d9032d071 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:57.953436 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-79b52c5a-603b-4f41-b2ea-751d9032d071 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:57.959723 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-79b52c5a-603b-4f41-b2ea-751d9032d071 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:57.960200 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-79b52c5a-603b-4f41-b2ea-751d9032d071 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:57.960631 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-79b52c5a-603b-4f41-b2ea-751d9032d071 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:57.961314 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-79b52c5a-603b-4f41-b2ea-751d9032d071 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:57.961759 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-79b52c5a-603b-4f41-b2ea-751d9032d071 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:57.962175 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-79b52c5a-603b-4f41-b2ea-751d9032d071 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:57.990792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-79b52c5a-603b-4f41-b2ea-751d9032d071 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044068 Oct 11 06:48:57.991322 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 522/998] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:57 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:58.629700 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b1c5f762-e391-4499-928d-5e8a18693080 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:58.631858 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b1c5f762-e391-4499-928d-5e8a18693080 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:58.638136 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b1c5f762-e391-4499-928d-5e8a18693080 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:58.638614 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b1c5f762-e391-4499-928d-5e8a18693080 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:58.639045 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b1c5f762-e391-4499-928d-5e8a18693080 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:58.639754 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b1c5f762-e391-4499-928d-5e8a18693080 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:58.640203 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b1c5f762-e391-4499-928d-5e8a18693080 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:58.640640 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b1c5f762-e391-4499-928d-5e8a18693080 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:58.658769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:58.674242 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b1c5f762-e391-4499-928d-5e8a18693080 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048403 Oct 11 06:48:58.674783 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 477/999] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:58 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:48:59.002164 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5599e192-f112-4bb3-b2d8-3ee018d20be5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:59.004223 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5599e192-f112-4bb3-b2d8-3ee018d20be5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:59.010605 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5599e192-f112-4bb3-b2d8-3ee018d20be5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:59.011073 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5599e192-f112-4bb3-b2d8-3ee018d20be5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:59.011539 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5599e192-f112-4bb3-b2d8-3ee018d20be5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:59.012219 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5599e192-f112-4bb3-b2d8-3ee018d20be5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:59.012656 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5599e192-f112-4bb3-b2d8-3ee018d20be5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:59.013068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5599e192-f112-4bb3-b2d8-3ee018d20be5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:59.042456 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5599e192-f112-4bb3-b2d8-3ee018d20be5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044282 Oct 11 06:48:59.042982 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 523/1000] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:48:58 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:48:59.689227 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-08fe2789-4c0f-4737-a89c-a14a8e499bb9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:48:59.691400 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-08fe2789-4c0f-4737-a89c-a14a8e499bb9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:48:59.698527 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-08fe2789-4c0f-4737-a89c-a14a8e499bb9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:59.699014 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-08fe2789-4c0f-4737-a89c-a14a8e499bb9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:59.699467 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-08fe2789-4c0f-4737-a89c-a14a8e499bb9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:59.700163 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-08fe2789-4c0f-4737-a89c-a14a8e499bb9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:48:59.700615 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-08fe2789-4c0f-4737-a89c-a14a8e499bb9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:48:59.701036 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-08fe2789-4c0f-4737-a89c-a14a8e499bb9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:48:59.730739 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-08fe2789-4c0f-4737-a89c-a14a8e499bb9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046897 Oct 11 06:48:59.731293 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 478/1001] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:48:59 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:00.054252 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8187a122-6d48-48d8-842e-88b35bda17c0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:00.056831 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8187a122-6d48-48d8-842e-88b35bda17c0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:00.063186 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8187a122-6d48-48d8-842e-88b35bda17c0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:00.063694 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8187a122-6d48-48d8-842e-88b35bda17c0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:00.064122 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8187a122-6d48-48d8-842e-88b35bda17c0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:00.064799 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8187a122-6d48-48d8-842e-88b35bda17c0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:00.065237 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8187a122-6d48-48d8-842e-88b35bda17c0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:00.065649 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8187a122-6d48-48d8-842e-88b35bda17c0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:00.094116 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8187a122-6d48-48d8-842e-88b35bda17c0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043882 Oct 11 06:49:00.094653 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 524/1002] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:00 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:00.743182 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-14218f7d-37ba-4053-9e7f-18588d390c4d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:00.745449 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-14218f7d-37ba-4053-9e7f-18588d390c4d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:00.752129 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14218f7d-37ba-4053-9e7f-18588d390c4d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:00.752615 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14218f7d-37ba-4053-9e7f-18588d390c4d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:00.753047 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14218f7d-37ba-4053-9e7f-18588d390c4d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:00.753804 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14218f7d-37ba-4053-9e7f-18588d390c4d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:00.754256 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14218f7d-37ba-4053-9e7f-18588d390c4d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:00.754675 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14218f7d-37ba-4053-9e7f-18588d390c4d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:00.784713 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-14218f7d-37ba-4053-9e7f-18588d390c4d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045822 Oct 11 06:49:00.785254 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 479/1003] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:00 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:01.105696 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-31758df5-1f38-409c-b6d8-03acf192482f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:01.107835 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-31758df5-1f38-409c-b6d8-03acf192482f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:01.114150 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-31758df5-1f38-409c-b6d8-03acf192482f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:01.114624 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-31758df5-1f38-409c-b6d8-03acf192482f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:01.115051 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-31758df5-1f38-409c-b6d8-03acf192482f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:01.115768 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-31758df5-1f38-409c-b6d8-03acf192482f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:01.116204 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-31758df5-1f38-409c-b6d8-03acf192482f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:01.116616 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-31758df5-1f38-409c-b6d8-03acf192482f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:01.145014 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-31758df5-1f38-409c-b6d8-03acf192482f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043366 Oct 11 06:49:01.145541 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 525/1004] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:01 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:01.797958 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f05c429f-d915-4e21-941c-dfa3c848eb74 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:01.800823 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f05c429f-d915-4e21-941c-dfa3c848eb74 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:01.807581 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f05c429f-d915-4e21-941c-dfa3c848eb74 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:01.808059 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f05c429f-d915-4e21-941c-dfa3c848eb74 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:01.808487 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f05c429f-d915-4e21-941c-dfa3c848eb74 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:01.809176 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f05c429f-d915-4e21-941c-dfa3c848eb74 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:01.809627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f05c429f-d915-4e21-941c-dfa3c848eb74 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:01.810043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f05c429f-d915-4e21-941c-dfa3c848eb74 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:01.838990 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f05c429f-d915-4e21-941c-dfa3c848eb74 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045080 Oct 11 06:49:01.843402 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 480/1005] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:01 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:02.157285 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ae326505-69eb-4fa9-9f50-0efb4b92712a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:02.159463 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ae326505-69eb-4fa9-9f50-0efb4b92712a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:02.166473 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ae326505-69eb-4fa9-9f50-0efb4b92712a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:02.166950 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ae326505-69eb-4fa9-9f50-0efb4b92712a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:02.167383 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ae326505-69eb-4fa9-9f50-0efb4b92712a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:02.168097 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ae326505-69eb-4fa9-9f50-0efb4b92712a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:02.168548 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ae326505-69eb-4fa9-9f50-0efb4b92712a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:02.168971 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ae326505-69eb-4fa9-9f50-0efb4b92712a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:02.197422 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ae326505-69eb-4fa9-9f50-0efb4b92712a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044072 Oct 11 06:49:02.197967 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 526/1006] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:02 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:02.851074 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6e4107e5-46a0-4b9b-9b13-063269986181 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:02.853942 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6e4107e5-46a0-4b9b-9b13-063269986181 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:02.860941 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e4107e5-46a0-4b9b-9b13-063269986181 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:02.861493 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e4107e5-46a0-4b9b-9b13-063269986181 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:02.861991 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e4107e5-46a0-4b9b-9b13-063269986181 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:02.864017 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e4107e5-46a0-4b9b-9b13-063269986181 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:02.864017 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e4107e5-46a0-4b9b-9b13-063269986181 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:02.864017 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e4107e5-46a0-4b9b-9b13-063269986181 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:02.892903 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6e4107e5-46a0-4b9b-9b13-063269986181 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045650 Oct 11 06:49:02.899581 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 481/1007] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:02 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:03.209570 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1ef09d53-13c9-48d3-8318-07581c29e509 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:03.211720 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1ef09d53-13c9-48d3-8318-07581c29e509 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:03.214667 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 06:49:03.214798 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Tue Oct 11 06:49:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments (ip 10.222.0.39) !!! Oct 11 06:49:03.220384 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1ef09d53-13c9-48d3-8318-07581c29e509 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:03.220928 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1ef09d53-13c9-48d3-8318-07581c29e509 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:03.221321 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1ef09d53-13c9-48d3-8318-07581c29e509 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:03.222025 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1ef09d53-13c9-48d3-8318-07581c29e509 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:03.222550 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1ef09d53-13c9-48d3-8318-07581c29e509 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:03.222993 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1ef09d53-13c9-48d3-8318-07581c29e509 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:03.253056 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1ef09d53-13c9-48d3-8318-07581c29e509 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047359 Oct 11 06:49:03.253607 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 527/1008] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:03 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:03.906919 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-57aa7d2b-3e09-4417-bb0b-135603232de8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:03.909146 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-57aa7d2b-3e09-4417-bb0b-135603232de8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:03.915464 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57aa7d2b-3e09-4417-bb0b-135603232de8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:03.916134 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57aa7d2b-3e09-4417-bb0b-135603232de8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:03.916562 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57aa7d2b-3e09-4417-bb0b-135603232de8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:03.917242 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57aa7d2b-3e09-4417-bb0b-135603232de8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:03.917685 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57aa7d2b-3e09-4417-bb0b-135603232de8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:03.918084 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57aa7d2b-3e09-4417-bb0b-135603232de8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:03.949752 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-57aa7d2b-3e09-4417-bb0b-135603232de8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046714 Oct 11 06:49:03.950462 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 482/1009] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:03 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:04.265441 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-04518766-4d1d-43d0-af2d-1be42028fe77 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:04.267635 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-04518766-4d1d-43d0-af2d-1be42028fe77 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:04.274187 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04518766-4d1d-43d0-af2d-1be42028fe77 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:04.274662 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04518766-4d1d-43d0-af2d-1be42028fe77 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:04.275087 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04518766-4d1d-43d0-af2d-1be42028fe77 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:04.275801 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04518766-4d1d-43d0-af2d-1be42028fe77 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:04.276248 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04518766-4d1d-43d0-af2d-1be42028fe77 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:04.276668 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04518766-4d1d-43d0-af2d-1be42028fe77 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:04.304755 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-04518766-4d1d-43d0-af2d-1be42028fe77 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043313 Oct 11 06:49:04.305292 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 528/1010] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:04 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:04.962011 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3ffc195a-aa79-4c7e-a02a-a4958487fa2d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:04.964688 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3ffc195a-aa79-4c7e-a02a-a4958487fa2d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:04.971741 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3ffc195a-aa79-4c7e-a02a-a4958487fa2d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:04.972222 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3ffc195a-aa79-4c7e-a02a-a4958487fa2d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:04.972652 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3ffc195a-aa79-4c7e-a02a-a4958487fa2d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:04.973340 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3ffc195a-aa79-4c7e-a02a-a4958487fa2d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:04.973922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3ffc195a-aa79-4c7e-a02a-a4958487fa2d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:04.974340 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3ffc195a-aa79-4c7e-a02a-a4958487fa2d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:05.004321 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3ffc195a-aa79-4c7e-a02a-a4958487fa2d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046211 Oct 11 06:49:05.004879 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 483/1011] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:04 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:05.317726 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b9875bf9-f211-45f2-9fd0-2cbc378bca18 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:05.319986 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b9875bf9-f211-45f2-9fd0-2cbc378bca18 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:05.327095 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b9875bf9-f211-45f2-9fd0-2cbc378bca18 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:05.327604 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b9875bf9-f211-45f2-9fd0-2cbc378bca18 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:05.328037 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b9875bf9-f211-45f2-9fd0-2cbc378bca18 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:05.328731 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b9875bf9-f211-45f2-9fd0-2cbc378bca18 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:05.329178 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b9875bf9-f211-45f2-9fd0-2cbc378bca18 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:05.329595 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b9875bf9-f211-45f2-9fd0-2cbc378bca18 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:05.358414 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b9875bf9-f211-45f2-9fd0-2cbc378bca18 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044858 Oct 11 06:49:05.358962 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 529/1012] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:05 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:06.016886 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-82b8ed05-1121-4a85-b1e9-d6b8fa2d3108 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:06.019034 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-82b8ed05-1121-4a85-b1e9-d6b8fa2d3108 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:06.025983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82b8ed05-1121-4a85-b1e9-d6b8fa2d3108 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:06.026470 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82b8ed05-1121-4a85-b1e9-d6b8fa2d3108 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:06.026997 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82b8ed05-1121-4a85-b1e9-d6b8fa2d3108 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:06.027720 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82b8ed05-1121-4a85-b1e9-d6b8fa2d3108 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:06.028491 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82b8ed05-1121-4a85-b1e9-d6b8fa2d3108 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:06.029220 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82b8ed05-1121-4a85-b1e9-d6b8fa2d3108 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:06.062343 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-82b8ed05-1121-4a85-b1e9-d6b8fa2d3108 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049312 Oct 11 06:49:06.067408 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 484/1013] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:06 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:06.370768 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a303d8a4-7d1c-4ac2-9c86-649e1e25d180 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:06.372912 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a303d8a4-7d1c-4ac2-9c86-649e1e25d180 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:06.379242 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a303d8a4-7d1c-4ac2-9c86-649e1e25d180 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:06.379742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a303d8a4-7d1c-4ac2-9c86-649e1e25d180 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:06.380167 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a303d8a4-7d1c-4ac2-9c86-649e1e25d180 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:06.380842 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a303d8a4-7d1c-4ac2-9c86-649e1e25d180 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:06.381277 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a303d8a4-7d1c-4ac2-9c86-649e1e25d180 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:06.381694 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a303d8a4-7d1c-4ac2-9c86-649e1e25d180 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:06.410437 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a303d8a4-7d1c-4ac2-9c86-649e1e25d180 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044156 Oct 11 06:49:06.411183 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 530/1014] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:06 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:07.074515 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bde4d6e5-6fff-4e53-aabc-775ab317acc3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:07.076755 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bde4d6e5-6fff-4e53-aabc-775ab317acc3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:07.083713 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bde4d6e5-6fff-4e53-aabc-775ab317acc3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:07.084186 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bde4d6e5-6fff-4e53-aabc-775ab317acc3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:07.084694 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bde4d6e5-6fff-4e53-aabc-775ab317acc3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:07.085293 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bde4d6e5-6fff-4e53-aabc-775ab317acc3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:07.085737 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bde4d6e5-6fff-4e53-aabc-775ab317acc3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:07.086154 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bde4d6e5-6fff-4e53-aabc-775ab317acc3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:07.117073 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bde4d6e5-6fff-4e53-aabc-775ab317acc3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046882 Oct 11 06:49:07.117743 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 485/1015] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:07 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:07.422830 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4da410a7-fd38-49d7-9bfa-f6eaa373225b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:07.424966 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4da410a7-fd38-49d7-9bfa-f6eaa373225b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:07.431845 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4da410a7-fd38-49d7-9bfa-f6eaa373225b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:07.432308 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4da410a7-fd38-49d7-9bfa-f6eaa373225b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:07.432731 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4da410a7-fd38-49d7-9bfa-f6eaa373225b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:07.433403 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4da410a7-fd38-49d7-9bfa-f6eaa373225b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:07.433840 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4da410a7-fd38-49d7-9bfa-f6eaa373225b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:07.434251 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4da410a7-fd38-49d7-9bfa-f6eaa373225b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:07.462748 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4da410a7-fd38-49d7-9bfa-f6eaa373225b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043996 Oct 11 06:49:07.463302 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 531/1016] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:07 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:08.128699 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-77f59ab2-0234-4150-a2cb-5548549e8946 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:08.130806 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-77f59ab2-0234-4150-a2cb-5548549e8946 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:08.137307 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-77f59ab2-0234-4150-a2cb-5548549e8946 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:08.137785 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-77f59ab2-0234-4150-a2cb-5548549e8946 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:08.138217 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-77f59ab2-0234-4150-a2cb-5548549e8946 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:08.138907 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-77f59ab2-0234-4150-a2cb-5548549e8946 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:08.139350 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-77f59ab2-0234-4150-a2cb-5548549e8946 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:08.139788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-77f59ab2-0234-4150-a2cb-5548549e8946 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:08.172333 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-77f59ab2-0234-4150-a2cb-5548549e8946 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047309 Oct 11 06:49:08.172897 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 486/1017] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:08 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:08.475165 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e9f55e8d-86d9-4eab-95fb-5f7cf562da85 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:08.477378 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e9f55e8d-86d9-4eab-95fb-5f7cf562da85 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:08.483771 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e9f55e8d-86d9-4eab-95fb-5f7cf562da85 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:08.484247 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e9f55e8d-86d9-4eab-95fb-5f7cf562da85 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:08.484673 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e9f55e8d-86d9-4eab-95fb-5f7cf562da85 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:08.485358 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e9f55e8d-86d9-4eab-95fb-5f7cf562da85 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:08.485802 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e9f55e8d-86d9-4eab-95fb-5f7cf562da85 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:08.486218 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e9f55e8d-86d9-4eab-95fb-5f7cf562da85 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:08.514615 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e9f55e8d-86d9-4eab-95fb-5f7cf562da85 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043481 Oct 11 06:49:08.515142 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 532/1018] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:08 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:09.185477 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e32aeb72-e7ff-4fd2-ae97-62aa4cbf8ace tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:09.187739 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e32aeb72-e7ff-4fd2-ae97-62aa4cbf8ace tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:09.190342 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=58 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:49:09.195713 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e32aeb72-e7ff-4fd2-ae97-62aa4cbf8ace tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:09.196205 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e32aeb72-e7ff-4fd2-ae97-62aa4cbf8ace tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:09.196639 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e32aeb72-e7ff-4fd2-ae97-62aa4cbf8ace tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:09.197341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e32aeb72-e7ff-4fd2-ae97-62aa4cbf8ace tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:09.197790 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e32aeb72-e7ff-4fd2-ae97-62aa4cbf8ace tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:09.198209 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e32aeb72-e7ff-4fd2-ae97-62aa4cbf8ace tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:09.228814 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e32aeb72-e7ff-4fd2-ae97-62aa4cbf8ace tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047826 Oct 11 06:49:09.229375 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 487/1019] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:09 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:09.527170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4d66967e-f017-4970-94bb-146bc2223137 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:09.529384 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4d66967e-f017-4970-94bb-146bc2223137 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:09.535733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4d66967e-f017-4970-94bb-146bc2223137 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:09.536214 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4d66967e-f017-4970-94bb-146bc2223137 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:09.536648 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4d66967e-f017-4970-94bb-146bc2223137 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:09.537336 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4d66967e-f017-4970-94bb-146bc2223137 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:09.537811 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4d66967e-f017-4970-94bb-146bc2223137 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:09.538284 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4d66967e-f017-4970-94bb-146bc2223137 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:09.567156 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4d66967e-f017-4970-94bb-146bc2223137 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043962 Oct 11 06:49:09.567721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 533/1020] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:09 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:49:10.241580 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-06d39e37-a987-4c7d-b8cb-7ea05a3ab8c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:10.243734 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-06d39e37-a987-4c7d-b8cb-7ea05a3ab8c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:10.250024 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-06d39e37-a987-4c7d-b8cb-7ea05a3ab8c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:10.250501 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-06d39e37-a987-4c7d-b8cb-7ea05a3ab8c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:10.250934 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-06d39e37-a987-4c7d-b8cb-7ea05a3ab8c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:10.252975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-06d39e37-a987-4c7d-b8cb-7ea05a3ab8c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:10.252975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-06d39e37-a987-4c7d-b8cb-7ea05a3ab8c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:10.252975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-06d39e37-a987-4c7d-b8cb-7ea05a3ab8c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:10.283516 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-06d39e37-a987-4c7d-b8cb-7ea05a3ab8c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045963 Oct 11 06:49:10.284076 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 488/1021] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:10 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:10.580331 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4d783942-7185-4848-a70c-70cfe87a9c53 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:10.582392 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4d783942-7185-4848-a70c-70cfe87a9c53 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:10.589350 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4d783942-7185-4848-a70c-70cfe87a9c53 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:10.589830 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4d783942-7185-4848-a70c-70cfe87a9c53 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:10.590265 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4d783942-7185-4848-a70c-70cfe87a9c53 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:10.590957 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4d783942-7185-4848-a70c-70cfe87a9c53 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:10.591407 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4d783942-7185-4848-a70c-70cfe87a9c53 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:10.591853 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4d783942-7185-4848-a70c-70cfe87a9c53 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:10.620123 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4d783942-7185-4848-a70c-70cfe87a9c53 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043876 Oct 11 06:49:10.620657 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 534/1022] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:10 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:11.296480 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-62f26e31-9660-440f-87e1-1e43c172129e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:11.298671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-62f26e31-9660-440f-87e1-1e43c172129e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:11.306137 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62f26e31-9660-440f-87e1-1e43c172129e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:11.306538 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62f26e31-9660-440f-87e1-1e43c172129e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:11.306961 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62f26e31-9660-440f-87e1-1e43c172129e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:11.307693 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62f26e31-9660-440f-87e1-1e43c172129e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:11.308137 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62f26e31-9660-440f-87e1-1e43c172129e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:11.308554 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62f26e31-9660-440f-87e1-1e43c172129e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:11.342030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-62f26e31-9660-440f-87e1-1e43c172129e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049662 Oct 11 06:49:11.342614 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 489/1023] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:11 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:11.632247 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e7c31a65-47e4-42c3-bb68-f65525792551 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:11.634372 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e7c31a65-47e4-42c3-bb68-f65525792551 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:11.640800 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7c31a65-47e4-42c3-bb68-f65525792551 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:11.641275 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7c31a65-47e4-42c3-bb68-f65525792551 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:11.641735 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7c31a65-47e4-42c3-bb68-f65525792551 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:11.642419 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7c31a65-47e4-42c3-bb68-f65525792551 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:11.642863 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7c31a65-47e4-42c3-bb68-f65525792551 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:11.643281 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7c31a65-47e4-42c3-bb68-f65525792551 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:11.671942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e7c31a65-47e4-42c3-bb68-f65525792551 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043598 Oct 11 06:49:11.672480 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 535/1024] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:11 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:12.354525 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3aec5a51-c514-44c9-aae8-415b968ab5e4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:12.356736 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3aec5a51-c514-44c9-aae8-415b968ab5e4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:12.363000 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3aec5a51-c514-44c9-aae8-415b968ab5e4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:12.363515 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3aec5a51-c514-44c9-aae8-415b968ab5e4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:12.363946 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3aec5a51-c514-44c9-aae8-415b968ab5e4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:12.364631 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3aec5a51-c514-44c9-aae8-415b968ab5e4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:12.365109 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3aec5a51-c514-44c9-aae8-415b968ab5e4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:12.365531 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3aec5a51-c514-44c9-aae8-415b968ab5e4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:12.393844 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3aec5a51-c514-44c9-aae8-415b968ab5e4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043299 Oct 11 06:49:12.394377 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 490/1025] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:12 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:12.686278 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ea6ae009-e79b-417e-91a2-6b46eabf3f3f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:12.688407 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ea6ae009-e79b-417e-91a2-6b46eabf3f3f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:12.694690 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ea6ae009-e79b-417e-91a2-6b46eabf3f3f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:12.695165 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ea6ae009-e79b-417e-91a2-6b46eabf3f3f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:12.695631 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ea6ae009-e79b-417e-91a2-6b46eabf3f3f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:12.696310 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ea6ae009-e79b-417e-91a2-6b46eabf3f3f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:12.696752 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ea6ae009-e79b-417e-91a2-6b46eabf3f3f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:12.697171 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ea6ae009-e79b-417e-91a2-6b46eabf3f3f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:12.713813 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:49:12.727379 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ea6ae009-e79b-417e-91a2-6b46eabf3f3f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045523 Oct 11 06:49:12.727945 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 536/1026] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:12 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:13.406704 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1710bcbe-1e16-4746-9c4c-30dca68fd35f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:13.408879 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1710bcbe-1e16-4746-9c4c-30dca68fd35f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:13.415348 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1710bcbe-1e16-4746-9c4c-30dca68fd35f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:13.415861 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1710bcbe-1e16-4746-9c4c-30dca68fd35f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:13.416937 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1710bcbe-1e16-4746-9c4c-30dca68fd35f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:13.417633 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1710bcbe-1e16-4746-9c4c-30dca68fd35f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:13.418083 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1710bcbe-1e16-4746-9c4c-30dca68fd35f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:13.418504 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1710bcbe-1e16-4746-9c4c-30dca68fd35f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:13.446563 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1710bcbe-1e16-4746-9c4c-30dca68fd35f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043875 Oct 11 06:49:13.447098 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 491/1027] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:13 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:13.739848 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-55dcc544-3f7e-457e-ab0a-d0e5b6d17e6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:13.742020 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-55dcc544-3f7e-457e-ab0a-d0e5b6d17e6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:13.748102 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-55dcc544-3f7e-457e-ab0a-d0e5b6d17e6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:13.748578 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-55dcc544-3f7e-457e-ab0a-d0e5b6d17e6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:13.749015 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-55dcc544-3f7e-457e-ab0a-d0e5b6d17e6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:13.749706 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-55dcc544-3f7e-457e-ab0a-d0e5b6d17e6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:13.750150 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-55dcc544-3f7e-457e-ab0a-d0e5b6d17e6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:13.750570 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-55dcc544-3f7e-457e-ab0a-d0e5b6d17e6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:13.781147 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-55dcc544-3f7e-457e-ab0a-d0e5b6d17e6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045391 Oct 11 06:49:13.781699 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 537/1028] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:13 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:14.457995 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-aa1e47aa-d242-48ec-b32d-0bbf9590bcab tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:14.460151 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-aa1e47aa-d242-48ec-b32d-0bbf9590bcab tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:14.466731 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aa1e47aa-d242-48ec-b32d-0bbf9590bcab tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:14.467211 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aa1e47aa-d242-48ec-b32d-0bbf9590bcab tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:14.467682 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aa1e47aa-d242-48ec-b32d-0bbf9590bcab tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:14.468377 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aa1e47aa-d242-48ec-b32d-0bbf9590bcab tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:14.468843 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aa1e47aa-d242-48ec-b32d-0bbf9590bcab tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:14.469243 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aa1e47aa-d242-48ec-b32d-0bbf9590bcab tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:14.498346 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-aa1e47aa-d242-48ec-b32d-0bbf9590bcab tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044226 Oct 11 06:49:14.498883 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 492/1029] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:14 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:14.793956 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e749039c-844a-438f-82bc-b341553b3d42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:14.796114 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e749039c-844a-438f-82bc-b341553b3d42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:14.802603 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e749039c-844a-438f-82bc-b341553b3d42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:14.803109 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e749039c-844a-438f-82bc-b341553b3d42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:14.803587 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e749039c-844a-438f-82bc-b341553b3d42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:14.804266 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e749039c-844a-438f-82bc-b341553b3d42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:14.804714 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e749039c-844a-438f-82bc-b341553b3d42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:14.805128 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e749039c-844a-438f-82bc-b341553b3d42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:14.833370 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e749039c-844a-438f-82bc-b341553b3d42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043955 Oct 11 06:49:14.833906 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 538/1030] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:14 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:15.510769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9c3dcbe8-3231-4dea-b977-f9a947a9807d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:15.512968 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9c3dcbe8-3231-4dea-b977-f9a947a9807d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:15.519297 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9c3dcbe8-3231-4dea-b977-f9a947a9807d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:15.519804 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9c3dcbe8-3231-4dea-b977-f9a947a9807d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:15.520257 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9c3dcbe8-3231-4dea-b977-f9a947a9807d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:15.521233 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9c3dcbe8-3231-4dea-b977-f9a947a9807d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:15.521676 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9c3dcbe8-3231-4dea-b977-f9a947a9807d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:15.522092 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9c3dcbe8-3231-4dea-b977-f9a947a9807d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:15.549939 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9c3dcbe8-3231-4dea-b977-f9a947a9807d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043808 Oct 11 06:49:15.550463 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 493/1031] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:15 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:15.846172 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7e8ee4aa-73fd-4394-969d-65118b8872a4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:15.848314 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7e8ee4aa-73fd-4394-969d-65118b8872a4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:15.854738 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e8ee4aa-73fd-4394-969d-65118b8872a4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:15.855210 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e8ee4aa-73fd-4394-969d-65118b8872a4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:15.856203 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e8ee4aa-73fd-4394-969d-65118b8872a4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:15.856894 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e8ee4aa-73fd-4394-969d-65118b8872a4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:15.857338 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e8ee4aa-73fd-4394-969d-65118b8872a4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:15.857754 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e8ee4aa-73fd-4394-969d-65118b8872a4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:15.886974 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7e8ee4aa-73fd-4394-969d-65118b8872a4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044620 Oct 11 06:49:15.887540 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 539/1032] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:15 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:49:16.569841 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a2a45175-1069-4c3c-9407-3d4501f4305b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:16.571976 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a2a45175-1069-4c3c-9407-3d4501f4305b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:16.579723 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2a45175-1069-4c3c-9407-3d4501f4305b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:16.580317 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2a45175-1069-4c3c-9407-3d4501f4305b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:16.580748 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2a45175-1069-4c3c-9407-3d4501f4305b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:16.581444 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2a45175-1069-4c3c-9407-3d4501f4305b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:16.581888 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2a45175-1069-4c3c-9407-3d4501f4305b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:16.582302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2a45175-1069-4c3c-9407-3d4501f4305b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:16.599712 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:49:16.615916 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a2a45175-1069-4c3c-9407-3d4501f4305b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049961 Oct 11 06:49:16.616453 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 494/1033] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:16 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:16.898841 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1decfa15-ea72-47cb-959d-d27ea4e0393f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:16.900976 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1decfa15-ea72-47cb-959d-d27ea4e0393f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:16.907437 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1decfa15-ea72-47cb-959d-d27ea4e0393f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:16.908052 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1decfa15-ea72-47cb-959d-d27ea4e0393f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:16.908477 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1decfa15-ea72-47cb-959d-d27ea4e0393f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:16.909155 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1decfa15-ea72-47cb-959d-d27ea4e0393f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:16.909592 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1decfa15-ea72-47cb-959d-d27ea4e0393f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:16.910007 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1decfa15-ea72-47cb-959d-d27ea4e0393f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:16.939663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1decfa15-ea72-47cb-959d-d27ea4e0393f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044902 Oct 11 06:49:16.940201 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 540/1034] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:16 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:17.628431 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8e1ebcf1-3982-469d-91e5-d72d897b56c6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:17.630557 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8e1ebcf1-3982-469d-91e5-d72d897b56c6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:17.636606 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e1ebcf1-3982-469d-91e5-d72d897b56c6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:17.637083 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e1ebcf1-3982-469d-91e5-d72d897b56c6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:17.637517 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e1ebcf1-3982-469d-91e5-d72d897b56c6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:17.638201 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e1ebcf1-3982-469d-91e5-d72d897b56c6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:17.638651 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e1ebcf1-3982-469d-91e5-d72d897b56c6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:17.639069 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e1ebcf1-3982-469d-91e5-d72d897b56c6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:17.669345 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8e1ebcf1-3982-469d-91e5-d72d897b56c6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044809 Oct 11 06:49:17.669850 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 495/1035] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:17 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:17.952769 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-26333d5c-ea56-474a-96c6-ba78431bda1a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:17.954801 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-26333d5c-ea56-474a-96c6-ba78431bda1a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:17.961078 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-26333d5c-ea56-474a-96c6-ba78431bda1a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:17.961543 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-26333d5c-ea56-474a-96c6-ba78431bda1a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:17.961967 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-26333d5c-ea56-474a-96c6-ba78431bda1a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:17.962641 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-26333d5c-ea56-474a-96c6-ba78431bda1a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:17.963080 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-26333d5c-ea56-474a-96c6-ba78431bda1a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:17.963518 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-26333d5c-ea56-474a-96c6-ba78431bda1a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:17.991856 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-26333d5c-ea56-474a-96c6-ba78431bda1a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043683 Oct 11 06:49:17.992387 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 541/1036] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:17 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:18.681651 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e9398f93-50de-4633-9f09-641f2de107f0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:18.683802 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e9398f93-50de-4633-9f09-641f2de107f0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:18.690110 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e9398f93-50de-4633-9f09-641f2de107f0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:18.690583 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e9398f93-50de-4633-9f09-641f2de107f0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:18.691006 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e9398f93-50de-4633-9f09-641f2de107f0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:18.691727 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e9398f93-50de-4633-9f09-641f2de107f0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:18.692173 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e9398f93-50de-4633-9f09-641f2de107f0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:18.692587 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e9398f93-50de-4633-9f09-641f2de107f0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:18.721997 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e9398f93-50de-4633-9f09-641f2de107f0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044284 Oct 11 06:49:18.722543 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 496/1037] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:18 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:19.004181 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-62d43e68-13e4-4b00-be47-f29cefb78634 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:19.006280 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-62d43e68-13e4-4b00-be47-f29cefb78634 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:19.013130 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62d43e68-13e4-4b00-be47-f29cefb78634 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:19.013607 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62d43e68-13e4-4b00-be47-f29cefb78634 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:19.014039 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62d43e68-13e4-4b00-be47-f29cefb78634 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:19.014730 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62d43e68-13e4-4b00-be47-f29cefb78634 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:19.015181 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62d43e68-13e4-4b00-be47-f29cefb78634 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:19.015655 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62d43e68-13e4-4b00-be47-f29cefb78634 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:19.045464 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-62d43e68-13e4-4b00-be47-f29cefb78634 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045229 Oct 11 06:49:19.046014 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 542/1038] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:18 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:19.734600 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9bc2f7a5-ea46-4fdd-bf58-78f021be3cdf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:19.736748 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9bc2f7a5-ea46-4fdd-bf58-78f021be3cdf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:19.743098 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9bc2f7a5-ea46-4fdd-bf58-78f021be3cdf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:19.743633 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9bc2f7a5-ea46-4fdd-bf58-78f021be3cdf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:19.744058 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9bc2f7a5-ea46-4fdd-bf58-78f021be3cdf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:19.744738 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9bc2f7a5-ea46-4fdd-bf58-78f021be3cdf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:19.745180 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9bc2f7a5-ea46-4fdd-bf58-78f021be3cdf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:19.745599 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9bc2f7a5-ea46-4fdd-bf58-78f021be3cdf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:19.775039 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9bc2f7a5-ea46-4fdd-bf58-78f021be3cdf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044845 Oct 11 06:49:19.775616 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 497/1039] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:19 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:20.057973 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-919d700b-0684-4b2a-aa87-d45cbcd6750f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:20.060133 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-919d700b-0684-4b2a-aa87-d45cbcd6750f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:20.066444 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-919d700b-0684-4b2a-aa87-d45cbcd6750f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:20.066921 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-919d700b-0684-4b2a-aa87-d45cbcd6750f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:20.067353 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-919d700b-0684-4b2a-aa87-d45cbcd6750f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:20.068068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-919d700b-0684-4b2a-aa87-d45cbcd6750f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:20.068517 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-919d700b-0684-4b2a-aa87-d45cbcd6750f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:20.068935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-919d700b-0684-4b2a-aa87-d45cbcd6750f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:20.097657 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-919d700b-0684-4b2a-aa87-d45cbcd6750f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043606 Oct 11 06:49:20.098206 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 543/1040] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:20 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:20.787718 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-616892b3-28fb-467b-8408-ae84248d46bc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:20.789861 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-616892b3-28fb-467b-8408-ae84248d46bc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:20.796203 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-616892b3-28fb-467b-8408-ae84248d46bc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:20.796679 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-616892b3-28fb-467b-8408-ae84248d46bc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:20.797109 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-616892b3-28fb-467b-8408-ae84248d46bc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:20.797795 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-616892b3-28fb-467b-8408-ae84248d46bc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:20.798241 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-616892b3-28fb-467b-8408-ae84248d46bc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:20.798661 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-616892b3-28fb-467b-8408-ae84248d46bc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:20.828105 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-616892b3-28fb-467b-8408-ae84248d46bc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044399 Oct 11 06:49:20.828644 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 498/1041] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:20 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:21.110478 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c6bbda85-96e9-4f2b-b606-b4224685f65b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:21.112659 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c6bbda85-96e9-4f2b-b606-b4224685f65b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:21.118862 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c6bbda85-96e9-4f2b-b606-b4224685f65b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:21.119336 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c6bbda85-96e9-4f2b-b606-b4224685f65b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:21.119832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c6bbda85-96e9-4f2b-b606-b4224685f65b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:21.120520 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c6bbda85-96e9-4f2b-b606-b4224685f65b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:21.120964 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c6bbda85-96e9-4f2b-b606-b4224685f65b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:21.121387 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c6bbda85-96e9-4f2b-b606-b4224685f65b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:21.150843 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c6bbda85-96e9-4f2b-b606-b4224685f65b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044841 Oct 11 06:49:21.151379 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 544/1042] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:21 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:21.841139 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a52dad06-c951-4bcc-9db8-fd1c1f30bd97 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:21.843274 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a52dad06-c951-4bcc-9db8-fd1c1f30bd97 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:21.849661 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a52dad06-c951-4bcc-9db8-fd1c1f30bd97 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:21.850146 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a52dad06-c951-4bcc-9db8-fd1c1f30bd97 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:21.850578 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a52dad06-c951-4bcc-9db8-fd1c1f30bd97 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:21.851268 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a52dad06-c951-4bcc-9db8-fd1c1f30bd97 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:21.851758 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a52dad06-c951-4bcc-9db8-fd1c1f30bd97 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:21.852174 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a52dad06-c951-4bcc-9db8-fd1c1f30bd97 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:21.880288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a52dad06-c951-4bcc-9db8-fd1c1f30bd97 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043720 Oct 11 06:49:21.880825 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 499/1043] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:21 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:22.162676 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-361f3b7b-5538-44ee-a12c-e9c7fa403c32 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:22.164832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-361f3b7b-5538-44ee-a12c-e9c7fa403c32 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:22.171237 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-361f3b7b-5538-44ee-a12c-e9c7fa403c32 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:22.171743 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-361f3b7b-5538-44ee-a12c-e9c7fa403c32 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:22.172174 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-361f3b7b-5538-44ee-a12c-e9c7fa403c32 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:22.172862 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-361f3b7b-5538-44ee-a12c-e9c7fa403c32 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:22.173311 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-361f3b7b-5538-44ee-a12c-e9c7fa403c32 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:22.173732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-361f3b7b-5538-44ee-a12c-e9c7fa403c32 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:22.203194 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-361f3b7b-5538-44ee-a12c-e9c7fa403c32 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044375 Oct 11 06:49:22.203767 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 545/1044] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:22 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:22.893103 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a1bb0404-e0b9-495e-a231-27764e989676 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:22.895542 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a1bb0404-e0b9-495e-a231-27764e989676 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:22.901775 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a1bb0404-e0b9-495e-a231-27764e989676 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:22.902248 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a1bb0404-e0b9-495e-a231-27764e989676 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:22.902678 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a1bb0404-e0b9-495e-a231-27764e989676 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:22.903358 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a1bb0404-e0b9-495e-a231-27764e989676 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:22.903829 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a1bb0404-e0b9-495e-a231-27764e989676 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:22.904244 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a1bb0404-e0b9-495e-a231-27764e989676 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:22.932331 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a1bb0404-e0b9-495e-a231-27764e989676 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043125 Oct 11 06:49:22.932862 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 500/1045] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:22 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:23.215361 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7cde8fc9-d6f0-4695-928f-241d9879cc1a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:23.217530 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7cde8fc9-d6f0-4695-928f-241d9879cc1a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:23.224005 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7cde8fc9-d6f0-4695-928f-241d9879cc1a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:23.224479 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7cde8fc9-d6f0-4695-928f-241d9879cc1a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:23.224909 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7cde8fc9-d6f0-4695-928f-241d9879cc1a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:23.225588 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7cde8fc9-d6f0-4695-928f-241d9879cc1a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:23.226035 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7cde8fc9-d6f0-4695-928f-241d9879cc1a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:23.226453 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7cde8fc9-d6f0-4695-928f-241d9879cc1a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:23.255823 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7cde8fc9-d6f0-4695-928f-241d9879cc1a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044616 Oct 11 06:49:23.256364 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 546/1046] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:23 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:23.945428 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8a799a65-b496-4824-ac29-e0b88ffb1916 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:23.947669 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8a799a65-b496-4824-ac29-e0b88ffb1916 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:23.954642 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8a799a65-b496-4824-ac29-e0b88ffb1916 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:23.955222 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8a799a65-b496-4824-ac29-e0b88ffb1916 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:23.955753 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8a799a65-b496-4824-ac29-e0b88ffb1916 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:23.956506 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8a799a65-b496-4824-ac29-e0b88ffb1916 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:23.957022 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8a799a65-b496-4824-ac29-e0b88ffb1916 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:23.957524 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8a799a65-b496-4824-ac29-e0b88ffb1916 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:23.986300 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8a799a65-b496-4824-ac29-e0b88ffb1916 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044988 Oct 11 06:49:23.986859 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 501/1047] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:23 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:24.267253 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-53bad76d-f50e-49fe-b6d6-248bb95b892e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:24.269402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-53bad76d-f50e-49fe-b6d6-248bb95b892e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:24.276079 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-53bad76d-f50e-49fe-b6d6-248bb95b892e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:24.276560 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-53bad76d-f50e-49fe-b6d6-248bb95b892e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:24.276995 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-53bad76d-f50e-49fe-b6d6-248bb95b892e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:24.277682 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-53bad76d-f50e-49fe-b6d6-248bb95b892e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:24.278128 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-53bad76d-f50e-49fe-b6d6-248bb95b892e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:24.278553 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-53bad76d-f50e-49fe-b6d6-248bb95b892e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:24.307222 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-53bad76d-f50e-49fe-b6d6-248bb95b892e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043907 Oct 11 06:49:24.307780 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 547/1048] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:24 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:24.998199 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1d6457b8-9feb-4e66-be69-09ad64f876f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:25.000482 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1d6457b8-9feb-4e66-be69-09ad64f876f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:25.007051 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d6457b8-9feb-4e66-be69-09ad64f876f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:25.007572 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d6457b8-9feb-4e66-be69-09ad64f876f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:25.008010 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d6457b8-9feb-4e66-be69-09ad64f876f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:25.008706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d6457b8-9feb-4e66-be69-09ad64f876f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:25.009158 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d6457b8-9feb-4e66-be69-09ad64f876f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:25.009579 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d6457b8-9feb-4e66-be69-09ad64f876f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:25.039559 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1d6457b8-9feb-4e66-be69-09ad64f876f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045381 Oct 11 06:49:25.040093 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 502/1049] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:24 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:25.320013 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-23f80f0e-4fad-4d5d-989d-7f176531caa0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:25.322230 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-23f80f0e-4fad-4d5d-989d-7f176531caa0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:25.329142 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-23f80f0e-4fad-4d5d-989d-7f176531caa0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:25.329622 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-23f80f0e-4fad-4d5d-989d-7f176531caa0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:25.330059 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-23f80f0e-4fad-4d5d-989d-7f176531caa0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:25.330742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-23f80f0e-4fad-4d5d-989d-7f176531caa0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:25.331180 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-23f80f0e-4fad-4d5d-989d-7f176531caa0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:25.331623 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-23f80f0e-4fad-4d5d-989d-7f176531caa0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:25.363768 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-23f80f0e-4fad-4d5d-989d-7f176531caa0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047534 Oct 11 06:49:25.364323 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 548/1050] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:25 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:26.052433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-00d69d08-dde0-40c8-b0c3-ed75b124e506 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:26.054554 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-00d69d08-dde0-40c8-b0c3-ed75b124e506 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:26.060997 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-00d69d08-dde0-40c8-b0c3-ed75b124e506 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:26.061480 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-00d69d08-dde0-40c8-b0c3-ed75b124e506 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:26.061912 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-00d69d08-dde0-40c8-b0c3-ed75b124e506 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:26.062623 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-00d69d08-dde0-40c8-b0c3-ed75b124e506 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:26.063072 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-00d69d08-dde0-40c8-b0c3-ed75b124e506 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:26.063519 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-00d69d08-dde0-40c8-b0c3-ed75b124e506 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:26.092766 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-00d69d08-dde0-40c8-b0c3-ed75b124e506 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044219 Oct 11 06:49:26.093304 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 503/1051] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:26 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:26.375745 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1a149c27-2d1a-4531-8a58-bc3756b893c9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:26.377897 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1a149c27-2d1a-4531-8a58-bc3756b893c9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:26.380259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=58 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:49:26.385782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1a149c27-2d1a-4531-8a58-bc3756b893c9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:26.386255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1a149c27-2d1a-4531-8a58-bc3756b893c9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:26.386689 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1a149c27-2d1a-4531-8a58-bc3756b893c9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:26.387915 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1a149c27-2d1a-4531-8a58-bc3756b893c9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:26.388358 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1a149c27-2d1a-4531-8a58-bc3756b893c9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:26.388778 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1a149c27-2d1a-4531-8a58-bc3756b893c9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:26.419470 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1a149c27-2d1a-4531-8a58-bc3756b893c9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047608 Oct 11 06:49:26.420032 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 549/1052] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:26 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:27.105170 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-dcdc92a3-3340-4b0f-a93e-373b1889487b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:27.107395 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-dcdc92a3-3340-4b0f-a93e-373b1889487b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:27.113910 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dcdc92a3-3340-4b0f-a93e-373b1889487b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:27.114394 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dcdc92a3-3340-4b0f-a93e-373b1889487b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:27.114831 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dcdc92a3-3340-4b0f-a93e-373b1889487b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:27.115572 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dcdc92a3-3340-4b0f-a93e-373b1889487b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:27.116027 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dcdc92a3-3340-4b0f-a93e-373b1889487b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:27.116450 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dcdc92a3-3340-4b0f-a93e-373b1889487b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:27.146313 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-dcdc92a3-3340-4b0f-a93e-373b1889487b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045107 Oct 11 06:49:27.146854 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 504/1053] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:27 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:27.431720 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-875db640-d57a-4685-ab5a-98535266ad58 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:27.434438 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-875db640-d57a-4685-ab5a-98535266ad58 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:27.440849 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-875db640-d57a-4685-ab5a-98535266ad58 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:27.441327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-875db640-d57a-4685-ab5a-98535266ad58 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:27.441761 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-875db640-d57a-4685-ab5a-98535266ad58 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:27.442451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-875db640-d57a-4685-ab5a-98535266ad58 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:27.442897 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-875db640-d57a-4685-ab5a-98535266ad58 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:27.443315 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-875db640-d57a-4685-ab5a-98535266ad58 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:27.472230 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-875db640-d57a-4685-ab5a-98535266ad58 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044443 Oct 11 06:49:27.472767 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 550/1054] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:27 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:28.158363 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8e095dab-abfc-4801-8f48-adc341243002 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:28.160575 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8e095dab-abfc-4801-8f48-adc341243002 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:28.166884 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e095dab-abfc-4801-8f48-adc341243002 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:28.167364 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e095dab-abfc-4801-8f48-adc341243002 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:28.167834 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e095dab-abfc-4801-8f48-adc341243002 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:28.168527 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e095dab-abfc-4801-8f48-adc341243002 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:28.168981 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e095dab-abfc-4801-8f48-adc341243002 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:28.169442 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e095dab-abfc-4801-8f48-adc341243002 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:28.200268 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8e095dab-abfc-4801-8f48-adc341243002 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045270 Oct 11 06:49:28.200816 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 505/1055] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:28 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:28.484953 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6bff7007-5e59-4a1b-b759-9a7d8b0a9384 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:28.487086 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6bff7007-5e59-4a1b-b759-9a7d8b0a9384 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:28.493583 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6bff7007-5e59-4a1b-b759-9a7d8b0a9384 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:28.494060 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6bff7007-5e59-4a1b-b759-9a7d8b0a9384 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:28.494487 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6bff7007-5e59-4a1b-b759-9a7d8b0a9384 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:28.495174 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6bff7007-5e59-4a1b-b759-9a7d8b0a9384 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:28.495648 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6bff7007-5e59-4a1b-b759-9a7d8b0a9384 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:28.496074 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6bff7007-5e59-4a1b-b759-9a7d8b0a9384 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:28.524956 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6bff7007-5e59-4a1b-b759-9a7d8b0a9384 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044445 Oct 11 06:49:28.525486 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 551/1056] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:28 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:29.214229 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d3bd726d-d12e-49ec-89f9-d0cf7fa3ad68 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:29.216957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d3bd726d-d12e-49ec-89f9-d0cf7fa3ad68 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:29.223337 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d3bd726d-d12e-49ec-89f9-d0cf7fa3ad68 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:29.223845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d3bd726d-d12e-49ec-89f9-d0cf7fa3ad68 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:29.224275 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d3bd726d-d12e-49ec-89f9-d0cf7fa3ad68 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:29.225018 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d3bd726d-d12e-49ec-89f9-d0cf7fa3ad68 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:29.225467 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d3bd726d-d12e-49ec-89f9-d0cf7fa3ad68 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:29.225883 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d3bd726d-d12e-49ec-89f9-d0cf7fa3ad68 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:29.255218 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d3bd726d-d12e-49ec-89f9-d0cf7fa3ad68 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044947 Oct 11 06:49:29.255787 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 506/1057] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:29 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:29.536239 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d887ad79-d510-4be2-b00f-81a87f240e8d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:29.538426 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d887ad79-d510-4be2-b00f-81a87f240e8d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:29.544719 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d887ad79-d510-4be2-b00f-81a87f240e8d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:29.545181 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d887ad79-d510-4be2-b00f-81a87f240e8d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:29.545615 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d887ad79-d510-4be2-b00f-81a87f240e8d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:29.546293 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d887ad79-d510-4be2-b00f-81a87f240e8d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:29.546731 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d887ad79-d510-4be2-b00f-81a87f240e8d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:29.547145 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d887ad79-d510-4be2-b00f-81a87f240e8d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:29.575709 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d887ad79-d510-4be2-b00f-81a87f240e8d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043316 Oct 11 06:49:29.576233 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 552/1058] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:29 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:30.267385 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b8414256-44c0-4faf-87d9-33931dac578b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:30.269542 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b8414256-44c0-4faf-87d9-33931dac578b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:30.276140 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8414256-44c0-4faf-87d9-33931dac578b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:30.276621 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8414256-44c0-4faf-87d9-33931dac578b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:30.277055 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8414256-44c0-4faf-87d9-33931dac578b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:30.277780 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8414256-44c0-4faf-87d9-33931dac578b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:30.278251 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8414256-44c0-4faf-87d9-33931dac578b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:30.278662 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8414256-44c0-4faf-87d9-33931dac578b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:30.309468 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b8414256-44c0-4faf-87d9-33931dac578b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045293 Oct 11 06:49:30.310029 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 507/1059] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:30 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:30.587407 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-182594f5-e561-4c03-ab26-d9b2e456f133 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:30.589534 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-182594f5-e561-4c03-ab26-d9b2e456f133 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:30.596311 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-182594f5-e561-4c03-ab26-d9b2e456f133 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:30.596780 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-182594f5-e561-4c03-ab26-d9b2e456f133 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:30.597201 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-182594f5-e561-4c03-ab26-d9b2e456f133 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:30.597872 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-182594f5-e561-4c03-ab26-d9b2e456f133 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:30.598308 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-182594f5-e561-4c03-ab26-d9b2e456f133 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:30.598718 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-182594f5-e561-4c03-ab26-d9b2e456f133 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:30.602285 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:49:30.627652 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-182594f5-e561-4c03-ab26-d9b2e456f133 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044020 Oct 11 06:49:30.628189 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 553/1060] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:30 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:31.321335 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d420974b-78ae-4421-9971-a345cbc12292 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:31.323539 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d420974b-78ae-4421-9971-a345cbc12292 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:31.330427 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d420974b-78ae-4421-9971-a345cbc12292 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:31.330909 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d420974b-78ae-4421-9971-a345cbc12292 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:31.331343 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d420974b-78ae-4421-9971-a345cbc12292 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:31.332070 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d420974b-78ae-4421-9971-a345cbc12292 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:31.332520 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d420974b-78ae-4421-9971-a345cbc12292 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:31.332941 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d420974b-78ae-4421-9971-a345cbc12292 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:31.361682 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d420974b-78ae-4421-9971-a345cbc12292 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044279 Oct 11 06:49:31.362231 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 508/1061] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:31 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:31.639873 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b7465ec2-c336-4d9e-9a1d-2e03591ecc58 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:31.642002 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b7465ec2-c336-4d9e-9a1d-2e03591ecc58 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:31.648860 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b7465ec2-c336-4d9e-9a1d-2e03591ecc58 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:31.649338 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b7465ec2-c336-4d9e-9a1d-2e03591ecc58 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:31.649775 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b7465ec2-c336-4d9e-9a1d-2e03591ecc58 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:31.650495 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b7465ec2-c336-4d9e-9a1d-2e03591ecc58 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:31.650970 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b7465ec2-c336-4d9e-9a1d-2e03591ecc58 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:31.651436 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b7465ec2-c336-4d9e-9a1d-2e03591ecc58 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:31.680187 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b7465ec2-c336-4d9e-9a1d-2e03591ecc58 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044269 Oct 11 06:49:31.680728 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 554/1062] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:31 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:32.374397 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e88651de-7c60-4c22-9dd7-af8cf1a3e4d5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:32.376729 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e88651de-7c60-4c22-9dd7-af8cf1a3e4d5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:32.383358 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e88651de-7c60-4c22-9dd7-af8cf1a3e4d5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:32.383868 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e88651de-7c60-4c22-9dd7-af8cf1a3e4d5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:32.384295 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e88651de-7c60-4c22-9dd7-af8cf1a3e4d5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:32.384984 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e88651de-7c60-4c22-9dd7-af8cf1a3e4d5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:32.385430 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e88651de-7c60-4c22-9dd7-af8cf1a3e4d5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:32.385850 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e88651de-7c60-4c22-9dd7-af8cf1a3e4d5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:32.422448 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e88651de-7c60-4c22-9dd7-af8cf1a3e4d5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052312 Oct 11 06:49:32.422995 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 509/1063] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:32 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:32.693475 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5e65634e-5073-4195-a622-b1c0910f335f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:32.695642 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5e65634e-5073-4195-a622-b1c0910f335f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:32.702624 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5e65634e-5073-4195-a622-b1c0910f335f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:32.703102 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5e65634e-5073-4195-a622-b1c0910f335f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:32.703569 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5e65634e-5073-4195-a622-b1c0910f335f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:32.704262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5e65634e-5073-4195-a622-b1c0910f335f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:32.704711 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5e65634e-5073-4195-a622-b1c0910f335f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:32.705130 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5e65634e-5073-4195-a622-b1c0910f335f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:32.734162 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5e65634e-5073-4195-a622-b1c0910f335f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044522 Oct 11 06:49:32.734740 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 555/1064] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:32 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:33.434065 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-97597801-ccd3-48f1-b9d0-e977565e25bf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:33.436212 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-97597801-ccd3-48f1-b9d0-e977565e25bf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:33.442610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-97597801-ccd3-48f1-b9d0-e977565e25bf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:33.443194 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-97597801-ccd3-48f1-b9d0-e977565e25bf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:33.443664 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-97597801-ccd3-48f1-b9d0-e977565e25bf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:33.444368 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-97597801-ccd3-48f1-b9d0-e977565e25bf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:33.444825 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-97597801-ccd3-48f1-b9d0-e977565e25bf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:33.445246 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-97597801-ccd3-48f1-b9d0-e977565e25bf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:33.470423 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:49:33.476164 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-97597801-ccd3-48f1-b9d0-e977565e25bf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046052 Oct 11 06:49:33.476718 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 510/1065] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:33 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:33.746263 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-46815644-dcf0-43b6-b855-26f53ad786f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:33.748429 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-46815644-dcf0-43b6-b855-26f53ad786f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:33.754717 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-46815644-dcf0-43b6-b855-26f53ad786f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:33.755191 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-46815644-dcf0-43b6-b855-26f53ad786f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:33.755671 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-46815644-dcf0-43b6-b855-26f53ad786f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:33.756384 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-46815644-dcf0-43b6-b855-26f53ad786f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:33.756832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-46815644-dcf0-43b6-b855-26f53ad786f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:33.757242 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-46815644-dcf0-43b6-b855-26f53ad786f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:33.787668 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-46815644-dcf0-43b6-b855-26f53ad786f0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045476 Oct 11 06:49:33.788219 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 556/1066] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:33 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:34.489308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-89e7f9f2-fbf0-4108-aea3-d9d115793ab8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:34.491533 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-89e7f9f2-fbf0-4108-aea3-d9d115793ab8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:34.498465 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-89e7f9f2-fbf0-4108-aea3-d9d115793ab8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:34.498947 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-89e7f9f2-fbf0-4108-aea3-d9d115793ab8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:34.499381 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-89e7f9f2-fbf0-4108-aea3-d9d115793ab8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:34.500117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-89e7f9f2-fbf0-4108-aea3-d9d115793ab8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:34.500572 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-89e7f9f2-fbf0-4108-aea3-d9d115793ab8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:34.500997 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-89e7f9f2-fbf0-4108-aea3-d9d115793ab8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:34.530036 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-89e7f9f2-fbf0-4108-aea3-d9d115793ab8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044833 Oct 11 06:49:34.530582 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 511/1067] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:34 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:34.800279 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f25bf832-fd02-48b2-9786-28758c14e257 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:34.802468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f25bf832-fd02-48b2-9786-28758c14e257 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:34.809480 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f25bf832-fd02-48b2-9786-28758c14e257 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:34.809951 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f25bf832-fd02-48b2-9786-28758c14e257 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:34.810377 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f25bf832-fd02-48b2-9786-28758c14e257 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:34.811058 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f25bf832-fd02-48b2-9786-28758c14e257 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:34.811530 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f25bf832-fd02-48b2-9786-28758c14e257 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:34.811949 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f25bf832-fd02-48b2-9786-28758c14e257 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:34.840457 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f25bf832-fd02-48b2-9786-28758c14e257 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044080 Oct 11 06:49:34.840996 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 557/1068] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:34 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:35.542462 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c59831e1-e068-4840-86ef-e6e77fc202f4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:35.544651 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c59831e1-e068-4840-86ef-e6e77fc202f4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:35.551347 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c59831e1-e068-4840-86ef-e6e77fc202f4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:35.551875 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c59831e1-e068-4840-86ef-e6e77fc202f4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:35.552336 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c59831e1-e068-4840-86ef-e6e77fc202f4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:35.553030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c59831e1-e068-4840-86ef-e6e77fc202f4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:35.553481 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c59831e1-e068-4840-86ef-e6e77fc202f4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:35.553901 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c59831e1-e068-4840-86ef-e6e77fc202f4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:35.583393 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c59831e1-e068-4840-86ef-e6e77fc202f4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044916 Oct 11 06:49:35.583973 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 512/1069] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:35 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:35.852010 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b40dd367-bac4-44d2-ac2d-04d99eca57e5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:35.854159 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b40dd367-bac4-44d2-ac2d-04d99eca57e5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:35.860539 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b40dd367-bac4-44d2-ac2d-04d99eca57e5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:35.861009 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b40dd367-bac4-44d2-ac2d-04d99eca57e5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:35.861438 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b40dd367-bac4-44d2-ac2d-04d99eca57e5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:35.862195 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b40dd367-bac4-44d2-ac2d-04d99eca57e5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:35.862562 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b40dd367-bac4-44d2-ac2d-04d99eca57e5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:35.862976 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b40dd367-bac4-44d2-ac2d-04d99eca57e5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:35.893055 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b40dd367-bac4-44d2-ac2d-04d99eca57e5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044827 Oct 11 06:49:35.893603 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 558/1070] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:35 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:36.596372 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f8742708-c7b4-4662-a49d-a14cca4ffe5b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:36.598534 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f8742708-c7b4-4662-a49d-a14cca4ffe5b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:36.604969 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f8742708-c7b4-4662-a49d-a14cca4ffe5b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:36.606043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f8742708-c7b4-4662-a49d-a14cca4ffe5b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:36.606477 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f8742708-c7b4-4662-a49d-a14cca4ffe5b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:36.607180 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f8742708-c7b4-4662-a49d-a14cca4ffe5b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:36.607658 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f8742708-c7b4-4662-a49d-a14cca4ffe5b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:36.608080 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f8742708-c7b4-4662-a49d-a14cca4ffe5b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:36.637208 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f8742708-c7b4-4662-a49d-a14cca4ffe5b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044757 Oct 11 06:49:36.637950 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 513/1071] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:36 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:36.905353 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f642e6cf-6c49-48a3-b1c6-c6708f3b8c42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:36.907504 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f642e6cf-6c49-48a3-b1c6-c6708f3b8c42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:36.913847 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f642e6cf-6c49-48a3-b1c6-c6708f3b8c42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:36.914318 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f642e6cf-6c49-48a3-b1c6-c6708f3b8c42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:36.914745 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f642e6cf-6c49-48a3-b1c6-c6708f3b8c42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:36.915448 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f642e6cf-6c49-48a3-b1c6-c6708f3b8c42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:36.915890 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f642e6cf-6c49-48a3-b1c6-c6708f3b8c42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:36.916305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f642e6cf-6c49-48a3-b1c6-c6708f3b8c42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:36.945486 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f642e6cf-6c49-48a3-b1c6-c6708f3b8c42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043990 Oct 11 06:49:36.946023 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 559/1072] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:36 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:37.649885 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f69666fb-5bdb-4984-8b8d-a7dd2c0bb3a9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:37.652599 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f69666fb-5bdb-4984-8b8d-a7dd2c0bb3a9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:37.659098 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f69666fb-5bdb-4984-8b8d-a7dd2c0bb3a9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:37.659628 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f69666fb-5bdb-4984-8b8d-a7dd2c0bb3a9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:37.659941 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f69666fb-5bdb-4984-8b8d-a7dd2c0bb3a9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:37.660642 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f69666fb-5bdb-4984-8b8d-a7dd2c0bb3a9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:37.661097 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f69666fb-5bdb-4984-8b8d-a7dd2c0bb3a9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:37.661528 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f69666fb-5bdb-4984-8b8d-a7dd2c0bb3a9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:37.690691 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f69666fb-5bdb-4984-8b8d-a7dd2c0bb3a9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044660 Oct 11 06:49:37.691379 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 514/1073] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:37 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:37.958475 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a27dd7c2-194e-4d00-a38f-9031ae9f3620 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:37.960954 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a27dd7c2-194e-4d00-a38f-9031ae9f3620 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:37.968065 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a27dd7c2-194e-4d00-a38f-9031ae9f3620 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:37.968537 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a27dd7c2-194e-4d00-a38f-9031ae9f3620 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:37.968964 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a27dd7c2-194e-4d00-a38f-9031ae9f3620 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:37.969651 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a27dd7c2-194e-4d00-a38f-9031ae9f3620 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:37.970091 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a27dd7c2-194e-4d00-a38f-9031ae9f3620 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:37.970510 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a27dd7c2-194e-4d00-a38f-9031ae9f3620 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:37.999324 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a27dd7c2-194e-4d00-a38f-9031ae9f3620 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045147 Oct 11 06:49:37.999886 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 560/1074] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:37 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:38.703442 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6f37dd56-bc45-4429-bba5-bbd042518403 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:38.705486 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6f37dd56-bc45-4429-bba5-bbd042518403 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:38.711865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6f37dd56-bc45-4429-bba5-bbd042518403 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:38.712345 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6f37dd56-bc45-4429-bba5-bbd042518403 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:38.713216 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6f37dd56-bc45-4429-bba5-bbd042518403 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:38.713452 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6f37dd56-bc45-4429-bba5-bbd042518403 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:38.713902 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6f37dd56-bc45-4429-bba5-bbd042518403 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:38.714829 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6f37dd56-bc45-4429-bba5-bbd042518403 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:38.744920 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6f37dd56-bc45-4429-bba5-bbd042518403 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045491 Oct 11 06:49:38.745487 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 515/1075] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:38 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:39.012871 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-80a1e50e-b648-4e23-8549-7b17007879f3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:39.015226 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-80a1e50e-b648-4e23-8549-7b17007879f3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:39.021877 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-80a1e50e-b648-4e23-8549-7b17007879f3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:39.022216 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-80a1e50e-b648-4e23-8549-7b17007879f3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:39.022647 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-80a1e50e-b648-4e23-8549-7b17007879f3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:39.023336 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-80a1e50e-b648-4e23-8549-7b17007879f3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:39.023799 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-80a1e50e-b648-4e23-8549-7b17007879f3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:39.024205 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-80a1e50e-b648-4e23-8549-7b17007879f3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:39.054427 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-80a1e50e-b648-4e23-8549-7b17007879f3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046353 Oct 11 06:49:39.054983 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 561/1076] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:39 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:39.757689 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e8ebe363-a0f2-4d64-bf05-d7df52633b7b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:39.759758 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e8ebe363-a0f2-4d64-bf05-d7df52633b7b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:39.762547 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=58 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:49:39.767864 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e8ebe363-a0f2-4d64-bf05-d7df52633b7b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:39.768356 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e8ebe363-a0f2-4d64-bf05-d7df52633b7b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:39.768794 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e8ebe363-a0f2-4d64-bf05-d7df52633b7b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:39.769491 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e8ebe363-a0f2-4d64-bf05-d7df52633b7b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:39.770598 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e8ebe363-a0f2-4d64-bf05-d7df52633b7b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:39.770598 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e8ebe363-a0f2-4d64-bf05-d7df52633b7b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:39.800600 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e8ebe363-a0f2-4d64-bf05-d7df52633b7b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047029 Oct 11 06:49:39.801156 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 516/1077] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:39 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:40.066103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7980f3af-aded-4414-87f7-66c05846b5bb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:40.068305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7980f3af-aded-4414-87f7-66c05846b5bb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:40.075277 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7980f3af-aded-4414-87f7-66c05846b5bb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:40.075787 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7980f3af-aded-4414-87f7-66c05846b5bb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:40.076223 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7980f3af-aded-4414-87f7-66c05846b5bb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:40.076917 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7980f3af-aded-4414-87f7-66c05846b5bb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:40.077360 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7980f3af-aded-4414-87f7-66c05846b5bb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:40.077783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7980f3af-aded-4414-87f7-66c05846b5bb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:40.107722 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7980f3af-aded-4414-87f7-66c05846b5bb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045533 Oct 11 06:49:40.108271 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 562/1078] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:40 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:40.813407 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-55dc8778-6eef-4c67-a21e-fc553866ef0e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:40.815644 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-55dc8778-6eef-4c67-a21e-fc553866ef0e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:40.822009 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-55dc8778-6eef-4c67-a21e-fc553866ef0e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:40.822490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-55dc8778-6eef-4c67-a21e-fc553866ef0e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:40.822924 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-55dc8778-6eef-4c67-a21e-fc553866ef0e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:40.824169 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-55dc8778-6eef-4c67-a21e-fc553866ef0e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:40.824614 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-55dc8778-6eef-4c67-a21e-fc553866ef0e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:40.825039 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-55dc8778-6eef-4c67-a21e-fc553866ef0e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:40.855027 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-55dc8778-6eef-4c67-a21e-fc553866ef0e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045660 Oct 11 06:49:40.855603 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 517/1079] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:40 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:41.119674 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6ab6e8a5-cee9-46dd-bd91-c121a1359f61 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:41.122319 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6ab6e8a5-cee9-46dd-bd91-c121a1359f61 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:41.128668 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6ab6e8a5-cee9-46dd-bd91-c121a1359f61 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:41.129145 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6ab6e8a5-cee9-46dd-bd91-c121a1359f61 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:41.129576 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6ab6e8a5-cee9-46dd-bd91-c121a1359f61 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:41.130285 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6ab6e8a5-cee9-46dd-bd91-c121a1359f61 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:41.130673 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6ab6e8a5-cee9-46dd-bd91-c121a1359f61 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:41.131081 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6ab6e8a5-cee9-46dd-bd91-c121a1359f61 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:41.165007 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6ab6e8a5-cee9-46dd-bd91-c121a1359f61 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049208 Oct 11 06:49:41.165558 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 563/1080] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:41 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:41.866705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e6484418-ddcf-4d2a-a052-a86d8cbe7b78 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:41.868865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e6484418-ddcf-4d2a-a052-a86d8cbe7b78 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:41.875281 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e6484418-ddcf-4d2a-a052-a86d8cbe7b78 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:41.875800 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e6484418-ddcf-4d2a-a052-a86d8cbe7b78 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:41.876244 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e6484418-ddcf-4d2a-a052-a86d8cbe7b78 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:41.876943 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e6484418-ddcf-4d2a-a052-a86d8cbe7b78 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:41.877397 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e6484418-ddcf-4d2a-a052-a86d8cbe7b78 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:41.877821 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e6484418-ddcf-4d2a-a052-a86d8cbe7b78 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:41.908050 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e6484418-ddcf-4d2a-a052-a86d8cbe7b78 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045299 Oct 11 06:49:41.908603 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 518/1081] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:41 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:42.190492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ef8d2d0a-daf3-499e-85d4-ed2507606753 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:42.192657 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ef8d2d0a-daf3-499e-85d4-ed2507606753 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:42.199640 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef8d2d0a-daf3-499e-85d4-ed2507606753 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:42.200109 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef8d2d0a-daf3-499e-85d4-ed2507606753 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:42.200541 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef8d2d0a-daf3-499e-85d4-ed2507606753 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:42.201214 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef8d2d0a-daf3-499e-85d4-ed2507606753 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:42.201653 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef8d2d0a-daf3-499e-85d4-ed2507606753 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:42.202069 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef8d2d0a-daf3-499e-85d4-ed2507606753 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:42.233609 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ef8d2d0a-daf3-499e-85d4-ed2507606753 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060359 Oct 11 06:49:42.234345 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 564/1082] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:42 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:42.921065 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6ec0d43c-b2a2-4e16-b019-14dc21e6cfe3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:42.923195 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6ec0d43c-b2a2-4e16-b019-14dc21e6cfe3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:42.929756 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ec0d43c-b2a2-4e16-b019-14dc21e6cfe3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:42.930227 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ec0d43c-b2a2-4e16-b019-14dc21e6cfe3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:42.930653 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ec0d43c-b2a2-4e16-b019-14dc21e6cfe3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:42.931333 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ec0d43c-b2a2-4e16-b019-14dc21e6cfe3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:42.931802 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ec0d43c-b2a2-4e16-b019-14dc21e6cfe3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:42.932218 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ec0d43c-b2a2-4e16-b019-14dc21e6cfe3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:42.962493 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6ec0d43c-b2a2-4e16-b019-14dc21e6cfe3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045749 Oct 11 06:49:42.963060 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 519/1083] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:42 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:43.245350 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7f7a5b95-145f-46c4-853b-0fc6bb70c1b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:43.247496 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7f7a5b95-145f-46c4-853b-0fc6bb70c1b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:43.253930 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7f7a5b95-145f-46c4-853b-0fc6bb70c1b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:43.254407 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7f7a5b95-145f-46c4-853b-0fc6bb70c1b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:43.254842 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7f7a5b95-145f-46c4-853b-0fc6bb70c1b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:43.255557 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7f7a5b95-145f-46c4-853b-0fc6bb70c1b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:43.256003 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7f7a5b95-145f-46c4-853b-0fc6bb70c1b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:43.256419 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7f7a5b95-145f-46c4-853b-0fc6bb70c1b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:43.285313 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7f7a5b95-145f-46c4-853b-0fc6bb70c1b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044128 Oct 11 06:49:43.285848 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 565/1084] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:43 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:43.974947 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-19c39944-8124-45e9-9c1c-b531dd5ff4a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:43.977108 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-19c39944-8124-45e9-9c1c-b531dd5ff4a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:43.984110 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-19c39944-8124-45e9-9c1c-b531dd5ff4a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:43.984586 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-19c39944-8124-45e9-9c1c-b531dd5ff4a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:43.985015 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-19c39944-8124-45e9-9c1c-b531dd5ff4a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:43.985702 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-19c39944-8124-45e9-9c1c-b531dd5ff4a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:43.986153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-19c39944-8124-45e9-9c1c-b531dd5ff4a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:43.986570 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-19c39944-8124-45e9-9c1c-b531dd5ff4a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:44.015879 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-19c39944-8124-45e9-9c1c-b531dd5ff4a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044893 Oct 11 06:49:44.016436 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 520/1085] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:43 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:44.297540 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fba67a32-480f-42eb-a11e-028368a1452b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:44.299691 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fba67a32-480f-42eb-a11e-028368a1452b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:44.306048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fba67a32-480f-42eb-a11e-028368a1452b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:44.306523 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fba67a32-480f-42eb-a11e-028368a1452b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:44.307178 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fba67a32-480f-42eb-a11e-028368a1452b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:44.307894 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fba67a32-480f-42eb-a11e-028368a1452b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:44.308339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fba67a32-480f-42eb-a11e-028368a1452b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:44.308757 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fba67a32-480f-42eb-a11e-028368a1452b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:44.337517 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fba67a32-480f-42eb-a11e-028368a1452b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043912 Oct 11 06:49:44.338055 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 566/1086] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:44 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:45.028711 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c3a50df7-5683-4ae8-ad62-515c1ecc5ed4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:45.030904 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c3a50df7-5683-4ae8-ad62-515c1ecc5ed4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:45.037313 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c3a50df7-5683-4ae8-ad62-515c1ecc5ed4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:45.037794 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c3a50df7-5683-4ae8-ad62-515c1ecc5ed4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:45.038262 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c3a50df7-5683-4ae8-ad62-515c1ecc5ed4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:45.038951 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c3a50df7-5683-4ae8-ad62-515c1ecc5ed4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:45.039402 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c3a50df7-5683-4ae8-ad62-515c1ecc5ed4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:45.039858 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c3a50df7-5683-4ae8-ad62-515c1ecc5ed4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:45.069831 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c3a50df7-5683-4ae8-ad62-515c1ecc5ed4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045070 Oct 11 06:49:45.070525 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 521/1087] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:45 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:45.349993 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6b13008b-036e-4d4c-b86d-4298b25051db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:45.352190 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6b13008b-036e-4d4c-b86d-4298b25051db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:45.359156 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6b13008b-036e-4d4c-b86d-4298b25051db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:45.359745 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6b13008b-036e-4d4c-b86d-4298b25051db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:45.360177 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6b13008b-036e-4d4c-b86d-4298b25051db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:45.360875 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6b13008b-036e-4d4c-b86d-4298b25051db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:45.361320 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6b13008b-036e-4d4c-b86d-4298b25051db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:45.361736 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6b13008b-036e-4d4c-b86d-4298b25051db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:45.390884 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6b13008b-036e-4d4c-b86d-4298b25051db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044707 Oct 11 06:49:45.391685 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 567/1088] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:45 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:46.082539 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-69186e36-8262-46c3-8367-19b91ef939cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:46.084673 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-69186e36-8262-46c3-8367-19b91ef939cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:46.091802 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-69186e36-8262-46c3-8367-19b91ef939cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:46.092278 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-69186e36-8262-46c3-8367-19b91ef939cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:46.092707 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-69186e36-8262-46c3-8367-19b91ef939cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:46.093386 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-69186e36-8262-46c3-8367-19b91ef939cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:46.093835 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-69186e36-8262-46c3-8367-19b91ef939cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:46.094250 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-69186e36-8262-46c3-8367-19b91ef939cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:46.123211 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-69186e36-8262-46c3-8367-19b91ef939cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044587 Oct 11 06:49:46.123770 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 522/1089] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:46 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:46.403682 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d0d225c6-88ad-46a8-a9f2-324b1261462e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:46.405863 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d0d225c6-88ad-46a8-a9f2-324b1261462e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:46.412667 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0d225c6-88ad-46a8-a9f2-324b1261462e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:46.413128 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0d225c6-88ad-46a8-a9f2-324b1261462e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:46.413555 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0d225c6-88ad-46a8-a9f2-324b1261462e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:46.414243 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0d225c6-88ad-46a8-a9f2-324b1261462e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:46.414733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0d225c6-88ad-46a8-a9f2-324b1261462e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:46.415158 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0d225c6-88ad-46a8-a9f2-324b1261462e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:46.443915 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d0d225c6-88ad-46a8-a9f2-324b1261462e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044310 Oct 11 06:49:46.444460 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 568/1090] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:46 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:47.135823 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-00adc4c8-1d7f-4683-b427-3c1c50b5b29d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:47.137932 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-00adc4c8-1d7f-4683-b427-3c1c50b5b29d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:47.144358 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-00adc4c8-1d7f-4683-b427-3c1c50b5b29d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:47.145101 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-00adc4c8-1d7f-4683-b427-3c1c50b5b29d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:47.145533 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-00adc4c8-1d7f-4683-b427-3c1c50b5b29d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:47.146221 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-00adc4c8-1d7f-4683-b427-3c1c50b5b29d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:47.146670 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-00adc4c8-1d7f-4683-b427-3c1c50b5b29d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:47.147091 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-00adc4c8-1d7f-4683-b427-3c1c50b5b29d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:47.176976 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-00adc4c8-1d7f-4683-b427-3c1c50b5b29d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045307 Oct 11 06:49:47.177532 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 523/1091] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:47 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:47.456632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0ef55ea4-6466-47c0-8b89-a36473c30fd3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:47.458871 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0ef55ea4-6466-47c0-8b89-a36473c30fd3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:47.465947 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0ef55ea4-6466-47c0-8b89-a36473c30fd3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:47.466425 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0ef55ea4-6466-47c0-8b89-a36473c30fd3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:47.466856 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0ef55ea4-6466-47c0-8b89-a36473c30fd3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:47.467577 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0ef55ea4-6466-47c0-8b89-a36473c30fd3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:47.468022 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0ef55ea4-6466-47c0-8b89-a36473c30fd3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:47.468437 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0ef55ea4-6466-47c0-8b89-a36473c30fd3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:47.492369 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:49:47.497491 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0ef55ea4-6466-47c0-8b89-a36473c30fd3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044801 Oct 11 06:49:47.498030 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 569/1092] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:47 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:48.190184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-23b12481-e8bd-4c5a-a2dc-8e8afd5073dc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:48.192413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-23b12481-e8bd-4c5a-a2dc-8e8afd5073dc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:48.198901 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23b12481-e8bd-4c5a-a2dc-8e8afd5073dc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:48.199374 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23b12481-e8bd-4c5a-a2dc-8e8afd5073dc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:48.199826 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23b12481-e8bd-4c5a-a2dc-8e8afd5073dc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:48.200508 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23b12481-e8bd-4c5a-a2dc-8e8afd5073dc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:48.200956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23b12481-e8bd-4c5a-a2dc-8e8afd5073dc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:48.201373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23b12481-e8bd-4c5a-a2dc-8e8afd5073dc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:48.230400 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-23b12481-e8bd-4c5a-a2dc-8e8afd5073dc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044294 Oct 11 06:49:48.230947 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 524/1093] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:48 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:48.509313 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-eed65e9d-9560-43bd-8e47-4b4d8af7cf41 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:48.512324 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-eed65e9d-9560-43bd-8e47-4b4d8af7cf41 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:48.519091 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eed65e9d-9560-43bd-8e47-4b4d8af7cf41 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:48.519870 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eed65e9d-9560-43bd-8e47-4b4d8af7cf41 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:48.520304 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eed65e9d-9560-43bd-8e47-4b4d8af7cf41 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:48.520987 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eed65e9d-9560-43bd-8e47-4b4d8af7cf41 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:48.521431 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eed65e9d-9560-43bd-8e47-4b4d8af7cf41 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:48.521847 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eed65e9d-9560-43bd-8e47-4b4d8af7cf41 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:48.550088 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-eed65e9d-9560-43bd-8e47-4b4d8af7cf41 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044733 Oct 11 06:49:48.550631 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 570/1094] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:48 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:49.242880 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e7be503a-a918-4e54-989c-f0a2e10e9130 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:49.244968 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e7be503a-a918-4e54-989c-f0a2e10e9130 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:49.251340 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7be503a-a918-4e54-989c-f0a2e10e9130 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:49.251844 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7be503a-a918-4e54-989c-f0a2e10e9130 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:49.252275 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7be503a-a918-4e54-989c-f0a2e10e9130 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:49.252957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7be503a-a918-4e54-989c-f0a2e10e9130 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:49.253407 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7be503a-a918-4e54-989c-f0a2e10e9130 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:49.253822 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7be503a-a918-4e54-989c-f0a2e10e9130 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:49.282661 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e7be503a-a918-4e54-989c-f0a2e10e9130 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043807 Oct 11 06:49:49.283207 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 525/1095] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:49 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:49.562248 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8aedd0ea-6b2e-4dbd-a073-ba3bcfeb8787 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:49.564534 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8aedd0ea-6b2e-4dbd-a073-ba3bcfeb8787 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:49.571022 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8aedd0ea-6b2e-4dbd-a073-ba3bcfeb8787 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:49.571457 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8aedd0ea-6b2e-4dbd-a073-ba3bcfeb8787 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:49.571896 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8aedd0ea-6b2e-4dbd-a073-ba3bcfeb8787 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:49.572588 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8aedd0ea-6b2e-4dbd-a073-ba3bcfeb8787 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:49.573528 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8aedd0ea-6b2e-4dbd-a073-ba3bcfeb8787 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:49.573943 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8aedd0ea-6b2e-4dbd-a073-ba3bcfeb8787 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:49.603117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8aedd0ea-6b2e-4dbd-a073-ba3bcfeb8787 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044941 Oct 11 06:49:49.604299 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 571/1096] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:49 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:50.295657 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-615754e3-ccb1-477d-af36-9676d907c21e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:50.297767 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-615754e3-ccb1-477d-af36-9676d907c21e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:50.304136 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-615754e3-ccb1-477d-af36-9676d907c21e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:50.304610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-615754e3-ccb1-477d-af36-9676d907c21e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:50.305037 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-615754e3-ccb1-477d-af36-9676d907c21e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:50.305714 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-615754e3-ccb1-477d-af36-9676d907c21e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:50.306159 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-615754e3-ccb1-477d-af36-9676d907c21e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:50.306574 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-615754e3-ccb1-477d-af36-9676d907c21e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:50.337835 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-615754e3-ccb1-477d-af36-9676d907c21e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046681 Oct 11 06:49:50.338380 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 526/1097] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:50 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:50.616229 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0a4f3e62-ca21-405d-8332-e6d78e9fa643 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:50.618437 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0a4f3e62-ca21-405d-8332-e6d78e9fa643 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:50.624916 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0a4f3e62-ca21-405d-8332-e6d78e9fa643 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:50.625476 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0a4f3e62-ca21-405d-8332-e6d78e9fa643 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:50.625982 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0a4f3e62-ca21-405d-8332-e6d78e9fa643 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:50.626711 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0a4f3e62-ca21-405d-8332-e6d78e9fa643 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:50.627163 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0a4f3e62-ca21-405d-8332-e6d78e9fa643 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:50.627625 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0a4f3e62-ca21-405d-8332-e6d78e9fa643 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:50.657063 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0a4f3e62-ca21-405d-8332-e6d78e9fa643 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045026 Oct 11 06:49:50.657607 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 572/1098] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:50 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:51.350223 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-76d0d542-4ddf-4204-94a4-9572f621809b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:51.352392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-76d0d542-4ddf-4204-94a4-9572f621809b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:51.358626 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-76d0d542-4ddf-4204-94a4-9572f621809b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:51.359104 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-76d0d542-4ddf-4204-94a4-9572f621809b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:51.359580 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-76d0d542-4ddf-4204-94a4-9572f621809b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:51.360270 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-76d0d542-4ddf-4204-94a4-9572f621809b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:51.360744 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-76d0d542-4ddf-4204-94a4-9572f621809b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:51.361164 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-76d0d542-4ddf-4204-94a4-9572f621809b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:51.377764 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:49:51.391495 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-76d0d542-4ddf-4204-94a4-9572f621809b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045246 Oct 11 06:49:51.392033 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 527/1099] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:51 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:51.669585 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-873ffc7b-88e4-42af-bf6b-38a564a11e50 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:51.671727 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-873ffc7b-88e4-42af-bf6b-38a564a11e50 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:51.677737 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-873ffc7b-88e4-42af-bf6b-38a564a11e50 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:51.678219 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-873ffc7b-88e4-42af-bf6b-38a564a11e50 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:51.678653 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-873ffc7b-88e4-42af-bf6b-38a564a11e50 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:51.679446 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-873ffc7b-88e4-42af-bf6b-38a564a11e50 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:51.679934 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-873ffc7b-88e4-42af-bf6b-38a564a11e50 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:51.680357 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-873ffc7b-88e4-42af-bf6b-38a564a11e50 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:51.711102 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-873ffc7b-88e4-42af-bf6b-38a564a11e50 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045583 Oct 11 06:49:51.711694 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 573/1100] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:51 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:52.404744 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-76cbcef0-a21c-45e8-b4c9-4de44cee2436 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:52.406873 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-76cbcef0-a21c-45e8-b4c9-4de44cee2436 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:52.413352 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-76cbcef0-a21c-45e8-b4c9-4de44cee2436 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:52.413831 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-76cbcef0-a21c-45e8-b4c9-4de44cee2436 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:52.414261 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-76cbcef0-a21c-45e8-b4c9-4de44cee2436 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:52.414957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-76cbcef0-a21c-45e8-b4c9-4de44cee2436 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:52.415407 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-76cbcef0-a21c-45e8-b4c9-4de44cee2436 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:52.415846 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-76cbcef0-a21c-45e8-b4c9-4de44cee2436 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:52.445185 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-76cbcef0-a21c-45e8-b4c9-4de44cee2436 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044917 Oct 11 06:49:52.445721 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 528/1101] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:52 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:52.736739 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a64c29bb-2b27-45e3-a750-3afa9d6e2e9e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:52.738878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a64c29bb-2b27-45e3-a750-3afa9d6e2e9e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:52.745242 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a64c29bb-2b27-45e3-a750-3afa9d6e2e9e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:52.745757 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a64c29bb-2b27-45e3-a750-3afa9d6e2e9e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:52.746187 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a64c29bb-2b27-45e3-a750-3afa9d6e2e9e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:52.746884 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a64c29bb-2b27-45e3-a750-3afa9d6e2e9e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:52.747330 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a64c29bb-2b27-45e3-a750-3afa9d6e2e9e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:52.747779 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a64c29bb-2b27-45e3-a750-3afa9d6e2e9e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:52.921704 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a64c29bb-2b27-45e3-a750-3afa9d6e2e9e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.202410 Oct 11 06:49:52.922318 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 574/1102] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:52 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:53.457489 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5dccd327-015a-40d0-b309-1e1b95539cc3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:53.459632 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5dccd327-015a-40d0-b309-1e1b95539cc3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:53.465878 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5dccd327-015a-40d0-b309-1e1b95539cc3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:53.466351 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5dccd327-015a-40d0-b309-1e1b95539cc3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:53.466776 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5dccd327-015a-40d0-b309-1e1b95539cc3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:53.467479 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5dccd327-015a-40d0-b309-1e1b95539cc3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:53.467927 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5dccd327-015a-40d0-b309-1e1b95539cc3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:53.468342 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5dccd327-015a-40d0-b309-1e1b95539cc3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:53.498708 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5dccd327-015a-40d0-b309-1e1b95539cc3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045077 Oct 11 06:49:53.499241 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 529/1103] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:53 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:53.934557 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b10ffc78-7d53-4d81-954e-2c75d6776fce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:53.936660 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b10ffc78-7d53-4d81-954e-2c75d6776fce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:53.942902 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b10ffc78-7d53-4d81-954e-2c75d6776fce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:53.943369 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b10ffc78-7d53-4d81-954e-2c75d6776fce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:53.943820 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b10ffc78-7d53-4d81-954e-2c75d6776fce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:53.944499 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b10ffc78-7d53-4d81-954e-2c75d6776fce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:53.944934 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b10ffc78-7d53-4d81-954e-2c75d6776fce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:53.945343 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b10ffc78-7d53-4d81-954e-2c75d6776fce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:53.974616 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b10ffc78-7d53-4d81-954e-2c75d6776fce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044451 Oct 11 06:49:53.975090 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 575/1104] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:53 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:54.511446 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5a89032e-743d-4879-9885-ab42427ca4dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:54.513567 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5a89032e-743d-4879-9885-ab42427ca4dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:54.520249 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a89032e-743d-4879-9885-ab42427ca4dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:54.520727 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a89032e-743d-4879-9885-ab42427ca4dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:54.521155 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a89032e-743d-4879-9885-ab42427ca4dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:54.521841 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a89032e-743d-4879-9885-ab42427ca4dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:54.522290 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a89032e-743d-4879-9885-ab42427ca4dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:54.522712 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a89032e-743d-4879-9885-ab42427ca4dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:54.551948 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5a89032e-743d-4879-9885-ab42427ca4dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044512 Oct 11 06:49:54.552485 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 530/1105] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:54 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:54.986792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0661bc44-9e3e-40e6-a17a-4189712f262d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:54.988932 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0661bc44-9e3e-40e6-a17a-4189712f262d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:54.995172 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0661bc44-9e3e-40e6-a17a-4189712f262d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:54.995684 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0661bc44-9e3e-40e6-a17a-4189712f262d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:54.996113 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0661bc44-9e3e-40e6-a17a-4189712f262d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:54.996790 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0661bc44-9e3e-40e6-a17a-4189712f262d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:54.997232 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0661bc44-9e3e-40e6-a17a-4189712f262d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:54.997647 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0661bc44-9e3e-40e6-a17a-4189712f262d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:55.027244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0661bc44-9e3e-40e6-a17a-4189712f262d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044245 Oct 11 06:49:55.027740 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 576/1106] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:54 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:55.564419 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-51169e7b-65bb-4705-ac87-7d3acac5f139 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:55.566536 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-51169e7b-65bb-4705-ac87-7d3acac5f139 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:55.573592 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-51169e7b-65bb-4705-ac87-7d3acac5f139 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:55.574067 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-51169e7b-65bb-4705-ac87-7d3acac5f139 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:55.574497 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-51169e7b-65bb-4705-ac87-7d3acac5f139 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:55.575182 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-51169e7b-65bb-4705-ac87-7d3acac5f139 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:55.575658 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-51169e7b-65bb-4705-ac87-7d3acac5f139 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:55.576079 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-51169e7b-65bb-4705-ac87-7d3acac5f139 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:55.605238 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-51169e7b-65bb-4705-ac87-7d3acac5f139 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044782 Oct 11 06:49:55.605778 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 531/1107] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:55 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:56.038833 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e9a1f38d-c046-4bb8-81fe-c129277f097c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:56.040946 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e9a1f38d-c046-4bb8-81fe-c129277f097c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:56.047911 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e9a1f38d-c046-4bb8-81fe-c129277f097c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:56.048388 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e9a1f38d-c046-4bb8-81fe-c129277f097c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:56.048819 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e9a1f38d-c046-4bb8-81fe-c129277f097c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:56.049501 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e9a1f38d-c046-4bb8-81fe-c129277f097c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:56.049948 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e9a1f38d-c046-4bb8-81fe-c129277f097c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:56.050368 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e9a1f38d-c046-4bb8-81fe-c129277f097c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:56.084817 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e9a1f38d-c046-4bb8-81fe-c129277f097c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049941 Oct 11 06:49:56.085363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 577/1108] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:56 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:56.617712 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c8f1478c-8d5e-4991-955b-86ce7a00963a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:56.620390 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c8f1478c-8d5e-4991-955b-86ce7a00963a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:56.626779 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8f1478c-8d5e-4991-955b-86ce7a00963a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:56.627253 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8f1478c-8d5e-4991-955b-86ce7a00963a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:56.627713 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8f1478c-8d5e-4991-955b-86ce7a00963a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:56.628391 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8f1478c-8d5e-4991-955b-86ce7a00963a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:56.628829 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8f1478c-8d5e-4991-955b-86ce7a00963a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:56.629241 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8f1478c-8d5e-4991-955b-86ce7a00963a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:56.658128 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c8f1478c-8d5e-4991-955b-86ce7a00963a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044328 Oct 11 06:49:56.658600 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 532/1109] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:56 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:57.098132 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9e8789de-ce27-45c0-afd0-0a2d8a40a369 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:57.100307 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9e8789de-ce27-45c0-afd0-0a2d8a40a369 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:57.102580 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=58 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:49:57.108648 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e8789de-ce27-45c0-afd0-0a2d8a40a369 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:57.109131 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e8789de-ce27-45c0-afd0-0a2d8a40a369 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:57.109576 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e8789de-ce27-45c0-afd0-0a2d8a40a369 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:57.110271 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e8789de-ce27-45c0-afd0-0a2d8a40a369 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:57.110722 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e8789de-ce27-45c0-afd0-0a2d8a40a369 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:57.111144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e8789de-ce27-45c0-afd0-0a2d8a40a369 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:57.140190 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9e8789de-ce27-45c0-afd0-0a2d8a40a369 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045993 Oct 11 06:49:57.140737 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 578/1110] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:57 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:57.671126 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b3130744-d8b9-46cc-954e-9d77cde0a578 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:57.673275 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b3130744-d8b9-46cc-954e-9d77cde0a578 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:57.679590 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b3130744-d8b9-46cc-954e-9d77cde0a578 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:57.680062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b3130744-d8b9-46cc-954e-9d77cde0a578 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:57.680486 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b3130744-d8b9-46cc-954e-9d77cde0a578 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:57.681163 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b3130744-d8b9-46cc-954e-9d77cde0a578 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:57.681605 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b3130744-d8b9-46cc-954e-9d77cde0a578 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:57.682017 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b3130744-d8b9-46cc-954e-9d77cde0a578 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:57.709763 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b3130744-d8b9-46cc-954e-9d77cde0a578 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043119 Oct 11 06:49:57.710287 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 533/1111] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:57 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:58.152416 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f5e3a12f-d2d0-40fc-94d8-3709c8a7f37c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:58.154543 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f5e3a12f-d2d0-40fc-94d8-3709c8a7f37c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:58.161445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f5e3a12f-d2d0-40fc-94d8-3709c8a7f37c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:58.161946 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f5e3a12f-d2d0-40fc-94d8-3709c8a7f37c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:58.162366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f5e3a12f-d2d0-40fc-94d8-3709c8a7f37c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:58.163055 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f5e3a12f-d2d0-40fc-94d8-3709c8a7f37c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:58.163531 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f5e3a12f-d2d0-40fc-94d8-3709c8a7f37c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:58.163956 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f5e3a12f-d2d0-40fc-94d8-3709c8a7f37c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:58.193021 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f5e3a12f-d2d0-40fc-94d8-3709c8a7f37c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045011 Oct 11 06:49:58.193491 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 579/1112] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:58 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:58.722298 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-350210d6-3bd2-4935-b297-0e9ec88dec32 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:58.724517 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-350210d6-3bd2-4935-b297-0e9ec88dec32 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:58.731336 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-350210d6-3bd2-4935-b297-0e9ec88dec32 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:58.731853 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-350210d6-3bd2-4935-b297-0e9ec88dec32 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:58.732290 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-350210d6-3bd2-4935-b297-0e9ec88dec32 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:58.732988 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-350210d6-3bd2-4935-b297-0e9ec88dec32 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:58.733441 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-350210d6-3bd2-4935-b297-0e9ec88dec32 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:58.733865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-350210d6-3bd2-4935-b297-0e9ec88dec32 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:58.763153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-350210d6-3bd2-4935-b297-0e9ec88dec32 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044931 Oct 11 06:49:58.763727 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 534/1113] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:58 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:49:59.204743 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-03c87794-0ef6-4a83-b324-9d3c8195ad7f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:59.206878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-03c87794-0ef6-4a83-b324-9d3c8195ad7f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:59.214076 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-03c87794-0ef6-4a83-b324-9d3c8195ad7f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:59.214557 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-03c87794-0ef6-4a83-b324-9d3c8195ad7f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:59.214986 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-03c87794-0ef6-4a83-b324-9d3c8195ad7f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:59.215697 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-03c87794-0ef6-4a83-b324-9d3c8195ad7f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:59.216145 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-03c87794-0ef6-4a83-b324-9d3c8195ad7f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:59.216568 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-03c87794-0ef6-4a83-b324-9d3c8195ad7f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:59.247577 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-03c87794-0ef6-4a83-b324-9d3c8195ad7f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046645 Oct 11 06:49:59.248050 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 580/1114] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:49:59 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:49:59.776000 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-92c0ad4d-b52b-47e8-b8a5-f7bade6cb1ce tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:49:59.778129 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-92c0ad4d-b52b-47e8-b8a5-f7bade6cb1ce tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:49:59.784524 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-92c0ad4d-b52b-47e8-b8a5-f7bade6cb1ce tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:59.784999 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-92c0ad4d-b52b-47e8-b8a5-f7bade6cb1ce tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:59.785430 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-92c0ad4d-b52b-47e8-b8a5-f7bade6cb1ce tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:59.786123 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-92c0ad4d-b52b-47e8-b8a5-f7bade6cb1ce tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:49:59.786574 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-92c0ad4d-b52b-47e8-b8a5-f7bade6cb1ce tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:49:59.786998 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-92c0ad4d-b52b-47e8-b8a5-f7bade6cb1ce tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:49:59.816022 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-92c0ad4d-b52b-47e8-b8a5-f7bade6cb1ce tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044012 Oct 11 06:49:59.816568 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 535/1115] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:49:59 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:00.259917 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a395364f-25a0-42b6-b44b-311d0f4733ab tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:00.262037 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a395364f-25a0-42b6-b44b-311d0f4733ab tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:00.268408 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a395364f-25a0-42b6-b44b-311d0f4733ab tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:00.268891 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a395364f-25a0-42b6-b44b-311d0f4733ab tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:00.269586 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a395364f-25a0-42b6-b44b-311d0f4733ab tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:00.270284 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a395364f-25a0-42b6-b44b-311d0f4733ab tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:00.270733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a395364f-25a0-42b6-b44b-311d0f4733ab tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:00.271155 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a395364f-25a0-42b6-b44b-311d0f4733ab tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:00.299962 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a395364f-25a0-42b6-b44b-311d0f4733ab tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044117 Oct 11 06:50:00.300497 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 581/1116] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:00 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:00.828426 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-780c23a3-09bc-4ff4-8f9d-266f5ac6ff55 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:00.830523 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-780c23a3-09bc-4ff4-8f9d-266f5ac6ff55 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:00.836930 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-780c23a3-09bc-4ff4-8f9d-266f5ac6ff55 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:00.837404 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-780c23a3-09bc-4ff4-8f9d-266f5ac6ff55 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:00.837897 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-780c23a3-09bc-4ff4-8f9d-266f5ac6ff55 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:00.839116 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-780c23a3-09bc-4ff4-8f9d-266f5ac6ff55 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:00.839591 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-780c23a3-09bc-4ff4-8f9d-266f5ac6ff55 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:00.840010 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-780c23a3-09bc-4ff4-8f9d-266f5ac6ff55 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:00.868075 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-780c23a3-09bc-4ff4-8f9d-266f5ac6ff55 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043724 Oct 11 06:50:00.868607 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 536/1117] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:00 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 06:50:01.312974 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3d83398a-0307-4286-8b05-36470c68e6c3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:01.315199 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3d83398a-0307-4286-8b05-36470c68e6c3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:01.321473 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3d83398a-0307-4286-8b05-36470c68e6c3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:01.321947 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3d83398a-0307-4286-8b05-36470c68e6c3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:01.322945 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3d83398a-0307-4286-8b05-36470c68e6c3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:01.323651 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3d83398a-0307-4286-8b05-36470c68e6c3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:01.324093 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3d83398a-0307-4286-8b05-36470c68e6c3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:01.324506 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3d83398a-0307-4286-8b05-36470c68e6c3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:01.352553 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3d83398a-0307-4286-8b05-36470c68e6c3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043574 Oct 11 06:50:01.353085 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 582/1118] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:01 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:01.880522 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8f5ccc0c-e9be-47e6-9dd4-002d0eb3b1cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:01.882699 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8f5ccc0c-e9be-47e6-9dd4-002d0eb3b1cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:01.889103 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f5ccc0c-e9be-47e6-9dd4-002d0eb3b1cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:01.889585 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f5ccc0c-e9be-47e6-9dd4-002d0eb3b1cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:01.890013 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f5ccc0c-e9be-47e6-9dd4-002d0eb3b1cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:01.890700 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f5ccc0c-e9be-47e6-9dd4-002d0eb3b1cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:01.891174 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f5ccc0c-e9be-47e6-9dd4-002d0eb3b1cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:01.891625 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f5ccc0c-e9be-47e6-9dd4-002d0eb3b1cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:01.921080 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8f5ccc0c-e9be-47e6-9dd4-002d0eb3b1cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044510 Oct 11 06:50:01.921617 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 537/1119] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:01 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 06:50:02.365836 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-97de26cb-b71a-4960-a690-6c84b65e016f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:02.367971 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-97de26cb-b71a-4960-a690-6c84b65e016f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:02.374300 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-97de26cb-b71a-4960-a690-6c84b65e016f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:02.374770 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-97de26cb-b71a-4960-a690-6c84b65e016f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:02.375196 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-97de26cb-b71a-4960-a690-6c84b65e016f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:02.375908 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-97de26cb-b71a-4960-a690-6c84b65e016f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:02.376344 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-97de26cb-b71a-4960-a690-6c84b65e016f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:02.376756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-97de26cb-b71a-4960-a690-6c84b65e016f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:02.406184 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-97de26cb-b71a-4960-a690-6c84b65e016f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044606 Oct 11 06:50:02.406729 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 583/1120] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:02 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:02.933976 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-27db21c0-bc21-4564-8139-2a51405fc069 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:02.936127 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-27db21c0-bc21-4564-8139-2a51405fc069 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:02.942452 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-27db21c0-bc21-4564-8139-2a51405fc069 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:02.942925 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-27db21c0-bc21-4564-8139-2a51405fc069 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:02.943349 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-27db21c0-bc21-4564-8139-2a51405fc069 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:02.944056 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-27db21c0-bc21-4564-8139-2a51405fc069 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:02.944499 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-27db21c0-bc21-4564-8139-2a51405fc069 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:02.944910 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-27db21c0-bc21-4564-8139-2a51405fc069 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:02.973297 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-27db21c0-bc21-4564-8139-2a51405fc069 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043786 Oct 11 06:50:02.973832 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 538/1121] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:02 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:03.418819 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-da475696-3f9c-45fc-a55a-f2fe581f8552 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:03.421024 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-da475696-3f9c-45fc-a55a-f2fe581f8552 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:03.427359 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-da475696-3f9c-45fc-a55a-f2fe581f8552 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:03.427859 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-da475696-3f9c-45fc-a55a-f2fe581f8552 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:03.428284 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-da475696-3f9c-45fc-a55a-f2fe581f8552 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:03.428963 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-da475696-3f9c-45fc-a55a-f2fe581f8552 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:03.429409 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-da475696-3f9c-45fc-a55a-f2fe581f8552 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:03.429822 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-da475696-3f9c-45fc-a55a-f2fe581f8552 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:03.458190 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-da475696-3f9c-45fc-a55a-f2fe581f8552 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043939 Oct 11 06:50:03.458717 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 584/1122] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:03 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:03.985799 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5f61c906-e254-40c6-b3ee-9738a1ca43c6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:03.987861 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5f61c906-e254-40c6-b3ee-9738a1ca43c6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:03.994225 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f61c906-e254-40c6-b3ee-9738a1ca43c6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:03.994706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f61c906-e254-40c6-b3ee-9738a1ca43c6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:03.995142 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f61c906-e254-40c6-b3ee-9738a1ca43c6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:03.995867 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f61c906-e254-40c6-b3ee-9738a1ca43c6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:03.996319 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f61c906-e254-40c6-b3ee-9738a1ca43c6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:03.996742 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f61c906-e254-40c6-b3ee-9738a1ca43c6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:04.026275 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5f61c906-e254-40c6-b3ee-9738a1ca43c6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044534 Oct 11 06:50:04.026810 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 539/1123] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:03 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:04.471062 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c9a9320e-f78d-4be2-95e4-cdd603eec71f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:04.473281 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c9a9320e-f78d-4be2-95e4-cdd603eec71f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:04.480160 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c9a9320e-f78d-4be2-95e4-cdd603eec71f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:04.480632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c9a9320e-f78d-4be2-95e4-cdd603eec71f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:04.481064 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c9a9320e-f78d-4be2-95e4-cdd603eec71f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:04.481748 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c9a9320e-f78d-4be2-95e4-cdd603eec71f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:04.482193 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c9a9320e-f78d-4be2-95e4-cdd603eec71f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:04.482612 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c9a9320e-f78d-4be2-95e4-cdd603eec71f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:04.511329 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c9a9320e-f78d-4be2-95e4-cdd603eec71f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044202 Oct 11 06:50:04.511888 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 585/1124] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:04 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:05.038730 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-dadbf2a8-9964-4fa1-b205-1b0d8786f046 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:05.041477 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-dadbf2a8-9964-4fa1-b205-1b0d8786f046 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:05.047837 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dadbf2a8-9964-4fa1-b205-1b0d8786f046 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:05.048309 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dadbf2a8-9964-4fa1-b205-1b0d8786f046 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:05.048736 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dadbf2a8-9964-4fa1-b205-1b0d8786f046 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:05.049439 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dadbf2a8-9964-4fa1-b205-1b0d8786f046 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:05.049883 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dadbf2a8-9964-4fa1-b205-1b0d8786f046 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:05.050298 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dadbf2a8-9964-4fa1-b205-1b0d8786f046 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:05.078494 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-dadbf2a8-9964-4fa1-b205-1b0d8786f046 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043803 Oct 11 06:50:05.079023 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 540/1125] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:05 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:05.523979 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3f06cf38-ace8-44af-873c-251ad1941ca6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:05.526728 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3f06cf38-ace8-44af-873c-251ad1941ca6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:05.533089 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3f06cf38-ace8-44af-873c-251ad1941ca6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:05.533592 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3f06cf38-ace8-44af-873c-251ad1941ca6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:05.534029 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3f06cf38-ace8-44af-873c-251ad1941ca6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:05.534758 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3f06cf38-ace8-44af-873c-251ad1941ca6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:05.535211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3f06cf38-ace8-44af-873c-251ad1941ca6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:05.535762 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3f06cf38-ace8-44af-873c-251ad1941ca6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:05.551798 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:50:05.565550 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3f06cf38-ace8-44af-873c-251ad1941ca6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045483 Oct 11 06:50:05.566095 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 586/1126] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:05 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:06.091640 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-04d007fe-fcc9-46f3-862f-ceaf359bfe0f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:06.093675 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-04d007fe-fcc9-46f3-862f-ceaf359bfe0f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:06.100024 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-04d007fe-fcc9-46f3-862f-ceaf359bfe0f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:06.100491 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-04d007fe-fcc9-46f3-862f-ceaf359bfe0f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:06.100916 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-04d007fe-fcc9-46f3-862f-ceaf359bfe0f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:06.101589 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-04d007fe-fcc9-46f3-862f-ceaf359bfe0f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:06.102058 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-04d007fe-fcc9-46f3-862f-ceaf359bfe0f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:06.102470 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-04d007fe-fcc9-46f3-862f-ceaf359bfe0f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:06.130767 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-04d007fe-fcc9-46f3-862f-ceaf359bfe0f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043892 Oct 11 06:50:06.131307 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 541/1127] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:06 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:06.578455 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cc44e249-b81b-402a-ae40-14b46c58b176 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:06.580615 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cc44e249-b81b-402a-ae40-14b46c58b176 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:06.587004 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc44e249-b81b-402a-ae40-14b46c58b176 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:06.587571 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc44e249-b81b-402a-ae40-14b46c58b176 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:06.588012 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc44e249-b81b-402a-ae40-14b46c58b176 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:06.588700 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc44e249-b81b-402a-ae40-14b46c58b176 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:06.589152 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc44e249-b81b-402a-ae40-14b46c58b176 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:06.589574 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc44e249-b81b-402a-ae40-14b46c58b176 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:06.617633 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cc44e249-b81b-402a-ae40-14b46c58b176 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043096 Oct 11 06:50:06.618165 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 587/1128] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:06 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:07.143431 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f42c7b9c-22bf-4baa-91a0-9c30ee0cb5ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:07.145816 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f42c7b9c-22bf-4baa-91a0-9c30ee0cb5ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:07.152813 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f42c7b9c-22bf-4baa-91a0-9c30ee0cb5ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:07.153288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f42c7b9c-22bf-4baa-91a0-9c30ee0cb5ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:07.153722 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f42c7b9c-22bf-4baa-91a0-9c30ee0cb5ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:07.154405 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f42c7b9c-22bf-4baa-91a0-9c30ee0cb5ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:07.154851 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f42c7b9c-22bf-4baa-91a0-9c30ee0cb5ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:07.155266 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f42c7b9c-22bf-4baa-91a0-9c30ee0cb5ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:07.184730 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f42c7b9c-22bf-4baa-91a0-9c30ee0cb5ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045227 Oct 11 06:50:07.185205 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 542/1129] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:07 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:07.630283 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a8ba3507-8c25-4c07-a50b-f267f2a8f4ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:07.632415 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a8ba3507-8c25-4c07-a50b-f267f2a8f4ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:07.639183 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a8ba3507-8c25-4c07-a50b-f267f2a8f4ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:07.639685 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a8ba3507-8c25-4c07-a50b-f267f2a8f4ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:07.640110 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a8ba3507-8c25-4c07-a50b-f267f2a8f4ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:07.640821 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a8ba3507-8c25-4c07-a50b-f267f2a8f4ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:07.641260 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a8ba3507-8c25-4c07-a50b-f267f2a8f4ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:07.641669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a8ba3507-8c25-4c07-a50b-f267f2a8f4ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:07.670213 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a8ba3507-8c25-4c07-a50b-f267f2a8f4ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043777 Oct 11 06:50:07.670738 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 588/1130] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:07 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:08.197736 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7974713b-f14a-4b18-8a2d-0fc2bfd6dce8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:08.199985 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7974713b-f14a-4b18-8a2d-0fc2bfd6dce8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:08.206537 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7974713b-f14a-4b18-8a2d-0fc2bfd6dce8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:08.207151 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7974713b-f14a-4b18-8a2d-0fc2bfd6dce8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:08.207647 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7974713b-f14a-4b18-8a2d-0fc2bfd6dce8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:08.208346 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7974713b-f14a-4b18-8a2d-0fc2bfd6dce8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:08.208799 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7974713b-f14a-4b18-8a2d-0fc2bfd6dce8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:08.209259 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7974713b-f14a-4b18-8a2d-0fc2bfd6dce8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:08.239110 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7974713b-f14a-4b18-8a2d-0fc2bfd6dce8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045846 Oct 11 06:50:08.239650 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 543/1131] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:08 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:08.682833 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-267e891d-da69-48bb-b73e-b21204858b16 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:08.684994 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-267e891d-da69-48bb-b73e-b21204858b16 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:08.691352 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-267e891d-da69-48bb-b73e-b21204858b16 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:08.691868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-267e891d-da69-48bb-b73e-b21204858b16 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:08.692292 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-267e891d-da69-48bb-b73e-b21204858b16 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:08.692972 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-267e891d-da69-48bb-b73e-b21204858b16 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:08.693417 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-267e891d-da69-48bb-b73e-b21204858b16 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:08.693841 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-267e891d-da69-48bb-b73e-b21204858b16 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:08.723009 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-267e891d-da69-48bb-b73e-b21204858b16 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044513 Oct 11 06:50:08.723574 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 589/1132] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:08 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:09.251683 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c55fa976-3d4b-4603-9ff4-58e7cf3f3e7c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:09.254085 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c55fa976-3d4b-4603-9ff4-58e7cf3f3e7c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:09.260447 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c55fa976-3d4b-4603-9ff4-58e7cf3f3e7c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:09.260921 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c55fa976-3d4b-4603-9ff4-58e7cf3f3e7c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:09.261357 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c55fa976-3d4b-4603-9ff4-58e7cf3f3e7c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:09.262049 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c55fa976-3d4b-4603-9ff4-58e7cf3f3e7c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:09.262495 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c55fa976-3d4b-4603-9ff4-58e7cf3f3e7c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:09.262912 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c55fa976-3d4b-4603-9ff4-58e7cf3f3e7c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:09.266529 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:50:09.292205 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c55fa976-3d4b-4603-9ff4-58e7cf3f3e7c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044450 Oct 11 06:50:09.292859 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 544/1133] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:09 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:09.735783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-25ca8e29-5ebe-4c8a-82e9-a5087cfea3ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:09.737919 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-25ca8e29-5ebe-4c8a-82e9-a5087cfea3ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:09.744388 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25ca8e29-5ebe-4c8a-82e9-a5087cfea3ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:09.744869 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25ca8e29-5ebe-4c8a-82e9-a5087cfea3ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:09.745307 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25ca8e29-5ebe-4c8a-82e9-a5087cfea3ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:09.745996 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25ca8e29-5ebe-4c8a-82e9-a5087cfea3ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:09.746446 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25ca8e29-5ebe-4c8a-82e9-a5087cfea3ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:09.746870 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25ca8e29-5ebe-4c8a-82e9-a5087cfea3ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:09.777645 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-25ca8e29-5ebe-4c8a-82e9-a5087cfea3ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046297 Oct 11 06:50:09.778186 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 590/1134] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:09 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:10.305379 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-315f532a-2ddc-4513-b0b4-649facfdab2f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:10.307537 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-315f532a-2ddc-4513-b0b4-649facfdab2f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:10.309816 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=58 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:50:10.315663 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-315f532a-2ddc-4513-b0b4-649facfdab2f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:10.316149 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-315f532a-2ddc-4513-b0b4-649facfdab2f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:10.316586 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-315f532a-2ddc-4513-b0b4-649facfdab2f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:10.317284 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-315f532a-2ddc-4513-b0b4-649facfdab2f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:10.317732 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-315f532a-2ddc-4513-b0b4-649facfdab2f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:10.318151 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-315f532a-2ddc-4513-b0b4-649facfdab2f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:10.349097 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-315f532a-2ddc-4513-b0b4-649facfdab2f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047670 Oct 11 06:50:10.349646 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 545/1135] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:10 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:10.790001 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ec2c957d-8484-47da-aeb9-2d8b70b4bf7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:10.792166 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ec2c957d-8484-47da-aeb9-2d8b70b4bf7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:10.794160 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 06:50:10.794298 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Tue Oct 11 06:50:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments (ip 10.222.0.39) !!! Oct 11 06:50:10.803230 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec2c957d-8484-47da-aeb9-2d8b70b4bf7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:10.803807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec2c957d-8484-47da-aeb9-2d8b70b4bf7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:10.804230 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec2c957d-8484-47da-aeb9-2d8b70b4bf7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:10.804942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec2c957d-8484-47da-aeb9-2d8b70b4bf7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:10.805382 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec2c957d-8484-47da-aeb9-2d8b70b4bf7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:10.805844 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec2c957d-8484-47da-aeb9-2d8b70b4bf7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:10.836711 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ec2c957d-8484-47da-aeb9-2d8b70b4bf7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050724 Oct 11 06:50:10.837257 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 591/1136] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:10 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:11.362249 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d954788b-ef89-4654-845e-400e7a0858e5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:11.364410 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d954788b-ef89-4654-845e-400e7a0858e5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:11.371366 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d954788b-ef89-4654-845e-400e7a0858e5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:11.371869 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d954788b-ef89-4654-845e-400e7a0858e5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:11.372303 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d954788b-ef89-4654-845e-400e7a0858e5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:11.372991 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d954788b-ef89-4654-845e-400e7a0858e5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:11.373439 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d954788b-ef89-4654-845e-400e7a0858e5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:11.373865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d954788b-ef89-4654-845e-400e7a0858e5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:11.402263 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d954788b-ef89-4654-845e-400e7a0858e5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043984 Oct 11 06:50:11.402808 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 546/1137] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:11 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:11.848607 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1827c096-05de-439d-875d-aed54fd38910 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:11.850751 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1827c096-05de-439d-875d-aed54fd38910 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:11.857751 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1827c096-05de-439d-875d-aed54fd38910 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:11.858217 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1827c096-05de-439d-875d-aed54fd38910 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:11.858674 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1827c096-05de-439d-875d-aed54fd38910 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:11.859349 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1827c096-05de-439d-875d-aed54fd38910 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:11.859823 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1827c096-05de-439d-875d-aed54fd38910 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:11.860247 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1827c096-05de-439d-875d-aed54fd38910 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:11.888018 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1827c096-05de-439d-875d-aed54fd38910 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043314 Oct 11 06:50:11.888545 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 592/1138] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:11 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:12.414728 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-79ccd415-a0a8-4255-a542-66866e10a16a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:12.416880 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-79ccd415-a0a8-4255-a542-66866e10a16a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:12.423837 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-79ccd415-a0a8-4255-a542-66866e10a16a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:12.424309 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-79ccd415-a0a8-4255-a542-66866e10a16a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:12.424733 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-79ccd415-a0a8-4255-a542-66866e10a16a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:12.425414 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-79ccd415-a0a8-4255-a542-66866e10a16a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:12.425855 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-79ccd415-a0a8-4255-a542-66866e10a16a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:12.426269 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-79ccd415-a0a8-4255-a542-66866e10a16a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:12.453969 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-79ccd415-a0a8-4255-a542-66866e10a16a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043255 Oct 11 06:50:12.454498 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 547/1139] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:12 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:12.900367 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e31cacba-2b88-4b3b-aecf-d2fc3a17a83d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:12.903129 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e31cacba-2b88-4b3b-aecf-d2fc3a17a83d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:12.909439 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e31cacba-2b88-4b3b-aecf-d2fc3a17a83d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:12.909907 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e31cacba-2b88-4b3b-aecf-d2fc3a17a83d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:12.910331 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e31cacba-2b88-4b3b-aecf-d2fc3a17a83d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:12.911014 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e31cacba-2b88-4b3b-aecf-d2fc3a17a83d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:12.911472 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e31cacba-2b88-4b3b-aecf-d2fc3a17a83d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:12.911885 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e31cacba-2b88-4b3b-aecf-d2fc3a17a83d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:12.940007 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e31cacba-2b88-4b3b-aecf-d2fc3a17a83d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043552 Oct 11 06:50:12.940532 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 593/1140] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:12 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:13.466458 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c7f64140-5b27-429a-aed9-65cb6705ac2c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:13.468594 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c7f64140-5b27-429a-aed9-65cb6705ac2c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:13.474925 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c7f64140-5b27-429a-aed9-65cb6705ac2c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:13.475392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c7f64140-5b27-429a-aed9-65cb6705ac2c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:13.475847 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c7f64140-5b27-429a-aed9-65cb6705ac2c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:13.476528 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c7f64140-5b27-429a-aed9-65cb6705ac2c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:13.476967 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c7f64140-5b27-429a-aed9-65cb6705ac2c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:13.477383 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c7f64140-5b27-429a-aed9-65cb6705ac2c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:13.506837 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c7f64140-5b27-429a-aed9-65cb6705ac2c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044356 Oct 11 06:50:13.507365 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 548/1141] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:13 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:13.952226 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-948e0a24-691b-4fb3-97e5-a00b513a08e9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:13.954333 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-948e0a24-691b-4fb3-97e5-a00b513a08e9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:13.961234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-948e0a24-691b-4fb3-97e5-a00b513a08e9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:13.961699 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-948e0a24-691b-4fb3-97e5-a00b513a08e9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:13.962125 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-948e0a24-691b-4fb3-97e5-a00b513a08e9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:13.962801 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-948e0a24-691b-4fb3-97e5-a00b513a08e9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:13.963238 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-948e0a24-691b-4fb3-97e5-a00b513a08e9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:13.963678 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-948e0a24-691b-4fb3-97e5-a00b513a08e9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:13.992646 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-948e0a24-691b-4fb3-97e5-a00b513a08e9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044466 Oct 11 06:50:13.993177 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 594/1142] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:13 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:14.519399 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-aa80eba9-4d11-494a-a3ec-950a3e586a17 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:14.521598 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-aa80eba9-4d11-494a-a3ec-950a3e586a17 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:14.528904 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aa80eba9-4d11-494a-a3ec-950a3e586a17 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:14.529382 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aa80eba9-4d11-494a-a3ec-950a3e586a17 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:14.529815 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aa80eba9-4d11-494a-a3ec-950a3e586a17 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:14.530511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aa80eba9-4d11-494a-a3ec-950a3e586a17 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:14.530958 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aa80eba9-4d11-494a-a3ec-950a3e586a17 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:14.531387 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aa80eba9-4d11-494a-a3ec-950a3e586a17 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:14.560081 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-aa80eba9-4d11-494a-a3ec-950a3e586a17 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044924 Oct 11 06:50:14.560627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 549/1143] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:14 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:15.004819 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d8cade60-df13-4d35-b859-cd4d5f0b0478 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:15.006955 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d8cade60-df13-4d35-b859-cd4d5f0b0478 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:15.013284 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8cade60-df13-4d35-b859-cd4d5f0b0478 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:15.013759 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8cade60-df13-4d35-b859-cd4d5f0b0478 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:15.014197 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8cade60-df13-4d35-b859-cd4d5f0b0478 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:15.014881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8cade60-df13-4d35-b859-cd4d5f0b0478 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:15.015326 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8cade60-df13-4d35-b859-cd4d5f0b0478 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:15.015768 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8cade60-df13-4d35-b859-cd4d5f0b0478 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:15.044715 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d8cade60-df13-4d35-b859-cd4d5f0b0478 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043785 Oct 11 06:50:15.045249 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 595/1144] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:14 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:15.572538 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1adbd4ef-1677-4acb-962c-f8f7e3e1516a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:15.575298 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1adbd4ef-1677-4acb-962c-f8f7e3e1516a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:15.581935 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1adbd4ef-1677-4acb-962c-f8f7e3e1516a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:15.582409 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1adbd4ef-1677-4acb-962c-f8f7e3e1516a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:15.582837 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1adbd4ef-1677-4acb-962c-f8f7e3e1516a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:15.583552 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1adbd4ef-1677-4acb-962c-f8f7e3e1516a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:15.584008 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1adbd4ef-1677-4acb-962c-f8f7e3e1516a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:15.584426 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1adbd4ef-1677-4acb-962c-f8f7e3e1516a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:15.612544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1adbd4ef-1677-4acb-962c-f8f7e3e1516a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043992 Oct 11 06:50:15.613085 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 550/1145] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:15 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:16.056379 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-28eb507c-a37c-42f0-916a-1d1b7ff8c7c3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:16.058526 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-28eb507c-a37c-42f0-916a-1d1b7ff8c7c3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:16.064892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28eb507c-a37c-42f0-916a-1d1b7ff8c7c3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:16.065368 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28eb507c-a37c-42f0-916a-1d1b7ff8c7c3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:16.065799 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28eb507c-a37c-42f0-916a-1d1b7ff8c7c3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:16.066486 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28eb507c-a37c-42f0-916a-1d1b7ff8c7c3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:16.066932 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28eb507c-a37c-42f0-916a-1d1b7ff8c7c3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:16.067351 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28eb507c-a37c-42f0-916a-1d1b7ff8c7c3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:16.096352 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-28eb507c-a37c-42f0-916a-1d1b7ff8c7c3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043839 Oct 11 06:50:16.096886 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 596/1146] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:16 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:16.625199 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-32090734-3a2b-4f23-a59a-b0f835d8d7f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:16.627308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-32090734-3a2b-4f23-a59a-b0f835d8d7f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:16.633873 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-32090734-3a2b-4f23-a59a-b0f835d8d7f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:16.634355 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-32090734-3a2b-4f23-a59a-b0f835d8d7f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:16.634788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-32090734-3a2b-4f23-a59a-b0f835d8d7f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:16.635517 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-32090734-3a2b-4f23-a59a-b0f835d8d7f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:16.636462 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-32090734-3a2b-4f23-a59a-b0f835d8d7f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:16.636887 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-32090734-3a2b-4f23-a59a-b0f835d8d7f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:16.668824 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-32090734-3a2b-4f23-a59a-b0f835d8d7f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047183 Oct 11 06:50:16.669511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 551/1147] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:16 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:17.108532 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2f170f17-3f1b-49f1-b708-34b062f1a7a7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:17.110673 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2f170f17-3f1b-49f1-b708-34b062f1a7a7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:17.117078 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f170f17-3f1b-49f1-b708-34b062f1a7a7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:17.117556 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f170f17-3f1b-49f1-b708-34b062f1a7a7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:17.117991 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f170f17-3f1b-49f1-b708-34b062f1a7a7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:17.118707 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f170f17-3f1b-49f1-b708-34b062f1a7a7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:17.119157 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f170f17-3f1b-49f1-b708-34b062f1a7a7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:17.119621 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f170f17-3f1b-49f1-b708-34b062f1a7a7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:17.149163 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2f170f17-3f1b-49f1-b708-34b062f1a7a7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044575 Oct 11 06:50:17.149700 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 597/1148] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:17 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:17.681122 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-60017d54-1d95-4583-8498-c89ffe43ee27 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:17.683309 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-60017d54-1d95-4583-8498-c89ffe43ee27 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:17.689360 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-60017d54-1d95-4583-8498-c89ffe43ee27 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:17.689841 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-60017d54-1d95-4583-8498-c89ffe43ee27 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:17.690276 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-60017d54-1d95-4583-8498-c89ffe43ee27 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:17.690969 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-60017d54-1d95-4583-8498-c89ffe43ee27 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:17.691445 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-60017d54-1d95-4583-8498-c89ffe43ee27 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:17.691865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-60017d54-1d95-4583-8498-c89ffe43ee27 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:17.720814 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-60017d54-1d95-4583-8498-c89ffe43ee27 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043862 Oct 11 06:50:17.721357 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 552/1149] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:17 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:18.161407 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d0506300-4001-44ba-8a2b-81d07cd35608 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:18.163582 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d0506300-4001-44ba-8a2b-81d07cd35608 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:18.169833 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0506300-4001-44ba-8a2b-81d07cd35608 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:18.170296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0506300-4001-44ba-8a2b-81d07cd35608 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:18.170719 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0506300-4001-44ba-8a2b-81d07cd35608 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:18.171392 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0506300-4001-44ba-8a2b-81d07cd35608 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:18.171850 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0506300-4001-44ba-8a2b-81d07cd35608 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:18.172262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0506300-4001-44ba-8a2b-81d07cd35608 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:18.200750 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d0506300-4001-44ba-8a2b-81d07cd35608 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043191 Oct 11 06:50:18.201276 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 598/1150] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:18 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:50:18.733311 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7595ceb8-6d2a-4916-b2bc-cbcc0822aaca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:18.735502 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7595ceb8-6d2a-4916-b2bc-cbcc0822aaca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:18.741832 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7595ceb8-6d2a-4916-b2bc-cbcc0822aaca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:18.742307 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7595ceb8-6d2a-4916-b2bc-cbcc0822aaca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:18.742733 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7595ceb8-6d2a-4916-b2bc-cbcc0822aaca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:18.743435 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7595ceb8-6d2a-4916-b2bc-cbcc0822aaca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:18.743915 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7595ceb8-6d2a-4916-b2bc-cbcc0822aaca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:18.744328 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7595ceb8-6d2a-4916-b2bc-cbcc0822aaca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:18.773449 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7595ceb8-6d2a-4916-b2bc-cbcc0822aaca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044178 Oct 11 06:50:18.773998 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 553/1151] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:18 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:19.213339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2487d944-56f8-43b3-bdd9-40552d45f2a1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:19.215506 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2487d944-56f8-43b3-bdd9-40552d45f2a1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:19.221808 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2487d944-56f8-43b3-bdd9-40552d45f2a1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:19.222279 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2487d944-56f8-43b3-bdd9-40552d45f2a1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:19.222704 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2487d944-56f8-43b3-bdd9-40552d45f2a1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:19.223382 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2487d944-56f8-43b3-bdd9-40552d45f2a1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:19.223845 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2487d944-56f8-43b3-bdd9-40552d45f2a1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:19.224260 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2487d944-56f8-43b3-bdd9-40552d45f2a1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:19.252641 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2487d944-56f8-43b3-bdd9-40552d45f2a1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043227 Oct 11 06:50:19.253171 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 599/1152] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:19 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:19.786638 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6e5a1d5f-4771-4cee-b14f-1f3f12269ec1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:19.788738 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6e5a1d5f-4771-4cee-b14f-1f3f12269ec1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:19.795820 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e5a1d5f-4771-4cee-b14f-1f3f12269ec1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:19.796303 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e5a1d5f-4771-4cee-b14f-1f3f12269ec1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:19.796736 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e5a1d5f-4771-4cee-b14f-1f3f12269ec1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:19.797430 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e5a1d5f-4771-4cee-b14f-1f3f12269ec1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:19.797879 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e5a1d5f-4771-4cee-b14f-1f3f12269ec1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:19.798304 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e5a1d5f-4771-4cee-b14f-1f3f12269ec1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:19.826488 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6e5a1d5f-4771-4cee-b14f-1f3f12269ec1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043939 Oct 11 06:50:19.827026 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 554/1153] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:19 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 06:50:20.264819 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-202349e3-5213-4c2e-baad-1ef7b00e5690 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:20.266950 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-202349e3-5213-4c2e-baad-1ef7b00e5690 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:20.273570 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-202349e3-5213-4c2e-baad-1ef7b00e5690 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:20.274045 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-202349e3-5213-4c2e-baad-1ef7b00e5690 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:20.274477 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-202349e3-5213-4c2e-baad-1ef7b00e5690 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:20.275158 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-202349e3-5213-4c2e-baad-1ef7b00e5690 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:20.275637 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-202349e3-5213-4c2e-baad-1ef7b00e5690 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:20.276053 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-202349e3-5213-4c2e-baad-1ef7b00e5690 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:20.305369 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-202349e3-5213-4c2e-baad-1ef7b00e5690 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044979 Oct 11 06:50:20.305902 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 600/1154] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:20 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:20.839386 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3c2fc63a-4c19-43e8-96fe-6e706a2e131e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:20.841591 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3c2fc63a-4c19-43e8-96fe-6e706a2e131e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:20.847922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c2fc63a-4c19-43e8-96fe-6e706a2e131e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:20.848401 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c2fc63a-4c19-43e8-96fe-6e706a2e131e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:20.848833 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c2fc63a-4c19-43e8-96fe-6e706a2e131e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:20.849520 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c2fc63a-4c19-43e8-96fe-6e706a2e131e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:20.850009 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c2fc63a-4c19-43e8-96fe-6e706a2e131e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:20.850430 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c2fc63a-4c19-43e8-96fe-6e706a2e131e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:20.879663 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3c2fc63a-4c19-43e8-96fe-6e706a2e131e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044263 Oct 11 06:50:20.880210 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 555/1155] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:20 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:21.317680 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-326a7818-a89a-4fe0-94f2-bc7516658f5f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:21.319935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-326a7818-a89a-4fe0-94f2-bc7516658f5f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:21.321882 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 06:50:21.322024 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Tue Oct 11 06:50:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments (ip 10.222.0.39) !!! Oct 11 06:50:21.330907 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-326a7818-a89a-4fe0-94f2-bc7516658f5f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:21.331398 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-326a7818-a89a-4fe0-94f2-bc7516658f5f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:21.331869 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-326a7818-a89a-4fe0-94f2-bc7516658f5f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:21.332573 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-326a7818-a89a-4fe0-94f2-bc7516658f5f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:21.333046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-326a7818-a89a-4fe0-94f2-bc7516658f5f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:21.333469 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-326a7818-a89a-4fe0-94f2-bc7516658f5f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:21.363821 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-326a7818-a89a-4fe0-94f2-bc7516658f5f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050119 Oct 11 06:50:21.364362 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 601/1156] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:21 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:21.892612 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-703f0fac-f8b4-48f9-a3a8-699ca070ffb4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:21.895076 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-703f0fac-f8b4-48f9-a3a8-699ca070ffb4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:21.902214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-703f0fac-f8b4-48f9-a3a8-699ca070ffb4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:21.902855 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-703f0fac-f8b4-48f9-a3a8-699ca070ffb4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:21.903117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-703f0fac-f8b4-48f9-a3a8-699ca070ffb4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:21.903839 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-703f0fac-f8b4-48f9-a3a8-699ca070ffb4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:21.904291 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-703f0fac-f8b4-48f9-a3a8-699ca070ffb4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:21.904707 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-703f0fac-f8b4-48f9-a3a8-699ca070ffb4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:21.933718 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-703f0fac-f8b4-48f9-a3a8-699ca070ffb4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045011 Oct 11 06:50:21.934260 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 556/1157] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:21 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:22.377095 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e48942b0-461b-4282-919c-73e7f59e5489 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:22.379407 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e48942b0-461b-4282-919c-73e7f59e5489 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:22.386641 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e48942b0-461b-4282-919c-73e7f59e5489 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:22.387121 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e48942b0-461b-4282-919c-73e7f59e5489 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:22.387582 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e48942b0-461b-4282-919c-73e7f59e5489 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:22.388346 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e48942b0-461b-4282-919c-73e7f59e5489 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:22.388791 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e48942b0-461b-4282-919c-73e7f59e5489 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:22.389211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e48942b0-461b-4282-919c-73e7f59e5489 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:22.422909 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e48942b0-461b-4282-919c-73e7f59e5489 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049780 Oct 11 06:50:22.423517 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 602/1158] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:22 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:22.946359 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-296f4b29-33d6-4a19-8491-fcc7c7bd8155 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:22.948489 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-296f4b29-33d6-4a19-8491-fcc7c7bd8155 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:22.954769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-296f4b29-33d6-4a19-8491-fcc7c7bd8155 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:22.955232 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-296f4b29-33d6-4a19-8491-fcc7c7bd8155 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:22.955684 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-296f4b29-33d6-4a19-8491-fcc7c7bd8155 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:22.956363 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-296f4b29-33d6-4a19-8491-fcc7c7bd8155 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:22.956807 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-296f4b29-33d6-4a19-8491-fcc7c7bd8155 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:22.957221 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-296f4b29-33d6-4a19-8491-fcc7c7bd8155 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:22.986342 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-296f4b29-33d6-4a19-8491-fcc7c7bd8155 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043985 Oct 11 06:50:22.986872 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 557/1159] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:22 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:23.435503 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-eea664f2-543f-40b7-a101-6936b0acefa0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:23.437687 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-eea664f2-543f-40b7-a101-6936b0acefa0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:23.444006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eea664f2-543f-40b7-a101-6936b0acefa0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:23.444476 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eea664f2-543f-40b7-a101-6936b0acefa0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:23.444909 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eea664f2-543f-40b7-a101-6936b0acefa0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:23.445589 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eea664f2-543f-40b7-a101-6936b0acefa0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:23.446031 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eea664f2-543f-40b7-a101-6936b0acefa0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:23.446448 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eea664f2-543f-40b7-a101-6936b0acefa0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:23.450499 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:50:23.475929 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-eea664f2-543f-40b7-a101-6936b0acefa0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044306 Oct 11 06:50:23.476400 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 603/1160] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:23 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:23.999293 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-57a25bcf-67b4-417d-857e-4683aac3c958 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:24.001497 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-57a25bcf-67b4-417d-857e-4683aac3c958 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:24.003524 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 06:50:24.003670 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Tue Oct 11 06:50:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments (ip 10.222.0.39) !!! Oct 11 06:50:24.009653 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57a25bcf-67b4-417d-857e-4683aac3c958 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:24.010127 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57a25bcf-67b4-417d-857e-4683aac3c958 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:24.010560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57a25bcf-67b4-417d-857e-4683aac3c958 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:24.011249 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57a25bcf-67b4-417d-857e-4683aac3c958 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:24.011728 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57a25bcf-67b4-417d-857e-4683aac3c958 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:24.012175 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57a25bcf-67b4-417d-857e-4683aac3c958 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:24.042486 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-57a25bcf-67b4-417d-857e-4683aac3c958 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047233 Oct 11 06:50:24.043022 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 558/1161] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:23 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:24.488044 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6e22b43b-ec22-4f90-9204-d54df66146f2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:24.490207 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6e22b43b-ec22-4f90-9204-d54df66146f2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:24.496468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6e22b43b-ec22-4f90-9204-d54df66146f2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:24.496939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6e22b43b-ec22-4f90-9204-d54df66146f2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:24.497370 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6e22b43b-ec22-4f90-9204-d54df66146f2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:24.498054 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6e22b43b-ec22-4f90-9204-d54df66146f2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:24.498496 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6e22b43b-ec22-4f90-9204-d54df66146f2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:24.498915 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6e22b43b-ec22-4f90-9204-d54df66146f2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:24.527820 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6e22b43b-ec22-4f90-9204-d54df66146f2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043607 Oct 11 06:50:24.528346 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 604/1162] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:24 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:25.054917 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a2899d9d-09bd-49b9-99a1-25b93b64a06f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:25.057076 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a2899d9d-09bd-49b9-99a1-25b93b64a06f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:25.064005 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2899d9d-09bd-49b9-99a1-25b93b64a06f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:25.064486 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2899d9d-09bd-49b9-99a1-25b93b64a06f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:25.064923 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2899d9d-09bd-49b9-99a1-25b93b64a06f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:25.065615 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2899d9d-09bd-49b9-99a1-25b93b64a06f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:25.066065 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2899d9d-09bd-49b9-99a1-25b93b64a06f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:25.066486 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2899d9d-09bd-49b9-99a1-25b93b64a06f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:25.095620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a2899d9d-09bd-49b9-99a1-25b93b64a06f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044666 Oct 11 06:50:25.096161 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 559/1163] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:25 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:25.539436 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-92403d93-8e21-4675-b13a-58640c993fa3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:25.542154 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-92403d93-8e21-4675-b13a-58640c993fa3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:25.548476 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-92403d93-8e21-4675-b13a-58640c993fa3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:25.548955 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-92403d93-8e21-4675-b13a-58640c993fa3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:25.549387 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-92403d93-8e21-4675-b13a-58640c993fa3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:25.550076 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-92403d93-8e21-4675-b13a-58640c993fa3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:25.550525 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-92403d93-8e21-4675-b13a-58640c993fa3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:25.550945 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-92403d93-8e21-4675-b13a-58640c993fa3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:25.579853 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-92403d93-8e21-4675-b13a-58640c993fa3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044249 Oct 11 06:50:25.580389 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 605/1164] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:25 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:26.108043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-75056bfb-7de9-439c-90c5-91dd76dd8ba9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:26.110166 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-75056bfb-7de9-439c-90c5-91dd76dd8ba9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:26.116491 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-75056bfb-7de9-439c-90c5-91dd76dd8ba9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:26.116963 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-75056bfb-7de9-439c-90c5-91dd76dd8ba9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:26.117389 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-75056bfb-7de9-439c-90c5-91dd76dd8ba9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:26.118072 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-75056bfb-7de9-439c-90c5-91dd76dd8ba9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:26.118512 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-75056bfb-7de9-439c-90c5-91dd76dd8ba9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:26.118925 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-75056bfb-7de9-439c-90c5-91dd76dd8ba9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:26.143998 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:50:26.148706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-75056bfb-7de9-439c-90c5-91dd76dd8ba9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044691 Oct 11 06:50:26.149242 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 560/1165] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:26 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:26.592555 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-94ee1e9f-ef3b-4b49-b5b5-a098bd94fa3d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:26.594763 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-94ee1e9f-ef3b-4b49-b5b5-a098bd94fa3d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:26.601086 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-94ee1e9f-ef3b-4b49-b5b5-a098bd94fa3d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:26.601568 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-94ee1e9f-ef3b-4b49-b5b5-a098bd94fa3d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:26.602004 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-94ee1e9f-ef3b-4b49-b5b5-a098bd94fa3d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:26.602692 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-94ee1e9f-ef3b-4b49-b5b5-a098bd94fa3d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:26.603137 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-94ee1e9f-ef3b-4b49-b5b5-a098bd94fa3d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:26.603598 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-94ee1e9f-ef3b-4b49-b5b5-a098bd94fa3d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:26.632170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-94ee1e9f-ef3b-4b49-b5b5-a098bd94fa3d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044040 Oct 11 06:50:26.632708 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 606/1166] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:26 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:27.160845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3b27796d-dbec-43d4-97bf-b4a9b680635f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:27.162972 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3b27796d-dbec-43d4-97bf-b4a9b680635f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:27.169745 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3b27796d-dbec-43d4-97bf-b4a9b680635f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:27.170213 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3b27796d-dbec-43d4-97bf-b4a9b680635f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:27.170643 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3b27796d-dbec-43d4-97bf-b4a9b680635f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:27.171313 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3b27796d-dbec-43d4-97bf-b4a9b680635f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:27.171781 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3b27796d-dbec-43d4-97bf-b4a9b680635f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:27.172198 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3b27796d-dbec-43d4-97bf-b4a9b680635f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:27.201749 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3b27796d-dbec-43d4-97bf-b4a9b680635f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044852 Oct 11 06:50:27.202294 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 561/1167] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:27 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:27.644527 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cc50f5e7-5ef6-4602-a41c-6adfacf818f6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:27.646661 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cc50f5e7-5ef6-4602-a41c-6adfacf818f6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:27.648957 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=58 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:50:27.654157 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc50f5e7-5ef6-4602-a41c-6adfacf818f6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:27.654629 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc50f5e7-5ef6-4602-a41c-6adfacf818f6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:27.655065 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc50f5e7-5ef6-4602-a41c-6adfacf818f6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:27.655831 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc50f5e7-5ef6-4602-a41c-6adfacf818f6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:27.656275 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc50f5e7-5ef6-4602-a41c-6adfacf818f6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:27.656693 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc50f5e7-5ef6-4602-a41c-6adfacf818f6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:27.685990 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cc50f5e7-5ef6-4602-a41c-6adfacf818f6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045548 Oct 11 06:50:27.686522 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 607/1168] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:27 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:28.215850 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a1c0d2f6-0ece-4ce7-a000-dcc36a10b95d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:28.218079 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a1c0d2f6-0ece-4ce7-a000-dcc36a10b95d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:28.224512 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a1c0d2f6-0ece-4ce7-a000-dcc36a10b95d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:28.224985 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a1c0d2f6-0ece-4ce7-a000-dcc36a10b95d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:28.225413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a1c0d2f6-0ece-4ce7-a000-dcc36a10b95d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:28.226100 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a1c0d2f6-0ece-4ce7-a000-dcc36a10b95d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:28.226819 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a1c0d2f6-0ece-4ce7-a000-dcc36a10b95d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:28.227239 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a1c0d2f6-0ece-4ce7-a000-dcc36a10b95d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:28.255851 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a1c0d2f6-0ece-4ce7-a000-dcc36a10b95d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044429 Oct 11 06:50:28.256379 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 562/1169] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:28 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:28.698518 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-541414e7-d685-402f-94ef-ca66a7536c49 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:28.700702 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-541414e7-d685-402f-94ef-ca66a7536c49 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:28.706914 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-541414e7-d685-402f-94ef-ca66a7536c49 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:28.707383 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-541414e7-d685-402f-94ef-ca66a7536c49 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:28.707836 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-541414e7-d685-402f-94ef-ca66a7536c49 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:28.708511 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-541414e7-d685-402f-94ef-ca66a7536c49 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:28.708949 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-541414e7-d685-402f-94ef-ca66a7536c49 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:28.709361 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-541414e7-d685-402f-94ef-ca66a7536c49 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:28.738232 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-541414e7-d685-402f-94ef-ca66a7536c49 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044127 Oct 11 06:50:28.738757 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 608/1170] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:28 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:29.268734 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c40b146a-852b-4cf3-8a4c-0e12ea4aa3a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:29.270850 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c40b146a-852b-4cf3-8a4c-0e12ea4aa3a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:29.277305 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c40b146a-852b-4cf3-8a4c-0e12ea4aa3a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:29.277784 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c40b146a-852b-4cf3-8a4c-0e12ea4aa3a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:29.278220 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c40b146a-852b-4cf3-8a4c-0e12ea4aa3a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:29.278907 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c40b146a-852b-4cf3-8a4c-0e12ea4aa3a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:29.279357 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c40b146a-852b-4cf3-8a4c-0e12ea4aa3a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:29.279810 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c40b146a-852b-4cf3-8a4c-0e12ea4aa3a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:29.310805 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c40b146a-852b-4cf3-8a4c-0e12ea4aa3a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046361 Oct 11 06:50:29.311349 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 563/1171] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:29 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:29.749963 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-18943bdc-49f8-407e-8445-7c4555087f75 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:29.752149 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-18943bdc-49f8-407e-8445-7c4555087f75 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:29.758492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18943bdc-49f8-407e-8445-7c4555087f75 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:29.758973 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18943bdc-49f8-407e-8445-7c4555087f75 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:29.759405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18943bdc-49f8-407e-8445-7c4555087f75 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:29.760145 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18943bdc-49f8-407e-8445-7c4555087f75 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:29.760600 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18943bdc-49f8-407e-8445-7c4555087f75 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:29.761027 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18943bdc-49f8-407e-8445-7c4555087f75 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:29.790626 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-18943bdc-49f8-407e-8445-7c4555087f75 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044518 Oct 11 06:50:29.791219 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 609/1172] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:29 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:30.324011 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-82771c68-b4b6-46ba-8712-fce8c07b91a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:30.326397 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-82771c68-b4b6-46ba-8712-fce8c07b91a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:30.332795 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82771c68-b4b6-46ba-8712-fce8c07b91a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:30.333274 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82771c68-b4b6-46ba-8712-fce8c07b91a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:30.333707 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82771c68-b4b6-46ba-8712-fce8c07b91a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:30.334399 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82771c68-b4b6-46ba-8712-fce8c07b91a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:30.334844 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82771c68-b4b6-46ba-8712-fce8c07b91a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:30.335262 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82771c68-b4b6-46ba-8712-fce8c07b91a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:30.364959 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-82771c68-b4b6-46ba-8712-fce8c07b91a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045238 Oct 11 06:50:30.365500 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 564/1173] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:30 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:30.802956 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d749162c-0bd9-49bb-9422-7c93fe202103 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:30.805211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d749162c-0bd9-49bb-9422-7c93fe202103 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:30.812344 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d749162c-0bd9-49bb-9422-7c93fe202103 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:30.812815 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d749162c-0bd9-49bb-9422-7c93fe202103 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:30.813243 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d749162c-0bd9-49bb-9422-7c93fe202103 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:30.813926 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d749162c-0bd9-49bb-9422-7c93fe202103 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:30.814364 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d749162c-0bd9-49bb-9422-7c93fe202103 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:30.814784 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d749162c-0bd9-49bb-9422-7c93fe202103 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:30.842764 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d749162c-0bd9-49bb-9422-7c93fe202103 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043796 Oct 11 06:50:30.843291 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 610/1174] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:30 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:31.378015 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d712cfe2-38cf-48bd-85d7-ee9e8f5841dc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:31.380161 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d712cfe2-38cf-48bd-85d7-ee9e8f5841dc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:31.386494 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d712cfe2-38cf-48bd-85d7-ee9e8f5841dc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:31.386993 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d712cfe2-38cf-48bd-85d7-ee9e8f5841dc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:31.387439 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d712cfe2-38cf-48bd-85d7-ee9e8f5841dc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:31.388120 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d712cfe2-38cf-48bd-85d7-ee9e8f5841dc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:31.388563 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d712cfe2-38cf-48bd-85d7-ee9e8f5841dc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:31.388976 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d712cfe2-38cf-48bd-85d7-ee9e8f5841dc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:31.419239 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d712cfe2-38cf-48bd-85d7-ee9e8f5841dc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045117 Oct 11 06:50:31.419824 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 565/1175] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:31 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:31.855498 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-65c2d0cc-4997-4740-985c-01d5197bc8cf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:31.857655 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-65c2d0cc-4997-4740-985c-01d5197bc8cf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:31.864141 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-65c2d0cc-4997-4740-985c-01d5197bc8cf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:31.864611 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-65c2d0cc-4997-4740-985c-01d5197bc8cf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:31.865039 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-65c2d0cc-4997-4740-985c-01d5197bc8cf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:31.865724 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-65c2d0cc-4997-4740-985c-01d5197bc8cf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:31.866171 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-65c2d0cc-4997-4740-985c-01d5197bc8cf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:31.866588 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-65c2d0cc-4997-4740-985c-01d5197bc8cf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:31.897333 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-65c2d0cc-4997-4740-985c-01d5197bc8cf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045748 Oct 11 06:50:31.897866 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 611/1176] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:31 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:32.432552 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6597b043-dbec-400f-8dc0-ba814cc2af46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:32.434628 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6597b043-dbec-400f-8dc0-ba814cc2af46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:32.440960 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6597b043-dbec-400f-8dc0-ba814cc2af46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:32.441429 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6597b043-dbec-400f-8dc0-ba814cc2af46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:32.441850 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6597b043-dbec-400f-8dc0-ba814cc2af46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:32.442526 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6597b043-dbec-400f-8dc0-ba814cc2af46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:32.442960 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6597b043-dbec-400f-8dc0-ba814cc2af46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:32.443370 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6597b043-dbec-400f-8dc0-ba814cc2af46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:32.474607 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6597b043-dbec-400f-8dc0-ba814cc2af46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046782 Oct 11 06:50:32.475186 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 566/1177] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:32 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:32.909600 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5dbe65cc-5b24-44d2-a19e-e7164d2402ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:32.911885 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5dbe65cc-5b24-44d2-a19e-e7164d2402ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:32.918954 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5dbe65cc-5b24-44d2-a19e-e7164d2402ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:32.919449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5dbe65cc-5b24-44d2-a19e-e7164d2402ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:32.919876 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5dbe65cc-5b24-44d2-a19e-e7164d2402ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:32.920570 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5dbe65cc-5b24-44d2-a19e-e7164d2402ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:32.921015 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5dbe65cc-5b24-44d2-a19e-e7164d2402ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:32.921434 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5dbe65cc-5b24-44d2-a19e-e7164d2402ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:32.950697 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5dbe65cc-5b24-44d2-a19e-e7164d2402ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044941 Oct 11 06:50:32.951239 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 612/1178] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:32 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:33.487959 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4624fd1d-382c-487c-88e5-1be5d5c3bc6c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:33.490104 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4624fd1d-382c-487c-88e5-1be5d5c3bc6c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:33.497009 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4624fd1d-382c-487c-88e5-1be5d5c3bc6c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:33.497517 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4624fd1d-382c-487c-88e5-1be5d5c3bc6c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:33.497954 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4624fd1d-382c-487c-88e5-1be5d5c3bc6c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:33.498649 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4624fd1d-382c-487c-88e5-1be5d5c3bc6c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:33.499099 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4624fd1d-382c-487c-88e5-1be5d5c3bc6c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:33.499543 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4624fd1d-382c-487c-88e5-1be5d5c3bc6c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:33.528818 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4624fd1d-382c-487c-88e5-1be5d5c3bc6c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044852 Oct 11 06:50:33.529354 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 567/1179] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:33 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:33.964815 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bbed6e72-e57e-4ef6-b8d8-2505b868e80f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:33.967089 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bbed6e72-e57e-4ef6-b8d8-2505b868e80f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:33.973112 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bbed6e72-e57e-4ef6-b8d8-2505b868e80f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:33.973589 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bbed6e72-e57e-4ef6-b8d8-2505b868e80f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:33.974019 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bbed6e72-e57e-4ef6-b8d8-2505b868e80f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:33.974712 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bbed6e72-e57e-4ef6-b8d8-2505b868e80f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:33.975156 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bbed6e72-e57e-4ef6-b8d8-2505b868e80f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:33.976224 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bbed6e72-e57e-4ef6-b8d8-2505b868e80f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:34.005671 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bbed6e72-e57e-4ef6-b8d8-2505b868e80f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044645 Oct 11 06:50:34.006208 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 613/1180] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:33 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:34.540923 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-18ef9d23-1b49-4f39-a4e5-3ff3bc101756 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:34.543085 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-18ef9d23-1b49-4f39-a4e5-3ff3bc101756 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:34.549485 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-18ef9d23-1b49-4f39-a4e5-3ff3bc101756 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:34.549963 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-18ef9d23-1b49-4f39-a4e5-3ff3bc101756 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:34.550401 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-18ef9d23-1b49-4f39-a4e5-3ff3bc101756 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:34.551092 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-18ef9d23-1b49-4f39-a4e5-3ff3bc101756 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:34.551567 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-18ef9d23-1b49-4f39-a4e5-3ff3bc101756 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:34.551988 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-18ef9d23-1b49-4f39-a4e5-3ff3bc101756 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:34.580332 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-18ef9d23-1b49-4f39-a4e5-3ff3bc101756 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043443 Oct 11 06:50:34.580886 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 568/1181] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:34 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:35.017768 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cdd68dae-ba29-4323-9a31-487d1405fa78 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:35.020751 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cdd68dae-ba29-4323-9a31-487d1405fa78 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:35.027553 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cdd68dae-ba29-4323-9a31-487d1405fa78 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:35.027916 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cdd68dae-ba29-4323-9a31-487d1405fa78 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:35.028345 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cdd68dae-ba29-4323-9a31-487d1405fa78 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:35.029028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cdd68dae-ba29-4323-9a31-487d1405fa78 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:35.029469 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cdd68dae-ba29-4323-9a31-487d1405fa78 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:35.029889 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cdd68dae-ba29-4323-9a31-487d1405fa78 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:35.059630 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cdd68dae-ba29-4323-9a31-487d1405fa78 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045719 Oct 11 06:50:35.060178 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 614/1182] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:35 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:35.592586 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f537cfe0-2d5d-45ca-a542-7096964b30a2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:35.594715 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f537cfe0-2d5d-45ca-a542-7096964b30a2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:35.601195 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f537cfe0-2d5d-45ca-a542-7096964b30a2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:35.601678 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f537cfe0-2d5d-45ca-a542-7096964b30a2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:35.602162 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f537cfe0-2d5d-45ca-a542-7096964b30a2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:35.602804 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f537cfe0-2d5d-45ca-a542-7096964b30a2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:35.603258 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f537cfe0-2d5d-45ca-a542-7096964b30a2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:35.603706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f537cfe0-2d5d-45ca-a542-7096964b30a2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:35.632628 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f537cfe0-2d5d-45ca-a542-7096964b30a2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043943 Oct 11 06:50:35.633178 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 569/1183] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:35 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 06:50:36.072055 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7d985e0f-4468-40c6-afe9-362674040c66 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:36.074256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7d985e0f-4468-40c6-afe9-362674040c66 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:36.080959 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d985e0f-4468-40c6-afe9-362674040c66 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:36.081438 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d985e0f-4468-40c6-afe9-362674040c66 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:36.081931 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d985e0f-4468-40c6-afe9-362674040c66 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:36.082627 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d985e0f-4468-40c6-afe9-362674040c66 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:36.083072 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d985e0f-4468-40c6-afe9-362674040c66 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:36.083527 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d985e0f-4468-40c6-afe9-362674040c66 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:36.112913 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7d985e0f-4468-40c6-afe9-362674040c66 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044794 Oct 11 06:50:36.113470 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 615/1184] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:36 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:36.646071 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-63775cca-21aa-4069-b248-4ddece163cdb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:36.648219 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-63775cca-21aa-4069-b248-4ddece163cdb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:36.655089 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-63775cca-21aa-4069-b248-4ddece163cdb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:36.655608 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-63775cca-21aa-4069-b248-4ddece163cdb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:36.656042 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-63775cca-21aa-4069-b248-4ddece163cdb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:36.656759 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-63775cca-21aa-4069-b248-4ddece163cdb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:36.657273 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-63775cca-21aa-4069-b248-4ddece163cdb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:36.657623 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-63775cca-21aa-4069-b248-4ddece163cdb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:36.686311 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-63775cca-21aa-4069-b248-4ddece163cdb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044440 Oct 11 06:50:36.686850 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 570/1185] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:36 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:37.125401 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fb0dfd91-3d62-4763-a2d4-000291a94192 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:37.127546 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fb0dfd91-3d62-4763-a2d4-000291a94192 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:37.133554 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fb0dfd91-3d62-4763-a2d4-000291a94192 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:37.134136 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fb0dfd91-3d62-4763-a2d4-000291a94192 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:37.134566 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fb0dfd91-3d62-4763-a2d4-000291a94192 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:37.135872 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fb0dfd91-3d62-4763-a2d4-000291a94192 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:37.136315 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fb0dfd91-3d62-4763-a2d4-000291a94192 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:37.136733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fb0dfd91-3d62-4763-a2d4-000291a94192 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:37.166308 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fb0dfd91-3d62-4763-a2d4-000291a94192 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044687 Oct 11 06:50:37.166845 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 616/1186] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:37 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:37.698288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-549fd9d1-8294-4cce-8a86-7f183e4ab90e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:37.700474 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-549fd9d1-8294-4cce-8a86-7f183e4ab90e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:37.706769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-549fd9d1-8294-4cce-8a86-7f183e4ab90e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:37.707238 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-549fd9d1-8294-4cce-8a86-7f183e4ab90e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:37.707703 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-549fd9d1-8294-4cce-8a86-7f183e4ab90e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:37.708383 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-549fd9d1-8294-4cce-8a86-7f183e4ab90e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:37.708855 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-549fd9d1-8294-4cce-8a86-7f183e4ab90e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:37.709264 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-549fd9d1-8294-4cce-8a86-7f183e4ab90e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:37.738109 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-549fd9d1-8294-4cce-8a86-7f183e4ab90e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043815 Oct 11 06:50:37.738659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 571/1187] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:37 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:38.178019 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-73403657-7fbc-4062-baee-4f9d99793c08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:38.180240 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-73403657-7fbc-4062-baee-4f9d99793c08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:38.186540 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-73403657-7fbc-4062-baee-4f9d99793c08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:38.187022 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-73403657-7fbc-4062-baee-4f9d99793c08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:38.187496 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-73403657-7fbc-4062-baee-4f9d99793c08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:38.188203 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-73403657-7fbc-4062-baee-4f9d99793c08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:38.188646 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-73403657-7fbc-4062-baee-4f9d99793c08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:38.189066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-73403657-7fbc-4062-baee-4f9d99793c08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:38.219343 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-73403657-7fbc-4062-baee-4f9d99793c08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045079 Oct 11 06:50:38.219839 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 617/1188] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:38 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:38.750796 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b0f5fda5-0eba-440e-904a-0f5ba919b739 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:38.752953 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b0f5fda5-0eba-440e-904a-0f5ba919b739 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:38.759430 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b0f5fda5-0eba-440e-904a-0f5ba919b739 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:38.760514 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b0f5fda5-0eba-440e-904a-0f5ba919b739 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:38.760971 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b0f5fda5-0eba-440e-904a-0f5ba919b739 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:38.761652 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b0f5fda5-0eba-440e-904a-0f5ba919b739 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:38.762099 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b0f5fda5-0eba-440e-904a-0f5ba919b739 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:38.762515 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b0f5fda5-0eba-440e-904a-0f5ba919b739 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:38.790833 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b0f5fda5-0eba-440e-904a-0f5ba919b739 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044060 Oct 11 06:50:38.791380 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 572/1189] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:38 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:39.231920 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-42583f88-1698-4983-8184-ab4e736dc9be tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:39.234065 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-42583f88-1698-4983-8184-ab4e736dc9be tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:39.240144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42583f88-1698-4983-8184-ab4e736dc9be tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:39.240627 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42583f88-1698-4983-8184-ab4e736dc9be tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:39.241060 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42583f88-1698-4983-8184-ab4e736dc9be tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:39.241755 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42583f88-1698-4983-8184-ab4e736dc9be tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:39.242204 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42583f88-1698-4983-8184-ab4e736dc9be tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:39.242688 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42583f88-1698-4983-8184-ab4e736dc9be tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:39.272925 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-42583f88-1698-4983-8184-ab4e736dc9be tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045378 Oct 11 06:50:39.273465 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 618/1190] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:39 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:39.803339 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-969abc5d-bf9f-425c-838f-b617592619f7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:39.805374 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-969abc5d-bf9f-425c-838f-b617592619f7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:39.811821 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-969abc5d-bf9f-425c-838f-b617592619f7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:39.812326 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-969abc5d-bf9f-425c-838f-b617592619f7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:39.812755 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-969abc5d-bf9f-425c-838f-b617592619f7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:39.813437 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-969abc5d-bf9f-425c-838f-b617592619f7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:39.813882 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-969abc5d-bf9f-425c-838f-b617592619f7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:39.814296 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-969abc5d-bf9f-425c-838f-b617592619f7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:39.843715 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-969abc5d-bf9f-425c-838f-b617592619f7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044392 Oct 11 06:50:39.844249 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 573/1191] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:39 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:40.285999 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9e1b1755-3132-4522-824a-5a0c42712676 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:40.288245 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9e1b1755-3132-4522-824a-5a0c42712676 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:40.294558 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e1b1755-3132-4522-824a-5a0c42712676 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:40.295036 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e1b1755-3132-4522-824a-5a0c42712676 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:40.295506 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e1b1755-3132-4522-824a-5a0c42712676 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:40.296204 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e1b1755-3132-4522-824a-5a0c42712676 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:40.296652 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e1b1755-3132-4522-824a-5a0c42712676 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:40.297078 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e1b1755-3132-4522-824a-5a0c42712676 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:40.322588 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:50:40.329064 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9e1b1755-3132-4522-824a-5a0c42712676 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047045 Oct 11 06:50:40.329604 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 619/1192] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:40 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:40.856773 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-036628e5-6b1d-434d-b4aa-4ff96885d157 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:40.858863 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-036628e5-6b1d-434d-b4aa-4ff96885d157 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:40.861189 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=58 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:50:40.866280 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-036628e5-6b1d-434d-b4aa-4ff96885d157 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:40.866760 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-036628e5-6b1d-434d-b4aa-4ff96885d157 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:40.867190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-036628e5-6b1d-434d-b4aa-4ff96885d157 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:40.867914 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-036628e5-6b1d-434d-b4aa-4ff96885d157 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:40.868363 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-036628e5-6b1d-434d-b4aa-4ff96885d157 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:40.868781 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-036628e5-6b1d-434d-b4aa-4ff96885d157 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:40.897438 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-036628e5-6b1d-434d-b4aa-4ff96885d157 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045197 Oct 11 06:50:40.897911 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 574/1193] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:40 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:41.341683 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c86dd716-2606-4582-9eda-3ac619a7043e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:41.343833 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c86dd716-2606-4582-9eda-3ac619a7043e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:41.350262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c86dd716-2606-4582-9eda-3ac619a7043e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:41.350745 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c86dd716-2606-4582-9eda-3ac619a7043e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:41.351178 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c86dd716-2606-4582-9eda-3ac619a7043e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:41.351900 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c86dd716-2606-4582-9eda-3ac619a7043e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:41.352345 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c86dd716-2606-4582-9eda-3ac619a7043e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:41.352767 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c86dd716-2606-4582-9eda-3ac619a7043e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:41.381498 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c86dd716-2606-4582-9eda-3ac619a7043e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044245 Oct 11 06:50:41.382037 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 620/1194] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:41 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:41.910304 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cdb7bcd8-be57-46c7-a5e9-bdb8dbbea6a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:41.912420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cdb7bcd8-be57-46c7-a5e9-bdb8dbbea6a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:41.919234 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cdb7bcd8-be57-46c7-a5e9-bdb8dbbea6a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:41.919747 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cdb7bcd8-be57-46c7-a5e9-bdb8dbbea6a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:41.920174 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cdb7bcd8-be57-46c7-a5e9-bdb8dbbea6a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:41.920851 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cdb7bcd8-be57-46c7-a5e9-bdb8dbbea6a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:41.921292 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cdb7bcd8-be57-46c7-a5e9-bdb8dbbea6a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:41.921704 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cdb7bcd8-be57-46c7-a5e9-bdb8dbbea6a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:41.950487 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cdb7bcd8-be57-46c7-a5e9-bdb8dbbea6a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044178 Oct 11 06:50:41.951016 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 575/1195] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:41 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:42.394191 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-66a883c7-8a74-426b-99f7-961a21d76157 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:42.396395 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-66a883c7-8a74-426b-99f7-961a21d76157 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:42.403354 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-66a883c7-8a74-426b-99f7-961a21d76157 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:42.403862 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-66a883c7-8a74-426b-99f7-961a21d76157 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:42.404286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-66a883c7-8a74-426b-99f7-961a21d76157 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:42.405370 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-66a883c7-8a74-426b-99f7-961a21d76157 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:42.405975 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-66a883c7-8a74-426b-99f7-961a21d76157 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:42.406392 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-66a883c7-8a74-426b-99f7-961a21d76157 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:42.436627 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-66a883c7-8a74-426b-99f7-961a21d76157 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046535 Oct 11 06:50:42.437177 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 621/1196] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:42 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:42.962767 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-db49fa49-5758-4ce6-a0e1-d1eb0f230a2f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:42.965498 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-db49fa49-5758-4ce6-a0e1-d1eb0f230a2f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:42.971882 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db49fa49-5758-4ce6-a0e1-d1eb0f230a2f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:42.972361 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db49fa49-5758-4ce6-a0e1-d1eb0f230a2f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:42.972793 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db49fa49-5758-4ce6-a0e1-d1eb0f230a2f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:42.973478 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db49fa49-5758-4ce6-a0e1-d1eb0f230a2f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:42.973927 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db49fa49-5758-4ce6-a0e1-d1eb0f230a2f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:42.974347 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db49fa49-5758-4ce6-a0e1-d1eb0f230a2f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:43.002934 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-db49fa49-5758-4ce6-a0e1-d1eb0f230a2f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044107 Oct 11 06:50:43.003486 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 576/1197] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:42 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:43.450588 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-16c4e5c7-ddea-4e7b-b3b0-81805385366d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:43.452769 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-16c4e5c7-ddea-4e7b-b3b0-81805385366d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:43.459227 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-16c4e5c7-ddea-4e7b-b3b0-81805385366d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:43.459747 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-16c4e5c7-ddea-4e7b-b3b0-81805385366d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:43.460184 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-16c4e5c7-ddea-4e7b-b3b0-81805385366d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:43.461229 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-16c4e5c7-ddea-4e7b-b3b0-81805385366d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:43.461350 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-16c4e5c7-ddea-4e7b-b3b0-81805385366d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:43.461737 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-16c4e5c7-ddea-4e7b-b3b0-81805385366d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:43.491552 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-16c4e5c7-ddea-4e7b-b3b0-81805385366d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046294 Oct 11 06:50:43.492106 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 622/1198] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:43 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:44.014974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1deeaa76-ba83-440e-b6c3-b82384090385 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:44.017107 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1deeaa76-ba83-440e-b6c3-b82384090385 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:44.023734 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1deeaa76-ba83-440e-b6c3-b82384090385 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:44.024211 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1deeaa76-ba83-440e-b6c3-b82384090385 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:44.024643 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1deeaa76-ba83-440e-b6c3-b82384090385 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:44.025330 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1deeaa76-ba83-440e-b6c3-b82384090385 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:44.025779 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1deeaa76-ba83-440e-b6c3-b82384090385 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:44.026700 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1deeaa76-ba83-440e-b6c3-b82384090385 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:44.043361 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:50:44.057893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1deeaa76-ba83-440e-b6c3-b82384090385 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046865 Oct 11 06:50:44.058439 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 577/1199] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:44 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:44.507369 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6cbc68ff-206d-4b95-ac11-d88ed9fa9378 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:44.509747 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6cbc68ff-206d-4b95-ac11-d88ed9fa9378 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:44.516895 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6cbc68ff-206d-4b95-ac11-d88ed9fa9378 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:44.517374 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6cbc68ff-206d-4b95-ac11-d88ed9fa9378 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:44.518120 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6cbc68ff-206d-4b95-ac11-d88ed9fa9378 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:44.518767 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6cbc68ff-206d-4b95-ac11-d88ed9fa9378 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:44.519213 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6cbc68ff-206d-4b95-ac11-d88ed9fa9378 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:44.519665 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6cbc68ff-206d-4b95-ac11-d88ed9fa9378 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:44.548981 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6cbc68ff-206d-4b95-ac11-d88ed9fa9378 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046949 Oct 11 06:50:44.549541 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 623/1200] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:44 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:45.070214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a88156eb-0971-4b0e-9e26-cdca65c5207f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:45.072365 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a88156eb-0971-4b0e-9e26-cdca65c5207f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:45.079214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a88156eb-0971-4b0e-9e26-cdca65c5207f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:45.079720 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a88156eb-0971-4b0e-9e26-cdca65c5207f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:45.080153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a88156eb-0971-4b0e-9e26-cdca65c5207f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:45.080841 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a88156eb-0971-4b0e-9e26-cdca65c5207f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:45.081289 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a88156eb-0971-4b0e-9e26-cdca65c5207f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:45.081708 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a88156eb-0971-4b0e-9e26-cdca65c5207f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:45.110426 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a88156eb-0971-4b0e-9e26-cdca65c5207f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044180 Oct 11 06:50:45.110976 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 578/1201] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:45 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:45.563979 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a83d074f-4525-4d38-9cb6-c0a3e1111ee6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:45.566315 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a83d074f-4525-4d38-9cb6-c0a3e1111ee6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:45.572693 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a83d074f-4525-4d38-9cb6-c0a3e1111ee6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:45.573168 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a83d074f-4525-4d38-9cb6-c0a3e1111ee6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:45.573598 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a83d074f-4525-4d38-9cb6-c0a3e1111ee6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:45.574883 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a83d074f-4525-4d38-9cb6-c0a3e1111ee6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:45.575358 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a83d074f-4525-4d38-9cb6-c0a3e1111ee6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:45.575803 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a83d074f-4525-4d38-9cb6-c0a3e1111ee6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:45.604918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a83d074f-4525-4d38-9cb6-c0a3e1111ee6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047533 Oct 11 06:50:45.605969 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 624/1202] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:45 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:46.122892 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c7b40cc7-7f9e-42f9-9647-309f9d50def4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:46.125023 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c7b40cc7-7f9e-42f9-9647-309f9d50def4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:46.131387 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c7b40cc7-7f9e-42f9-9647-309f9d50def4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:46.131897 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c7b40cc7-7f9e-42f9-9647-309f9d50def4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:46.132333 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c7b40cc7-7f9e-42f9-9647-309f9d50def4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:46.133021 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c7b40cc7-7f9e-42f9-9647-309f9d50def4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:46.133469 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c7b40cc7-7f9e-42f9-9647-309f9d50def4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:46.133889 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c7b40cc7-7f9e-42f9-9647-309f9d50def4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:46.162707 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c7b40cc7-7f9e-42f9-9647-309f9d50def4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043800 Oct 11 06:50:46.163232 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 579/1203] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:46 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:46.617107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-36dc1618-832e-40d5-8429-a642314aff8b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:46.620950 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-36dc1618-832e-40d5-8429-a642314aff8b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:46.627278 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-36dc1618-832e-40d5-8429-a642314aff8b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:46.627794 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-36dc1618-832e-40d5-8429-a642314aff8b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:46.628273 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-36dc1618-832e-40d5-8429-a642314aff8b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:46.628926 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-36dc1618-832e-40d5-8429-a642314aff8b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:46.629373 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-36dc1618-832e-40d5-8429-a642314aff8b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:46.629789 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-36dc1618-832e-40d5-8429-a642314aff8b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:46.660423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-36dc1618-832e-40d5-8429-a642314aff8b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047250 Oct 11 06:50:46.660967 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 625/1204] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:46 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:47.174784 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e09c2a94-6a79-43b0-9bb9-e88c4abaf70e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:47.176941 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e09c2a94-6a79-43b0-9bb9-e88c4abaf70e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:47.178918 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 06:50:47.179066 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Tue Oct 11 06:50:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments (ip 10.222.0.39) !!! Oct 11 06:50:47.186130 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e09c2a94-6a79-43b0-9bb9-e88c4abaf70e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:47.186639 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e09c2a94-6a79-43b0-9bb9-e88c4abaf70e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:47.187070 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e09c2a94-6a79-43b0-9bb9-e88c4abaf70e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:47.187796 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e09c2a94-6a79-43b0-9bb9-e88c4abaf70e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:47.188250 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e09c2a94-6a79-43b0-9bb9-e88c4abaf70e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:47.188674 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e09c2a94-6a79-43b0-9bb9-e88c4abaf70e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:47.219148 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e09c2a94-6a79-43b0-9bb9-e88c4abaf70e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048325 Oct 11 06:50:47.219745 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 580/1205] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:47 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:47.673589 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bb629ed9-6ffa-4af7-be4e-1bb0f6cfe489 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:47.675736 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bb629ed9-6ffa-4af7-be4e-1bb0f6cfe489 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:47.681956 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bb629ed9-6ffa-4af7-be4e-1bb0f6cfe489 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:47.682425 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bb629ed9-6ffa-4af7-be4e-1bb0f6cfe489 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:47.682851 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bb629ed9-6ffa-4af7-be4e-1bb0f6cfe489 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:47.683621 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bb629ed9-6ffa-4af7-be4e-1bb0f6cfe489 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:47.684062 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bb629ed9-6ffa-4af7-be4e-1bb0f6cfe489 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:47.684473 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bb629ed9-6ffa-4af7-be4e-1bb0f6cfe489 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:47.715279 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bb629ed9-6ffa-4af7-be4e-1bb0f6cfe489 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045161 Oct 11 06:50:47.715864 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 626/1206] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:47 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:48.232274 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f3e85685-e3d7-4dda-820a-5c292f601576 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:48.234412 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f3e85685-e3d7-4dda-820a-5c292f601576 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:48.240408 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3e85685-e3d7-4dda-820a-5c292f601576 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:48.240888 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3e85685-e3d7-4dda-820a-5c292f601576 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:48.241327 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3e85685-e3d7-4dda-820a-5c292f601576 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:48.242013 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3e85685-e3d7-4dda-820a-5c292f601576 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:48.242463 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3e85685-e3d7-4dda-820a-5c292f601576 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:48.242883 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3e85685-e3d7-4dda-820a-5c292f601576 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:48.272371 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f3e85685-e3d7-4dda-820a-5c292f601576 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044600 Oct 11 06:50:48.272901 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 581/1207] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:48 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:48.740882 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7703a256-d05f-4e5d-ba6b-43997a18c8ea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:48.742990 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7703a256-d05f-4e5d-ba6b-43997a18c8ea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:48.749847 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7703a256-d05f-4e5d-ba6b-43997a18c8ea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:48.750326 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7703a256-d05f-4e5d-ba6b-43997a18c8ea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:48.750761 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7703a256-d05f-4e5d-ba6b-43997a18c8ea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:48.751470 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7703a256-d05f-4e5d-ba6b-43997a18c8ea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:48.751920 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7703a256-d05f-4e5d-ba6b-43997a18c8ea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:48.752334 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7703a256-d05f-4e5d-ba6b-43997a18c8ea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:48.782029 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7703a256-d05f-4e5d-ba6b-43997a18c8ea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045084 Oct 11 06:50:48.782571 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 627/1208] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:48 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:49.284995 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-54d928b0-91ce-4ed1-b80b-8fd739c058d3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:49.287084 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-54d928b0-91ce-4ed1-b80b-8fd739c058d3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:49.294128 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-54d928b0-91ce-4ed1-b80b-8fd739c058d3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:49.294594 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-54d928b0-91ce-4ed1-b80b-8fd739c058d3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:49.295017 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-54d928b0-91ce-4ed1-b80b-8fd739c058d3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:49.295730 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-54d928b0-91ce-4ed1-b80b-8fd739c058d3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:49.296176 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-54d928b0-91ce-4ed1-b80b-8fd739c058d3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:49.296587 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-54d928b0-91ce-4ed1-b80b-8fd739c058d3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:49.326049 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-54d928b0-91ce-4ed1-b80b-8fd739c058d3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044996 Oct 11 06:50:49.326595 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 582/1209] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:49 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:49.793913 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f3a78c3c-73e5-4457-8103-04c6611e9b2b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:49.796343 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f3a78c3c-73e5-4457-8103-04c6611e9b2b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:49.802520 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f3a78c3c-73e5-4457-8103-04c6611e9b2b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:49.802995 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f3a78c3c-73e5-4457-8103-04c6611e9b2b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:49.803449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f3a78c3c-73e5-4457-8103-04c6611e9b2b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:49.804146 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f3a78c3c-73e5-4457-8103-04c6611e9b2b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:49.804622 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f3a78c3c-73e5-4457-8103-04c6611e9b2b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:49.805039 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f3a78c3c-73e5-4457-8103-04c6611e9b2b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:49.837694 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f3a78c3c-73e5-4457-8103-04c6611e9b2b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047584 Oct 11 06:50:49.842244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 628/1210] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:49 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:50.338304 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9224d4e7-8d3e-454a-9b7b-7cafcd47677a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:50.340443 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9224d4e7-8d3e-454a-9b7b-7cafcd47677a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:50.346816 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9224d4e7-8d3e-454a-9b7b-7cafcd47677a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:50.347597 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9224d4e7-8d3e-454a-9b7b-7cafcd47677a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:50.348032 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9224d4e7-8d3e-454a-9b7b-7cafcd47677a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:50.348713 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9224d4e7-8d3e-454a-9b7b-7cafcd47677a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:50.349160 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9224d4e7-8d3e-454a-9b7b-7cafcd47677a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:50.349574 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9224d4e7-8d3e-454a-9b7b-7cafcd47677a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:50.379321 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9224d4e7-8d3e-454a-9b7b-7cafcd47677a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045013 Oct 11 06:50:50.379898 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 583/1211] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:50 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:50.849602 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-80e24838-b0a4-40ee-97a1-34c08fd65fd0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:50.851853 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-80e24838-b0a4-40ee-97a1-34c08fd65fd0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:50.859144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-80e24838-b0a4-40ee-97a1-34c08fd65fd0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:50.859603 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-80e24838-b0a4-40ee-97a1-34c08fd65fd0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:50.860043 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-80e24838-b0a4-40ee-97a1-34c08fd65fd0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:50.860740 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-80e24838-b0a4-40ee-97a1-34c08fd65fd0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:50.861195 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-80e24838-b0a4-40ee-97a1-34c08fd65fd0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:50.861619 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-80e24838-b0a4-40ee-97a1-34c08fd65fd0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:50.891719 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-80e24838-b0a4-40ee-97a1-34c08fd65fd0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046386 Oct 11 06:50:50.892675 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 629/1212] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:50 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:51.392777 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ae0b1a50-1b63-4e52-a95a-ebee63e30b79 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:51.394871 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ae0b1a50-1b63-4e52-a95a-ebee63e30b79 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:51.401198 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ae0b1a50-1b63-4e52-a95a-ebee63e30b79 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:51.401673 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ae0b1a50-1b63-4e52-a95a-ebee63e30b79 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:51.402100 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ae0b1a50-1b63-4e52-a95a-ebee63e30b79 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:51.402785 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ae0b1a50-1b63-4e52-a95a-ebee63e30b79 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:51.403227 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ae0b1a50-1b63-4e52-a95a-ebee63e30b79 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:51.403665 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ae0b1a50-1b63-4e52-a95a-ebee63e30b79 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:51.431863 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ae0b1a50-1b63-4e52-a95a-ebee63e30b79 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043283 Oct 11 06:50:51.432404 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 584/1213] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:51 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:51.904808 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ab11efbb-ea54-4ec0-a7ea-4aadfc725f72 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:51.907521 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ab11efbb-ea54-4ec0-a7ea-4aadfc725f72 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:51.914772 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ab11efbb-ea54-4ec0-a7ea-4aadfc725f72 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:51.915550 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ab11efbb-ea54-4ec0-a7ea-4aadfc725f72 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:51.915983 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ab11efbb-ea54-4ec0-a7ea-4aadfc725f72 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:51.916689 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ab11efbb-ea54-4ec0-a7ea-4aadfc725f72 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:51.917132 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ab11efbb-ea54-4ec0-a7ea-4aadfc725f72 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:51.918068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ab11efbb-ea54-4ec0-a7ea-4aadfc725f72 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:51.951912 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ab11efbb-ea54-4ec0-a7ea-4aadfc725f72 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048665 Oct 11 06:50:51.951912 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 630/1214] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:51 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:52.444609 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-408ff556-cb4b-4473-95bf-2c71238869f5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:52.446702 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-408ff556-cb4b-4473-95bf-2c71238869f5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:52.453113 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-408ff556-cb4b-4473-95bf-2c71238869f5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:52.453589 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-408ff556-cb4b-4473-95bf-2c71238869f5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:52.454021 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-408ff556-cb4b-4473-95bf-2c71238869f5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:52.454733 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-408ff556-cb4b-4473-95bf-2c71238869f5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:52.455181 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-408ff556-cb4b-4473-95bf-2c71238869f5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:52.455633 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-408ff556-cb4b-4473-95bf-2c71238869f5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:52.484269 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-408ff556-cb4b-4473-95bf-2c71238869f5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043600 Oct 11 06:50:52.484747 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 585/1215] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:52 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:52.961299 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a4a94b2b-3b41-4309-b4aa-7b1ebfe66c09 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:52.963463 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a4a94b2b-3b41-4309-b4aa-7b1ebfe66c09 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:52.970411 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a4a94b2b-3b41-4309-b4aa-7b1ebfe66c09 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:52.970889 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a4a94b2b-3b41-4309-b4aa-7b1ebfe66c09 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:52.971324 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a4a94b2b-3b41-4309-b4aa-7b1ebfe66c09 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:52.972056 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a4a94b2b-3b41-4309-b4aa-7b1ebfe66c09 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:52.972497 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a4a94b2b-3b41-4309-b4aa-7b1ebfe66c09 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:52.974211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a4a94b2b-3b41-4309-b4aa-7b1ebfe66c09 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:53.015978 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a4a94b2b-3b41-4309-b4aa-7b1ebfe66c09 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058373 Oct 11 06:50:53.016474 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 631/1216] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:52 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:53.496982 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c91d91f8-ddfb-498e-be90-dca9d28396ab tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:53.499078 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c91d91f8-ddfb-498e-be90-dca9d28396ab tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:53.505732 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c91d91f8-ddfb-498e-be90-dca9d28396ab tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:53.506212 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c91d91f8-ddfb-498e-be90-dca9d28396ab tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:53.506643 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c91d91f8-ddfb-498e-be90-dca9d28396ab tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:53.507330 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c91d91f8-ddfb-498e-be90-dca9d28396ab tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:53.507811 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c91d91f8-ddfb-498e-be90-dca9d28396ab tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:53.508231 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c91d91f8-ddfb-498e-be90-dca9d28396ab tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:53.537917 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c91d91f8-ddfb-498e-be90-dca9d28396ab tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045338 Oct 11 06:50:53.538471 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 586/1217] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:53 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:54.028193 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-47b36958-17d9-4172-a8da-d2500ffa7a5e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:54.030334 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-47b36958-17d9-4172-a8da-d2500ffa7a5e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:54.036552 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-47b36958-17d9-4172-a8da-d2500ffa7a5e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:54.037244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-47b36958-17d9-4172-a8da-d2500ffa7a5e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:54.037452 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-47b36958-17d9-4172-a8da-d2500ffa7a5e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:54.038139 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-47b36958-17d9-4172-a8da-d2500ffa7a5e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:54.038583 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-47b36958-17d9-4172-a8da-d2500ffa7a5e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:54.038996 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-47b36958-17d9-4172-a8da-d2500ffa7a5e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:54.080647 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-47b36958-17d9-4172-a8da-d2500ffa7a5e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056224 Oct 11 06:50:54.081195 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 632/1218] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:54 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:54.550828 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-42a7a309-19a8-4017-bd1e-f7bc0ac37f98 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:54.552956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-42a7a309-19a8-4017-bd1e-f7bc0ac37f98 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:54.559239 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42a7a309-19a8-4017-bd1e-f7bc0ac37f98 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:54.559751 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42a7a309-19a8-4017-bd1e-f7bc0ac37f98 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:54.560180 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42a7a309-19a8-4017-bd1e-f7bc0ac37f98 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:54.560862 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42a7a309-19a8-4017-bd1e-f7bc0ac37f98 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:54.561302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42a7a309-19a8-4017-bd1e-f7bc0ac37f98 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:54.561717 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42a7a309-19a8-4017-bd1e-f7bc0ac37f98 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:54.590311 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-42a7a309-19a8-4017-bd1e-f7bc0ac37f98 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043568 Oct 11 06:50:54.590831 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 587/1219] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:54 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:55.092583 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2b049058-cb03-4f21-acfc-9343cc72698a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:55.095026 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2b049058-cb03-4f21-acfc-9343cc72698a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:55.101379 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2b049058-cb03-4f21-acfc-9343cc72698a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:55.101853 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2b049058-cb03-4f21-acfc-9343cc72698a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:55.102305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2b049058-cb03-4f21-acfc-9343cc72698a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:55.103029 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2b049058-cb03-4f21-acfc-9343cc72698a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:55.103494 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2b049058-cb03-4f21-acfc-9343cc72698a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:55.103914 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2b049058-cb03-4f21-acfc-9343cc72698a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:55.146834 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2b049058-cb03-4f21-acfc-9343cc72698a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058175 Oct 11 06:50:55.147371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 633/1220] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:55 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:55.602304 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-caad96a4-2230-4b4f-9ee7-8a444e0c2faa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:55.604428 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-caad96a4-2230-4b4f-9ee7-8a444e0c2faa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:55.611271 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-caad96a4-2230-4b4f-9ee7-8a444e0c2faa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:55.611784 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-caad96a4-2230-4b4f-9ee7-8a444e0c2faa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:55.612241 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-caad96a4-2230-4b4f-9ee7-8a444e0c2faa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:55.612911 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-caad96a4-2230-4b4f-9ee7-8a444e0c2faa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:55.613356 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-caad96a4-2230-4b4f-9ee7-8a444e0c2faa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:55.613775 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-caad96a4-2230-4b4f-9ee7-8a444e0c2faa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:55.643888 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-caad96a4-2230-4b4f-9ee7-8a444e0c2faa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045556 Oct 11 06:50:55.644428 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 588/1221] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:55 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:56.158917 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8e5ab27b-3690-4217-bc91-e6cc90857cbb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:56.161127 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8e5ab27b-3690-4217-bc91-e6cc90857cbb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:56.167681 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8e5ab27b-3690-4217-bc91-e6cc90857cbb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:56.168154 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8e5ab27b-3690-4217-bc91-e6cc90857cbb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:56.168581 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8e5ab27b-3690-4217-bc91-e6cc90857cbb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:56.169265 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8e5ab27b-3690-4217-bc91-e6cc90857cbb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:56.169701 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8e5ab27b-3690-4217-bc91-e6cc90857cbb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:56.170111 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8e5ab27b-3690-4217-bc91-e6cc90857cbb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:56.199668 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8e5ab27b-3690-4217-bc91-e6cc90857cbb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044759 Oct 11 06:50:56.200217 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 634/1222] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:56 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:56.656448 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3b733c73-4fdf-4746-911f-b4e481a1ab92 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:56.658623 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3b733c73-4fdf-4746-911f-b4e481a1ab92 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:56.665047 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3b733c73-4fdf-4746-911f-b4e481a1ab92 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:56.665518 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3b733c73-4fdf-4746-911f-b4e481a1ab92 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:56.665944 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3b733c73-4fdf-4746-911f-b4e481a1ab92 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:56.666624 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3b733c73-4fdf-4746-911f-b4e481a1ab92 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:56.667065 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3b733c73-4fdf-4746-911f-b4e481a1ab92 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:56.667519 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3b733c73-4fdf-4746-911f-b4e481a1ab92 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:56.696036 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3b733c73-4fdf-4746-911f-b4e481a1ab92 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043570 Oct 11 06:50:56.696570 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 589/1223] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:56 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:57.212384 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0e036415-bd88-46fe-a31e-0990ee7b0770 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:57.225317 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0e036415-bd88-46fe-a31e-0990ee7b0770 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:57.234460 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0e036415-bd88-46fe-a31e-0990ee7b0770 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:57.234976 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0e036415-bd88-46fe-a31e-0990ee7b0770 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:57.235616 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0e036415-bd88-46fe-a31e-0990ee7b0770 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:57.236352 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0e036415-bd88-46fe-a31e-0990ee7b0770 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:57.236805 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0e036415-bd88-46fe-a31e-0990ee7b0770 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:57.237223 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0e036415-bd88-46fe-a31e-0990ee7b0770 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:57.265798 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0e036415-bd88-46fe-a31e-0990ee7b0770 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058551 Oct 11 06:50:57.266336 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 635/1224] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:57 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:57.709261 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-954a87e4-3466-4b4a-ac40-3cb61661632f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:57.711442 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-954a87e4-3466-4b4a-ac40-3cb61661632f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:57.718337 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-954a87e4-3466-4b4a-ac40-3cb61661632f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:57.718799 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-954a87e4-3466-4b4a-ac40-3cb61661632f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:57.719233 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-954a87e4-3466-4b4a-ac40-3cb61661632f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:57.719949 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-954a87e4-3466-4b4a-ac40-3cb61661632f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:57.720402 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-954a87e4-3466-4b4a-ac40-3cb61661632f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:57.720817 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-954a87e4-3466-4b4a-ac40-3cb61661632f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:57.749773 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-954a87e4-3466-4b4a-ac40-3cb61661632f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044425 Oct 11 06:50:57.750309 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 590/1225] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:57 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:58.278288 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5352823a-6a21-48c7-8cee-8419e933e8b0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:58.280593 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5352823a-6a21-48c7-8cee-8419e933e8b0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:58.282849 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=58 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:50:58.288426 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5352823a-6a21-48c7-8cee-8419e933e8b0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:58.288942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5352823a-6a21-48c7-8cee-8419e933e8b0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:58.289366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5352823a-6a21-48c7-8cee-8419e933e8b0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:58.290054 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5352823a-6a21-48c7-8cee-8419e933e8b0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:58.290493 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5352823a-6a21-48c7-8cee-8419e933e8b0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:58.290910 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5352823a-6a21-48c7-8cee-8419e933e8b0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:58.307472 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:50:58.321198 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5352823a-6a21-48c7-8cee-8419e933e8b0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047063 Oct 11 06:50:58.321734 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 636/1226] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:58 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:58.762229 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ad72e699-7330-4ffe-949f-03b17ce827fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:58.764369 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ad72e699-7330-4ffe-949f-03b17ce827fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:58.771105 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ad72e699-7330-4ffe-949f-03b17ce827fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:58.771617 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ad72e699-7330-4ffe-949f-03b17ce827fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:58.772054 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ad72e699-7330-4ffe-949f-03b17ce827fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:58.772749 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ad72e699-7330-4ffe-949f-03b17ce827fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:58.773199 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ad72e699-7330-4ffe-949f-03b17ce827fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:58.773623 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ad72e699-7330-4ffe-949f-03b17ce827fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:58.802983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ad72e699-7330-4ffe-949f-03b17ce827fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044728 Oct 11 06:50:58.803547 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 591/1227] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:58 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:50:59.333530 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-849f8ad1-6303-4653-aa22-39291b5f64bb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:59.336042 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-849f8ad1-6303-4653-aa22-39291b5f64bb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:59.343205 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-849f8ad1-6303-4653-aa22-39291b5f64bb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:59.343782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-849f8ad1-6303-4653-aa22-39291b5f64bb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:59.344212 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-849f8ad1-6303-4653-aa22-39291b5f64bb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:59.344909 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-849f8ad1-6303-4653-aa22-39291b5f64bb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:59.345363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-849f8ad1-6303-4653-aa22-39291b5f64bb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:59.345756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-849f8ad1-6303-4653-aa22-39291b5f64bb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:59.374973 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-849f8ad1-6303-4653-aa22-39291b5f64bb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045521 Oct 11 06:50:59.375524 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 637/1228] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:50:59 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:50:59.815442 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d551b00f-22e0-444e-ad3f-4cf29f47db0b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:50:59.817635 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d551b00f-22e0-444e-ad3f-4cf29f47db0b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:50:59.824734 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d551b00f-22e0-444e-ad3f-4cf29f47db0b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:59.825220 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d551b00f-22e0-444e-ad3f-4cf29f47db0b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:59.825654 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d551b00f-22e0-444e-ad3f-4cf29f47db0b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:59.826342 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d551b00f-22e0-444e-ad3f-4cf29f47db0b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:50:59.826798 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d551b00f-22e0-444e-ad3f-4cf29f47db0b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:50:59.827217 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d551b00f-22e0-444e-ad3f-4cf29f47db0b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:50:59.856026 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d551b00f-22e0-444e-ad3f-4cf29f47db0b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044601 Oct 11 06:50:59.856568 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 592/1229] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:50:59 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:00.386040 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-64f595a7-fe47-4c7e-abb6-6eeffbea48db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:00.388341 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-64f595a7-fe47-4c7e-abb6-6eeffbea48db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:00.394845 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-64f595a7-fe47-4c7e-abb6-6eeffbea48db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:00.395327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-64f595a7-fe47-4c7e-abb6-6eeffbea48db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:00.395784 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-64f595a7-fe47-4c7e-abb6-6eeffbea48db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:00.396475 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-64f595a7-fe47-4c7e-abb6-6eeffbea48db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:00.396920 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-64f595a7-fe47-4c7e-abb6-6eeffbea48db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:00.397333 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-64f595a7-fe47-4c7e-abb6-6eeffbea48db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:00.428515 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-64f595a7-fe47-4c7e-abb6-6eeffbea48db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046260 Oct 11 06:51:00.429195 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 638/1230] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:00 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:00.868141 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-63b0b368-7cb3-41cf-8ec3-7c32f5c2e892 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:00.870183 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-63b0b368-7cb3-41cf-8ec3-7c32f5c2e892 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:00.876582 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-63b0b368-7cb3-41cf-8ec3-7c32f5c2e892 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:00.877054 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-63b0b368-7cb3-41cf-8ec3-7c32f5c2e892 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:00.877508 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-63b0b368-7cb3-41cf-8ec3-7c32f5c2e892 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:00.878198 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-63b0b368-7cb3-41cf-8ec3-7c32f5c2e892 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:00.878644 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-63b0b368-7cb3-41cf-8ec3-7c32f5c2e892 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:00.879060 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-63b0b368-7cb3-41cf-8ec3-7c32f5c2e892 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:00.908391 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-63b0b368-7cb3-41cf-8ec3-7c32f5c2e892 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044289 Oct 11 06:51:00.908930 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 593/1231] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:00 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:01.440873 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8f0c3669-74ad-4d9e-8420-835c297327e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:01.442997 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8f0c3669-74ad-4d9e-8420-835c297327e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:01.449407 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f0c3669-74ad-4d9e-8420-835c297327e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:01.449877 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f0c3669-74ad-4d9e-8420-835c297327e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:01.450299 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f0c3669-74ad-4d9e-8420-835c297327e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:01.450983 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f0c3669-74ad-4d9e-8420-835c297327e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:01.451443 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f0c3669-74ad-4d9e-8420-835c297327e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:01.451854 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f0c3669-74ad-4d9e-8420-835c297327e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:01.480727 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8f0c3669-74ad-4d9e-8420-835c297327e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043780 Oct 11 06:51:01.481256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 639/1232] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:01 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:01.921875 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8000b495-ed03-48cb-8f96-eebfdce35573 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:01.924002 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8000b495-ed03-48cb-8f96-eebfdce35573 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:01.930294 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8000b495-ed03-48cb-8f96-eebfdce35573 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:01.930762 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8000b495-ed03-48cb-8f96-eebfdce35573 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:01.931191 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8000b495-ed03-48cb-8f96-eebfdce35573 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:01.931911 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8000b495-ed03-48cb-8f96-eebfdce35573 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:01.932357 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8000b495-ed03-48cb-8f96-eebfdce35573 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:01.932770 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8000b495-ed03-48cb-8f96-eebfdce35573 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:01.936270 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:01.960678 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8000b495-ed03-48cb-8f96-eebfdce35573 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043529 Oct 11 06:51:01.961205 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 594/1233] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:01 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:02.492587 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-eca4fb8f-67a6-4bf2-af5a-e80c97464800 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:02.494772 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-eca4fb8f-67a6-4bf2-af5a-e80c97464800 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:02.501971 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eca4fb8f-67a6-4bf2-af5a-e80c97464800 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:02.502440 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eca4fb8f-67a6-4bf2-af5a-e80c97464800 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:02.502866 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eca4fb8f-67a6-4bf2-af5a-e80c97464800 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:02.503578 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eca4fb8f-67a6-4bf2-af5a-e80c97464800 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:02.504020 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eca4fb8f-67a6-4bf2-af5a-e80c97464800 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:02.504432 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eca4fb8f-67a6-4bf2-af5a-e80c97464800 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:02.533802 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-eca4fb8f-67a6-4bf2-af5a-e80c97464800 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045004 Oct 11 06:51:02.534328 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 640/1234] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:02 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:02.973697 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2470b6b9-f6a2-46f0-9506-9fa1fc09d979 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:02.975867 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2470b6b9-f6a2-46f0-9506-9fa1fc09d979 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:02.982603 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2470b6b9-f6a2-46f0-9506-9fa1fc09d979 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:02.983073 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2470b6b9-f6a2-46f0-9506-9fa1fc09d979 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:02.983531 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2470b6b9-f6a2-46f0-9506-9fa1fc09d979 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:02.984213 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2470b6b9-f6a2-46f0-9506-9fa1fc09d979 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:02.984654 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2470b6b9-f6a2-46f0-9506-9fa1fc09d979 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:02.985068 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2470b6b9-f6a2-46f0-9506-9fa1fc09d979 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:03.013531 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2470b6b9-f6a2-46f0-9506-9fa1fc09d979 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043759 Oct 11 06:51:03.014064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 595/1235] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:02 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:03.546498 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c00a6ee6-f4bc-407b-9e2d-d3f702592905 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:03.549221 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c00a6ee6-f4bc-407b-9e2d-d3f702592905 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:03.555274 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c00a6ee6-f4bc-407b-9e2d-d3f702592905 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:03.555772 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c00a6ee6-f4bc-407b-9e2d-d3f702592905 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:03.556203 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c00a6ee6-f4bc-407b-9e2d-d3f702592905 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:03.556894 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c00a6ee6-f4bc-407b-9e2d-d3f702592905 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:03.558824 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c00a6ee6-f4bc-407b-9e2d-d3f702592905 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:03.559274 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c00a6ee6-f4bc-407b-9e2d-d3f702592905 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:03.589890 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c00a6ee6-f4bc-407b-9e2d-d3f702592905 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047721 Oct 11 06:51:03.590508 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 641/1236] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:03 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:04.026290 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-66f3e6f1-d42b-4ddc-b7b5-156e49e1de86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:04.028444 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-66f3e6f1-d42b-4ddc-b7b5-156e49e1de86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:04.034873 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-66f3e6f1-d42b-4ddc-b7b5-156e49e1de86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:04.035353 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-66f3e6f1-d42b-4ddc-b7b5-156e49e1de86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:04.035846 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-66f3e6f1-d42b-4ddc-b7b5-156e49e1de86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:04.036538 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-66f3e6f1-d42b-4ddc-b7b5-156e49e1de86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:04.036991 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-66f3e6f1-d42b-4ddc-b7b5-156e49e1de86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:04.037412 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-66f3e6f1-d42b-4ddc-b7b5-156e49e1de86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:04.066116 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-66f3e6f1-d42b-4ddc-b7b5-156e49e1de86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043784 Oct 11 06:51:04.066652 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 596/1237] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:04 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:04.602267 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fecf69f1-27a2-4dc9-870a-75db5e062e49 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:04.605077 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fecf69f1-27a2-4dc9-870a-75db5e062e49 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:04.611346 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fecf69f1-27a2-4dc9-870a-75db5e062e49 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:04.611899 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fecf69f1-27a2-4dc9-870a-75db5e062e49 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:04.612323 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fecf69f1-27a2-4dc9-870a-75db5e062e49 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:04.613281 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fecf69f1-27a2-4dc9-870a-75db5e062e49 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:04.613493 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fecf69f1-27a2-4dc9-870a-75db5e062e49 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:04.613846 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fecf69f1-27a2-4dc9-870a-75db5e062e49 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:04.644016 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fecf69f1-27a2-4dc9-870a-75db5e062e49 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045657 Oct 11 06:51:04.644568 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 642/1238] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:04 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:05.078729 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7c393d81-b845-41d3-9a04-04602543e97b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:05.081006 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7c393d81-b845-41d3-9a04-04602543e97b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:05.087337 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7c393d81-b845-41d3-9a04-04602543e97b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:05.087850 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7c393d81-b845-41d3-9a04-04602543e97b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:05.088285 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7c393d81-b845-41d3-9a04-04602543e97b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:05.089508 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7c393d81-b845-41d3-9a04-04602543e97b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:05.089965 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7c393d81-b845-41d3-9a04-04602543e97b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:05.090385 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7c393d81-b845-41d3-9a04-04602543e97b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:05.119554 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7c393d81-b845-41d3-9a04-04602543e97b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044740 Oct 11 06:51:05.120105 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 597/1239] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:05 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:05.655682 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-59c7f97b-e7ae-4ace-8dbd-efaea27d9d43 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:05.657823 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-59c7f97b-e7ae-4ace-8dbd-efaea27d9d43 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:05.664353 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-59c7f97b-e7ae-4ace-8dbd-efaea27d9d43 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:05.664838 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-59c7f97b-e7ae-4ace-8dbd-efaea27d9d43 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:05.665271 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-59c7f97b-e7ae-4ace-8dbd-efaea27d9d43 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:05.665968 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-59c7f97b-e7ae-4ace-8dbd-efaea27d9d43 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:05.666414 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-59c7f97b-e7ae-4ace-8dbd-efaea27d9d43 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:05.666837 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-59c7f97b-e7ae-4ace-8dbd-efaea27d9d43 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:05.699515 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-59c7f97b-e7ae-4ace-8dbd-efaea27d9d43 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047642 Oct 11 06:51:05.704054 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 643/1240] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:05 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:06.131882 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-fa964c7f-f59e-4484-b362-4ecbcdeee93f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:06.133967 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-fa964c7f-f59e-4484-b362-4ecbcdeee93f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:06.140301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fa964c7f-f59e-4484-b362-4ecbcdeee93f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:06.140770 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fa964c7f-f59e-4484-b362-4ecbcdeee93f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:06.141197 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fa964c7f-f59e-4484-b362-4ecbcdeee93f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:06.142145 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fa964c7f-f59e-4484-b362-4ecbcdeee93f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:06.142588 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fa964c7f-f59e-4484-b362-4ecbcdeee93f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:06.142998 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fa964c7f-f59e-4484-b362-4ecbcdeee93f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:06.171425 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-fa964c7f-f59e-4484-b362-4ecbcdeee93f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043500 Oct 11 06:51:06.171978 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 598/1241] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:06 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:06.711512 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-75d6c303-03b2-4b9e-a79a-6cebd7ca865f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:06.714280 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-75d6c303-03b2-4b9e-a79a-6cebd7ca865f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:06.720681 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-75d6c303-03b2-4b9e-a79a-6cebd7ca865f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:06.721151 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-75d6c303-03b2-4b9e-a79a-6cebd7ca865f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:06.721595 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-75d6c303-03b2-4b9e-a79a-6cebd7ca865f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:06.722289 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-75d6c303-03b2-4b9e-a79a-6cebd7ca865f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:06.722740 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-75d6c303-03b2-4b9e-a79a-6cebd7ca865f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:06.723165 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-75d6c303-03b2-4b9e-a79a-6cebd7ca865f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:06.753138 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-75d6c303-03b2-4b9e-a79a-6cebd7ca865f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045532 Oct 11 06:51:06.753679 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 644/1242] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:06 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:07.183410 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5746af00-974d-4ac4-a7a9-feb04434e3af tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:07.185560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5746af00-974d-4ac4-a7a9-feb04434e3af tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:07.191940 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5746af00-974d-4ac4-a7a9-feb04434e3af tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:07.192410 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5746af00-974d-4ac4-a7a9-feb04434e3af tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:07.192837 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5746af00-974d-4ac4-a7a9-feb04434e3af tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:07.193517 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5746af00-974d-4ac4-a7a9-feb04434e3af tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:07.193957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5746af00-974d-4ac4-a7a9-feb04434e3af tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:07.194372 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5746af00-974d-4ac4-a7a9-feb04434e3af tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:07.223341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5746af00-974d-4ac4-a7a9-feb04434e3af tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044318 Oct 11 06:51:07.223914 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 599/1243] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:07 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:07.765244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3b51c96e-0f81-4d5d-889e-0222eb8efe49 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:07.767745 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3b51c96e-0f81-4d5d-889e-0222eb8efe49 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:07.774031 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b51c96e-0f81-4d5d-889e-0222eb8efe49 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:07.774513 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b51c96e-0f81-4d5d-889e-0222eb8efe49 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:07.774947 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b51c96e-0f81-4d5d-889e-0222eb8efe49 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:07.776280 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b51c96e-0f81-4d5d-889e-0222eb8efe49 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:07.776736 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b51c96e-0f81-4d5d-889e-0222eb8efe49 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:07.777160 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b51c96e-0f81-4d5d-889e-0222eb8efe49 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:07.808589 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3b51c96e-0f81-4d5d-889e-0222eb8efe49 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047227 Oct 11 06:51:07.809591 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 645/1244] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:07 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:08.235999 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9abcd230-661b-4954-83fb-75fadc91af2c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:08.238029 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9abcd230-661b-4954-83fb-75fadc91af2c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:08.244452 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9abcd230-661b-4954-83fb-75fadc91af2c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:08.244929 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9abcd230-661b-4954-83fb-75fadc91af2c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:08.245382 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9abcd230-661b-4954-83fb-75fadc91af2c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:08.246050 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9abcd230-661b-4954-83fb-75fadc91af2c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:08.246497 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9abcd230-661b-4954-83fb-75fadc91af2c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:08.246919 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9abcd230-661b-4954-83fb-75fadc91af2c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:08.277161 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9abcd230-661b-4954-83fb-75fadc91af2c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045195 Oct 11 06:51:08.277705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 600/1245] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:08 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:08.820145 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ac43cb88-df1e-440a-b1da-50875e6a5ce4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:08.822283 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ac43cb88-df1e-440a-b1da-50875e6a5ce4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:08.828869 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ac43cb88-df1e-440a-b1da-50875e6a5ce4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:08.829345 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ac43cb88-df1e-440a-b1da-50875e6a5ce4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:08.829774 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ac43cb88-df1e-440a-b1da-50875e6a5ce4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:08.830466 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ac43cb88-df1e-440a-b1da-50875e6a5ce4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:08.830909 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ac43cb88-df1e-440a-b1da-50875e6a5ce4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:08.831328 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ac43cb88-df1e-440a-b1da-50875e6a5ce4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:08.860934 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ac43cb88-df1e-440a-b1da-50875e6a5ce4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044521 Oct 11 06:51:08.861767 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 646/1246] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:08 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:09.289751 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3cf913d5-5062-4b91-a188-af1deba4ca00 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:09.292475 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3cf913d5-5062-4b91-a188-af1deba4ca00 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:09.298756 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3cf913d5-5062-4b91-a188-af1deba4ca00 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:09.299230 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3cf913d5-5062-4b91-a188-af1deba4ca00 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:09.299705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3cf913d5-5062-4b91-a188-af1deba4ca00 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:09.300392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3cf913d5-5062-4b91-a188-af1deba4ca00 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:09.300841 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3cf913d5-5062-4b91-a188-af1deba4ca00 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:09.301264 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3cf913d5-5062-4b91-a188-af1deba4ca00 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:09.329491 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3cf913d5-5062-4b91-a188-af1deba4ca00 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043708 Oct 11 06:51:09.330023 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 601/1247] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:09 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:09.872621 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9b710eb5-1e5f-4978-8e49-795584137ade tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:09.874730 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9b710eb5-1e5f-4978-8e49-795584137ade tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:09.880993 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9b710eb5-1e5f-4978-8e49-795584137ade tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:09.881460 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9b710eb5-1e5f-4978-8e49-795584137ade tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:09.881888 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9b710eb5-1e5f-4978-8e49-795584137ade tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:09.882574 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9b710eb5-1e5f-4978-8e49-795584137ade tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:09.883012 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9b710eb5-1e5f-4978-8e49-795584137ade tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:09.883439 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9b710eb5-1e5f-4978-8e49-795584137ade tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:09.913656 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9b710eb5-1e5f-4978-8e49-795584137ade tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044842 Oct 11 06:51:09.914199 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 647/1248] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:09 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:10.341191 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ba8b94ee-e4aa-421b-a2a9-eede0c378f07 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:10.343328 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ba8b94ee-e4aa-421b-a2a9-eede0c378f07 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:10.349750 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba8b94ee-e4aa-421b-a2a9-eede0c378f07 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:10.350223 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba8b94ee-e4aa-421b-a2a9-eede0c378f07 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:10.350648 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba8b94ee-e4aa-421b-a2a9-eede0c378f07 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:10.351328 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba8b94ee-e4aa-421b-a2a9-eede0c378f07 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:10.351792 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba8b94ee-e4aa-421b-a2a9-eede0c378f07 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:10.352204 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba8b94ee-e4aa-421b-a2a9-eede0c378f07 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:10.381154 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ba8b94ee-e4aa-421b-a2a9-eede0c378f07 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043936 Oct 11 06:51:10.381691 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 602/1249] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:10 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:10.928892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5d9fa25c-cbb2-416d-9127-c527a0638dd0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:10.931105 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5d9fa25c-cbb2-416d-9127-c527a0638dd0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:10.937631 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5d9fa25c-cbb2-416d-9127-c527a0638dd0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:10.938111 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5d9fa25c-cbb2-416d-9127-c527a0638dd0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:10.938530 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5d9fa25c-cbb2-416d-9127-c527a0638dd0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:10.939222 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5d9fa25c-cbb2-416d-9127-c527a0638dd0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:10.939695 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5d9fa25c-cbb2-416d-9127-c527a0638dd0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:10.940105 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5d9fa25c-cbb2-416d-9127-c527a0638dd0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:10.970279 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5d9fa25c-cbb2-416d-9127-c527a0638dd0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048357 Oct 11 06:51:10.971131 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 648/1250] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:10 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:11.393973 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-23be69b0-5729-4fde-84c9-a61e763d3d87 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:11.396092 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-23be69b0-5729-4fde-84c9-a61e763d3d87 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:11.398373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=58 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:11.404401 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23be69b0-5729-4fde-84c9-a61e763d3d87 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:11.404875 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23be69b0-5729-4fde-84c9-a61e763d3d87 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:11.405301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23be69b0-5729-4fde-84c9-a61e763d3d87 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:11.405985 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23be69b0-5729-4fde-84c9-a61e763d3d87 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:11.406426 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23be69b0-5729-4fde-84c9-a61e763d3d87 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:11.406838 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23be69b0-5729-4fde-84c9-a61e763d3d87 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:11.435479 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-23be69b0-5729-4fde-84c9-a61e763d3d87 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045798 Oct 11 06:51:11.436057 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 603/1251] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:11 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:11.984247 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fd3507cd-698c-4e0e-948d-22b2b3257cff tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:11.986472 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fd3507cd-698c-4e0e-948d-22b2b3257cff tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:11.992849 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fd3507cd-698c-4e0e-948d-22b2b3257cff tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:11.993330 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fd3507cd-698c-4e0e-948d-22b2b3257cff tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:11.993764 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fd3507cd-698c-4e0e-948d-22b2b3257cff tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:11.995092 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fd3507cd-698c-4e0e-948d-22b2b3257cff tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:11.995580 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fd3507cd-698c-4e0e-948d-22b2b3257cff tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:11.996004 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fd3507cd-698c-4e0e-948d-22b2b3257cff tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:12.026091 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fd3507cd-698c-4e0e-948d-22b2b3257cff tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047779 Oct 11 06:51:12.026841 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 649/1252] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:11 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:12.448016 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f2f2b125-b47b-487e-b5fc-d3139d4017b4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:12.450163 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f2f2b125-b47b-487e-b5fc-d3139d4017b4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:12.456501 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f2f2b125-b47b-487e-b5fc-d3139d4017b4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:12.456980 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f2f2b125-b47b-487e-b5fc-d3139d4017b4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:12.457413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f2f2b125-b47b-487e-b5fc-d3139d4017b4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:12.458099 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f2f2b125-b47b-487e-b5fc-d3139d4017b4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:12.458547 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f2f2b125-b47b-487e-b5fc-d3139d4017b4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:12.458965 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f2f2b125-b47b-487e-b5fc-d3139d4017b4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:12.488416 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f2f2b125-b47b-487e-b5fc-d3139d4017b4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044451 Oct 11 06:51:12.488948 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 604/1253] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:12 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:13.037966 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-dcdc1e52-af4b-4b65-95b8-e34f1cf5173d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:13.040127 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-dcdc1e52-af4b-4b65-95b8-e34f1cf5173d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:13.046162 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dcdc1e52-af4b-4b65-95b8-e34f1cf5173d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:13.046832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dcdc1e52-af4b-4b65-95b8-e34f1cf5173d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:13.047268 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dcdc1e52-af4b-4b65-95b8-e34f1cf5173d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:13.047991 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dcdc1e52-af4b-4b65-95b8-e34f1cf5173d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:13.048432 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dcdc1e52-af4b-4b65-95b8-e34f1cf5173d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:13.048848 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dcdc1e52-af4b-4b65-95b8-e34f1cf5173d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:13.079178 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-dcdc1e52-af4b-4b65-95b8-e34f1cf5173d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044999 Oct 11 06:51:13.079751 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 650/1254] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:13 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:13.146765 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cf1ca43d-8df6-4426-8314-ae6cd21f8a95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:13.148930 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cf1ca43d-8df6-4426-8314-ae6cd21f8a95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:13.154673 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf1ca43d-8df6-4426-8314-ae6cd21f8a95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:13.155144 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf1ca43d-8df6-4426-8314-ae6cd21f8a95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:13.155607 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf1ca43d-8df6-4426-8314-ae6cd21f8a95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:13.156289 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf1ca43d-8df6-4426-8314-ae6cd21f8a95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:13.156734 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf1ca43d-8df6-4426-8314-ae6cd21f8a95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:13.157151 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf1ca43d-8df6-4426-8314-ae6cd21f8a95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:13.185353 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cf1ca43d-8df6-4426-8314-ae6cd21f8a95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042545 Oct 11 06:51:13.185885 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 605/1255] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:13 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:13.501385 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3649c534-cbc0-4c1c-9adb-a1b584143d19 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:13.503557 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3649c534-cbc0-4c1c-9adb-a1b584143d19 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:13.509491 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3649c534-cbc0-4c1c-9adb-a1b584143d19 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:13.509988 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3649c534-cbc0-4c1c-9adb-a1b584143d19 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:13.510419 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3649c534-cbc0-4c1c-9adb-a1b584143d19 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:13.511105 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3649c534-cbc0-4c1c-9adb-a1b584143d19 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:13.511583 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3649c534-cbc0-4c1c-9adb-a1b584143d19 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:13.512005 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3649c534-cbc0-4c1c-9adb-a1b584143d19 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:13.541592 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3649c534-cbc0-4c1c-9adb-a1b584143d19 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043664 Oct 11 06:51:13.542146 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 651/1256] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:13 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:14.091324 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-28b1daba-b5b9-49b5-ace1-0b9d9f0842ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:14.093506 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-28b1daba-b5b9-49b5-ace1-0b9d9f0842ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:14.100115 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-28b1daba-b5b9-49b5-ace1-0b9d9f0842ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:14.100599 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-28b1daba-b5b9-49b5-ace1-0b9d9f0842ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:14.101035 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-28b1daba-b5b9-49b5-ace1-0b9d9f0842ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:14.101774 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-28b1daba-b5b9-49b5-ace1-0b9d9f0842ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:14.102237 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-28b1daba-b5b9-49b5-ace1-0b9d9f0842ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:14.102654 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-28b1daba-b5b9-49b5-ace1-0b9d9f0842ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:14.132566 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-28b1daba-b5b9-49b5-ace1-0b9d9f0842ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045537 Oct 11 06:51:14.133093 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 606/1257] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:14 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:14.197922 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-84244976-a5c4-4018-8166-197706f87902 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:14.200101 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-84244976-a5c4-4018-8166-197706f87902 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:14.206482 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-84244976-a5c4-4018-8166-197706f87902 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:14.206959 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-84244976-a5c4-4018-8166-197706f87902 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:14.207392 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-84244976-a5c4-4018-8166-197706f87902 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:14.208555 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-84244976-a5c4-4018-8166-197706f87902 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:14.209162 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-84244976-a5c4-4018-8166-197706f87902 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:14.209592 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-84244976-a5c4-4018-8166-197706f87902 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:14.238631 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-84244976-a5c4-4018-8166-197706f87902 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045379 Oct 11 06:51:14.239168 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 652/1258] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:14 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:14.553857 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7d317320-1c07-4d1f-a524-12b75ffb89ce tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:14.555979 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7d317320-1c07-4d1f-a524-12b75ffb89ce tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:14.562386 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7d317320-1c07-4d1f-a524-12b75ffb89ce tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:14.562861 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7d317320-1c07-4d1f-a524-12b75ffb89ce tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:14.563293 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7d317320-1c07-4d1f-a524-12b75ffb89ce tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:14.564014 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7d317320-1c07-4d1f-a524-12b75ffb89ce tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:14.564464 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7d317320-1c07-4d1f-a524-12b75ffb89ce tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:14.564882 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7d317320-1c07-4d1f-a524-12b75ffb89ce tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:14.596161 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7d317320-1c07-4d1f-a524-12b75ffb89ce tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046193 Oct 11 06:51:14.596712 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 607/1259] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:14 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:15.145403 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a400ba94-de1d-4f99-9f9b-19757289c165 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:15.147582 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a400ba94-de1d-4f99-9f9b-19757289c165 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:15.153423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a400ba94-de1d-4f99-9f9b-19757289c165 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:15.153899 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a400ba94-de1d-4f99-9f9b-19757289c165 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:15.154330 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a400ba94-de1d-4f99-9f9b-19757289c165 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:15.155026 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a400ba94-de1d-4f99-9f9b-19757289c165 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:15.155492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a400ba94-de1d-4f99-9f9b-19757289c165 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:15.156125 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a400ba94-de1d-4f99-9f9b-19757289c165 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:15.159652 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:15.186703 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a400ba94-de1d-4f99-9f9b-19757289c165 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045490 Oct 11 06:51:15.187247 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 653/1260] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:15 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:15.214528 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-14462844-f213-4969-b506-e39e566bd3d1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:15.215024 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-14462844-f213-4969-b506-e39e566bd3d1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:15.221366 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14462844-f213-4969-b506-e39e566bd3d1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:15.221848 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14462844-f213-4969-b506-e39e566bd3d1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:15.222287 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14462844-f213-4969-b506-e39e566bd3d1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:15.222983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14462844-f213-4969-b506-e39e566bd3d1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:15.223455 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14462844-f213-4969-b506-e39e566bd3d1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:15.223884 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14462844-f213-4969-b506-e39e566bd3d1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:15.250629 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5c7ec343-f1e2-4f61-9179-99ccea43425d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:15.252799 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5c7ec343-f1e2-4f61-9179-99ccea43425d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:15.258986 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5c7ec343-f1e2-4f61-9179-99ccea43425d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:15.259488 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5c7ec343-f1e2-4f61-9179-99ccea43425d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:15.259924 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5c7ec343-f1e2-4f61-9179-99ccea43425d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:15.260605 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5c7ec343-f1e2-4f61-9179-99ccea43425d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:15.261047 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5c7ec343-f1e2-4f61-9179-99ccea43425d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:15.261463 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5c7ec343-f1e2-4f61-9179-99ccea43425d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:15.290650 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5c7ec343-f1e2-4f61-9179-99ccea43425d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043864 Oct 11 06:51:15.291840 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 654/1261] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:15 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:51:15.452235 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-14462844-f213-4969-b506-e39e566bd3d1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lazy-loading 'services' on Instance uuid 0240e39b-9517-4a93-9789-705cd357e01c {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 06:51:15.567522 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-14462844-f213-4969-b506-e39e566bd3d1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c/os-volume_attachments/cf807148-2095-4017-a5f8-84014925eb82" status: 202 len: 0 microversion: 2.1 time: 0.357102 Oct 11 06:51:15.568112 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 608/1262] 10.222.0.39 () {58 vars in 1416 bytes} [Tue Oct 11 06:51:15 2022] DELETE /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c/os-volume_attachments/cf807148-2095-4017-a5f8-84014925eb82 => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 06:51:15.609217 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-435464e2-a9cb-4ee6-94a2-b306935ad532 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:15.611310 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-435464e2-a9cb-4ee6-94a2-b306935ad532 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:15.617139 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-435464e2-a9cb-4ee6-94a2-b306935ad532 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:15.617611 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-435464e2-a9cb-4ee6-94a2-b306935ad532 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:15.618047 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-435464e2-a9cb-4ee6-94a2-b306935ad532 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:15.618715 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-435464e2-a9cb-4ee6-94a2-b306935ad532 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:15.619154 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-435464e2-a9cb-4ee6-94a2-b306935ad532 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:15.619599 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-435464e2-a9cb-4ee6-94a2-b306935ad532 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:15.649002 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-435464e2-a9cb-4ee6-94a2-b306935ad532 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043799 Oct 11 06:51:15.649469 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 655/1263] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:15 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:16.199995 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-397390b2-cd42-4250-b0c6-ec031842864b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:16.202237 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-397390b2-cd42-4250-b0c6-ec031842864b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:16.208264 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-397390b2-cd42-4250-b0c6-ec031842864b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:16.208750 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-397390b2-cd42-4250-b0c6-ec031842864b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:16.209212 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-397390b2-cd42-4250-b0c6-ec031842864b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:16.209902 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-397390b2-cd42-4250-b0c6-ec031842864b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:16.210346 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-397390b2-cd42-4250-b0c6-ec031842864b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:16.210769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-397390b2-cd42-4250-b0c6-ec031842864b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:16.241075 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-397390b2-cd42-4250-b0c6-ec031842864b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046062 Oct 11 06:51:16.241702 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 609/1264] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:16 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:16.303437 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d0ef1129-59d8-4ce7-9daf-ddaecafa3901 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:16.305576 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d0ef1129-59d8-4ce7-9daf-ddaecafa3901 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:16.312625 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0ef1129-59d8-4ce7-9daf-ddaecafa3901 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:16.313100 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0ef1129-59d8-4ce7-9daf-ddaecafa3901 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:16.313531 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0ef1129-59d8-4ce7-9daf-ddaecafa3901 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:16.314214 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0ef1129-59d8-4ce7-9daf-ddaecafa3901 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:16.314660 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0ef1129-59d8-4ce7-9daf-ddaecafa3901 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:16.315075 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0ef1129-59d8-4ce7-9daf-ddaecafa3901 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:16.343625 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d0ef1129-59d8-4ce7-9daf-ddaecafa3901 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044074 Oct 11 06:51:16.344154 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 656/1265] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:16 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:16.661924 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-204c0d97-9d10-4b82-8aee-f49b664726be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:16.664044 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-204c0d97-9d10-4b82-8aee-f49b664726be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:16.670346 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-204c0d97-9d10-4b82-8aee-f49b664726be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:16.670819 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-204c0d97-9d10-4b82-8aee-f49b664726be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:16.671253 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-204c0d97-9d10-4b82-8aee-f49b664726be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:16.671972 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-204c0d97-9d10-4b82-8aee-f49b664726be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:16.672419 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-204c0d97-9d10-4b82-8aee-f49b664726be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:16.672849 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-204c0d97-9d10-4b82-8aee-f49b664726be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:16.676511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:16.703449 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-204c0d97-9d10-4b82-8aee-f49b664726be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045335 Oct 11 06:51:16.703995 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 610/1266] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:16 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:17.253835 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-552ff696-2722-489e-b136-2485babd3f45 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:17.256003 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-552ff696-2722-489e-b136-2485babd3f45 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:17.262770 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-552ff696-2722-489e-b136-2485babd3f45 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:17.263187 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-552ff696-2722-489e-b136-2485babd3f45 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:17.263649 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-552ff696-2722-489e-b136-2485babd3f45 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:17.264339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-552ff696-2722-489e-b136-2485babd3f45 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:17.264812 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-552ff696-2722-489e-b136-2485babd3f45 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:17.265236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-552ff696-2722-489e-b136-2485babd3f45 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:17.295949 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-552ff696-2722-489e-b136-2485babd3f45 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046121 Oct 11 06:51:17.296671 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 657/1267] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:17 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:17.354837 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-456f0a82-f1ec-4116-87e3-e75c5ff14497 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:17.356946 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-456f0a82-f1ec-4116-87e3-e75c5ff14497 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:17.363245 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-456f0a82-f1ec-4116-87e3-e75c5ff14497 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:17.363754 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-456f0a82-f1ec-4116-87e3-e75c5ff14497 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:17.364181 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-456f0a82-f1ec-4116-87e3-e75c5ff14497 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:17.364858 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-456f0a82-f1ec-4116-87e3-e75c5ff14497 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:17.365304 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-456f0a82-f1ec-4116-87e3-e75c5ff14497 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:17.365717 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-456f0a82-f1ec-4116-87e3-e75c5ff14497 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:17.394367 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-456f0a82-f1ec-4116-87e3-e75c5ff14497 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043430 Oct 11 06:51:17.394899 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 611/1268] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:17 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:17.715848 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e4440f79-43f2-44e3-9f35-e96ab282d19b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:17.717972 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e4440f79-43f2-44e3-9f35-e96ab282d19b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:17.724334 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e4440f79-43f2-44e3-9f35-e96ab282d19b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:17.724809 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e4440f79-43f2-44e3-9f35-e96ab282d19b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:17.725230 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e4440f79-43f2-44e3-9f35-e96ab282d19b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:17.725908 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e4440f79-43f2-44e3-9f35-e96ab282d19b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:17.726345 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e4440f79-43f2-44e3-9f35-e96ab282d19b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:17.726754 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e4440f79-43f2-44e3-9f35-e96ab282d19b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:17.756248 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e4440f79-43f2-44e3-9f35-e96ab282d19b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044400 Oct 11 06:51:17.756788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 658/1269] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:17 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:18.308667 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e1556834-4a4d-4eb2-adf5-5e4c57535b11 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:51:18.310843 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e1556834-4a4d-4eb2-adf5-5e4c57535b11 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:18.316719 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e1556834-4a4d-4eb2-adf5-5e4c57535b11 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:18.317154 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e1556834-4a4d-4eb2-adf5-5e4c57535b11 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:18.317584 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e1556834-4a4d-4eb2-adf5-5e4c57535b11 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:18.318277 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e1556834-4a4d-4eb2-adf5-5e4c57535b11 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:18.318725 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e1556834-4a4d-4eb2-adf5-5e4c57535b11 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:18.319140 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e1556834-4a4d-4eb2-adf5-5e4c57535b11 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:18.406689 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2eeadcc4-7812-4398-bf04-7dcbdcfb3ce6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:18.408863 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2eeadcc4-7812-4398-bf04-7dcbdcfb3ce6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:18.414889 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2eeadcc4-7812-4398-bf04-7dcbdcfb3ce6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:18.415372 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2eeadcc4-7812-4398-bf04-7dcbdcfb3ce6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:18.416477 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2eeadcc4-7812-4398-bf04-7dcbdcfb3ce6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:18.417171 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2eeadcc4-7812-4398-bf04-7dcbdcfb3ce6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:18.417620 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2eeadcc4-7812-4398-bf04-7dcbdcfb3ce6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:18.418039 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2eeadcc4-7812-4398-bf04-7dcbdcfb3ce6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:18.425706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e1556834-4a4d-4eb2-adf5-5e4c57535b11 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "POST /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/action" status: 200 len: 41297 microversion: 2.1 time: 0.120777 Oct 11 06:51:18.432329 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 612/1270] 10.222.0.39 () {60 vars in 1278 bytes} [Tue Oct 11 06:51:18 2022] POST /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e/action => generated 41297 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:18.447884 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2eeadcc4-7812-4398-bf04-7dcbdcfb3ce6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045075 Oct 11 06:51:18.448425 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 659/1271] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:18 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:51:18.770289 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5f138aae-afb3-4aae-b8d3-b521fbaf3a97 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:18.772562 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5f138aae-afb3-4aae-b8d3-b521fbaf3a97 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:18.780146 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f138aae-afb3-4aae-b8d3-b521fbaf3a97 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:18.780626 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f138aae-afb3-4aae-b8d3-b521fbaf3a97 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:18.781053 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f138aae-afb3-4aae-b8d3-b521fbaf3a97 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:18.781747 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f138aae-afb3-4aae-b8d3-b521fbaf3a97 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:18.782192 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f138aae-afb3-4aae-b8d3-b521fbaf3a97 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:18.782608 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f138aae-afb3-4aae-b8d3-b521fbaf3a97 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:18.813516 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5f138aae-afb3-4aae-b8d3-b521fbaf3a97 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047762 Oct 11 06:51:18.814058 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 613/1272] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:18 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:19.459812 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-eaf13416-1dc6-40a5-9e17-e6d8f43122bf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:19.461979 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-eaf13416-1dc6-40a5-9e17-e6d8f43122bf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:19.468231 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eaf13416-1dc6-40a5-9e17-e6d8f43122bf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:19.468703 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eaf13416-1dc6-40a5-9e17-e6d8f43122bf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:19.469132 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eaf13416-1dc6-40a5-9e17-e6d8f43122bf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:19.469814 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eaf13416-1dc6-40a5-9e17-e6d8f43122bf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:19.470256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eaf13416-1dc6-40a5-9e17-e6d8f43122bf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:19.470671 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eaf13416-1dc6-40a5-9e17-e6d8f43122bf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:19.500086 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-eaf13416-1dc6-40a5-9e17-e6d8f43122bf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044193 Oct 11 06:51:19.500630 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 660/1273] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:19 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:19.825942 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7ac52431-7d4e-40cd-9980-e9d7677ca971 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:19.828107 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7ac52431-7d4e-40cd-9980-e9d7677ca971 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:19.834414 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7ac52431-7d4e-40cd-9980-e9d7677ca971 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:19.834900 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7ac52431-7d4e-40cd-9980-e9d7677ca971 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:19.835334 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7ac52431-7d4e-40cd-9980-e9d7677ca971 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:19.836061 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7ac52431-7d4e-40cd-9980-e9d7677ca971 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:19.836517 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7ac52431-7d4e-40cd-9980-e9d7677ca971 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:19.836939 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7ac52431-7d4e-40cd-9980-e9d7677ca971 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:19.867783 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7ac52431-7d4e-40cd-9980-e9d7677ca971 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045683 Oct 11 06:51:19.868332 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 614/1274] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:19 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:20.512984 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9b70072c-31a9-4129-a154-29ba2d98608a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:20.515176 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9b70072c-31a9-4129-a154-29ba2d98608a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:20.521753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9b70072c-31a9-4129-a154-29ba2d98608a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:20.522228 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9b70072c-31a9-4129-a154-29ba2d98608a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:20.522660 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9b70072c-31a9-4129-a154-29ba2d98608a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:20.523348 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9b70072c-31a9-4129-a154-29ba2d98608a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:20.523829 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9b70072c-31a9-4129-a154-29ba2d98608a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:20.524257 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9b70072c-31a9-4129-a154-29ba2d98608a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:20.553322 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9b70072c-31a9-4129-a154-29ba2d98608a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044918 Oct 11 06:51:20.553913 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 661/1275] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:20 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:20.880309 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c1378fc7-c0ed-4505-9a87-d41d9b590f99 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:20.882432 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c1378fc7-c0ed-4505-9a87-d41d9b590f99 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:20.889122 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1378fc7-c0ed-4505-9a87-d41d9b590f99 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:20.889608 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1378fc7-c0ed-4505-9a87-d41d9b590f99 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:20.890045 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1378fc7-c0ed-4505-9a87-d41d9b590f99 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:20.890775 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1378fc7-c0ed-4505-9a87-d41d9b590f99 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:20.891225 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1378fc7-c0ed-4505-9a87-d41d9b590f99 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:20.891959 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1378fc7-c0ed-4505-9a87-d41d9b590f99 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:20.923389 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c1378fc7-c0ed-4505-9a87-d41d9b590f99 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047026 Oct 11 06:51:20.923998 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 615/1276] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:20 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:21.565522 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-06cd4528-ebbe-4a5c-989f-fcb919a05cd3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:21.567777 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-06cd4528-ebbe-4a5c-989f-fcb919a05cd3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:21.573782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-06cd4528-ebbe-4a5c-989f-fcb919a05cd3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:21.574255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-06cd4528-ebbe-4a5c-989f-fcb919a05cd3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:21.574684 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-06cd4528-ebbe-4a5c-989f-fcb919a05cd3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:21.575366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-06cd4528-ebbe-4a5c-989f-fcb919a05cd3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:21.575836 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-06cd4528-ebbe-4a5c-989f-fcb919a05cd3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:21.576251 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-06cd4528-ebbe-4a5c-989f-fcb919a05cd3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:21.605492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-06cd4528-ebbe-4a5c-989f-fcb919a05cd3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043933 Oct 11 06:51:21.606029 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 662/1277] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:21 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:21.935916 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-96f55c97-e997-425a-8fb4-2b5091549330 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:21.938055 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-96f55c97-e997-425a-8fb4-2b5091549330 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:21.944261 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-96f55c97-e997-425a-8fb4-2b5091549330 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:21.944739 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-96f55c97-e997-425a-8fb4-2b5091549330 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:21.945169 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-96f55c97-e997-425a-8fb4-2b5091549330 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:21.945861 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-96f55c97-e997-425a-8fb4-2b5091549330 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:21.946306 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-96f55c97-e997-425a-8fb4-2b5091549330 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:21.947216 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-96f55c97-e997-425a-8fb4-2b5091549330 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:21.976399 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-96f55c97-e997-425a-8fb4-2b5091549330 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044401 Oct 11 06:51:21.976956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 616/1278] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:21 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:22.617617 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f30a8814-4e66-4a41-b73e-4bbc251878c2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:22.619794 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f30a8814-4e66-4a41-b73e-4bbc251878c2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:22.628073 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f30a8814-4e66-4a41-b73e-4bbc251878c2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:22.628551 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f30a8814-4e66-4a41-b73e-4bbc251878c2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:22.628981 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f30a8814-4e66-4a41-b73e-4bbc251878c2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:22.629672 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f30a8814-4e66-4a41-b73e-4bbc251878c2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:22.630114 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f30a8814-4e66-4a41-b73e-4bbc251878c2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:22.630529 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f30a8814-4e66-4a41-b73e-4bbc251878c2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:22.659631 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f30a8814-4e66-4a41-b73e-4bbc251878c2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045880 Oct 11 06:51:22.660180 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 663/1279] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:22 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:22.989156 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-859e2bc2-c4f2-46e5-8cdc-a1a530e9756a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:22.991245 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-859e2bc2-c4f2-46e5-8cdc-a1a530e9756a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:22.997716 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-859e2bc2-c4f2-46e5-8cdc-a1a530e9756a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:22.998186 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-859e2bc2-c4f2-46e5-8cdc-a1a530e9756a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:22.998618 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-859e2bc2-c4f2-46e5-8cdc-a1a530e9756a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:22.999303 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-859e2bc2-c4f2-46e5-8cdc-a1a530e9756a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:22.999770 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-859e2bc2-c4f2-46e5-8cdc-a1a530e9756a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:23.000185 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-859e2bc2-c4f2-46e5-8cdc-a1a530e9756a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:23.030564 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-859e2bc2-c4f2-46e5-8cdc-a1a530e9756a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045590 Oct 11 06:51:23.031120 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 617/1280] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:22 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:23.672301 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e09e795b-81c7-47ec-88a2-c37a5b59d634 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:23.674464 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e09e795b-81c7-47ec-88a2-c37a5b59d634 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:23.680843 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e09e795b-81c7-47ec-88a2-c37a5b59d634 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:23.681317 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e09e795b-81c7-47ec-88a2-c37a5b59d634 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:23.681749 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e09e795b-81c7-47ec-88a2-c37a5b59d634 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:23.682428 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e09e795b-81c7-47ec-88a2-c37a5b59d634 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:23.683402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e09e795b-81c7-47ec-88a2-c37a5b59d634 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:23.683841 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e09e795b-81c7-47ec-88a2-c37a5b59d634 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:23.712938 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e09e795b-81c7-47ec-88a2-c37a5b59d634 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044529 Oct 11 06:51:23.713490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 664/1281] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:23 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:24.042664 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c9717a44-c572-4c97-bc68-347bb98bdb04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:24.044771 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c9717a44-c572-4c97-bc68-347bb98bdb04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:24.051332 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c9717a44-c572-4c97-bc68-347bb98bdb04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:24.051838 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c9717a44-c572-4c97-bc68-347bb98bdb04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:24.052264 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c9717a44-c572-4c97-bc68-347bb98bdb04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:24.052953 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c9717a44-c572-4c97-bc68-347bb98bdb04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:24.053396 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c9717a44-c572-4c97-bc68-347bb98bdb04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:24.053817 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c9717a44-c572-4c97-bc68-347bb98bdb04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:24.084009 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c9717a44-c572-4c97-bc68-347bb98bdb04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045755 Oct 11 06:51:24.084933 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 618/1282] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:24 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:24.725690 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5c9de118-d7ca-446d-b51f-9c4e5ea56053 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:24.727798 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5c9de118-d7ca-446d-b51f-9c4e5ea56053 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:24.734144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5c9de118-d7ca-446d-b51f-9c4e5ea56053 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:24.734612 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5c9de118-d7ca-446d-b51f-9c4e5ea56053 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:24.735043 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5c9de118-d7ca-446d-b51f-9c4e5ea56053 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:24.735755 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5c9de118-d7ca-446d-b51f-9c4e5ea56053 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:24.736192 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5c9de118-d7ca-446d-b51f-9c4e5ea56053 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:24.736601 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5c9de118-d7ca-446d-b51f-9c4e5ea56053 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:24.764980 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5c9de118-d7ca-446d-b51f-9c4e5ea56053 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043561 Oct 11 06:51:24.765513 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 665/1283] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:24 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:25.096543 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cb09b662-64f3-4ac4-9cc8-507772171bba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:25.098563 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cb09b662-64f3-4ac4-9cc8-507772171bba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:25.105061 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb09b662-64f3-4ac4-9cc8-507772171bba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:25.105539 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb09b662-64f3-4ac4-9cc8-507772171bba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:25.105972 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb09b662-64f3-4ac4-9cc8-507772171bba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:25.106662 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb09b662-64f3-4ac4-9cc8-507772171bba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:25.107111 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb09b662-64f3-4ac4-9cc8-507772171bba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:25.107568 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb09b662-64f3-4ac4-9cc8-507772171bba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:25.137513 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cb09b662-64f3-4ac4-9cc8-507772171bba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044924 Oct 11 06:51:25.138074 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 619/1284] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:25 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:25.778156 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ad1dc54e-cd29-4d13-9edd-cef3241ea9ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:25.780260 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ad1dc54e-cd29-4d13-9edd-cef3241ea9ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:25.786861 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ad1dc54e-cd29-4d13-9edd-cef3241ea9ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:25.787345 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ad1dc54e-cd29-4d13-9edd-cef3241ea9ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:25.787797 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ad1dc54e-cd29-4d13-9edd-cef3241ea9ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:25.788483 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ad1dc54e-cd29-4d13-9edd-cef3241ea9ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:25.788926 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ad1dc54e-cd29-4d13-9edd-cef3241ea9ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:25.789343 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ad1dc54e-cd29-4d13-9edd-cef3241ea9ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:25.818297 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ad1dc54e-cd29-4d13-9edd-cef3241ea9ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044724 Oct 11 06:51:25.818827 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 666/1285] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:25 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:26.149550 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1bcc9514-cdf7-4321-88ce-22610360c5ca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:26.152286 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1bcc9514-cdf7-4321-88ce-22610360c5ca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:26.158683 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1bcc9514-cdf7-4321-88ce-22610360c5ca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:26.159157 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1bcc9514-cdf7-4321-88ce-22610360c5ca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:26.159625 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1bcc9514-cdf7-4321-88ce-22610360c5ca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:26.160315 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1bcc9514-cdf7-4321-88ce-22610360c5ca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:26.160796 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1bcc9514-cdf7-4321-88ce-22610360c5ca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:26.161210 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1bcc9514-cdf7-4321-88ce-22610360c5ca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:26.189736 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1bcc9514-cdf7-4321-88ce-22610360c5ca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044122 Oct 11 06:51:26.190286 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 620/1286] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:26 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:26.830186 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3856ea8a-02e4-4db4-9a82-30927c9711d2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:26.832261 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3856ea8a-02e4-4db4-9a82-30927c9711d2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:26.838524 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3856ea8a-02e4-4db4-9a82-30927c9711d2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:26.838990 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3856ea8a-02e4-4db4-9a82-30927c9711d2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:26.839438 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3856ea8a-02e4-4db4-9a82-30927c9711d2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:26.840112 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3856ea8a-02e4-4db4-9a82-30927c9711d2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:26.840551 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3856ea8a-02e4-4db4-9a82-30927c9711d2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:26.840963 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3856ea8a-02e4-4db4-9a82-30927c9711d2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:26.869668 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3856ea8a-02e4-4db4-9a82-30927c9711d2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043457 Oct 11 06:51:26.870797 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 667/1287] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:26 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:27.202295 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b4b41da1-85b6-4634-af4f-5a30a0761e21 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:27.204435 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b4b41da1-85b6-4634-af4f-5a30a0761e21 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:27.210692 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b4b41da1-85b6-4634-af4f-5a30a0761e21 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:27.211163 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b4b41da1-85b6-4634-af4f-5a30a0761e21 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:27.211629 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b4b41da1-85b6-4634-af4f-5a30a0761e21 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:27.212310 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b4b41da1-85b6-4634-af4f-5a30a0761e21 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:27.212749 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b4b41da1-85b6-4634-af4f-5a30a0761e21 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:27.213164 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b4b41da1-85b6-4634-af4f-5a30a0761e21 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:27.243152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b4b41da1-85b6-4634-af4f-5a30a0761e21 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044795 Oct 11 06:51:27.243734 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 621/1288] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:27 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:27.882515 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d2181a20-57dd-489b-b8ef-6f8841c5a7e9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:27.884668 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d2181a20-57dd-489b-b8ef-6f8841c5a7e9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:27.891798 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d2181a20-57dd-489b-b8ef-6f8841c5a7e9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:27.892274 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d2181a20-57dd-489b-b8ef-6f8841c5a7e9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:27.892708 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d2181a20-57dd-489b-b8ef-6f8841c5a7e9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:27.893397 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d2181a20-57dd-489b-b8ef-6f8841c5a7e9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:27.893846 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d2181a20-57dd-489b-b8ef-6f8841c5a7e9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:27.894267 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d2181a20-57dd-489b-b8ef-6f8841c5a7e9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:27.924939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d2181a20-57dd-489b-b8ef-6f8841c5a7e9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046378 Oct 11 06:51:27.925491 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 668/1289] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:27 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:28.256010 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-55e9b18a-e771-498a-ba2a-32b5efcb5aa1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:28.258021 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-55e9b18a-e771-498a-ba2a-32b5efcb5aa1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:28.264936 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-55e9b18a-e771-498a-ba2a-32b5efcb5aa1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:28.265405 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-55e9b18a-e771-498a-ba2a-32b5efcb5aa1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:28.265832 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-55e9b18a-e771-498a-ba2a-32b5efcb5aa1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:28.266787 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-55e9b18a-e771-498a-ba2a-32b5efcb5aa1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:28.267228 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-55e9b18a-e771-498a-ba2a-32b5efcb5aa1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:28.267666 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-55e9b18a-e771-498a-ba2a-32b5efcb5aa1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:28.296444 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-55e9b18a-e771-498a-ba2a-32b5efcb5aa1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044504 Oct 11 06:51:28.296975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 622/1290] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:28 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 06:51:28.937336 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2b6eec9c-e0ea-49fb-9dd0-8f30ca3fd6e9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:28.939438 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2b6eec9c-e0ea-49fb-9dd0-8f30ca3fd6e9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:28.941719 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=66 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:28.947064 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2b6eec9c-e0ea-49fb-9dd0-8f30ca3fd6e9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:28.947574 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2b6eec9c-e0ea-49fb-9dd0-8f30ca3fd6e9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:28.948116 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2b6eec9c-e0ea-49fb-9dd0-8f30ca3fd6e9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:28.949190 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2b6eec9c-e0ea-49fb-9dd0-8f30ca3fd6e9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:28.949861 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2b6eec9c-e0ea-49fb-9dd0-8f30ca3fd6e9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:28.950292 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2b6eec9c-e0ea-49fb-9dd0-8f30ca3fd6e9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:28.975708 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:28.981422 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2b6eec9c-e0ea-49fb-9dd0-8f30ca3fd6e9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048185 Oct 11 06:51:28.981968 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 669/1291] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:28 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:29.308858 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-42cd78d9-35d9-4deb-b599-86a835a7393b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:29.310914 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-42cd78d9-35d9-4deb-b599-86a835a7393b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:29.317321 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42cd78d9-35d9-4deb-b599-86a835a7393b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:29.317795 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42cd78d9-35d9-4deb-b599-86a835a7393b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:29.318227 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42cd78d9-35d9-4deb-b599-86a835a7393b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:29.318909 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42cd78d9-35d9-4deb-b599-86a835a7393b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:29.319357 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42cd78d9-35d9-4deb-b599-86a835a7393b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:29.319799 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42cd78d9-35d9-4deb-b599-86a835a7393b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:29.349186 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-42cd78d9-35d9-4deb-b599-86a835a7393b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044358 Oct 11 06:51:29.349729 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 623/1292] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:29 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:29.994107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6cb6b044-fd1d-4416-b0be-cbb778488620 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:29.996775 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6cb6b044-fd1d-4416-b0be-cbb778488620 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:30.003095 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6cb6b044-fd1d-4416-b0be-cbb778488620 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:30.003600 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6cb6b044-fd1d-4416-b0be-cbb778488620 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:30.004038 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6cb6b044-fd1d-4416-b0be-cbb778488620 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:30.004712 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6cb6b044-fd1d-4416-b0be-cbb778488620 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:30.005154 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6cb6b044-fd1d-4416-b0be-cbb778488620 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:30.005568 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6cb6b044-fd1d-4416-b0be-cbb778488620 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:30.033416 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6cb6b044-fd1d-4416-b0be-cbb778488620 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043577 Oct 11 06:51:30.033940 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 670/1293] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:29 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:30.361651 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4b705455-01aa-43b0-9de3-dabe9cded395 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:30.363779 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4b705455-01aa-43b0-9de3-dabe9cded395 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:30.370118 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b705455-01aa-43b0-9de3-dabe9cded395 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:30.370589 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b705455-01aa-43b0-9de3-dabe9cded395 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:30.371016 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b705455-01aa-43b0-9de3-dabe9cded395 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:30.371726 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b705455-01aa-43b0-9de3-dabe9cded395 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:30.372174 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b705455-01aa-43b0-9de3-dabe9cded395 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:30.372591 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b705455-01aa-43b0-9de3-dabe9cded395 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:30.400700 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4b705455-01aa-43b0-9de3-dabe9cded395 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042982 Oct 11 06:51:30.401736 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 624/1294] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:30 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:31.045875 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0d95daa8-7851-430a-a9f4-d269fa3d0ff4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:31.047931 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0d95daa8-7851-430a-a9f4-d269fa3d0ff4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:31.054248 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0d95daa8-7851-430a-a9f4-d269fa3d0ff4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:31.054720 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0d95daa8-7851-430a-a9f4-d269fa3d0ff4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:31.055149 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0d95daa8-7851-430a-a9f4-d269fa3d0ff4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:31.055866 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0d95daa8-7851-430a-a9f4-d269fa3d0ff4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:31.056314 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0d95daa8-7851-430a-a9f4-d269fa3d0ff4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:31.056732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0d95daa8-7851-430a-a9f4-d269fa3d0ff4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:31.085828 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0d95daa8-7851-430a-a9f4-d269fa3d0ff4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044040 Oct 11 06:51:31.086360 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 671/1295] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:31 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:31.412829 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4c2f8433-0360-440a-be7a-831addaf7c69 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:31.414920 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4c2f8433-0360-440a-be7a-831addaf7c69 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:31.421892 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4c2f8433-0360-440a-be7a-831addaf7c69 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:31.422372 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4c2f8433-0360-440a-be7a-831addaf7c69 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:31.422800 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4c2f8433-0360-440a-be7a-831addaf7c69 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:31.423576 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4c2f8433-0360-440a-be7a-831addaf7c69 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:31.424027 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4c2f8433-0360-440a-be7a-831addaf7c69 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:31.424474 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4c2f8433-0360-440a-be7a-831addaf7c69 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:31.453177 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4c2f8433-0360-440a-be7a-831addaf7c69 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044413 Oct 11 06:51:31.453719 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 625/1296] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:31 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:32.097297 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f94e5ba1-2b43-40d7-b689-df277ab4ef84 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:32.099327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f94e5ba1-2b43-40d7-b689-df277ab4ef84 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:32.105609 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f94e5ba1-2b43-40d7-b689-df277ab4ef84 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:32.106109 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f94e5ba1-2b43-40d7-b689-df277ab4ef84 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:32.106535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f94e5ba1-2b43-40d7-b689-df277ab4ef84 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:32.107207 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f94e5ba1-2b43-40d7-b689-df277ab4ef84 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:32.107672 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f94e5ba1-2b43-40d7-b689-df277ab4ef84 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:32.108088 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f94e5ba1-2b43-40d7-b689-df277ab4ef84 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:32.136520 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f94e5ba1-2b43-40d7-b689-df277ab4ef84 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043229 Oct 11 06:51:32.137056 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 672/1297] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:32 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:32.465234 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e9080a3c-e7c1-4747-80de-1d1ea2b83e46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:32.467457 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e9080a3c-e7c1-4747-80de-1d1ea2b83e46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:32.473827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e9080a3c-e7c1-4747-80de-1d1ea2b83e46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:32.474309 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e9080a3c-e7c1-4747-80de-1d1ea2b83e46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:32.474743 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e9080a3c-e7c1-4747-80de-1d1ea2b83e46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:32.475447 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e9080a3c-e7c1-4747-80de-1d1ea2b83e46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:32.475902 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e9080a3c-e7c1-4747-80de-1d1ea2b83e46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:32.476322 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e9080a3c-e7c1-4747-80de-1d1ea2b83e46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:32.504970 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e9080a3c-e7c1-4747-80de-1d1ea2b83e46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043749 Oct 11 06:51:32.505496 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 626/1298] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:32 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:33.149084 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-26e1ca58-4b86-4f39-8173-0d2fca69b281 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:33.151200 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-26e1ca58-4b86-4f39-8173-0d2fca69b281 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:33.157553 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-26e1ca58-4b86-4f39-8173-0d2fca69b281 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:33.158022 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-26e1ca58-4b86-4f39-8173-0d2fca69b281 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:33.158476 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-26e1ca58-4b86-4f39-8173-0d2fca69b281 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:33.159151 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-26e1ca58-4b86-4f39-8173-0d2fca69b281 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:33.159624 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-26e1ca58-4b86-4f39-8173-0d2fca69b281 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:33.160038 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-26e1ca58-4b86-4f39-8173-0d2fca69b281 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:33.189777 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-26e1ca58-4b86-4f39-8173-0d2fca69b281 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044612 Oct 11 06:51:33.190316 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 673/1299] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:33 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:33.517698 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cc5a26f6-f55c-4013-9996-da35c9782c46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:33.519810 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cc5a26f6-f55c-4013-9996-da35c9782c46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:33.526694 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc5a26f6-f55c-4013-9996-da35c9782c46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:33.527174 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc5a26f6-f55c-4013-9996-da35c9782c46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:33.527639 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc5a26f6-f55c-4013-9996-da35c9782c46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:33.528335 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc5a26f6-f55c-4013-9996-da35c9782c46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:33.528788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc5a26f6-f55c-4013-9996-da35c9782c46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:33.529211 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc5a26f6-f55c-4013-9996-da35c9782c46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:33.532965 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:33.559349 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cc5a26f6-f55c-4013-9996-da35c9782c46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045901 Oct 11 06:51:33.559929 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 627/1300] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:33 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:34.202149 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e0d20915-a355-401d-af6e-176e64909bd6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:34.204294 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e0d20915-a355-401d-af6e-176e64909bd6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:34.210615 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0d20915-a355-401d-af6e-176e64909bd6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:34.211077 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0d20915-a355-401d-af6e-176e64909bd6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:34.211530 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0d20915-a355-401d-af6e-176e64909bd6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:34.212321 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0d20915-a355-401d-af6e-176e64909bd6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:34.212626 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0d20915-a355-401d-af6e-176e64909bd6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:34.213061 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0d20915-a355-401d-af6e-176e64909bd6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:34.241287 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e0d20915-a355-401d-af6e-176e64909bd6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043651 Oct 11 06:51:34.241821 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 674/1301] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:34 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:34.572003 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-92f6aa74-4bc4-42f3-a167-175141547e4c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:34.574108 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-92f6aa74-4bc4-42f3-a167-175141547e4c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:34.580483 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-92f6aa74-4bc4-42f3-a167-175141547e4c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:34.580966 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-92f6aa74-4bc4-42f3-a167-175141547e4c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:34.581403 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-92f6aa74-4bc4-42f3-a167-175141547e4c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:34.582098 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-92f6aa74-4bc4-42f3-a167-175141547e4c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:34.582548 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-92f6aa74-4bc4-42f3-a167-175141547e4c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:34.582974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-92f6aa74-4bc4-42f3-a167-175141547e4c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:34.612994 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-92f6aa74-4bc4-42f3-a167-175141547e4c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044990 Oct 11 06:51:34.613553 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 628/1302] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:34 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:35.253596 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8bc41a5d-8c61-4e3e-b934-9352796fff10 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:35.255727 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8bc41a5d-8c61-4e3e-b934-9352796fff10 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:35.262644 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8bc41a5d-8c61-4e3e-b934-9352796fff10 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:35.263116 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8bc41a5d-8c61-4e3e-b934-9352796fff10 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:35.263591 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8bc41a5d-8c61-4e3e-b934-9352796fff10 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:35.264272 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8bc41a5d-8c61-4e3e-b934-9352796fff10 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:35.264715 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8bc41a5d-8c61-4e3e-b934-9352796fff10 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:35.265129 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8bc41a5d-8c61-4e3e-b934-9352796fff10 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:35.294393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8bc41a5d-8c61-4e3e-b934-9352796fff10 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044895 Oct 11 06:51:35.294927 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 675/1303] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:35 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:35.626299 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-732df74e-5e5b-47c2-a3c1-47879855dddd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:35.628405 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-732df74e-5e5b-47c2-a3c1-47879855dddd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:35.634968 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-732df74e-5e5b-47c2-a3c1-47879855dddd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:35.636035 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-732df74e-5e5b-47c2-a3c1-47879855dddd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:35.636463 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-732df74e-5e5b-47c2-a3c1-47879855dddd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:35.637145 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-732df74e-5e5b-47c2-a3c1-47879855dddd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:35.637841 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-732df74e-5e5b-47c2-a3c1-47879855dddd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:35.638257 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-732df74e-5e5b-47c2-a3c1-47879855dddd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:35.667238 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-732df74e-5e5b-47c2-a3c1-47879855dddd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044897 Oct 11 06:51:35.667807 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 629/1304] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:35 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:36.307214 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-278ed96e-073b-4779-bd6a-5b3b62c1438c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:36.309313 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-278ed96e-073b-4779-bd6a-5b3b62c1438c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:36.315703 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-278ed96e-073b-4779-bd6a-5b3b62c1438c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:36.316177 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-278ed96e-073b-4779-bd6a-5b3b62c1438c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:36.316608 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-278ed96e-073b-4779-bd6a-5b3b62c1438c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:36.317290 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-278ed96e-073b-4779-bd6a-5b3b62c1438c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:36.317730 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-278ed96e-073b-4779-bd6a-5b3b62c1438c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:36.318145 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-278ed96e-073b-4779-bd6a-5b3b62c1438c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:36.346779 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-278ed96e-073b-4779-bd6a-5b3b62c1438c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043713 Oct 11 06:51:36.347307 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 676/1305] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:36 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:36.679582 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-08d757bb-fbeb-44f6-a69a-8efa991630d7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:36.681719 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-08d757bb-fbeb-44f6-a69a-8efa991630d7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:36.689269 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-08d757bb-fbeb-44f6-a69a-8efa991630d7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:36.689746 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-08d757bb-fbeb-44f6-a69a-8efa991630d7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:36.690196 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-08d757bb-fbeb-44f6-a69a-8efa991630d7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:36.690892 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-08d757bb-fbeb-44f6-a69a-8efa991630d7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:36.691338 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-08d757bb-fbeb-44f6-a69a-8efa991630d7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:36.691794 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-08d757bb-fbeb-44f6-a69a-8efa991630d7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:36.721228 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-08d757bb-fbeb-44f6-a69a-8efa991630d7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045613 Oct 11 06:51:36.721772 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 630/1306] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:36 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:37.358591 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-74e58908-b924-47b1-b00d-14839714d7a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:37.360802 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-74e58908-b924-47b1-b00d-14839714d7a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:37.367119 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-74e58908-b924-47b1-b00d-14839714d7a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:37.367646 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-74e58908-b924-47b1-b00d-14839714d7a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:37.368088 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-74e58908-b924-47b1-b00d-14839714d7a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:37.368778 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-74e58908-b924-47b1-b00d-14839714d7a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:37.369335 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-74e58908-b924-47b1-b00d-14839714d7a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:37.370305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-74e58908-b924-47b1-b00d-14839714d7a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:37.399312 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-74e58908-b924-47b1-b00d-14839714d7a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044667 Oct 11 06:51:37.399880 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 677/1307] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:37 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:37.734207 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-85de2e4b-640e-4e65-a87f-1ade65ac4cca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:37.736297 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-85de2e4b-640e-4e65-a87f-1ade65ac4cca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:37.742579 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85de2e4b-640e-4e65-a87f-1ade65ac4cca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:37.743051 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85de2e4b-640e-4e65-a87f-1ade65ac4cca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:37.743516 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85de2e4b-640e-4e65-a87f-1ade65ac4cca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:37.744208 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85de2e4b-640e-4e65-a87f-1ade65ac4cca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:37.744654 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85de2e4b-640e-4e65-a87f-1ade65ac4cca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:37.745123 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85de2e4b-640e-4e65-a87f-1ade65ac4cca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:37.773575 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-85de2e4b-640e-4e65-a87f-1ade65ac4cca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043392 Oct 11 06:51:37.774113 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 631/1308] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:37 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:38.411884 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-eb37527b-bfd4-4ede-a315-6970736fb5f2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:38.414018 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-eb37527b-bfd4-4ede-a315-6970736fb5f2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:38.420384 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eb37527b-bfd4-4ede-a315-6970736fb5f2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:38.420856 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eb37527b-bfd4-4ede-a315-6970736fb5f2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:38.421285 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eb37527b-bfd4-4ede-a315-6970736fb5f2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:38.421969 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eb37527b-bfd4-4ede-a315-6970736fb5f2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:38.422412 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eb37527b-bfd4-4ede-a315-6970736fb5f2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:38.422829 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eb37527b-bfd4-4ede-a315-6970736fb5f2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:38.452447 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-eb37527b-bfd4-4ede-a315-6970736fb5f2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044722 Oct 11 06:51:38.452980 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 678/1309] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:38 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:38.786670 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ae1eaad4-0bc6-40b1-835e-004a68a7ade1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:38.788763 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ae1eaad4-0bc6-40b1-835e-004a68a7ade1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:38.795633 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ae1eaad4-0bc6-40b1-835e-004a68a7ade1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:38.796112 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ae1eaad4-0bc6-40b1-835e-004a68a7ade1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:38.796541 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ae1eaad4-0bc6-40b1-835e-004a68a7ade1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:38.797226 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ae1eaad4-0bc6-40b1-835e-004a68a7ade1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:38.797673 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ae1eaad4-0bc6-40b1-835e-004a68a7ade1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:38.798088 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ae1eaad4-0bc6-40b1-835e-004a68a7ade1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:38.826921 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ae1eaad4-0bc6-40b1-835e-004a68a7ade1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044365 Oct 11 06:51:38.827469 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 632/1310] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:38 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:39.464847 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1bfc503e-bac8-48d9-b8b9-6b3c11a8f19f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:39.466978 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1bfc503e-bac8-48d9-b8b9-6b3c11a8f19f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:39.473272 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1bfc503e-bac8-48d9-b8b9-6b3c11a8f19f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:39.473746 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1bfc503e-bac8-48d9-b8b9-6b3c11a8f19f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:39.474172 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1bfc503e-bac8-48d9-b8b9-6b3c11a8f19f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:39.474853 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1bfc503e-bac8-48d9-b8b9-6b3c11a8f19f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:39.475299 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1bfc503e-bac8-48d9-b8b9-6b3c11a8f19f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:39.475747 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1bfc503e-bac8-48d9-b8b9-6b3c11a8f19f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:39.504686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1bfc503e-bac8-48d9-b8b9-6b3c11a8f19f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044293 Oct 11 06:51:39.505223 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 679/1311] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:39 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:39.839156 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9cd45b43-7005-4042-babe-752fc49d04d2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:39.841221 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9cd45b43-7005-4042-babe-752fc49d04d2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:39.847668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9cd45b43-7005-4042-babe-752fc49d04d2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:39.848144 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9cd45b43-7005-4042-babe-752fc49d04d2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:39.848576 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9cd45b43-7005-4042-babe-752fc49d04d2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:39.849262 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9cd45b43-7005-4042-babe-752fc49d04d2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:39.849708 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9cd45b43-7005-4042-babe-752fc49d04d2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:39.850126 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9cd45b43-7005-4042-babe-752fc49d04d2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:39.879214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9cd45b43-7005-4042-babe-752fc49d04d2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044717 Oct 11 06:51:39.879793 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 633/1312] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:39 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:40.517500 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-72d072f7-d8eb-438c-9b9f-f457b3e625f6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:40.519724 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-72d072f7-d8eb-438c-9b9f-f457b3e625f6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:40.525995 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-72d072f7-d8eb-438c-9b9f-f457b3e625f6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:40.526466 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-72d072f7-d8eb-438c-9b9f-f457b3e625f6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:40.526892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-72d072f7-d8eb-438c-9b9f-f457b3e625f6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:40.527610 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-72d072f7-d8eb-438c-9b9f-f457b3e625f6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:40.528051 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-72d072f7-d8eb-438c-9b9f-f457b3e625f6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:40.528473 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-72d072f7-d8eb-438c-9b9f-f457b3e625f6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:40.557592 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-72d072f7-d8eb-438c-9b9f-f457b3e625f6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043679 Oct 11 06:51:40.558116 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 680/1313] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:40 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:40.891879 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0004353b-c404-42ce-bb63-84acf2bcd197 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:40.894008 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0004353b-c404-42ce-bb63-84acf2bcd197 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:40.900878 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0004353b-c404-42ce-bb63-84acf2bcd197 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:40.901359 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0004353b-c404-42ce-bb63-84acf2bcd197 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:40.901792 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0004353b-c404-42ce-bb63-84acf2bcd197 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:40.902473 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0004353b-c404-42ce-bb63-84acf2bcd197 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:40.902927 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0004353b-c404-42ce-bb63-84acf2bcd197 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:40.903342 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0004353b-c404-42ce-bb63-84acf2bcd197 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:40.931648 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0004353b-c404-42ce-bb63-84acf2bcd197 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043964 Oct 11 06:51:40.932184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 634/1314] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:40 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:41.569892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-277feb6b-8db7-4021-b469-e203b2c53913 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:41.572740 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-277feb6b-8db7-4021-b469-e203b2c53913 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:41.579885 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-277feb6b-8db7-4021-b469-e203b2c53913 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:41.580308 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-277feb6b-8db7-4021-b469-e203b2c53913 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:41.580740 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-277feb6b-8db7-4021-b469-e203b2c53913 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:41.581431 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-277feb6b-8db7-4021-b469-e203b2c53913 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:41.581880 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-277feb6b-8db7-4021-b469-e203b2c53913 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:41.582333 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-277feb6b-8db7-4021-b469-e203b2c53913 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:41.610913 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-277feb6b-8db7-4021-b469-e203b2c53913 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045018 Oct 11 06:51:41.611465 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 681/1315] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:41 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:41.943920 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6c4c6d1f-94dc-4b67-814e-f01f1b667f18 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:41.946012 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6c4c6d1f-94dc-4b67-814e-f01f1b667f18 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:41.948449 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=64 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:41.953576 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c4c6d1f-94dc-4b67-814e-f01f1b667f18 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:41.954053 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c4c6d1f-94dc-4b67-814e-f01f1b667f18 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:41.954482 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c4c6d1f-94dc-4b67-814e-f01f1b667f18 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:41.955165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c4c6d1f-94dc-4b67-814e-f01f1b667f18 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:41.955634 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c4c6d1f-94dc-4b67-814e-f01f1b667f18 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:41.956051 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c4c6d1f-94dc-4b67-814e-f01f1b667f18 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:41.984755 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6c4c6d1f-94dc-4b67-814e-f01f1b667f18 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044738 Oct 11 06:51:41.985296 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 635/1316] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:41 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:42.622267 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5ec541e2-7830-4beb-92fe-eafb5981e90c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:42.624565 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5ec541e2-7830-4beb-92fe-eafb5981e90c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:42.630837 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ec541e2-7830-4beb-92fe-eafb5981e90c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:42.631262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ec541e2-7830-4beb-92fe-eafb5981e90c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:42.631735 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ec541e2-7830-4beb-92fe-eafb5981e90c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:42.632418 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ec541e2-7830-4beb-92fe-eafb5981e90c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:42.632865 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ec541e2-7830-4beb-92fe-eafb5981e90c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:42.633287 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ec541e2-7830-4beb-92fe-eafb5981e90c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:42.662606 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5ec541e2-7830-4beb-92fe-eafb5981e90c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044254 Oct 11 06:51:42.663142 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 682/1317] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:42 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:42.997513 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-84c8ccf1-0638-456f-9c09-c2d203c06f9c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:42.999637 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-84c8ccf1-0638-456f-9c09-c2d203c06f9c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:43.006015 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-84c8ccf1-0638-456f-9c09-c2d203c06f9c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:43.006492 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-84c8ccf1-0638-456f-9c09-c2d203c06f9c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:43.006929 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-84c8ccf1-0638-456f-9c09-c2d203c06f9c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:43.007648 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-84c8ccf1-0638-456f-9c09-c2d203c06f9c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:43.008100 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-84c8ccf1-0638-456f-9c09-c2d203c06f9c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:43.008519 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-84c8ccf1-0638-456f-9c09-c2d203c06f9c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:43.037593 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-84c8ccf1-0638-456f-9c09-c2d203c06f9c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044559 Oct 11 06:51:43.038137 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 636/1318] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:42 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:43.674299 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c53e8c52-8b5d-4b4a-94f5-44af41fd8e62 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:43.676523 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c53e8c52-8b5d-4b4a-94f5-44af41fd8e62 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:43.683536 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c53e8c52-8b5d-4b4a-94f5-44af41fd8e62 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:43.684014 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c53e8c52-8b5d-4b4a-94f5-44af41fd8e62 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:43.684446 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c53e8c52-8b5d-4b4a-94f5-44af41fd8e62 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:43.685134 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c53e8c52-8b5d-4b4a-94f5-44af41fd8e62 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:43.685579 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c53e8c52-8b5d-4b4a-94f5-44af41fd8e62 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:43.685997 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c53e8c52-8b5d-4b4a-94f5-44af41fd8e62 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:43.714439 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c53e8c52-8b5d-4b4a-94f5-44af41fd8e62 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044164 Oct 11 06:51:43.714973 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 683/1319] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:43 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:51:44.049967 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cf9a34c3-7175-4362-b566-1b6e81295414 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:44.052015 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cf9a34c3-7175-4362-b566-1b6e81295414 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:44.058397 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf9a34c3-7175-4362-b566-1b6e81295414 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:44.058869 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf9a34c3-7175-4362-b566-1b6e81295414 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:44.059321 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf9a34c3-7175-4362-b566-1b6e81295414 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:44.060023 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf9a34c3-7175-4362-b566-1b6e81295414 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:44.060466 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf9a34c3-7175-4362-b566-1b6e81295414 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:44.060878 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf9a34c3-7175-4362-b566-1b6e81295414 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:44.090674 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cf9a34c3-7175-4362-b566-1b6e81295414 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044688 Oct 11 06:51:44.091205 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 637/1320] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:44 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:44.726768 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-89c55461-9c67-4822-ab65-8aa1144e6d0b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:44.729117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-89c55461-9c67-4822-ab65-8aa1144e6d0b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:44.735544 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89c55461-9c67-4822-ab65-8aa1144e6d0b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:44.736021 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89c55461-9c67-4822-ab65-8aa1144e6d0b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:44.736452 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89c55461-9c67-4822-ab65-8aa1144e6d0b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:44.737155 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89c55461-9c67-4822-ab65-8aa1144e6d0b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:44.737594 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89c55461-9c67-4822-ab65-8aa1144e6d0b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:44.738021 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89c55461-9c67-4822-ab65-8aa1144e6d0b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:44.768349 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-89c55461-9c67-4822-ab65-8aa1144e6d0b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045601 Oct 11 06:51:44.768886 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 684/1321] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:44 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:45.102704 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-21df63d2-cdd4-46a1-a05f-e40736f29584 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:45.105314 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-21df63d2-cdd4-46a1-a05f-e40736f29584 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:45.111654 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-21df63d2-cdd4-46a1-a05f-e40736f29584 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:45.112124 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-21df63d2-cdd4-46a1-a05f-e40736f29584 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:45.112544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-21df63d2-cdd4-46a1-a05f-e40736f29584 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:45.113221 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-21df63d2-cdd4-46a1-a05f-e40736f29584 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:45.113663 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-21df63d2-cdd4-46a1-a05f-e40736f29584 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:45.114076 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-21df63d2-cdd4-46a1-a05f-e40736f29584 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:45.142952 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-21df63d2-cdd4-46a1-a05f-e40736f29584 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044220 Oct 11 06:51:45.143508 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 638/1322] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:45 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:45.781309 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-03544032-6a3a-4105-9f26-ba6a278fb849 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:45.783357 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-03544032-6a3a-4105-9f26-ba6a278fb849 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:45.789678 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-03544032-6a3a-4105-9f26-ba6a278fb849 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:45.790147 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-03544032-6a3a-4105-9f26-ba6a278fb849 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:45.790575 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-03544032-6a3a-4105-9f26-ba6a278fb849 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:45.791254 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-03544032-6a3a-4105-9f26-ba6a278fb849 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:45.791723 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-03544032-6a3a-4105-9f26-ba6a278fb849 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:45.792139 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-03544032-6a3a-4105-9f26-ba6a278fb849 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:45.820718 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-03544032-6a3a-4105-9f26-ba6a278fb849 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043476 Oct 11 06:51:45.821301 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 685/1323] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:45 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:46.155282 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9e6fca4d-55af-4996-804f-4f902ecdb231 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:46.157460 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9e6fca4d-55af-4996-804f-4f902ecdb231 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:46.163762 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9e6fca4d-55af-4996-804f-4f902ecdb231 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:46.164231 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9e6fca4d-55af-4996-804f-4f902ecdb231 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:46.164656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9e6fca4d-55af-4996-804f-4f902ecdb231 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:46.165341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9e6fca4d-55af-4996-804f-4f902ecdb231 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:46.165812 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9e6fca4d-55af-4996-804f-4f902ecdb231 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:46.166222 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9e6fca4d-55af-4996-804f-4f902ecdb231 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:46.195594 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9e6fca4d-55af-4996-804f-4f902ecdb231 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044244 Oct 11 06:51:46.196145 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 639/1324] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:46 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:46.684119 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-dc1c86ef-73c5-4e93-934e-8bb756402fbe tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:46.684682 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-dc1c86ef-73c5-4e93-934e-8bb756402fbe tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:46.691396 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc1c86ef-73c5-4e93-934e-8bb756402fbe tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:46.691899 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc1c86ef-73c5-4e93-934e-8bb756402fbe tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:46.692326 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc1c86ef-73c5-4e93-934e-8bb756402fbe tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:46.693012 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc1c86ef-73c5-4e93-934e-8bb756402fbe tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:46.693450 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc1c86ef-73c5-4e93-934e-8bb756402fbe tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:46.693861 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc1c86ef-73c5-4e93-934e-8bb756402fbe tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:46.711855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:46.719642 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-dc1c86ef-73c5-4e93-934e-8bb756402fbe tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Going to try to terminate instance {{(pid=125266) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 06:51:46.794198 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-dc1c86ef-73c5-4e93-934e-8bb756402fbe tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "DELETE /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 204 len: 0 microversion: 2.1 time: 0.115077 Oct 11 06:51:46.795135 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 686/1325] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Oct 11 06:51:46 2022] DELETE /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 06:51:46.803128 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-dd5902cb-bb3c-4d78-824a-8d52666b3b5c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:46.803760 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-dd5902cb-bb3c-4d78-824a-8d52666b3b5c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:46.810175 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dd5902cb-bb3c-4d78-824a-8d52666b3b5c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:46.810647 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dd5902cb-bb3c-4d78-824a-8d52666b3b5c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:46.811071 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dd5902cb-bb3c-4d78-824a-8d52666b3b5c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:46.811809 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dd5902cb-bb3c-4d78-824a-8d52666b3b5c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:46.812248 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dd5902cb-bb3c-4d78-824a-8d52666b3b5c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:46.812659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dd5902cb-bb3c-4d78-824a-8d52666b3b5c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:46.834081 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e6901bfa-0bf8-483c-9afb-26696c1cb1eb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:46.836311 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e6901bfa-0bf8-483c-9afb-26696c1cb1eb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:46.842204 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e6901bfa-0bf8-483c-9afb-26696c1cb1eb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:46.842686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e6901bfa-0bf8-483c-9afb-26696c1cb1eb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:46.843119 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e6901bfa-0bf8-483c-9afb-26696c1cb1eb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:46.843843 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e6901bfa-0bf8-483c-9afb-26696c1cb1eb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:46.844290 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e6901bfa-0bf8-483c-9afb-26696c1cb1eb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:46.844715 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e6901bfa-0bf8-483c-9afb-26696c1cb1eb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:46.876638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e6901bfa-0bf8-483c-9afb-26696c1cb1eb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046731 Oct 11 06:51:46.877273 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 687/1326] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:46 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:51:46.940728 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-dd5902cb-bb3c-4d78-824a-8d52666b3b5c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:51:46.949430 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-dd5902cb-bb3c-4d78-824a-8d52666b3b5c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150178 Oct 11 06:51:46.950016 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 640/1327] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:51:46 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:51:47.209122 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a9bc0178-dbb3-48e8-89b8-4be9bff6b1bd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:47.211202 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a9bc0178-dbb3-48e8-89b8-4be9bff6b1bd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:47.217120 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9bc0178-dbb3-48e8-89b8-4be9bff6b1bd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:47.217600 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9bc0178-dbb3-48e8-89b8-4be9bff6b1bd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:47.218034 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9bc0178-dbb3-48e8-89b8-4be9bff6b1bd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:47.218730 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9bc0178-dbb3-48e8-89b8-4be9bff6b1bd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:47.219177 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9bc0178-dbb3-48e8-89b8-4be9bff6b1bd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:47.219653 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9bc0178-dbb3-48e8-89b8-4be9bff6b1bd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:47.250734 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a9bc0178-dbb3-48e8-89b8-4be9bff6b1bd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045949 Oct 11 06:51:47.251293 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 688/1328] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:47 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:51:47.889829 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f19aa711-ad80-41b4-a1ca-bd6bf8179314 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:47.892310 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f19aa711-ad80-41b4-a1ca-bd6bf8179314 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:47.898714 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f19aa711-ad80-41b4-a1ca-bd6bf8179314 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:47.899208 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f19aa711-ad80-41b4-a1ca-bd6bf8179314 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:47.899665 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f19aa711-ad80-41b4-a1ca-bd6bf8179314 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:47.901030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f19aa711-ad80-41b4-a1ca-bd6bf8179314 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:47.901487 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f19aa711-ad80-41b4-a1ca-bd6bf8179314 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:47.901911 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f19aa711-ad80-41b4-a1ca-bd6bf8179314 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:47.931759 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f19aa711-ad80-41b4-a1ca-bd6bf8179314 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045879 Oct 11 06:51:47.932312 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 641/1329] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:47 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:47.972945 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8d2ed6c5-9a0c-4682-aa2a-c8e1b5dbf706 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:47.973839 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8d2ed6c5-9a0c-4682-aa2a-c8e1b5dbf706 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:47.980200 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8d2ed6c5-9a0c-4682-aa2a-c8e1b5dbf706 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:47.980659 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8d2ed6c5-9a0c-4682-aa2a-c8e1b5dbf706 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:47.981093 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8d2ed6c5-9a0c-4682-aa2a-c8e1b5dbf706 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:47.981784 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8d2ed6c5-9a0c-4682-aa2a-c8e1b5dbf706 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:47.982243 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8d2ed6c5-9a0c-4682-aa2a-c8e1b5dbf706 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:47.982665 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8d2ed6c5-9a0c-4682-aa2a-c8e1b5dbf706 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:48.260921 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8d2ed6c5-9a0c-4682-aa2a-c8e1b5dbf706 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:51:48.262710 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8f24f03c-fba0-4876-9233-f5959e3b8f3a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:48.264832 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8f24f03c-fba0-4876-9233-f5959e3b8f3a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:48.269357 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8d2ed6c5-9a0c-4682-aa2a-c8e1b5dbf706 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.300483 Oct 11 06:51:48.269918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 689/1330] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:51:47 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:51:48.270945 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f24f03c-fba0-4876-9233-f5959e3b8f3a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:48.271438 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f24f03c-fba0-4876-9233-f5959e3b8f3a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:48.271887 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f24f03c-fba0-4876-9233-f5959e3b8f3a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:48.272582 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f24f03c-fba0-4876-9233-f5959e3b8f3a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:48.273032 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f24f03c-fba0-4876-9233-f5959e3b8f3a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:48.273443 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f24f03c-fba0-4876-9233-f5959e3b8f3a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:48.301644 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8f24f03c-fba0-4876-9233-f5959e3b8f3a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043368 Oct 11 06:51:48.302191 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 642/1331] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:48 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 06:51:48.944099 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1dd8d7c1-0f76-4f96-b2bc-4a6b42221213 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:48.946310 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1dd8d7c1-0f76-4f96-b2bc-4a6b42221213 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:48.952311 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1dd8d7c1-0f76-4f96-b2bc-4a6b42221213 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:48.952787 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1dd8d7c1-0f76-4f96-b2bc-4a6b42221213 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:48.953219 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1dd8d7c1-0f76-4f96-b2bc-4a6b42221213 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:48.953901 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1dd8d7c1-0f76-4f96-b2bc-4a6b42221213 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:48.954347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1dd8d7c1-0f76-4f96-b2bc-4a6b42221213 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:48.954766 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1dd8d7c1-0f76-4f96-b2bc-4a6b42221213 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:48.984085 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1dd8d7c1-0f76-4f96-b2bc-4a6b42221213 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043977 Oct 11 06:51:48.984679 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 690/1332] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:48 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:49.293224 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1c579b85-9f6a-495e-ac53-949e0f88ab87 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:49.294220 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1c579b85-9f6a-495e-ac53-949e0f88ab87 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:49.300718 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c579b85-9f6a-495e-ac53-949e0f88ab87 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:49.301195 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c579b85-9f6a-495e-ac53-949e0f88ab87 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:49.301631 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c579b85-9f6a-495e-ac53-949e0f88ab87 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:49.302322 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c579b85-9f6a-495e-ac53-949e0f88ab87 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:49.302776 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c579b85-9f6a-495e-ac53-949e0f88ab87 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:49.303199 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c579b85-9f6a-495e-ac53-949e0f88ab87 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:49.314077 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-adf39c87-9ace-4d70-916f-68f4b00cf67f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:49.316233 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-adf39c87-9ace-4d70-916f-68f4b00cf67f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:49.322679 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-adf39c87-9ace-4d70-916f-68f4b00cf67f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:49.323155 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-adf39c87-9ace-4d70-916f-68f4b00cf67f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:49.323619 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-adf39c87-9ace-4d70-916f-68f4b00cf67f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:49.324311 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-adf39c87-9ace-4d70-916f-68f4b00cf67f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:49.324825 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-adf39c87-9ace-4d70-916f-68f4b00cf67f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:49.325243 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-adf39c87-9ace-4d70-916f-68f4b00cf67f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:49.355627 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-adf39c87-9ace-4d70-916f-68f4b00cf67f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045414 Oct 11 06:51:49.356186 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 691/1333] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Oct 11 06:51:49 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 06:51:49.434801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1c579b85-9f6a-495e-ac53-949e0f88ab87 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:51:49.438721 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:49.444705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1c579b85-9f6a-495e-ac53-949e0f88ab87 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.156044 Oct 11 06:51:49.445263 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 643/1334] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:51:49 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:51:50.129347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e15ba76d-1834-49cd-9dd9-8b813be5aa70 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:50.131500 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e15ba76d-1834-49cd-9dd9-8b813be5aa70 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:50.137785 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e15ba76d-1834-49cd-9dd9-8b813be5aa70 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:50.138260 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e15ba76d-1834-49cd-9dd9-8b813be5aa70 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:50.138690 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e15ba76d-1834-49cd-9dd9-8b813be5aa70 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:50.139373 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e15ba76d-1834-49cd-9dd9-8b813be5aa70 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:50.139843 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e15ba76d-1834-49cd-9dd9-8b813be5aa70 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:50.140263 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e15ba76d-1834-49cd-9dd9-8b813be5aa70 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:50.170434 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e15ba76d-1834-49cd-9dd9-8b813be5aa70 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.177957 Oct 11 06:51:50.171012 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 692/1335] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:49 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:50.367776 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-39a72d4b-038f-4dac-86cc-e06534527fa8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:51:50.369807 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-39a72d4b-038f-4dac-86cc-e06534527fa8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:50.376055 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-39a72d4b-038f-4dac-86cc-e06534527fa8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:50.376525 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-39a72d4b-038f-4dac-86cc-e06534527fa8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:50.376946 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-39a72d4b-038f-4dac-86cc-e06534527fa8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:50.377624 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-39a72d4b-038f-4dac-86cc-e06534527fa8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:50.378061 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-39a72d4b-038f-4dac-86cc-e06534527fa8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:50.378470 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-39a72d4b-038f-4dac-86cc-e06534527fa8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:50.468264 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e360e0c4-d244-4b4f-8e6d-b34afc38dbe4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:50.468971 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e360e0c4-d244-4b4f-8e6d-b34afc38dbe4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:50.471823 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-39a72d4b-038f-4dac-86cc-e06534527fa8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "POST /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/action" status: 200 len: 38021 microversion: 2.20 time: 0.108086 Oct 11 06:51:50.479079 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 644/1336] 10.222.0.39 () {62 vars in 1319 bytes} [Tue Oct 11 06:51:50 2022] POST /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff/action => generated 38021 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 11 06:51:50.479254 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e360e0c4-d244-4b4f-8e6d-b34afc38dbe4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:50.479254 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e360e0c4-d244-4b4f-8e6d-b34afc38dbe4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:50.479254 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e360e0c4-d244-4b4f-8e6d-b34afc38dbe4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:50.479254 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e360e0c4-d244-4b4f-8e6d-b34afc38dbe4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:50.479625 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e360e0c4-d244-4b4f-8e6d-b34afc38dbe4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:50.479625 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e360e0c4-d244-4b4f-8e6d-b34afc38dbe4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:50.610026 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e360e0c4-d244-4b4f-8e6d-b34afc38dbe4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:51:50.618182 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e360e0c4-d244-4b4f-8e6d-b34afc38dbe4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.153789 Oct 11 06:51:50.619180 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 693/1337] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:51:50 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:51:51.183678 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e5d008a7-0ced-4517-942f-15ac8b08762e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:51.185884 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e5d008a7-0ced-4517-942f-15ac8b08762e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:51.192789 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e5d008a7-0ced-4517-942f-15ac8b08762e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:51.193273 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e5d008a7-0ced-4517-942f-15ac8b08762e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:51.193707 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e5d008a7-0ced-4517-942f-15ac8b08762e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:51.194394 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e5d008a7-0ced-4517-942f-15ac8b08762e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:51.194844 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e5d008a7-0ced-4517-942f-15ac8b08762e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:51.195261 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e5d008a7-0ced-4517-942f-15ac8b08762e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:51.225217 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e5d008a7-0ced-4517-942f-15ac8b08762e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046438 Oct 11 06:51:51.225760 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 645/1338] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:51 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:51.641187 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-77710c5b-659d-474f-a0ac-166990ae1d8e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:51.641885 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-77710c5b-659d-474f-a0ac-166990ae1d8e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:51.648410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77710c5b-659d-474f-a0ac-166990ae1d8e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:51.648887 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77710c5b-659d-474f-a0ac-166990ae1d8e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:51.649316 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77710c5b-659d-474f-a0ac-166990ae1d8e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:51.650641 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77710c5b-659d-474f-a0ac-166990ae1d8e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:51.651085 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77710c5b-659d-474f-a0ac-166990ae1d8e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:51.651532 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77710c5b-659d-474f-a0ac-166990ae1d8e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:51.775528 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-77710c5b-659d-474f-a0ac-166990ae1d8e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:51:51.783935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-77710c5b-659d-474f-a0ac-166990ae1d8e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.146783 Oct 11 06:51:51.784500 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 694/1339] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:51:51 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:51:52.237994 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5a8256e8-471f-434c-87ca-89b326d83fb3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:52.240255 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5a8256e8-471f-434c-87ca-89b326d83fb3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:52.247398 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a8256e8-471f-434c-87ca-89b326d83fb3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:52.247901 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a8256e8-471f-434c-87ca-89b326d83fb3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:52.248334 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a8256e8-471f-434c-87ca-89b326d83fb3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:52.249022 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a8256e8-471f-434c-87ca-89b326d83fb3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:52.249525 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a8256e8-471f-434c-87ca-89b326d83fb3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:52.249892 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a8256e8-471f-434c-87ca-89b326d83fb3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:52.279526 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5a8256e8-471f-434c-87ca-89b326d83fb3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045401 Oct 11 06:51:52.280074 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 646/1340] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:52 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:52.806317 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-907aaf96-9cea-47fa-ba76-8d14b10c0c16 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:52.806912 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-907aaf96-9cea-47fa-ba76-8d14b10c0c16 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:52.813331 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-907aaf96-9cea-47fa-ba76-8d14b10c0c16 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:52.813806 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-907aaf96-9cea-47fa-ba76-8d14b10c0c16 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:52.814234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-907aaf96-9cea-47fa-ba76-8d14b10c0c16 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:52.814921 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-907aaf96-9cea-47fa-ba76-8d14b10c0c16 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:52.815367 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-907aaf96-9cea-47fa-ba76-8d14b10c0c16 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:52.815817 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-907aaf96-9cea-47fa-ba76-8d14b10c0c16 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:52.941394 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-907aaf96-9cea-47fa-ba76-8d14b10c0c16 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:51:52.949420 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-907aaf96-9cea-47fa-ba76-8d14b10c0c16 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.146926 Oct 11 06:51:52.949967 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 695/1341] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:51:52 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:51:53.291653 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-45a949be-c854-4965-965f-300c16991f40 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:53.293793 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-45a949be-c854-4965-965f-300c16991f40 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:53.300436 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-45a949be-c854-4965-965f-300c16991f40 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:53.300913 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-45a949be-c854-4965-965f-300c16991f40 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:53.301345 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-45a949be-c854-4965-965f-300c16991f40 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:53.302040 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-45a949be-c854-4965-965f-300c16991f40 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:53.302481 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-45a949be-c854-4965-965f-300c16991f40 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:53.302895 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-45a949be-c854-4965-965f-300c16991f40 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:53.332192 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-45a949be-c854-4965-965f-300c16991f40 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044362 Oct 11 06:51:53.332781 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 647/1342] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:53 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:53.972968 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a19afce5-097c-4ab4-ad4d-b358a8681c68 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:53.973577 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a19afce5-097c-4ab4-ad4d-b358a8681c68 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:53.980490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a19afce5-097c-4ab4-ad4d-b358a8681c68 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:53.980968 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a19afce5-097c-4ab4-ad4d-b358a8681c68 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:53.981397 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a19afce5-097c-4ab4-ad4d-b358a8681c68 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:53.982087 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a19afce5-097c-4ab4-ad4d-b358a8681c68 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:53.982532 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a19afce5-097c-4ab4-ad4d-b358a8681c68 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:53.982955 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a19afce5-097c-4ab4-ad4d-b358a8681c68 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:54.110910 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a19afce5-097c-4ab4-ad4d-b358a8681c68 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:51:54.119619 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a19afce5-097c-4ab4-ad4d-b358a8681c68 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150373 Oct 11 06:51:54.120189 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 696/1343] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:51:53 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:51:54.344579 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-440912fa-aff8-4806-80c6-1d63815ed777 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:54.346681 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-440912fa-aff8-4806-80c6-1d63815ed777 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:54.353667 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-440912fa-aff8-4806-80c6-1d63815ed777 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:54.354147 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-440912fa-aff8-4806-80c6-1d63815ed777 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:54.354585 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-440912fa-aff8-4806-80c6-1d63815ed777 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:54.355273 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-440912fa-aff8-4806-80c6-1d63815ed777 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:54.355752 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-440912fa-aff8-4806-80c6-1d63815ed777 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:54.356177 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-440912fa-aff8-4806-80c6-1d63815ed777 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:54.384586 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-440912fa-aff8-4806-80c6-1d63815ed777 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043914 Oct 11 06:51:54.385084 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 648/1344] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:54 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:55.142133 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-42e14b7c-cd53-4902-9095-a57cbb124a43 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:55.142843 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-42e14b7c-cd53-4902-9095-a57cbb124a43 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:55.150459 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42e14b7c-cd53-4902-9095-a57cbb124a43 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:55.150939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42e14b7c-cd53-4902-9095-a57cbb124a43 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:55.151367 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42e14b7c-cd53-4902-9095-a57cbb124a43 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:55.152101 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42e14b7c-cd53-4902-9095-a57cbb124a43 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:55.152547 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42e14b7c-cd53-4902-9095-a57cbb124a43 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:55.153016 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42e14b7c-cd53-4902-9095-a57cbb124a43 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:55.280559 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-42e14b7c-cd53-4902-9095-a57cbb124a43 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:51:55.288709 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-42e14b7c-cd53-4902-9095-a57cbb124a43 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150659 Oct 11 06:51:55.289262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 697/1345] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:51:55 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:51:55.396979 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5ca230da-c407-40cb-be45-ccb5fc4d5a67 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:55.399190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5ca230da-c407-40cb-be45-ccb5fc4d5a67 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:55.403093 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 06:51:55.403439 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Tue Oct 11 06:51:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments (ip 10.222.0.39) !!! Oct 11 06:51:55.410425 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ca230da-c407-40cb-be45-ccb5fc4d5a67 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:55.411069 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ca230da-c407-40cb-be45-ccb5fc4d5a67 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:55.411328 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ca230da-c407-40cb-be45-ccb5fc4d5a67 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:55.412027 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ca230da-c407-40cb-be45-ccb5fc4d5a67 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:55.412497 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ca230da-c407-40cb-be45-ccb5fc4d5a67 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:55.412919 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ca230da-c407-40cb-be45-ccb5fc4d5a67 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:55.445916 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5ca230da-c407-40cb-be45-ccb5fc4d5a67 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052833 Oct 11 06:51:55.446973 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 649/1346] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:55 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:56.312817 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2ad6bdde-3223-4c5f-9032-2662a813f1b9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:56.313351 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2ad6bdde-3223-4c5f-9032-2662a813f1b9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:56.319763 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ad6bdde-3223-4c5f-9032-2662a813f1b9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:56.320236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ad6bdde-3223-4c5f-9032-2662a813f1b9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:56.320665 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ad6bdde-3223-4c5f-9032-2662a813f1b9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:56.321348 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ad6bdde-3223-4c5f-9032-2662a813f1b9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:56.321791 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ad6bdde-3223-4c5f-9032-2662a813f1b9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:56.322209 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ad6bdde-3223-4c5f-9032-2662a813f1b9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:56.451553 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2ad6bdde-3223-4c5f-9032-2662a813f1b9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:51:56.458131 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bcc92ee6-3437-4288-b6d9-0e1a5531281b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:56.459777 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2ad6bdde-3223-4c5f-9032-2662a813f1b9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150829 Oct 11 06:51:56.460284 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bcc92ee6-3437-4288-b6d9-0e1a5531281b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:56.460435 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 698/1347] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:51:56 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:51:56.467139 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bcc92ee6-3437-4288-b6d9-0e1a5531281b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:56.467652 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bcc92ee6-3437-4288-b6d9-0e1a5531281b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:56.468085 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bcc92ee6-3437-4288-b6d9-0e1a5531281b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:56.468774 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bcc92ee6-3437-4288-b6d9-0e1a5531281b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:56.469219 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bcc92ee6-3437-4288-b6d9-0e1a5531281b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:56.469637 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bcc92ee6-3437-4288-b6d9-0e1a5531281b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:56.498504 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bcc92ee6-3437-4288-b6d9-0e1a5531281b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044244 Oct 11 06:51:56.499042 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 650/1348] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:56 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:51:57.511679 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ad17ca93-89b0-42b4-832a-64faf8496c84 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:57.513821 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ad17ca93-89b0-42b4-832a-64faf8496c84 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:57.520540 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ad17ca93-89b0-42b4-832a-64faf8496c84 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:57.521020 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ad17ca93-89b0-42b4-832a-64faf8496c84 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:57.521454 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ad17ca93-89b0-42b4-832a-64faf8496c84 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:57.522176 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ad17ca93-89b0-42b4-832a-64faf8496c84 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:57.522626 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ad17ca93-89b0-42b4-832a-64faf8496c84 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:57.523048 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ad17ca93-89b0-42b4-832a-64faf8496c84 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:57.552739 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ad17ca93-89b0-42b4-832a-64faf8496c84 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045647 Oct 11 06:51:57.553417 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 651/1349] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:57 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:51:57.614313 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-69f998e6-ad49-4d78-9603-66a025c5982d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:57.614994 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-69f998e6-ad49-4d78-9603-66a025c5982d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:57.620788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-69f998e6-ad49-4d78-9603-66a025c5982d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:57.621861 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-69f998e6-ad49-4d78-9603-66a025c5982d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:57.622300 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-69f998e6-ad49-4d78-9603-66a025c5982d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:57.622984 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-69f998e6-ad49-4d78-9603-66a025c5982d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:57.623444 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-69f998e6-ad49-4d78-9603-66a025c5982d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:57.623862 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-69f998e6-ad49-4d78-9603-66a025c5982d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:57.750558 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-69f998e6-ad49-4d78-9603-66a025c5982d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:51:57.759108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-69f998e6-ad49-4d78-9603-66a025c5982d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.278952 Oct 11 06:51:57.759714 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 699/1350] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:51:57 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:51:58.566582 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1d2c1474-6a37-4d1d-9bf5-5b6ae08f7d94 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:58.568698 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1d2c1474-6a37-4d1d-9bf5-5b6ae08f7d94 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:58.575202 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d2c1474-6a37-4d1d-9bf5-5b6ae08f7d94 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:58.575715 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d2c1474-6a37-4d1d-9bf5-5b6ae08f7d94 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:58.576153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d2c1474-6a37-4d1d-9bf5-5b6ae08f7d94 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:58.576845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d2c1474-6a37-4d1d-9bf5-5b6ae08f7d94 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:58.577296 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d2c1474-6a37-4d1d-9bf5-5b6ae08f7d94 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:58.577718 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d2c1474-6a37-4d1d-9bf5-5b6ae08f7d94 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:58.606618 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1d2c1474-6a37-4d1d-9bf5-5b6ae08f7d94 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044026 Oct 11 06:51:58.607153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 652/1351] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:58 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:58.781899 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-66cf431c-1421-4db7-8728-d92858d97326 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:58.782508 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-66cf431c-1421-4db7-8728-d92858d97326 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:58.788821 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-66cf431c-1421-4db7-8728-d92858d97326 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:58.789294 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-66cf431c-1421-4db7-8728-d92858d97326 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:58.789722 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-66cf431c-1421-4db7-8728-d92858d97326 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:58.791058 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-66cf431c-1421-4db7-8728-d92858d97326 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:58.791529 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-66cf431c-1421-4db7-8728-d92858d97326 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:58.791946 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-66cf431c-1421-4db7-8728-d92858d97326 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:58.917458 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-66cf431c-1421-4db7-8728-d92858d97326 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:51:58.925475 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-66cf431c-1421-4db7-8728-d92858d97326 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147443 Oct 11 06:51:58.926041 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 700/1352] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:51:58 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:51:59.618823 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-987d4e84-9321-4c99-b029-93e436ec761d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:59.620945 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-987d4e84-9321-4c99-b029-93e436ec761d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:59.627291 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-987d4e84-9321-4c99-b029-93e436ec761d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:59.627801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-987d4e84-9321-4c99-b029-93e436ec761d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:59.628231 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-987d4e84-9321-4c99-b029-93e436ec761d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:59.628919 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-987d4e84-9321-4c99-b029-93e436ec761d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:59.629369 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-987d4e84-9321-4c99-b029-93e436ec761d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:59.629789 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-987d4e84-9321-4c99-b029-93e436ec761d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:59.658610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-987d4e84-9321-4c99-b029-93e436ec761d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043672 Oct 11 06:51:59.659082 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 653/1353] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:51:59 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:51:59.948959 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1066b15e-eccd-48a3-a78e-6869d5ac55a2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:51:59.949501 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1066b15e-eccd-48a3-a78e-6869d5ac55a2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:51:59.951937 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:59.957154 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1066b15e-eccd-48a3-a78e-6869d5ac55a2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:59.957633 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1066b15e-eccd-48a3-a78e-6869d5ac55a2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:59.958066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1066b15e-eccd-48a3-a78e-6869d5ac55a2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:59.958756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1066b15e-eccd-48a3-a78e-6869d5ac55a2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:51:59.959202 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1066b15e-eccd-48a3-a78e-6869d5ac55a2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:51:59.959651 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1066b15e-eccd-48a3-a78e-6869d5ac55a2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:51:59.978610 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:52:00.091353 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1066b15e-eccd-48a3-a78e-6869d5ac55a2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:00.099426 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1066b15e-eccd-48a3-a78e-6869d5ac55a2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.154807 Oct 11 06:52:00.099979 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 701/1354] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:51:59 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:00.669935 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-86ef1ef3-6b15-484d-9c2c-181aecac616c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:00.672112 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-86ef1ef3-6b15-484d-9c2c-181aecac616c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:00.678345 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-86ef1ef3-6b15-484d-9c2c-181aecac616c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:00.678818 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-86ef1ef3-6b15-484d-9c2c-181aecac616c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:00.679246 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-86ef1ef3-6b15-484d-9c2c-181aecac616c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:00.679964 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-86ef1ef3-6b15-484d-9c2c-181aecac616c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:00.680408 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-86ef1ef3-6b15-484d-9c2c-181aecac616c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:00.680820 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-86ef1ef3-6b15-484d-9c2c-181aecac616c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:00.709202 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-86ef1ef3-6b15-484d-9c2c-181aecac616c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043222 Oct 11 06:52:00.709734 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 654/1355] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:00 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:01.123023 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d448c290-4c91-48a1-9109-e87c380efcd6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:01.123638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d448c290-4c91-48a1-9109-e87c380efcd6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:01.129974 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d448c290-4c91-48a1-9109-e87c380efcd6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:01.130440 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d448c290-4c91-48a1-9109-e87c380efcd6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:01.130865 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d448c290-4c91-48a1-9109-e87c380efcd6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:01.131567 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d448c290-4c91-48a1-9109-e87c380efcd6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:01.132020 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d448c290-4c91-48a1-9109-e87c380efcd6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:01.132432 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d448c290-4c91-48a1-9109-e87c380efcd6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:01.257380 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d448c290-4c91-48a1-9109-e87c380efcd6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:01.265845 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d448c290-4c91-48a1-9109-e87c380efcd6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.146706 Oct 11 06:52:01.266394 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 702/1356] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:01 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:01.721716 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8fcd7afe-fdae-43b4-8040-9e2acfb612b1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:01.723829 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8fcd7afe-fdae-43b4-8040-9e2acfb612b1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:01.730806 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8fcd7afe-fdae-43b4-8040-9e2acfb612b1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:01.731283 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8fcd7afe-fdae-43b4-8040-9e2acfb612b1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:01.731737 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8fcd7afe-fdae-43b4-8040-9e2acfb612b1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:01.732421 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8fcd7afe-fdae-43b4-8040-9e2acfb612b1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:01.732868 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8fcd7afe-fdae-43b4-8040-9e2acfb612b1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:01.733286 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8fcd7afe-fdae-43b4-8040-9e2acfb612b1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:01.761534 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8fcd7afe-fdae-43b4-8040-9e2acfb612b1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043963 Oct 11 06:52:01.762062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 655/1357] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:01 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:02.288665 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5600fa11-323e-4524-816a-730d4d01d394 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:02.289270 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5600fa11-323e-4524-816a-730d4d01d394 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:02.296619 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5600fa11-323e-4524-816a-730d4d01d394 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:02.297090 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5600fa11-323e-4524-816a-730d4d01d394 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:02.297518 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5600fa11-323e-4524-816a-730d4d01d394 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:02.298202 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5600fa11-323e-4524-816a-730d4d01d394 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:02.298646 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5600fa11-323e-4524-816a-730d4d01d394 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:02.299063 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5600fa11-323e-4524-816a-730d4d01d394 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:02.433373 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5600fa11-323e-4524-816a-730d4d01d394 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:02.441387 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5600fa11-323e-4524-816a-730d4d01d394 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.156527 Oct 11 06:52:02.441942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 703/1358] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:02 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:02.774171 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-591c3df9-9dde-4951-8b82-c264a7655d65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:02.776329 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-591c3df9-9dde-4951-8b82-c264a7655d65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:02.782859 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-591c3df9-9dde-4951-8b82-c264a7655d65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:02.783342 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-591c3df9-9dde-4951-8b82-c264a7655d65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:02.783808 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-591c3df9-9dde-4951-8b82-c264a7655d65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:02.784502 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-591c3df9-9dde-4951-8b82-c264a7655d65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:02.784953 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-591c3df9-9dde-4951-8b82-c264a7655d65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:02.785369 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-591c3df9-9dde-4951-8b82-c264a7655d65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:02.814677 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-591c3df9-9dde-4951-8b82-c264a7655d65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044488 Oct 11 06:52:02.815215 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 656/1359] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:02 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:03.465454 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c99e406b-7f81-4409-80e8-6593ec221b79 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:03.466163 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c99e406b-7f81-4409-80e8-6593ec221b79 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:03.472598 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c99e406b-7f81-4409-80e8-6593ec221b79 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:03.473075 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c99e406b-7f81-4409-80e8-6593ec221b79 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:03.473503 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c99e406b-7f81-4409-80e8-6593ec221b79 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:03.474185 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c99e406b-7f81-4409-80e8-6593ec221b79 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:03.474633 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c99e406b-7f81-4409-80e8-6593ec221b79 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:03.475048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c99e406b-7f81-4409-80e8-6593ec221b79 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:03.598849 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c99e406b-7f81-4409-80e8-6593ec221b79 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:03.607378 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c99e406b-7f81-4409-80e8-6593ec221b79 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.145783 Oct 11 06:52:03.607955 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 704/1360] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:03 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:03.826994 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e4bcc345-875e-4daa-a6f2-de638d3f6ba7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:03.829156 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e4bcc345-875e-4daa-a6f2-de638d3f6ba7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:03.835530 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e4bcc345-875e-4daa-a6f2-de638d3f6ba7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:03.836012 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e4bcc345-875e-4daa-a6f2-de638d3f6ba7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:03.836449 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e4bcc345-875e-4daa-a6f2-de638d3f6ba7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:03.837167 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e4bcc345-875e-4daa-a6f2-de638d3f6ba7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:03.837703 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e4bcc345-875e-4daa-a6f2-de638d3f6ba7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:03.838129 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e4bcc345-875e-4daa-a6f2-de638d3f6ba7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:03.866762 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e4bcc345-875e-4daa-a6f2-de638d3f6ba7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043724 Oct 11 06:52:03.867302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 657/1361] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:03 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:04.630932 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d0ad2bfe-2fec-4959-8bae-1af23a3bafa5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:04.631570 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d0ad2bfe-2fec-4959-8bae-1af23a3bafa5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:04.638510 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0ad2bfe-2fec-4959-8bae-1af23a3bafa5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:04.638986 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0ad2bfe-2fec-4959-8bae-1af23a3bafa5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:04.639501 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0ad2bfe-2fec-4959-8bae-1af23a3bafa5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:04.640476 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0ad2bfe-2fec-4959-8bae-1af23a3bafa5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:04.640926 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0ad2bfe-2fec-4959-8bae-1af23a3bafa5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:04.641348 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0ad2bfe-2fec-4959-8bae-1af23a3bafa5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:04.774012 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d0ad2bfe-2fec-4959-8bae-1af23a3bafa5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:04.783314 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d0ad2bfe-2fec-4959-8bae-1af23a3bafa5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.156182 Oct 11 06:52:04.783898 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 705/1362] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:04 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:04.879585 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c4c97933-5cbb-4151-8537-2acb1faaa50b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:04.881670 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c4c97933-5cbb-4151-8537-2acb1faaa50b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:04.888871 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4c97933-5cbb-4151-8537-2acb1faaa50b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:04.889341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4c97933-5cbb-4151-8537-2acb1faaa50b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:04.889764 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4c97933-5cbb-4151-8537-2acb1faaa50b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:04.890693 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4c97933-5cbb-4151-8537-2acb1faaa50b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:04.891135 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4c97933-5cbb-4151-8537-2acb1faaa50b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:04.891582 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4c97933-5cbb-4151-8537-2acb1faaa50b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:04.920006 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c4c97933-5cbb-4151-8537-2acb1faaa50b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044322 Oct 11 06:52:04.920555 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 658/1363] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:04 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:05.805981 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1cff2ecf-149f-4f35-b0a1-87927e2d21ec tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:05.806584 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1cff2ecf-149f-4f35-b0a1-87927e2d21ec tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:05.813000 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1cff2ecf-149f-4f35-b0a1-87927e2d21ec tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:05.813491 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1cff2ecf-149f-4f35-b0a1-87927e2d21ec tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:05.813900 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1cff2ecf-149f-4f35-b0a1-87927e2d21ec tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:05.814591 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1cff2ecf-149f-4f35-b0a1-87927e2d21ec tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:05.815029 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1cff2ecf-149f-4f35-b0a1-87927e2d21ec tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:05.815477 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1cff2ecf-149f-4f35-b0a1-87927e2d21ec tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:05.932993 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bed8801f-fa04-40d0-b7e1-6e0bf3fb34b7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:05.935499 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bed8801f-fa04-40d0-b7e1-6e0bf3fb34b7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:05.941819 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bed8801f-fa04-40d0-b7e1-6e0bf3fb34b7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:05.942293 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bed8801f-fa04-40d0-b7e1-6e0bf3fb34b7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:05.942720 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bed8801f-fa04-40d0-b7e1-6e0bf3fb34b7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:05.943427 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bed8801f-fa04-40d0-b7e1-6e0bf3fb34b7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:05.943581 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1cff2ecf-149f-4f35-b0a1-87927e2d21ec tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:05.943878 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bed8801f-fa04-40d0-b7e1-6e0bf3fb34b7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:05.944291 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bed8801f-fa04-40d0-b7e1-6e0bf3fb34b7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:05.951682 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1cff2ecf-149f-4f35-b0a1-87927e2d21ec tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149492 Oct 11 06:52:05.952263 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 706/1364] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:05 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:05.974961 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bed8801f-fa04-40d0-b7e1-6e0bf3fb34b7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046462 Oct 11 06:52:05.975442 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 659/1365] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:05 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:52:06.974886 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ca810629-e925-40c7-b634-e88509b2d678 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:06.975531 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ca810629-e925-40c7-b634-e88509b2d678 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:06.982569 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ca810629-e925-40c7-b634-e88509b2d678 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:06.983053 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ca810629-e925-40c7-b634-e88509b2d678 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:06.983511 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ca810629-e925-40c7-b634-e88509b2d678 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:06.984208 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ca810629-e925-40c7-b634-e88509b2d678 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:06.984656 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ca810629-e925-40c7-b634-e88509b2d678 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:06.985079 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ca810629-e925-40c7-b634-e88509b2d678 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:06.987336 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-fbb9fbc2-d3b4-41d4-aedd-4b20e4d6b2b5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:06.989476 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-fbb9fbc2-d3b4-41d4-aedd-4b20e4d6b2b5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:06.995502 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fbb9fbc2-d3b4-41d4-aedd-4b20e4d6b2b5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:06.995982 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fbb9fbc2-d3b4-41d4-aedd-4b20e4d6b2b5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:06.996414 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fbb9fbc2-d3b4-41d4-aedd-4b20e4d6b2b5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:06.997107 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fbb9fbc2-d3b4-41d4-aedd-4b20e4d6b2b5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:06.997557 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fbb9fbc2-d3b4-41d4-aedd-4b20e4d6b2b5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:06.997976 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fbb9fbc2-d3b4-41d4-aedd-4b20e4d6b2b5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:07.022928 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:52:07.029166 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-fbb9fbc2-d3b4-41d4-aedd-4b20e4d6b2b5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045608 Oct 11 06:52:07.029967 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 660/1366] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:06 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:52:07.110832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ca810629-e925-40c7-b634-e88509b2d678 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:07.118894 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ca810629-e925-40c7-b634-e88509b2d678 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147891 Oct 11 06:52:07.119464 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 707/1367] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:06 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:08.042398 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-edded8a5-58d4-45d3-8114-87d6f74a4d21 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:08.044538 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-edded8a5-58d4-45d3-8114-87d6f74a4d21 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:08.050787 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-edded8a5-58d4-45d3-8114-87d6f74a4d21 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:08.051269 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-edded8a5-58d4-45d3-8114-87d6f74a4d21 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:08.051742 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-edded8a5-58d4-45d3-8114-87d6f74a4d21 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:08.052432 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-edded8a5-58d4-45d3-8114-87d6f74a4d21 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:08.052881 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-edded8a5-58d4-45d3-8114-87d6f74a4d21 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:08.053300 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-edded8a5-58d4-45d3-8114-87d6f74a4d21 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:08.081968 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-edded8a5-58d4-45d3-8114-87d6f74a4d21 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044412 Oct 11 06:52:08.082501 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 661/1368] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:08 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:08.142085 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4e202311-57db-4c4c-b255-3699bab44091 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:08.142776 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4e202311-57db-4c4c-b255-3699bab44091 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:08.149178 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4e202311-57db-4c4c-b255-3699bab44091 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:08.150234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4e202311-57db-4c4c-b255-3699bab44091 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:08.150672 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4e202311-57db-4c4c-b255-3699bab44091 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:08.151366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4e202311-57db-4c4c-b255-3699bab44091 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:08.151854 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4e202311-57db-4c4c-b255-3699bab44091 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:08.152278 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4e202311-57db-4c4c-b255-3699bab44091 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:08.281280 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4e202311-57db-4c4c-b255-3699bab44091 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:08.289526 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4e202311-57db-4c4c-b255-3699bab44091 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.151494 Oct 11 06:52:08.290150 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 708/1369] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:08 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:09.094228 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-107b618e-efda-4baf-986b-e3d75fbc7a93 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:09.096609 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-107b618e-efda-4baf-986b-e3d75fbc7a93 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:09.103382 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-107b618e-efda-4baf-986b-e3d75fbc7a93 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:09.103885 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-107b618e-efda-4baf-986b-e3d75fbc7a93 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:09.104311 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-107b618e-efda-4baf-986b-e3d75fbc7a93 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:09.104987 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-107b618e-efda-4baf-986b-e3d75fbc7a93 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:09.105431 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-107b618e-efda-4baf-986b-e3d75fbc7a93 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:09.105840 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-107b618e-efda-4baf-986b-e3d75fbc7a93 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:09.135538 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-107b618e-efda-4baf-986b-e3d75fbc7a93 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045255 Oct 11 06:52:09.136072 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 662/1370] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:09 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:09.312454 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8f7565fa-84ed-4c45-92d7-f7ea78bed0fa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:09.313066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8f7565fa-84ed-4c45-92d7-f7ea78bed0fa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:09.319861 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f7565fa-84ed-4c45-92d7-f7ea78bed0fa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:09.320345 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f7565fa-84ed-4c45-92d7-f7ea78bed0fa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:09.320776 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f7565fa-84ed-4c45-92d7-f7ea78bed0fa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:09.321471 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f7565fa-84ed-4c45-92d7-f7ea78bed0fa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:09.321919 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f7565fa-84ed-4c45-92d7-f7ea78bed0fa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:09.322341 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f7565fa-84ed-4c45-92d7-f7ea78bed0fa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:09.449470 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8f7565fa-84ed-4c45-92d7-f7ea78bed0fa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:09.457630 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8f7565fa-84ed-4c45-92d7-f7ea78bed0fa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149227 Oct 11 06:52:09.458185 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 709/1371] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:09 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:10.148245 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0a08a6fb-421c-4a75-91e7-4709e0ea9695 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:10.150409 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0a08a6fb-421c-4a75-91e7-4709e0ea9695 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:10.156732 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0a08a6fb-421c-4a75-91e7-4709e0ea9695 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:10.157538 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0a08a6fb-421c-4a75-91e7-4709e0ea9695 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:10.157978 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0a08a6fb-421c-4a75-91e7-4709e0ea9695 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:10.158666 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0a08a6fb-421c-4a75-91e7-4709e0ea9695 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:10.159141 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0a08a6fb-421c-4a75-91e7-4709e0ea9695 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:10.159586 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0a08a6fb-421c-4a75-91e7-4709e0ea9695 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:10.188762 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0a08a6fb-421c-4a75-91e7-4709e0ea9695 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044763 Oct 11 06:52:10.189294 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 663/1372] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:10 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:10.481664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d54657ac-0f2e-47b5-9573-6cbdc78ec3ac tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:10.482271 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d54657ac-0f2e-47b5-9573-6cbdc78ec3ac tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:10.488632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d54657ac-0f2e-47b5-9573-6cbdc78ec3ac tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:10.489107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d54657ac-0f2e-47b5-9573-6cbdc78ec3ac tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:10.489537 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d54657ac-0f2e-47b5-9573-6cbdc78ec3ac tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:10.490218 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d54657ac-0f2e-47b5-9573-6cbdc78ec3ac tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:10.490664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d54657ac-0f2e-47b5-9573-6cbdc78ec3ac tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:10.491084 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d54657ac-0f2e-47b5-9573-6cbdc78ec3ac tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:10.620258 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d54657ac-0f2e-47b5-9573-6cbdc78ec3ac tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:10.628311 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d54657ac-0f2e-47b5-9573-6cbdc78ec3ac tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150976 Oct 11 06:52:10.628881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 710/1373] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:10 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:11.200261 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-09c63d68-ca84-47e5-9083-b1e08122e8dd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:11.202354 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-09c63d68-ca84-47e5-9083-b1e08122e8dd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:11.208751 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-09c63d68-ca84-47e5-9083-b1e08122e8dd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:11.209219 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-09c63d68-ca84-47e5-9083-b1e08122e8dd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:11.209641 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-09c63d68-ca84-47e5-9083-b1e08122e8dd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:11.210323 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-09c63d68-ca84-47e5-9083-b1e08122e8dd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:11.210764 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-09c63d68-ca84-47e5-9083-b1e08122e8dd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:11.211174 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-09c63d68-ca84-47e5-9083-b1e08122e8dd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:11.240184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-09c63d68-ca84-47e5-9083-b1e08122e8dd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043896 Oct 11 06:52:11.240720 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 664/1374] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:11 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:11.651388 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b158efea-af78-40b5-8db3-231302664047 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:11.652020 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b158efea-af78-40b5-8db3-231302664047 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:11.658364 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b158efea-af78-40b5-8db3-231302664047 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:11.658793 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b158efea-af78-40b5-8db3-231302664047 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:11.659231 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b158efea-af78-40b5-8db3-231302664047 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:11.659965 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b158efea-af78-40b5-8db3-231302664047 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:11.660415 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b158efea-af78-40b5-8db3-231302664047 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:11.660837 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b158efea-af78-40b5-8db3-231302664047 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:11.785460 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b158efea-af78-40b5-8db3-231302664047 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:11.794230 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b158efea-af78-40b5-8db3-231302664047 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147160 Oct 11 06:52:11.794790 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 711/1375] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:11 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:12.252438 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-aeeaa879-9c8d-4096-ba47-daac9d82661e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:12.254480 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-aeeaa879-9c8d-4096-ba47-daac9d82661e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:12.256800 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=60 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:52:12.262592 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aeeaa879-9c8d-4096-ba47-daac9d82661e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:12.263062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aeeaa879-9c8d-4096-ba47-daac9d82661e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:12.263514 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aeeaa879-9c8d-4096-ba47-daac9d82661e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:12.264198 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aeeaa879-9c8d-4096-ba47-daac9d82661e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:12.265044 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aeeaa879-9c8d-4096-ba47-daac9d82661e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:12.265552 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aeeaa879-9c8d-4096-ba47-daac9d82661e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:12.294015 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-aeeaa879-9c8d-4096-ba47-daac9d82661e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045809 Oct 11 06:52:12.294547 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 665/1376] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:12 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:12.817792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ae2ea335-8c7e-4465-abaa-6ced48828064 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:12.818332 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ae2ea335-8c7e-4465-abaa-6ced48828064 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:12.824638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ae2ea335-8c7e-4465-abaa-6ced48828064 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:12.825110 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ae2ea335-8c7e-4465-abaa-6ced48828064 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:12.825542 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ae2ea335-8c7e-4465-abaa-6ced48828064 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:12.826229 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ae2ea335-8c7e-4465-abaa-6ced48828064 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:12.826676 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ae2ea335-8c7e-4465-abaa-6ced48828064 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:12.827087 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ae2ea335-8c7e-4465-abaa-6ced48828064 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:12.952943 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ae2ea335-8c7e-4465-abaa-6ced48828064 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:12.961109 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ae2ea335-8c7e-4465-abaa-6ced48828064 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147273 Oct 11 06:52:12.961672 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 712/1377] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:12 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:13.306441 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-766a6a5f-c576-4062-b7ab-894ef423110e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:13.308561 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-766a6a5f-c576-4062-b7ab-894ef423110e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:13.314945 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-766a6a5f-c576-4062-b7ab-894ef423110e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:13.315442 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-766a6a5f-c576-4062-b7ab-894ef423110e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:13.315870 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-766a6a5f-c576-4062-b7ab-894ef423110e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:13.316549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-766a6a5f-c576-4062-b7ab-894ef423110e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:13.316992 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-766a6a5f-c576-4062-b7ab-894ef423110e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:13.317863 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-766a6a5f-c576-4062-b7ab-894ef423110e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:13.346833 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-766a6a5f-c576-4062-b7ab-894ef423110e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044377 Oct 11 06:52:13.347360 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 666/1378] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:13 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:13.984521 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d17a143b-71e7-4eb4-9753-e55ccfaf2d62 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:13.985133 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d17a143b-71e7-4eb4-9753-e55ccfaf2d62 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:13.991542 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d17a143b-71e7-4eb4-9753-e55ccfaf2d62 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:13.992021 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d17a143b-71e7-4eb4-9753-e55ccfaf2d62 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:13.992453 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d17a143b-71e7-4eb4-9753-e55ccfaf2d62 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:13.993151 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d17a143b-71e7-4eb4-9753-e55ccfaf2d62 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:13.993599 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d17a143b-71e7-4eb4-9753-e55ccfaf2d62 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:13.994017 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d17a143b-71e7-4eb4-9753-e55ccfaf2d62 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:14.125726 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d17a143b-71e7-4eb4-9753-e55ccfaf2d62 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:14.134261 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d17a143b-71e7-4eb4-9753-e55ccfaf2d62 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.153062 Oct 11 06:52:14.134804 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 713/1379] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:13 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:14.359268 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-edb819a2-7588-4d07-a204-7d49dc63dda4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:14.361698 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-edb819a2-7588-4d07-a204-7d49dc63dda4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:14.367989 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-edb819a2-7588-4d07-a204-7d49dc63dda4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:14.368459 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-edb819a2-7588-4d07-a204-7d49dc63dda4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:14.368885 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-edb819a2-7588-4d07-a204-7d49dc63dda4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:14.369567 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-edb819a2-7588-4d07-a204-7d49dc63dda4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:14.370009 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-edb819a2-7588-4d07-a204-7d49dc63dda4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:14.370422 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-edb819a2-7588-4d07-a204-7d49dc63dda4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:14.398881 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-edb819a2-7588-4d07-a204-7d49dc63dda4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043513 Oct 11 06:52:14.400071 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 667/1380] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:14 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:15.157864 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b406e346-bb1d-4262-8c08-b08b76b32245 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:15.158473 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b406e346-bb1d-4262-8c08-b08b76b32245 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:15.164861 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b406e346-bb1d-4262-8c08-b08b76b32245 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:15.165952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b406e346-bb1d-4262-8c08-b08b76b32245 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:15.166380 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b406e346-bb1d-4262-8c08-b08b76b32245 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:15.167057 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b406e346-bb1d-4262-8c08-b08b76b32245 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:15.167541 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b406e346-bb1d-4262-8c08-b08b76b32245 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:15.167959 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b406e346-bb1d-4262-8c08-b08b76b32245 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:15.292106 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b406e346-bb1d-4262-8c08-b08b76b32245 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:15.300111 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b406e346-bb1d-4262-8c08-b08b76b32245 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.146019 Oct 11 06:52:15.300663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 714/1381] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:15 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:15.411865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-287837b4-6965-4d56-8750-149d97fa174f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:15.414058 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-287837b4-6965-4d56-8750-149d97fa174f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:15.421308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-287837b4-6965-4d56-8750-149d97fa174f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:15.421794 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-287837b4-6965-4d56-8750-149d97fa174f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:15.422232 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-287837b4-6965-4d56-8750-149d97fa174f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:15.422929 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-287837b4-6965-4d56-8750-149d97fa174f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:15.423387 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-287837b4-6965-4d56-8750-149d97fa174f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:15.423832 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-287837b4-6965-4d56-8750-149d97fa174f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:15.452563 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-287837b4-6965-4d56-8750-149d97fa174f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044704 Oct 11 06:52:15.453127 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 668/1382] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:15 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:16.323447 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d49a9ea1-f0df-47b7-a1c8-4da03a1ca8be tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:16.323992 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d49a9ea1-f0df-47b7-a1c8-4da03a1ca8be tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:16.330728 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d49a9ea1-f0df-47b7-a1c8-4da03a1ca8be tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:16.331260 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d49a9ea1-f0df-47b7-a1c8-4da03a1ca8be tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:16.331719 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d49a9ea1-f0df-47b7-a1c8-4da03a1ca8be tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:16.332401 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d49a9ea1-f0df-47b7-a1c8-4da03a1ca8be tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:16.332849 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d49a9ea1-f0df-47b7-a1c8-4da03a1ca8be tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:16.333267 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d49a9ea1-f0df-47b7-a1c8-4da03a1ca8be tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:16.462180 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d49a9ea1-f0df-47b7-a1c8-4da03a1ca8be tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:16.464223 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-fde90a80-ee2c-484e-b40d-186c8594ff4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:16.466316 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-fde90a80-ee2c-484e-b40d-186c8594ff4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:16.470350 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d49a9ea1-f0df-47b7-a1c8-4da03a1ca8be tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.151567 Oct 11 06:52:16.470902 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 715/1383] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:16 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:16.472580 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fde90a80-ee2c-484e-b40d-186c8594ff4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:16.473121 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fde90a80-ee2c-484e-b40d-186c8594ff4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:16.473551 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fde90a80-ee2c-484e-b40d-186c8594ff4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:16.474242 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fde90a80-ee2c-484e-b40d-186c8594ff4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:16.474686 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fde90a80-ee2c-484e-b40d-186c8594ff4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:16.475098 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fde90a80-ee2c-484e-b40d-186c8594ff4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:16.504263 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-fde90a80-ee2c-484e-b40d-186c8594ff4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043986 Oct 11 06:52:16.504788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 669/1384] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:16 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:52:17.493980 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-dc516642-89ee-47ca-a33e-019e0f7e507d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:17.494595 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-dc516642-89ee-47ca-a33e-019e0f7e507d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:17.501036 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc516642-89ee-47ca-a33e-019e0f7e507d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:17.501514 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc516642-89ee-47ca-a33e-019e0f7e507d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:17.501949 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc516642-89ee-47ca-a33e-019e0f7e507d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:17.502640 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc516642-89ee-47ca-a33e-019e0f7e507d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:17.503088 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc516642-89ee-47ca-a33e-019e0f7e507d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:17.503707 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc516642-89ee-47ca-a33e-019e0f7e507d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:17.516289 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9cb72d81-c434-4a7a-b7a0-1a1dbb7ba72e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:17.518450 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9cb72d81-c434-4a7a-b7a0-1a1dbb7ba72e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:17.525376 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9cb72d81-c434-4a7a-b7a0-1a1dbb7ba72e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:17.525854 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9cb72d81-c434-4a7a-b7a0-1a1dbb7ba72e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:17.526287 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9cb72d81-c434-4a7a-b7a0-1a1dbb7ba72e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:17.526980 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9cb72d81-c434-4a7a-b7a0-1a1dbb7ba72e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:17.527440 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9cb72d81-c434-4a7a-b7a0-1a1dbb7ba72e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:17.527866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9cb72d81-c434-4a7a-b7a0-1a1dbb7ba72e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:17.557061 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9cb72d81-c434-4a7a-b7a0-1a1dbb7ba72e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045151 Oct 11 06:52:17.557617 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 670/1385] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:17 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:52:17.629812 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-dc516642-89ee-47ca-a33e-019e0f7e507d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:17.638006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-dc516642-89ee-47ca-a33e-019e0f7e507d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147876 Oct 11 06:52:17.638559 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 716/1386] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:17 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:18.568564 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-24b3d7cf-e35d-4219-99e9-55323a9ec6fd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:18.570617 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-24b3d7cf-e35d-4219-99e9-55323a9ec6fd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:18.577034 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-24b3d7cf-e35d-4219-99e9-55323a9ec6fd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:18.577519 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-24b3d7cf-e35d-4219-99e9-55323a9ec6fd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:18.577949 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-24b3d7cf-e35d-4219-99e9-55323a9ec6fd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:18.578630 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-24b3d7cf-e35d-4219-99e9-55323a9ec6fd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:18.579077 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-24b3d7cf-e35d-4219-99e9-55323a9ec6fd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:18.579522 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-24b3d7cf-e35d-4219-99e9-55323a9ec6fd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:18.608858 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-24b3d7cf-e35d-4219-99e9-55323a9ec6fd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044291 Oct 11 06:52:18.609414 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 671/1387] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:18 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:52:18.661766 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4725076e-e961-412a-a2b6-ad2a4d3d3e71 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:18.662381 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4725076e-e961-412a-a2b6-ad2a4d3d3e71 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:18.669309 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4725076e-e961-412a-a2b6-ad2a4d3d3e71 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:18.669789 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4725076e-e961-412a-a2b6-ad2a4d3d3e71 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:18.670223 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4725076e-e961-412a-a2b6-ad2a4d3d3e71 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:18.670917 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4725076e-e961-412a-a2b6-ad2a4d3d3e71 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:18.671368 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4725076e-e961-412a-a2b6-ad2a4d3d3e71 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:18.671816 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4725076e-e961-412a-a2b6-ad2a4d3d3e71 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:18.801141 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4725076e-e961-412a-a2b6-ad2a4d3d3e71 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:18.809970 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4725076e-e961-412a-a2b6-ad2a4d3d3e71 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.151966 Oct 11 06:52:18.810564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 717/1388] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:18 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:19.621087 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d9bca3b6-aad8-4efe-8989-c673e1e83102 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:19.623299 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d9bca3b6-aad8-4efe-8989-c673e1e83102 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:19.629620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d9bca3b6-aad8-4efe-8989-c673e1e83102 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:19.630098 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d9bca3b6-aad8-4efe-8989-c673e1e83102 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:19.630528 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d9bca3b6-aad8-4efe-8989-c673e1e83102 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:19.631215 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d9bca3b6-aad8-4efe-8989-c673e1e83102 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:19.631692 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d9bca3b6-aad8-4efe-8989-c673e1e83102 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:19.632113 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d9bca3b6-aad8-4efe-8989-c673e1e83102 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:19.806139 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d9bca3b6-aad8-4efe-8989-c673e1e83102 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.188296 Oct 11 06:52:19.806581 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 672/1389] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:19 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:19.833447 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c216d234-6d57-4655-accf-da66d77437f0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:19.834041 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c216d234-6d57-4655-accf-da66d77437f0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:19.840417 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c216d234-6d57-4655-accf-da66d77437f0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:19.840882 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c216d234-6d57-4655-accf-da66d77437f0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:19.841301 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c216d234-6d57-4655-accf-da66d77437f0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:19.841980 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c216d234-6d57-4655-accf-da66d77437f0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:19.842420 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c216d234-6d57-4655-accf-da66d77437f0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:19.842833 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c216d234-6d57-4655-accf-da66d77437f0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:19.846731 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:52:19.967596 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c216d234-6d57-4655-accf-da66d77437f0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:19.975531 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c216d234-6d57-4655-accf-da66d77437f0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.145828 Oct 11 06:52:19.976077 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 718/1390] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:19 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:20.818280 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0fbd6876-9046-4bfc-a345-8677655e6f6f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:20.820446 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0fbd6876-9046-4bfc-a345-8677655e6f6f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:20.827613 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0fbd6876-9046-4bfc-a345-8677655e6f6f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:20.828094 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0fbd6876-9046-4bfc-a345-8677655e6f6f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:20.828527 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0fbd6876-9046-4bfc-a345-8677655e6f6f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:20.829220 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0fbd6876-9046-4bfc-a345-8677655e6f6f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:20.829670 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0fbd6876-9046-4bfc-a345-8677655e6f6f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:20.830084 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0fbd6876-9046-4bfc-a345-8677655e6f6f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:20.858878 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0fbd6876-9046-4bfc-a345-8677655e6f6f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044505 Oct 11 06:52:20.859403 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 673/1391] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:20 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:20.997938 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-465a20d8-a430-4ece-906c-de91ad11e451 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:20.998538 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-465a20d8-a430-4ece-906c-de91ad11e451 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:21.004686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-465a20d8-a430-4ece-906c-de91ad11e451 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:21.005162 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-465a20d8-a430-4ece-906c-de91ad11e451 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:21.005594 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-465a20d8-a430-4ece-906c-de91ad11e451 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:21.006278 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-465a20d8-a430-4ece-906c-de91ad11e451 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:21.006728 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-465a20d8-a430-4ece-906c-de91ad11e451 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:21.007146 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-465a20d8-a430-4ece-906c-de91ad11e451 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:21.132577 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-465a20d8-a430-4ece-906c-de91ad11e451 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:21.141425 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-465a20d8-a430-4ece-906c-de91ad11e451 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147280 Oct 11 06:52:21.141980 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 719/1392] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:20 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:21.871619 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2d73fd81-a5e9-4720-a881-67e01c5a491d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:21.873743 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2d73fd81-a5e9-4720-a881-67e01c5a491d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:21.880081 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d73fd81-a5e9-4720-a881-67e01c5a491d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:21.880558 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d73fd81-a5e9-4720-a881-67e01c5a491d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:21.880988 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d73fd81-a5e9-4720-a881-67e01c5a491d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:21.881677 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d73fd81-a5e9-4720-a881-67e01c5a491d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:21.882128 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d73fd81-a5e9-4720-a881-67e01c5a491d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:21.882549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d73fd81-a5e9-4720-a881-67e01c5a491d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:21.911258 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2d73fd81-a5e9-4720-a881-67e01c5a491d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044142 Oct 11 06:52:21.911811 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 674/1393] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:21 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:22.166484 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fe1bc942-e754-42c8-80b4-f529d29df1a4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:22.167000 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fe1bc942-e754-42c8-80b4-f529d29df1a4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:22.173335 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fe1bc942-e754-42c8-80b4-f529d29df1a4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:22.173802 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fe1bc942-e754-42c8-80b4-f529d29df1a4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:22.174227 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fe1bc942-e754-42c8-80b4-f529d29df1a4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:22.174905 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fe1bc942-e754-42c8-80b4-f529d29df1a4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:22.175397 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fe1bc942-e754-42c8-80b4-f529d29df1a4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:22.175839 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fe1bc942-e754-42c8-80b4-f529d29df1a4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:22.302025 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fe1bc942-e754-42c8-80b4-f529d29df1a4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:22.310156 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fe1bc942-e754-42c8-80b4-f529d29df1a4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.148112 Oct 11 06:52:22.310705 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 720/1394] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:22 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:22.924209 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e4ff95af-6d97-47bb-adc4-a709aae8b4d8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:22.926366 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e4ff95af-6d97-47bb-adc4-a709aae8b4d8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:22.933308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e4ff95af-6d97-47bb-adc4-a709aae8b4d8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:22.933794 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e4ff95af-6d97-47bb-adc4-a709aae8b4d8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:22.934236 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e4ff95af-6d97-47bb-adc4-a709aae8b4d8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:22.934934 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e4ff95af-6d97-47bb-adc4-a709aae8b4d8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:22.935388 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e4ff95af-6d97-47bb-adc4-a709aae8b4d8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:22.935835 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e4ff95af-6d97-47bb-adc4-a709aae8b4d8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:22.964819 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e4ff95af-6d97-47bb-adc4-a709aae8b4d8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044601 Oct 11 06:52:22.965350 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 675/1395] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:22 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:23.333768 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-41ec0e2a-c451-412e-9b4e-1f9b231a44ef tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:23.334308 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-41ec0e2a-c451-412e-9b4e-1f9b231a44ef tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:23.340689 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-41ec0e2a-c451-412e-9b4e-1f9b231a44ef tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:23.341168 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-41ec0e2a-c451-412e-9b4e-1f9b231a44ef tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:23.341599 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-41ec0e2a-c451-412e-9b4e-1f9b231a44ef tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:23.342287 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-41ec0e2a-c451-412e-9b4e-1f9b231a44ef tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:23.342741 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-41ec0e2a-c451-412e-9b4e-1f9b231a44ef tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:23.343170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-41ec0e2a-c451-412e-9b4e-1f9b231a44ef tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:23.469323 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-41ec0e2a-c451-412e-9b4e-1f9b231a44ef tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:23.477991 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-41ec0e2a-c451-412e-9b4e-1f9b231a44ef tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.148099 Oct 11 06:52:23.478552 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 721/1396] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:23 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:23.977010 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f5686670-0585-45ac-9b50-166a7f6a496f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:23.979132 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f5686670-0585-45ac-9b50-166a7f6a496f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:23.985725 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f5686670-0585-45ac-9b50-166a7f6a496f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:23.986205 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f5686670-0585-45ac-9b50-166a7f6a496f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:23.986637 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f5686670-0585-45ac-9b50-166a7f6a496f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:23.987327 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f5686670-0585-45ac-9b50-166a7f6a496f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:23.987806 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f5686670-0585-45ac-9b50-166a7f6a496f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:23.988228 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f5686670-0585-45ac-9b50-166a7f6a496f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:24.017199 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f5686670-0585-45ac-9b50-166a7f6a496f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044142 Oct 11 06:52:24.017737 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 676/1397] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:23 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:24.501008 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5e1c996d-f702-4a6e-9a03-4930fd132a15 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:24.501609 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5e1c996d-f702-4a6e-9a03-4930fd132a15 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:24.507956 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5e1c996d-f702-4a6e-9a03-4930fd132a15 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:24.509017 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5e1c996d-f702-4a6e-9a03-4930fd132a15 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:24.509708 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5e1c996d-f702-4a6e-9a03-4930fd132a15 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:24.510129 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5e1c996d-f702-4a6e-9a03-4930fd132a15 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:24.510569 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5e1c996d-f702-4a6e-9a03-4930fd132a15 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:24.510981 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5e1c996d-f702-4a6e-9a03-4930fd132a15 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:24.640830 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5e1c996d-f702-4a6e-9a03-4930fd132a15 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:24.648949 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5e1c996d-f702-4a6e-9a03-4930fd132a15 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.151769 Oct 11 06:52:24.649492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 722/1398] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:24 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:25.029645 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7906b6ff-c828-4eb8-a242-df50590e4d7b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:25.031778 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7906b6ff-c828-4eb8-a242-df50590e4d7b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:25.038155 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7906b6ff-c828-4eb8-a242-df50590e4d7b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:25.038626 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7906b6ff-c828-4eb8-a242-df50590e4d7b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:25.039053 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7906b6ff-c828-4eb8-a242-df50590e4d7b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:25.040371 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7906b6ff-c828-4eb8-a242-df50590e4d7b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:25.040818 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7906b6ff-c828-4eb8-a242-df50590e4d7b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:25.041234 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7906b6ff-c828-4eb8-a242-df50590e4d7b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:25.057068 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:52:25.071139 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7906b6ff-c828-4eb8-a242-df50590e4d7b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045424 Oct 11 06:52:25.071694 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 677/1399] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:25 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:25.671645 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-96a3cb54-f7d7-47f0-b85c-251fe7571a8f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:25.672248 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-96a3cb54-f7d7-47f0-b85c-251fe7571a8f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:25.678620 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96a3cb54-f7d7-47f0-b85c-251fe7571a8f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:25.679090 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96a3cb54-f7d7-47f0-b85c-251fe7571a8f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:25.679554 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96a3cb54-f7d7-47f0-b85c-251fe7571a8f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:25.680744 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96a3cb54-f7d7-47f0-b85c-251fe7571a8f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:25.681181 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96a3cb54-f7d7-47f0-b85c-251fe7571a8f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:25.681593 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96a3cb54-f7d7-47f0-b85c-251fe7571a8f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:25.806288 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-96a3cb54-f7d7-47f0-b85c-251fe7571a8f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:25.814385 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-96a3cb54-f7d7-47f0-b85c-251fe7571a8f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.146467 Oct 11 06:52:25.815023 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 723/1400] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:25 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:26.083819 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-379ccdef-0403-4a9e-b22f-0510cc82341f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:26.085856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-379ccdef-0403-4a9e-b22f-0510cc82341f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:26.092215 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-379ccdef-0403-4a9e-b22f-0510cc82341f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:26.092689 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-379ccdef-0403-4a9e-b22f-0510cc82341f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:26.093117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-379ccdef-0403-4a9e-b22f-0510cc82341f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:26.093797 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-379ccdef-0403-4a9e-b22f-0510cc82341f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:26.094243 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-379ccdef-0403-4a9e-b22f-0510cc82341f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:26.094661 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-379ccdef-0403-4a9e-b22f-0510cc82341f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:26.125420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-379ccdef-0403-4a9e-b22f-0510cc82341f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045790 Oct 11 06:52:26.125940 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 678/1401] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:26 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:26.838952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f62c4f12-4629-4fd7-a39f-1461bbf979a9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:26.839811 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f62c4f12-4629-4fd7-a39f-1461bbf979a9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:26.847200 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f62c4f12-4629-4fd7-a39f-1461bbf979a9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:26.847708 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f62c4f12-4629-4fd7-a39f-1461bbf979a9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:26.848134 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f62c4f12-4629-4fd7-a39f-1461bbf979a9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:26.848814 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f62c4f12-4629-4fd7-a39f-1461bbf979a9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:26.849255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f62c4f12-4629-4fd7-a39f-1461bbf979a9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:26.849667 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f62c4f12-4629-4fd7-a39f-1461bbf979a9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:26.975536 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f62c4f12-4629-4fd7-a39f-1461bbf979a9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:26.983637 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f62c4f12-4629-4fd7-a39f-1461bbf979a9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149984 Oct 11 06:52:26.984170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 724/1402] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:26 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:27.138167 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5e2fa984-d3e0-4117-96c9-b52dc64eeed5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:27.140620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5e2fa984-d3e0-4117-96c9-b52dc64eeed5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:27.147156 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5e2fa984-d3e0-4117-96c9-b52dc64eeed5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:27.147706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5e2fa984-d3e0-4117-96c9-b52dc64eeed5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:27.148141 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5e2fa984-d3e0-4117-96c9-b52dc64eeed5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:27.149559 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5e2fa984-d3e0-4117-96c9-b52dc64eeed5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:27.149905 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5e2fa984-d3e0-4117-96c9-b52dc64eeed5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:27.150326 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5e2fa984-d3e0-4117-96c9-b52dc64eeed5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:27.178742 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5e2fa984-d3e0-4117-96c9-b52dc64eeed5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044487 Oct 11 06:52:27.179243 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 679/1403] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:27 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:28.006109 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-df870308-b3c5-42a4-9c27-df028ae73409 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:28.006633 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-df870308-b3c5-42a4-9c27-df028ae73409 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:28.013220 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-df870308-b3c5-42a4-9c27-df028ae73409 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:28.013697 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-df870308-b3c5-42a4-9c27-df028ae73409 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:28.014398 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-df870308-b3c5-42a4-9c27-df028ae73409 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:28.015088 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-df870308-b3c5-42a4-9c27-df028ae73409 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:28.015570 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-df870308-b3c5-42a4-9c27-df028ae73409 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:28.015996 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-df870308-b3c5-42a4-9c27-df028ae73409 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:28.143272 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-df870308-b3c5-42a4-9c27-df028ae73409 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:28.151917 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-df870308-b3c5-42a4-9c27-df028ae73409 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149881 Oct 11 06:52:28.152479 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 725/1404] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:28 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:28.191237 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6f3b5587-c999-4539-9000-54723454da06 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:28.193518 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6f3b5587-c999-4539-9000-54723454da06 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:28.200146 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6f3b5587-c999-4539-9000-54723454da06 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:28.200624 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6f3b5587-c999-4539-9000-54723454da06 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:28.201058 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6f3b5587-c999-4539-9000-54723454da06 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:28.201751 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6f3b5587-c999-4539-9000-54723454da06 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:28.202205 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6f3b5587-c999-4539-9000-54723454da06 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:28.202627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6f3b5587-c999-4539-9000-54723454da06 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:28.232287 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6f3b5587-c999-4539-9000-54723454da06 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044943 Oct 11 06:52:28.232824 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 680/1405] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:28 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:29.175731 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0e61dafd-159a-441b-8eaa-e389e3d60282 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:29.176370 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0e61dafd-159a-441b-8eaa-e389e3d60282 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:29.183347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0e61dafd-159a-441b-8eaa-e389e3d60282 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:29.183849 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0e61dafd-159a-441b-8eaa-e389e3d60282 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:29.184276 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0e61dafd-159a-441b-8eaa-e389e3d60282 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:29.184959 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0e61dafd-159a-441b-8eaa-e389e3d60282 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:29.185404 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0e61dafd-159a-441b-8eaa-e389e3d60282 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:29.185822 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0e61dafd-159a-441b-8eaa-e389e3d60282 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:29.245679 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a2463541-383e-4aa3-abdf-f2e41ea78233 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:29.247653 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a2463541-383e-4aa3-abdf-f2e41ea78233 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:29.254483 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2463541-383e-4aa3-abdf-f2e41ea78233 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:29.254953 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2463541-383e-4aa3-abdf-f2e41ea78233 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:29.255380 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2463541-383e-4aa3-abdf-f2e41ea78233 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:29.256096 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2463541-383e-4aa3-abdf-f2e41ea78233 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:29.256538 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2463541-383e-4aa3-abdf-f2e41ea78233 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:29.256955 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2463541-383e-4aa3-abdf-f2e41ea78233 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:29.286336 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a2463541-383e-4aa3-abdf-f2e41ea78233 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045639 Oct 11 06:52:29.286883 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 681/1406] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:29 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:52:29.313796 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0e61dafd-159a-441b-8eaa-e389e3d60282 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:29.321954 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0e61dafd-159a-441b-8eaa-e389e3d60282 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150058 Oct 11 06:52:29.322507 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 726/1407] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:29 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:30.299274 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-71fa6df9-8f88-4632-b3cc-d66a06721e07 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:30.301457 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-71fa6df9-8f88-4632-b3cc-d66a06721e07 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:30.308427 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-71fa6df9-8f88-4632-b3cc-d66a06721e07 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:30.308908 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-71fa6df9-8f88-4632-b3cc-d66a06721e07 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:30.309347 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-71fa6df9-8f88-4632-b3cc-d66a06721e07 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:30.310037 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-71fa6df9-8f88-4632-b3cc-d66a06721e07 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:30.310489 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-71fa6df9-8f88-4632-b3cc-d66a06721e07 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:30.310911 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-71fa6df9-8f88-4632-b3cc-d66a06721e07 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:30.340180 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-71fa6df9-8f88-4632-b3cc-d66a06721e07 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044888 Oct 11 06:52:30.340724 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 682/1408] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:30 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:30.344664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-671d2b4d-0835-4abe-9719-eee89a42945c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:30.345262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-671d2b4d-0835-4abe-9719-eee89a42945c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:30.347542 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=52 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:52:30.352582 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-671d2b4d-0835-4abe-9719-eee89a42945c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:30.353052 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-671d2b4d-0835-4abe-9719-eee89a42945c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:30.353473 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-671d2b4d-0835-4abe-9719-eee89a42945c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:30.354153 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-671d2b4d-0835-4abe-9719-eee89a42945c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:30.354594 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-671d2b4d-0835-4abe-9719-eee89a42945c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:30.355006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-671d2b4d-0835-4abe-9719-eee89a42945c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:30.484753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-671d2b4d-0835-4abe-9719-eee89a42945c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:30.493495 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-671d2b4d-0835-4abe-9719-eee89a42945c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.152563 Oct 11 06:52:30.494046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 727/1409] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:30 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:31.352769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-470e0ac5-b3bd-4a95-9160-d276cb5e373e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:31.354862 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-470e0ac5-b3bd-4a95-9160-d276cb5e373e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:31.361245 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-470e0ac5-b3bd-4a95-9160-d276cb5e373e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:31.361723 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-470e0ac5-b3bd-4a95-9160-d276cb5e373e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:31.362148 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-470e0ac5-b3bd-4a95-9160-d276cb5e373e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:31.362827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-470e0ac5-b3bd-4a95-9160-d276cb5e373e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:31.363271 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-470e0ac5-b3bd-4a95-9160-d276cb5e373e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:31.363711 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-470e0ac5-b3bd-4a95-9160-d276cb5e373e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:31.392606 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-470e0ac5-b3bd-4a95-9160-d276cb5e373e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043811 Oct 11 06:52:31.393135 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 683/1410] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:31 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:31.517401 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1d18a923-a016-4320-9f68-c372afdc3405 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:31.518081 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1d18a923-a016-4320-9f68-c372afdc3405 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:31.525028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1d18a923-a016-4320-9f68-c372afdc3405 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:31.525496 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1d18a923-a016-4320-9f68-c372afdc3405 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:31.525916 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1d18a923-a016-4320-9f68-c372afdc3405 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:31.526591 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1d18a923-a016-4320-9f68-c372afdc3405 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:31.527028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1d18a923-a016-4320-9f68-c372afdc3405 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:31.527459 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1d18a923-a016-4320-9f68-c372afdc3405 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:31.651360 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1d18a923-a016-4320-9f68-c372afdc3405 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:31.659437 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1d18a923-a016-4320-9f68-c372afdc3405 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.146237 Oct 11 06:52:31.659935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 728/1411] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:31 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:32.405337 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8e579a45-025d-4d8a-930a-45ddb67b487c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:32.407521 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8e579a45-025d-4d8a-930a-45ddb67b487c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:32.413962 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e579a45-025d-4d8a-930a-45ddb67b487c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:32.414446 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e579a45-025d-4d8a-930a-45ddb67b487c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:32.415535 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e579a45-025d-4d8a-930a-45ddb67b487c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:32.416227 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e579a45-025d-4d8a-930a-45ddb67b487c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:32.416673 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e579a45-025d-4d8a-930a-45ddb67b487c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:32.417088 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e579a45-025d-4d8a-930a-45ddb67b487c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:32.445317 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8e579a45-025d-4d8a-930a-45ddb67b487c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043951 Oct 11 06:52:32.445860 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 684/1412] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:32 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:32.684022 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9eb5ebe7-85cf-4fc8-b7c6-782f06c9f3dd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:32.684569 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9eb5ebe7-85cf-4fc8-b7c6-782f06c9f3dd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:32.690893 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9eb5ebe7-85cf-4fc8-b7c6-782f06c9f3dd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:32.691370 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9eb5ebe7-85cf-4fc8-b7c6-782f06c9f3dd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:32.691834 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9eb5ebe7-85cf-4fc8-b7c6-782f06c9f3dd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:32.692524 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9eb5ebe7-85cf-4fc8-b7c6-782f06c9f3dd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:32.692973 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9eb5ebe7-85cf-4fc8-b7c6-782f06c9f3dd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:32.693396 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9eb5ebe7-85cf-4fc8-b7c6-782f06c9f3dd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:32.820847 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9eb5ebe7-85cf-4fc8-b7c6-782f06c9f3dd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:32.829416 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9eb5ebe7-85cf-4fc8-b7c6-782f06c9f3dd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149243 Oct 11 06:52:32.830152 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 729/1413] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:32 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:33.457530 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2113c556-ba84-486b-bfb8-3238e3d5c2b3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:33.459665 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2113c556-ba84-486b-bfb8-3238e3d5c2b3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:33.465987 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2113c556-ba84-486b-bfb8-3238e3d5c2b3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:33.466459 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2113c556-ba84-486b-bfb8-3238e3d5c2b3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:33.466884 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2113c556-ba84-486b-bfb8-3238e3d5c2b3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:33.467599 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2113c556-ba84-486b-bfb8-3238e3d5c2b3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:33.468044 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2113c556-ba84-486b-bfb8-3238e3d5c2b3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:33.468458 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2113c556-ba84-486b-bfb8-3238e3d5c2b3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:33.496858 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2113c556-ba84-486b-bfb8-3238e3d5c2b3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043345 Oct 11 06:52:33.497389 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 685/1414] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:33 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:33.853789 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-20fe595a-462c-4baf-8e8a-87913fba7291 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:33.854400 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-20fe595a-462c-4baf-8e8a-87913fba7291 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:33.860779 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20fe595a-462c-4baf-8e8a-87913fba7291 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:33.861259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20fe595a-462c-4baf-8e8a-87913fba7291 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:33.861694 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20fe595a-462c-4baf-8e8a-87913fba7291 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:33.862385 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20fe595a-462c-4baf-8e8a-87913fba7291 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:33.862841 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20fe595a-462c-4baf-8e8a-87913fba7291 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:33.863267 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20fe595a-462c-4baf-8e8a-87913fba7291 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:33.987758 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-20fe595a-462c-4baf-8e8a-87913fba7291 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:33.995910 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-20fe595a-462c-4baf-8e8a-87913fba7291 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.146432 Oct 11 06:52:33.996477 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 730/1415] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:33 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:34.509548 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-59afb6d8-8afb-4e10-8156-eca74c0c2d1b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:34.511680 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-59afb6d8-8afb-4e10-8156-eca74c0c2d1b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:34.518398 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-59afb6d8-8afb-4e10-8156-eca74c0c2d1b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:34.518870 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-59afb6d8-8afb-4e10-8156-eca74c0c2d1b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:34.519295 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-59afb6d8-8afb-4e10-8156-eca74c0c2d1b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:34.520000 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-59afb6d8-8afb-4e10-8156-eca74c0c2d1b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:34.520447 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-59afb6d8-8afb-4e10-8156-eca74c0c2d1b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:34.520864 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-59afb6d8-8afb-4e10-8156-eca74c0c2d1b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:34.549431 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-59afb6d8-8afb-4e10-8156-eca74c0c2d1b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044304 Oct 11 06:52:34.549959 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 686/1416] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:34 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:35.019542 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0be29a95-a0e8-486c-b911-8644c4d5986b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:35.020092 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0be29a95-a0e8-486c-b911-8644c4d5986b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:35.026568 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0be29a95-a0e8-486c-b911-8644c4d5986b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:35.027041 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0be29a95-a0e8-486c-b911-8644c4d5986b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:35.027489 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0be29a95-a0e8-486c-b911-8644c4d5986b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:35.028176 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0be29a95-a0e8-486c-b911-8644c4d5986b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:35.028621 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0be29a95-a0e8-486c-b911-8644c4d5986b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:35.029040 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0be29a95-a0e8-486c-b911-8644c4d5986b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:35.157312 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0be29a95-a0e8-486c-b911-8644c4d5986b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:35.166233 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0be29a95-a0e8-486c-b911-8644c4d5986b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150529 Oct 11 06:52:35.166787 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 731/1417] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:35 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:35.561716 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3e3efc87-ee7f-49d9-9b1d-a48159ee359b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:35.563881 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3e3efc87-ee7f-49d9-9b1d-a48159ee359b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:35.570362 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e3efc87-ee7f-49d9-9b1d-a48159ee359b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:35.570842 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e3efc87-ee7f-49d9-9b1d-a48159ee359b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:35.571277 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e3efc87-ee7f-49d9-9b1d-a48159ee359b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:35.572009 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e3efc87-ee7f-49d9-9b1d-a48159ee359b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:35.572464 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e3efc87-ee7f-49d9-9b1d-a48159ee359b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:35.572888 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e3efc87-ee7f-49d9-9b1d-a48159ee359b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:35.602396 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3e3efc87-ee7f-49d9-9b1d-a48159ee359b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044631 Oct 11 06:52:35.603534 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 687/1418] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:35 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:36.189890 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-18312ba4-e8aa-41e4-a3ce-35383a895392 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:36.190493 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-18312ba4-e8aa-41e4-a3ce-35383a895392 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:36.196937 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18312ba4-e8aa-41e4-a3ce-35383a895392 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:36.197413 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18312ba4-e8aa-41e4-a3ce-35383a895392 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:36.197841 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18312ba4-e8aa-41e4-a3ce-35383a895392 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:36.198529 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18312ba4-e8aa-41e4-a3ce-35383a895392 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:36.198978 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18312ba4-e8aa-41e4-a3ce-35383a895392 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:36.199398 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18312ba4-e8aa-41e4-a3ce-35383a895392 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:36.330995 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-18312ba4-e8aa-41e4-a3ce-35383a895392 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:36.339581 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-18312ba4-e8aa-41e4-a3ce-35383a895392 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.153493 Oct 11 06:52:36.340146 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 732/1419] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:36 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:36.615316 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f9518d9d-d72e-467b-af1b-6e64493789f1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:36.617466 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f9518d9d-d72e-467b-af1b-6e64493789f1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:36.623834 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f9518d9d-d72e-467b-af1b-6e64493789f1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:36.624313 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f9518d9d-d72e-467b-af1b-6e64493789f1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:36.624745 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f9518d9d-d72e-467b-af1b-6e64493789f1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:36.625436 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f9518d9d-d72e-467b-af1b-6e64493789f1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:36.625882 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f9518d9d-d72e-467b-af1b-6e64493789f1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:36.626303 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f9518d9d-d72e-467b-af1b-6e64493789f1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:36.655847 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f9518d9d-d72e-467b-af1b-6e64493789f1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044458 Oct 11 06:52:36.656383 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 688/1420] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:36 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:37.363643 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-db77df1b-0df4-496a-b152-899b09369da7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:37.364248 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-db77df1b-0df4-496a-b152-899b09369da7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:37.371292 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-db77df1b-0df4-496a-b152-899b09369da7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:37.371790 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-db77df1b-0df4-496a-b152-899b09369da7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:37.372215 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-db77df1b-0df4-496a-b152-899b09369da7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:37.372898 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-db77df1b-0df4-496a-b152-899b09369da7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:37.373344 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-db77df1b-0df4-496a-b152-899b09369da7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:37.373760 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-db77df1b-0df4-496a-b152-899b09369da7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:37.497274 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-db77df1b-0df4-496a-b152-899b09369da7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:37.505340 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-db77df1b-0df4-496a-b152-899b09369da7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.145528 Oct 11 06:52:37.505895 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 733/1421] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:37 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:37.668748 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0f325f77-a882-4073-a3a2-4f24e3999e9e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:37.670834 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0f325f77-a882-4073-a3a2-4f24e3999e9e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:37.677195 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0f325f77-a882-4073-a3a2-4f24e3999e9e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:37.677672 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0f325f77-a882-4073-a3a2-4f24e3999e9e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:37.678117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0f325f77-a882-4073-a3a2-4f24e3999e9e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:37.678806 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0f325f77-a882-4073-a3a2-4f24e3999e9e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:37.679255 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0f325f77-a882-4073-a3a2-4f24e3999e9e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:37.679696 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0f325f77-a882-4073-a3a2-4f24e3999e9e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:37.707689 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0f325f77-a882-4073-a3a2-4f24e3999e9e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043506 Oct 11 06:52:37.708220 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 689/1422] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:37 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:38.529064 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-09c460c8-1a12-497f-9dee-9e41d22cce5a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:38.529633 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-09c460c8-1a12-497f-9dee-9e41d22cce5a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:38.536067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-09c460c8-1a12-497f-9dee-9e41d22cce5a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:38.536542 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-09c460c8-1a12-497f-9dee-9e41d22cce5a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:38.536974 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-09c460c8-1a12-497f-9dee-9e41d22cce5a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:38.537655 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-09c460c8-1a12-497f-9dee-9e41d22cce5a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:38.538102 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-09c460c8-1a12-497f-9dee-9e41d22cce5a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:38.538520 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-09c460c8-1a12-497f-9dee-9e41d22cce5a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:38.666267 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-09c460c8-1a12-497f-9dee-9e41d22cce5a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:38.669664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:52:38.675107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-09c460c8-1a12-497f-9dee-9e41d22cce5a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150022 Oct 11 06:52:38.675694 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 734/1423] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:38 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:38.720630 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-966715cc-b0ee-4dbf-bcee-926d9557c065 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:38.722802 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-966715cc-b0ee-4dbf-bcee-926d9557c065 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:38.729657 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-966715cc-b0ee-4dbf-bcee-926d9557c065 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:38.730131 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-966715cc-b0ee-4dbf-bcee-926d9557c065 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:38.730560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-966715cc-b0ee-4dbf-bcee-926d9557c065 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:38.731241 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-966715cc-b0ee-4dbf-bcee-926d9557c065 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:38.731718 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-966715cc-b0ee-4dbf-bcee-926d9557c065 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:38.732136 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-966715cc-b0ee-4dbf-bcee-926d9557c065 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:38.761344 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-966715cc-b0ee-4dbf-bcee-926d9557c065 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044739 Oct 11 06:52:38.761884 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 690/1424] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:38 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:39.698189 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-68f606c2-7b16-4c96-a17c-f3487f22c206 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:39.698792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-68f606c2-7b16-4c96-a17c-f3487f22c206 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:39.705618 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-68f606c2-7b16-4c96-a17c-f3487f22c206 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:39.706097 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-68f606c2-7b16-4c96-a17c-f3487f22c206 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:39.706529 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-68f606c2-7b16-4c96-a17c-f3487f22c206 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:39.707245 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-68f606c2-7b16-4c96-a17c-f3487f22c206 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:39.707722 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-68f606c2-7b16-4c96-a17c-f3487f22c206 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:39.708146 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-68f606c2-7b16-4c96-a17c-f3487f22c206 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:39.773427 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5f62ebc2-4340-4f47-ad1d-704fa4907b79 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:39.776188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5f62ebc2-4340-4f47-ad1d-704fa4907b79 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:39.782488 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f62ebc2-4340-4f47-ad1d-704fa4907b79 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:39.782963 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f62ebc2-4340-4f47-ad1d-704fa4907b79 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:39.783390 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f62ebc2-4340-4f47-ad1d-704fa4907b79 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:39.784125 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f62ebc2-4340-4f47-ad1d-704fa4907b79 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:39.784551 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f62ebc2-4340-4f47-ad1d-704fa4907b79 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:39.784970 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f62ebc2-4340-4f47-ad1d-704fa4907b79 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:39.814038 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5f62ebc2-4340-4f47-ad1d-704fa4907b79 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044617 Oct 11 06:52:39.814949 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 691/1425] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:39 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:52:39.834573 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-68f606c2-7b16-4c96-a17c-f3487f22c206 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:39.843348 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-68f606c2-7b16-4c96-a17c-f3487f22c206 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149426 Oct 11 06:52:39.843922 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 735/1426] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:39 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:40.825977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e1881484-cad1-4a3e-951e-94e283a15276 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:40.828165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e1881484-cad1-4a3e-951e-94e283a15276 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:40.834437 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e1881484-cad1-4a3e-951e-94e283a15276 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:40.834918 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e1881484-cad1-4a3e-951e-94e283a15276 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:40.835348 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e1881484-cad1-4a3e-951e-94e283a15276 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:40.836058 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e1881484-cad1-4a3e-951e-94e283a15276 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:40.836529 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e1881484-cad1-4a3e-951e-94e283a15276 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:40.837456 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e1881484-cad1-4a3e-951e-94e283a15276 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:40.866284 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e1881484-cad1-4a3e-951e-94e283a15276 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044286 Oct 11 06:52:40.866507 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b9254a36-8932-4edd-ab56-f028fbafe49f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:40.866930 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 692/1427] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:40 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:40.867082 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b9254a36-8932-4edd-ab56-f028fbafe49f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:40.873473 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b9254a36-8932-4edd-ab56-f028fbafe49f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:40.873958 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b9254a36-8932-4edd-ab56-f028fbafe49f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:40.874388 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b9254a36-8932-4edd-ab56-f028fbafe49f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:40.875080 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b9254a36-8932-4edd-ab56-f028fbafe49f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:40.875559 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b9254a36-8932-4edd-ab56-f028fbafe49f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:40.875984 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b9254a36-8932-4edd-ab56-f028fbafe49f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:41.003289 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b9254a36-8932-4edd-ab56-f028fbafe49f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:41.011934 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b9254a36-8932-4edd-ab56-f028fbafe49f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149424 Oct 11 06:52:41.012487 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 736/1428] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:40 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:52:41.878571 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4aed4878-5eb5-4729-9610-3b8b094c0a91 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:41.880734 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4aed4878-5eb5-4729-9610-3b8b094c0a91 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:41.887620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4aed4878-5eb5-4729-9610-3b8b094c0a91 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:41.888096 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4aed4878-5eb5-4729-9610-3b8b094c0a91 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:41.888781 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4aed4878-5eb5-4729-9610-3b8b094c0a91 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:41.889467 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4aed4878-5eb5-4729-9610-3b8b094c0a91 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:41.889920 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4aed4878-5eb5-4729-9610-3b8b094c0a91 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:41.890337 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4aed4878-5eb5-4729-9610-3b8b094c0a91 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:41.919104 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4aed4878-5eb5-4729-9610-3b8b094c0a91 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044486 Oct 11 06:52:41.919658 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 693/1429] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:41 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:42.035727 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5ef6318e-9ccb-4a98-a126-edfdd5a8b21a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:42.036335 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5ef6318e-9ccb-4a98-a126-edfdd5a8b21a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:42.043071 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ef6318e-9ccb-4a98-a126-edfdd5a8b21a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:42.043592 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ef6318e-9ccb-4a98-a126-edfdd5a8b21a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:42.044029 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ef6318e-9ccb-4a98-a126-edfdd5a8b21a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:42.044721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ef6318e-9ccb-4a98-a126-edfdd5a8b21a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:42.045179 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ef6318e-9ccb-4a98-a126-edfdd5a8b21a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:42.045624 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ef6318e-9ccb-4a98-a126-edfdd5a8b21a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:42.175788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5ef6318e-9ccb-4a98-a126-edfdd5a8b21a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:42.184451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5ef6318e-9ccb-4a98-a126-edfdd5a8b21a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.152668 Oct 11 06:52:42.185016 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 737/1430] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:42 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:42.931279 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7438ac07-cf19-42a1-bdea-7f52f3d4b3fe tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:42.933438 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7438ac07-cf19-42a1-bdea-7f52f3d4b3fe tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:42.935779 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=58 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:52:42.940970 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7438ac07-cf19-42a1-bdea-7f52f3d4b3fe tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:42.941449 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7438ac07-cf19-42a1-bdea-7f52f3d4b3fe tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:42.941880 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7438ac07-cf19-42a1-bdea-7f52f3d4b3fe tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:42.942565 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7438ac07-cf19-42a1-bdea-7f52f3d4b3fe tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:42.943015 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7438ac07-cf19-42a1-bdea-7f52f3d4b3fe tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:42.943457 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7438ac07-cf19-42a1-bdea-7f52f3d4b3fe tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:42.947249 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:52:42.972818 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7438ac07-cf19-42a1-bdea-7f52f3d4b3fe tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045447 Oct 11 06:52:42.973361 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 694/1431] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:42 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:43.208504 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-be4ff299-d08d-4225-a2db-a79aff1a808f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:43.209107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-be4ff299-d08d-4225-a2db-a79aff1a808f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:43.215958 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-be4ff299-d08d-4225-a2db-a79aff1a808f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:43.216424 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-be4ff299-d08d-4225-a2db-a79aff1a808f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:43.216845 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-be4ff299-d08d-4225-a2db-a79aff1a808f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:43.217521 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-be4ff299-d08d-4225-a2db-a79aff1a808f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:43.217964 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-be4ff299-d08d-4225-a2db-a79aff1a808f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:43.218374 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-be4ff299-d08d-4225-a2db-a79aff1a808f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:43.343622 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-be4ff299-d08d-4225-a2db-a79aff1a808f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:43.351730 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-be4ff299-d08d-4225-a2db-a79aff1a808f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147083 Oct 11 06:52:43.352288 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 738/1432] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:43 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:43.985791 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-85d48989-8525-4b29-b6f1-5bb398af0f73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:43.987977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-85d48989-8525-4b29-b6f1-5bb398af0f73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:43.994312 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85d48989-8525-4b29-b6f1-5bb398af0f73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:43.994791 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85d48989-8525-4b29-b6f1-5bb398af0f73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:43.995222 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85d48989-8525-4b29-b6f1-5bb398af0f73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:43.995935 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85d48989-8525-4b29-b6f1-5bb398af0f73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:43.996386 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85d48989-8525-4b29-b6f1-5bb398af0f73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:43.996825 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85d48989-8525-4b29-b6f1-5bb398af0f73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:44.026210 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-85d48989-8525-4b29-b6f1-5bb398af0f73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044351 Oct 11 06:52:44.026744 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 695/1433] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:43 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:44.374893 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7d087256-33b2-470b-95c7-8864ce1a022b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:44.375538 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7d087256-33b2-470b-95c7-8864ce1a022b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:44.381968 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d087256-33b2-470b-95c7-8864ce1a022b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:44.382442 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d087256-33b2-470b-95c7-8864ce1a022b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:44.382874 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d087256-33b2-470b-95c7-8864ce1a022b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:44.384297 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d087256-33b2-470b-95c7-8864ce1a022b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:44.384752 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d087256-33b2-470b-95c7-8864ce1a022b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:44.385171 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d087256-33b2-470b-95c7-8864ce1a022b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:44.514273 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7d087256-33b2-470b-95c7-8864ce1a022b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:44.522428 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7d087256-33b2-470b-95c7-8864ce1a022b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.151410 Oct 11 06:52:44.522991 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 739/1434] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:44 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:45.038400 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9b7318e5-31cb-482c-8d96-05b06136cb73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:45.041110 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9b7318e5-31cb-482c-8d96-05b06136cb73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:45.047601 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9b7318e5-31cb-482c-8d96-05b06136cb73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:45.048080 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9b7318e5-31cb-482c-8d96-05b06136cb73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:45.048507 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9b7318e5-31cb-482c-8d96-05b06136cb73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:45.049188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9b7318e5-31cb-482c-8d96-05b06136cb73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:45.049634 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9b7318e5-31cb-482c-8d96-05b06136cb73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:45.050051 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9b7318e5-31cb-482c-8d96-05b06136cb73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:45.079226 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9b7318e5-31cb-482c-8d96-05b06136cb73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044744 Oct 11 06:52:45.079786 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 696/1435] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:45 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:45.545145 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-28e9f4e5-e535-4bca-a4d6-13854d84ab61 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:45.545683 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-28e9f4e5-e535-4bca-a4d6-13854d84ab61 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:45.552030 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28e9f4e5-e535-4bca-a4d6-13854d84ab61 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:45.552508 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28e9f4e5-e535-4bca-a4d6-13854d84ab61 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:45.552934 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28e9f4e5-e535-4bca-a4d6-13854d84ab61 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:45.553649 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28e9f4e5-e535-4bca-a4d6-13854d84ab61 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:45.554094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28e9f4e5-e535-4bca-a4d6-13854d84ab61 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:45.554514 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28e9f4e5-e535-4bca-a4d6-13854d84ab61 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:45.679441 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-28e9f4e5-e535-4bca-a4d6-13854d84ab61 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:45.687482 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-28e9f4e5-e535-4bca-a4d6-13854d84ab61 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.146251 Oct 11 06:52:45.688044 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 740/1436] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:45 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:46.091401 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-29a0662e-0a2e-4a25-a231-b6b184ba610f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:46.093575 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-29a0662e-0a2e-4a25-a231-b6b184ba610f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:46.099961 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-29a0662e-0a2e-4a25-a231-b6b184ba610f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:46.100441 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-29a0662e-0a2e-4a25-a231-b6b184ba610f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:46.100875 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-29a0662e-0a2e-4a25-a231-b6b184ba610f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:46.101564 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-29a0662e-0a2e-4a25-a231-b6b184ba610f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:46.102017 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-29a0662e-0a2e-4a25-a231-b6b184ba610f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:46.102436 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-29a0662e-0a2e-4a25-a231-b6b184ba610f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:46.131065 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-29a0662e-0a2e-4a25-a231-b6b184ba610f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043586 Oct 11 06:52:46.131639 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 697/1437] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:46 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:46.711207 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e6250627-ba3b-439c-a5c1-f1c67e191fbc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:46.712375 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e6250627-ba3b-439c-a5c1-f1c67e191fbc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:46.719035 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e6250627-ba3b-439c-a5c1-f1c67e191fbc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:46.719594 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e6250627-ba3b-439c-a5c1-f1c67e191fbc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:46.719895 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e6250627-ba3b-439c-a5c1-f1c67e191fbc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:46.720585 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e6250627-ba3b-439c-a5c1-f1c67e191fbc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:46.721034 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e6250627-ba3b-439c-a5c1-f1c67e191fbc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:46.721648 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e6250627-ba3b-439c-a5c1-f1c67e191fbc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:46.853179 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e6250627-ba3b-439c-a5c1-f1c67e191fbc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:46.861508 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e6250627-ba3b-439c-a5c1-f1c67e191fbc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.154131 Oct 11 06:52:46.862068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 741/1438] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:46 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:47.144805 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3afd7837-8f71-4073-a0ff-83357bdc50b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:47.146969 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3afd7837-8f71-4073-a0ff-83357bdc50b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:47.153999 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3afd7837-8f71-4073-a0ff-83357bdc50b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:47.154478 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3afd7837-8f71-4073-a0ff-83357bdc50b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:47.154909 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3afd7837-8f71-4073-a0ff-83357bdc50b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:47.155632 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3afd7837-8f71-4073-a0ff-83357bdc50b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:47.156082 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3afd7837-8f71-4073-a0ff-83357bdc50b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:47.156501 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3afd7837-8f71-4073-a0ff-83357bdc50b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:47.185586 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3afd7837-8f71-4073-a0ff-83357bdc50b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044713 Oct 11 06:52:47.186118 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 698/1439] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:47 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:47.884541 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-26166531-a92a-4df6-8107-3b5c0c2b9058 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:47.885248 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-26166531-a92a-4df6-8107-3b5c0c2b9058 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:47.892019 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-26166531-a92a-4df6-8107-3b5c0c2b9058 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:47.892496 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-26166531-a92a-4df6-8107-3b5c0c2b9058 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:47.892929 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-26166531-a92a-4df6-8107-3b5c0c2b9058 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:47.893628 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-26166531-a92a-4df6-8107-3b5c0c2b9058 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:47.894082 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-26166531-a92a-4df6-8107-3b5c0c2b9058 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:47.894508 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-26166531-a92a-4df6-8107-3b5c0c2b9058 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:48.019923 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-26166531-a92a-4df6-8107-3b5c0c2b9058 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:48.028042 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-26166531-a92a-4df6-8107-3b5c0c2b9058 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147283 Oct 11 06:52:48.028540 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 742/1440] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:47 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:48.198469 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-fd91e9a9-a40b-43ab-a776-8897eb84cbf2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:48.200638 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-fd91e9a9-a40b-43ab-a776-8897eb84cbf2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:48.206569 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fd91e9a9-a40b-43ab-a776-8897eb84cbf2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:48.207050 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fd91e9a9-a40b-43ab-a776-8897eb84cbf2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:48.207516 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fd91e9a9-a40b-43ab-a776-8897eb84cbf2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:48.208210 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fd91e9a9-a40b-43ab-a776-8897eb84cbf2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:48.208662 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fd91e9a9-a40b-43ab-a776-8897eb84cbf2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:48.209087 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fd91e9a9-a40b-43ab-a776-8897eb84cbf2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:48.238481 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-fd91e9a9-a40b-43ab-a776-8897eb84cbf2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044183 Oct 11 06:52:48.239019 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 699/1441] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:48 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:49.051497 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c3cd0770-1fbe-46d3-98bf-0182fb85b66e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:49.052223 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c3cd0770-1fbe-46d3-98bf-0182fb85b66e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:49.059036 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c3cd0770-1fbe-46d3-98bf-0182fb85b66e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:49.059559 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c3cd0770-1fbe-46d3-98bf-0182fb85b66e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:49.059988 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c3cd0770-1fbe-46d3-98bf-0182fb85b66e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:49.060665 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c3cd0770-1fbe-46d3-98bf-0182fb85b66e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:49.061103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c3cd0770-1fbe-46d3-98bf-0182fb85b66e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:49.061512 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c3cd0770-1fbe-46d3-98bf-0182fb85b66e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:49.186061 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c3cd0770-1fbe-46d3-98bf-0182fb85b66e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:49.194042 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c3cd0770-1fbe-46d3-98bf-0182fb85b66e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.146428 Oct 11 06:52:49.194667 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 743/1442] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:49 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:49.250835 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-dcd04e8d-3332-4a7d-919c-ccf559e40b2e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:49.253026 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-dcd04e8d-3332-4a7d-919c-ccf559e40b2e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:49.259333 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dcd04e8d-3332-4a7d-919c-ccf559e40b2e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:49.259838 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dcd04e8d-3332-4a7d-919c-ccf559e40b2e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:49.260267 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dcd04e8d-3332-4a7d-919c-ccf559e40b2e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:49.260946 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dcd04e8d-3332-4a7d-919c-ccf559e40b2e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:49.261391 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dcd04e8d-3332-4a7d-919c-ccf559e40b2e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:49.261804 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dcd04e8d-3332-4a7d-919c-ccf559e40b2e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:49.290580 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-dcd04e8d-3332-4a7d-919c-ccf559e40b2e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043185 Oct 11 06:52:49.291104 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 700/1443] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:49 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:50.218559 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-77b232fb-ad8a-4b62-a1fd-f4cc34504c15 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:50.219167 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-77b232fb-ad8a-4b62-a1fd-f4cc34504c15 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:50.225608 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77b232fb-ad8a-4b62-a1fd-f4cc34504c15 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:50.226085 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77b232fb-ad8a-4b62-a1fd-f4cc34504c15 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:50.226536 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77b232fb-ad8a-4b62-a1fd-f4cc34504c15 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:50.227223 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77b232fb-ad8a-4b62-a1fd-f4cc34504c15 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:50.227696 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77b232fb-ad8a-4b62-a1fd-f4cc34504c15 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:50.228114 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77b232fb-ad8a-4b62-a1fd-f4cc34504c15 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:50.302337 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bb0833b6-b235-4422-8a96-5bb99c69f83b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:50.304478 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bb0833b6-b235-4422-8a96-5bb99c69f83b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:50.311141 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb0833b6-b235-4422-8a96-5bb99c69f83b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:50.311677 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb0833b6-b235-4422-8a96-5bb99c69f83b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:50.312118 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb0833b6-b235-4422-8a96-5bb99c69f83b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:50.312821 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb0833b6-b235-4422-8a96-5bb99c69f83b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:50.313277 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb0833b6-b235-4422-8a96-5bb99c69f83b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:50.313704 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb0833b6-b235-4422-8a96-5bb99c69f83b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:50.344073 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bb0833b6-b235-4422-8a96-5bb99c69f83b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045619 Oct 11 06:52:50.344630 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 701/1444] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:50 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:52:50.357960 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-77b232fb-ad8a-4b62-a1fd-f4cc34504c15 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:50.366033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-77b232fb-ad8a-4b62-a1fd-f4cc34504c15 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.151409 Oct 11 06:52:50.366588 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 744/1445] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:50 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:51.356425 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-86f52c3d-7cb9-45d4-86eb-d9b9fe172878 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:51.358566 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-86f52c3d-7cb9-45d4-86eb-d9b9fe172878 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:51.365187 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-86f52c3d-7cb9-45d4-86eb-d9b9fe172878 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:51.365674 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-86f52c3d-7cb9-45d4-86eb-d9b9fe172878 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:51.366107 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-86f52c3d-7cb9-45d4-86eb-d9b9fe172878 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:51.366803 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-86f52c3d-7cb9-45d4-86eb-d9b9fe172878 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:51.367255 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-86f52c3d-7cb9-45d4-86eb-d9b9fe172878 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:51.368301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-86f52c3d-7cb9-45d4-86eb-d9b9fe172878 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:51.390358 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-510bbdfb-2dcd-4186-a04b-0fb494cec3c6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:51.390960 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-510bbdfb-2dcd-4186-a04b-0fb494cec3c6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:51.396982 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-510bbdfb-2dcd-4186-a04b-0fb494cec3c6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:51.397454 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-510bbdfb-2dcd-4186-a04b-0fb494cec3c6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:51.397879 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-510bbdfb-2dcd-4186-a04b-0fb494cec3c6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:51.398559 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-510bbdfb-2dcd-4186-a04b-0fb494cec3c6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:51.398736 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-86f52c3d-7cb9-45d4-86eb-d9b9fe172878 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046313 Oct 11 06:52:51.399065 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-510bbdfb-2dcd-4186-a04b-0fb494cec3c6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:51.399489 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 702/1446] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:51 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:51.399675 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-510bbdfb-2dcd-4186-a04b-0fb494cec3c6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:51.527054 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-510bbdfb-2dcd-4186-a04b-0fb494cec3c6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:51.535050 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-510bbdfb-2dcd-4186-a04b-0fb494cec3c6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.148668 Oct 11 06:52:51.535631 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 745/1447] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:51 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:52:52.410287 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b8fa9c2a-db01-4658-b0a3-2c40a159609b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:52.412495 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b8fa9c2a-db01-4658-b0a3-2c40a159609b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:52.419545 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8fa9c2a-db01-4658-b0a3-2c40a159609b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:52.420028 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8fa9c2a-db01-4658-b0a3-2c40a159609b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:52.420465 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8fa9c2a-db01-4658-b0a3-2c40a159609b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:52.421184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8fa9c2a-db01-4658-b0a3-2c40a159609b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:52.421640 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8fa9c2a-db01-4658-b0a3-2c40a159609b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:52.422063 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8fa9c2a-db01-4658-b0a3-2c40a159609b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:52.451306 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b8fa9c2a-db01-4658-b0a3-2c40a159609b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045110 Oct 11 06:52:52.451874 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 703/1448] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:52 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:52.559272 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-01b06e96-e148-45d7-bb3b-958196e5a747 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:52.559905 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-01b06e96-e148-45d7-bb3b-958196e5a747 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:52.566233 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-01b06e96-e148-45d7-bb3b-958196e5a747 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:52.566711 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-01b06e96-e148-45d7-bb3b-958196e5a747 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:52.567141 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-01b06e96-e148-45d7-bb3b-958196e5a747 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:52.567856 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-01b06e96-e148-45d7-bb3b-958196e5a747 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:52.568299 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-01b06e96-e148-45d7-bb3b-958196e5a747 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:52.568722 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-01b06e96-e148-45d7-bb3b-958196e5a747 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:52.695951 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-01b06e96-e148-45d7-bb3b-958196e5a747 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:52.703961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-01b06e96-e148-45d7-bb3b-958196e5a747 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149128 Oct 11 06:52:52.704511 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 746/1449] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:52 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:53.463653 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a5f70645-14cc-45e1-85d6-c2438911bbcf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:53.465769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a5f70645-14cc-45e1-85d6-c2438911bbcf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:53.472249 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a5f70645-14cc-45e1-85d6-c2438911bbcf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:53.472729 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a5f70645-14cc-45e1-85d6-c2438911bbcf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:53.473166 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a5f70645-14cc-45e1-85d6-c2438911bbcf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:53.473852 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a5f70645-14cc-45e1-85d6-c2438911bbcf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:53.474302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a5f70645-14cc-45e1-85d6-c2438911bbcf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:53.474724 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a5f70645-14cc-45e1-85d6-c2438911bbcf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:53.503368 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a5f70645-14cc-45e1-85d6-c2438911bbcf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043696 Oct 11 06:52:53.503928 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 704/1450] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:53 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:53.728733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-300d78c9-8d1c-4a93-9f30-c6cbc6d65948 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:53.729395 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-300d78c9-8d1c-4a93-9f30-c6cbc6d65948 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:53.735797 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-300d78c9-8d1c-4a93-9f30-c6cbc6d65948 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:53.736274 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-300d78c9-8d1c-4a93-9f30-c6cbc6d65948 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:53.736698 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-300d78c9-8d1c-4a93-9f30-c6cbc6d65948 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:53.737396 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-300d78c9-8d1c-4a93-9f30-c6cbc6d65948 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:53.737842 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-300d78c9-8d1c-4a93-9f30-c6cbc6d65948 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:53.738255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-300d78c9-8d1c-4a93-9f30-c6cbc6d65948 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:53.901131 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-300d78c9-8d1c-4a93-9f30-c6cbc6d65948 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:53.909320 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-300d78c9-8d1c-4a93-9f30-c6cbc6d65948 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.185548 Oct 11 06:52:53.909930 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 747/1451] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:53 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:54.515945 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5068d600-f010-4c3b-8b13-028c1745c619 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:54.518006 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5068d600-f010-4c3b-8b13-028c1745c619 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:54.524315 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5068d600-f010-4c3b-8b13-028c1745c619 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:54.524787 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5068d600-f010-4c3b-8b13-028c1745c619 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:54.525221 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5068d600-f010-4c3b-8b13-028c1745c619 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:54.525910 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5068d600-f010-4c3b-8b13-028c1745c619 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:54.526357 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5068d600-f010-4c3b-8b13-028c1745c619 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:54.526777 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5068d600-f010-4c3b-8b13-028c1745c619 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:54.556139 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5068d600-f010-4c3b-8b13-028c1745c619 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043766 Oct 11 06:52:54.556675 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 705/1452] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:54 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:54.933883 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e53ee854-07ed-48fe-82d8-e740b671375f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:54.934487 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e53ee854-07ed-48fe-82d8-e740b671375f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:54.940822 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e53ee854-07ed-48fe-82d8-e740b671375f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:54.941310 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e53ee854-07ed-48fe-82d8-e740b671375f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:54.941747 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e53ee854-07ed-48fe-82d8-e740b671375f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:54.942440 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e53ee854-07ed-48fe-82d8-e740b671375f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:54.942889 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e53ee854-07ed-48fe-82d8-e740b671375f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:54.943315 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e53ee854-07ed-48fe-82d8-e740b671375f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:55.073247 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e53ee854-07ed-48fe-82d8-e740b671375f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:55.081348 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e53ee854-07ed-48fe-82d8-e740b671375f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.151853 Oct 11 06:52:55.081907 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 748/1453] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:54 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:55.568271 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4b716a48-8a7a-42d8-aafa-9328203cd15a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:55.570431 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4b716a48-8a7a-42d8-aafa-9328203cd15a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:55.576933 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b716a48-8a7a-42d8-aafa-9328203cd15a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:55.577414 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b716a48-8a7a-42d8-aafa-9328203cd15a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:55.577843 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b716a48-8a7a-42d8-aafa-9328203cd15a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:55.578535 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b716a48-8a7a-42d8-aafa-9328203cd15a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:55.578983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b716a48-8a7a-42d8-aafa-9328203cd15a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:55.579424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b716a48-8a7a-42d8-aafa-9328203cd15a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:55.608552 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4b716a48-8a7a-42d8-aafa-9328203cd15a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044318 Oct 11 06:52:55.609088 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 706/1454] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:55 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:56.104649 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-dbd14c65-f1b5-4caa-8908-91548e2f5cc9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:56.105279 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-dbd14c65-f1b5-4caa-8908-91548e2f5cc9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:56.112265 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dbd14c65-f1b5-4caa-8908-91548e2f5cc9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:56.112742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dbd14c65-f1b5-4caa-8908-91548e2f5cc9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:56.113167 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dbd14c65-f1b5-4caa-8908-91548e2f5cc9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:56.113850 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dbd14c65-f1b5-4caa-8908-91548e2f5cc9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:56.114293 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dbd14c65-f1b5-4caa-8908-91548e2f5cc9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:56.114797 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dbd14c65-f1b5-4caa-8908-91548e2f5cc9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:56.242380 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-dbd14c65-f1b5-4caa-8908-91548e2f5cc9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:56.250972 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-dbd14c65-f1b5-4caa-8908-91548e2f5cc9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150227 Oct 11 06:52:56.251545 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 749/1455] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:56 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:56.621262 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-19ea6d71-ad7c-4764-b322-670801b806fe tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:56.623342 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-19ea6d71-ad7c-4764-b322-670801b806fe tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:56.630307 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-19ea6d71-ad7c-4764-b322-670801b806fe tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:56.630784 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-19ea6d71-ad7c-4764-b322-670801b806fe tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:56.631218 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-19ea6d71-ad7c-4764-b322-670801b806fe tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:56.631957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-19ea6d71-ad7c-4764-b322-670801b806fe tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:56.632406 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-19ea6d71-ad7c-4764-b322-670801b806fe tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:56.632825 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-19ea6d71-ad7c-4764-b322-670801b806fe tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:56.661731 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-19ea6d71-ad7c-4764-b322-670801b806fe tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044914 Oct 11 06:52:56.662258 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 707/1456] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:56 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:57.274889 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0a5539bb-1953-420c-9e45-7a12090d2bab tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:57.275561 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0a5539bb-1953-420c-9e45-7a12090d2bab tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:57.282042 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0a5539bb-1953-420c-9e45-7a12090d2bab tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:57.282516 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0a5539bb-1953-420c-9e45-7a12090d2bab tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:57.282945 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0a5539bb-1953-420c-9e45-7a12090d2bab tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:57.283982 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0a5539bb-1953-420c-9e45-7a12090d2bab tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:57.284109 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0a5539bb-1953-420c-9e45-7a12090d2bab tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:57.284557 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0a5539bb-1953-420c-9e45-7a12090d2bab tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:57.413792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0a5539bb-1953-420c-9e45-7a12090d2bab tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:57.422650 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0a5539bb-1953-420c-9e45-7a12090d2bab tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.152143 Oct 11 06:52:57.423200 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 750/1457] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:57 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:57.673923 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7996ce2b-030a-45ca-a784-d530fc927604 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:57.676061 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7996ce2b-030a-45ca-a784-d530fc927604 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:57.682552 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7996ce2b-030a-45ca-a784-d530fc927604 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:57.683040 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7996ce2b-030a-45ca-a784-d530fc927604 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:57.683509 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7996ce2b-030a-45ca-a784-d530fc927604 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:57.684201 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7996ce2b-030a-45ca-a784-d530fc927604 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:57.684651 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7996ce2b-030a-45ca-a784-d530fc927604 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:57.685070 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7996ce2b-030a-45ca-a784-d530fc927604 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:57.714420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7996ce2b-030a-45ca-a784-d530fc927604 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044467 Oct 11 06:52:57.714965 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 708/1458] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:57 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:58.445220 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-790f1c2f-2b0e-4599-927a-85098cea2264 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:58.445915 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-790f1c2f-2b0e-4599-927a-85098cea2264 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:58.452466 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-790f1c2f-2b0e-4599-927a-85098cea2264 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:58.452946 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-790f1c2f-2b0e-4599-927a-85098cea2264 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:58.453381 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-790f1c2f-2b0e-4599-927a-85098cea2264 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:58.454078 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-790f1c2f-2b0e-4599-927a-85098cea2264 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:58.454528 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-790f1c2f-2b0e-4599-927a-85098cea2264 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:58.454951 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-790f1c2f-2b0e-4599-927a-85098cea2264 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:58.472565 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:52:58.583877 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-790f1c2f-2b0e-4599-927a-85098cea2264 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:58.592595 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-790f1c2f-2b0e-4599-927a-85098cea2264 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.151208 Oct 11 06:52:58.593148 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 751/1459] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:58 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:58.726099 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f91be673-a84e-4542-8eee-41438e02c8c3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:58.728716 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f91be673-a84e-4542-8eee-41438e02c8c3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:58.735010 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f91be673-a84e-4542-8eee-41438e02c8c3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:58.735527 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f91be673-a84e-4542-8eee-41438e02c8c3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:58.735965 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f91be673-a84e-4542-8eee-41438e02c8c3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:58.736653 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f91be673-a84e-4542-8eee-41438e02c8c3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:58.737103 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f91be673-a84e-4542-8eee-41438e02c8c3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:58.737524 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f91be673-a84e-4542-8eee-41438e02c8c3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:58.766422 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f91be673-a84e-4542-8eee-41438e02c8c3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044288 Oct 11 06:52:58.766961 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 709/1460] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:58 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:52:59.615973 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1440cfd5-fc92-4958-9521-4bbb00924ff0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:59.616591 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1440cfd5-fc92-4958-9521-4bbb00924ff0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:59.623343 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1440cfd5-fc92-4958-9521-4bbb00924ff0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:59.623850 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1440cfd5-fc92-4958-9521-4bbb00924ff0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:59.624284 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1440cfd5-fc92-4958-9521-4bbb00924ff0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:59.624968 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1440cfd5-fc92-4958-9521-4bbb00924ff0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:59.625414 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1440cfd5-fc92-4958-9521-4bbb00924ff0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:59.625834 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1440cfd5-fc92-4958-9521-4bbb00924ff0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:59.753537 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1440cfd5-fc92-4958-9521-4bbb00924ff0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:52:59.761705 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1440cfd5-fc92-4958-9521-4bbb00924ff0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149517 Oct 11 06:52:59.762259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 752/1461] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:52:59 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:52:59.778160 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ba185a1c-6216-421f-898a-750b010f45f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:52:59.780316 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ba185a1c-6216-421f-898a-750b010f45f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:52:59.786718 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba185a1c-6216-421f-898a-750b010f45f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:59.787195 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba185a1c-6216-421f-898a-750b010f45f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:59.787690 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba185a1c-6216-421f-898a-750b010f45f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:59.788382 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba185a1c-6216-421f-898a-750b010f45f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:52:59.788828 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba185a1c-6216-421f-898a-750b010f45f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:52:59.789757 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba185a1c-6216-421f-898a-750b010f45f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:52:59.814672 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:52:59.820174 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ba185a1c-6216-421f-898a-750b010f45f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046001 Oct 11 06:52:59.820718 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 710/1462] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:52:59 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:00.785080 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0a41f298-08ae-458e-a211-1cdb3e7025e8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:00.785663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0a41f298-08ae-458e-a211-1cdb3e7025e8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:00.787944 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=52 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:53:00.793483 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0a41f298-08ae-458e-a211-1cdb3e7025e8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:00.793948 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0a41f298-08ae-458e-a211-1cdb3e7025e8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:00.794378 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0a41f298-08ae-458e-a211-1cdb3e7025e8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:00.795054 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0a41f298-08ae-458e-a211-1cdb3e7025e8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:00.795527 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0a41f298-08ae-458e-a211-1cdb3e7025e8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:00.795943 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0a41f298-08ae-458e-a211-1cdb3e7025e8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:00.832685 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d19ad9fd-bdba-43d5-83bf-0301134fdff4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:00.835048 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d19ad9fd-bdba-43d5-83bf-0301134fdff4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:00.842157 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d19ad9fd-bdba-43d5-83bf-0301134fdff4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:00.842721 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d19ad9fd-bdba-43d5-83bf-0301134fdff4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:00.843256 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d19ad9fd-bdba-43d5-83bf-0301134fdff4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:00.844095 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d19ad9fd-bdba-43d5-83bf-0301134fdff4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:00.844615 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d19ad9fd-bdba-43d5-83bf-0301134fdff4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:00.845115 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d19ad9fd-bdba-43d5-83bf-0301134fdff4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:00.874564 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d19ad9fd-bdba-43d5-83bf-0301134fdff4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046073 Oct 11 06:53:00.875125 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 711/1463] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:00 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:53:00.924922 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0a41f298-08ae-458e-a211-1cdb3e7025e8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:00.936733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0a41f298-08ae-458e-a211-1cdb3e7025e8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.155575 Oct 11 06:53:00.937290 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 753/1464] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:00 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:01.886572 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0b5f7252-293b-466a-86fa-1124e35a46bc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:01.888991 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0b5f7252-293b-466a-86fa-1124e35a46bc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:01.895340 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b5f7252-293b-466a-86fa-1124e35a46bc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:01.895853 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b5f7252-293b-466a-86fa-1124e35a46bc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:01.896286 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b5f7252-293b-466a-86fa-1124e35a46bc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:01.896978 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b5f7252-293b-466a-86fa-1124e35a46bc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:01.897428 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b5f7252-293b-466a-86fa-1124e35a46bc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:01.897846 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b5f7252-293b-466a-86fa-1124e35a46bc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:01.926760 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0b5f7252-293b-466a-86fa-1124e35a46bc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044141 Oct 11 06:53:01.927288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 712/1465] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:01 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:01.960597 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d3c47fce-c81b-4ffd-9ee8-a049ca2bb630 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:01.961733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d3c47fce-c81b-4ffd-9ee8-a049ca2bb630 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:01.968031 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d3c47fce-c81b-4ffd-9ee8-a049ca2bb630 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:01.968497 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d3c47fce-c81b-4ffd-9ee8-a049ca2bb630 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:01.968930 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d3c47fce-c81b-4ffd-9ee8-a049ca2bb630 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:01.969608 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d3c47fce-c81b-4ffd-9ee8-a049ca2bb630 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:01.970048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d3c47fce-c81b-4ffd-9ee8-a049ca2bb630 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:01.970462 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d3c47fce-c81b-4ffd-9ee8-a049ca2bb630 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:02.095201 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d3c47fce-c81b-4ffd-9ee8-a049ca2bb630 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:02.103298 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d3c47fce-c81b-4ffd-9ee8-a049ca2bb630 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.146483 Oct 11 06:53:02.103881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 754/1466] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:01 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:02.939508 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-48c9d47e-6813-4056-9c7a-5fa24f8f57a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:02.941631 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-48c9d47e-6813-4056-9c7a-5fa24f8f57a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:02.948109 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-48c9d47e-6813-4056-9c7a-5fa24f8f57a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:02.948585 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-48c9d47e-6813-4056-9c7a-5fa24f8f57a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:02.949008 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-48c9d47e-6813-4056-9c7a-5fa24f8f57a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:02.949691 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-48c9d47e-6813-4056-9c7a-5fa24f8f57a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:02.950137 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-48c9d47e-6813-4056-9c7a-5fa24f8f57a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:02.950553 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-48c9d47e-6813-4056-9c7a-5fa24f8f57a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:02.979138 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-48c9d47e-6813-4056-9c7a-5fa24f8f57a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044297 Oct 11 06:53:02.979713 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 713/1467] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:02 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:03.125920 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-385c0a6e-2ec3-45af-816e-f75f50b34795 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:03.126583 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-385c0a6e-2ec3-45af-816e-f75f50b34795 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:03.133388 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-385c0a6e-2ec3-45af-816e-f75f50b34795 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:03.133853 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-385c0a6e-2ec3-45af-816e-f75f50b34795 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:03.134276 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-385c0a6e-2ec3-45af-816e-f75f50b34795 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:03.134949 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-385c0a6e-2ec3-45af-816e-f75f50b34795 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:03.135389 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-385c0a6e-2ec3-45af-816e-f75f50b34795 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:03.135835 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-385c0a6e-2ec3-45af-816e-f75f50b34795 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:03.262244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-385c0a6e-2ec3-45af-816e-f75f50b34795 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:03.270664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-385c0a6e-2ec3-45af-816e-f75f50b34795 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.148500 Oct 11 06:53:03.271224 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 755/1468] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:03 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:03.991439 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-316ffb33-d6ef-4ac3-bf9d-c28b2713958d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:03.993542 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-316ffb33-d6ef-4ac3-bf9d-c28b2713958d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:03.999871 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-316ffb33-d6ef-4ac3-bf9d-c28b2713958d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:04.000350 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-316ffb33-d6ef-4ac3-bf9d-c28b2713958d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:04.000783 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-316ffb33-d6ef-4ac3-bf9d-c28b2713958d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:04.001470 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-316ffb33-d6ef-4ac3-bf9d-c28b2713958d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:04.001924 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-316ffb33-d6ef-4ac3-bf9d-c28b2713958d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:04.002334 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-316ffb33-d6ef-4ac3-bf9d-c28b2713958d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:04.031970 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-316ffb33-d6ef-4ac3-bf9d-c28b2713958d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044599 Oct 11 06:53:04.032518 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 714/1469] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:03 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:04.294079 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-59121c60-2cfa-4bda-b245-a5bbb24ff0a4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:04.294633 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-59121c60-2cfa-4bda-b245-a5bbb24ff0a4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:04.300953 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-59121c60-2cfa-4bda-b245-a5bbb24ff0a4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:04.301429 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-59121c60-2cfa-4bda-b245-a5bbb24ff0a4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:04.301859 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-59121c60-2cfa-4bda-b245-a5bbb24ff0a4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:04.302547 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-59121c60-2cfa-4bda-b245-a5bbb24ff0a4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:04.302993 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-59121c60-2cfa-4bda-b245-a5bbb24ff0a4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:04.303420 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-59121c60-2cfa-4bda-b245-a5bbb24ff0a4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:04.433532 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-59121c60-2cfa-4bda-b245-a5bbb24ff0a4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:04.441616 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-59121c60-2cfa-4bda-b245-a5bbb24ff0a4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.151417 Oct 11 06:53:04.442172 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 756/1470] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:04 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:05.045174 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-93764436-b724-4365-ab8e-84c7d4cd414c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:05.047240 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-93764436-b724-4365-ab8e-84c7d4cd414c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:05.053672 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93764436-b724-4365-ab8e-84c7d4cd414c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:05.054157 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93764436-b724-4365-ab8e-84c7d4cd414c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:05.055185 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93764436-b724-4365-ab8e-84c7d4cd414c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:05.055986 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93764436-b724-4365-ab8e-84c7d4cd414c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:05.056441 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93764436-b724-4365-ab8e-84c7d4cd414c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:05.056871 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93764436-b724-4365-ab8e-84c7d4cd414c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:05.085430 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-93764436-b724-4365-ab8e-84c7d4cd414c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044300 Oct 11 06:53:05.085983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 715/1471] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:05 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:05.465703 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ee1e982b-d687-48e0-8f8e-8cd4d36d5a25 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:05.466305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ee1e982b-d687-48e0-8f8e-8cd4d36d5a25 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:05.472625 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ee1e982b-d687-48e0-8f8e-8cd4d36d5a25 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:05.473097 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ee1e982b-d687-48e0-8f8e-8cd4d36d5a25 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:05.473520 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ee1e982b-d687-48e0-8f8e-8cd4d36d5a25 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:05.474197 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ee1e982b-d687-48e0-8f8e-8cd4d36d5a25 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:05.474635 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ee1e982b-d687-48e0-8f8e-8cd4d36d5a25 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:05.475045 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ee1e982b-d687-48e0-8f8e-8cd4d36d5a25 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:05.601087 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ee1e982b-d687-48e0-8f8e-8cd4d36d5a25 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:05.609840 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ee1e982b-d687-48e0-8f8e-8cd4d36d5a25 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147921 Oct 11 06:53:05.610404 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 757/1472] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:05 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:06.098735 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f55f9195-9fe4-4df7-898d-a087b028bfe0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:06.100917 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f55f9195-9fe4-4df7-898d-a087b028bfe0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:06.107368 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f55f9195-9fe4-4df7-898d-a087b028bfe0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:06.107871 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f55f9195-9fe4-4df7-898d-a087b028bfe0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:06.108298 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f55f9195-9fe4-4df7-898d-a087b028bfe0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:06.108980 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f55f9195-9fe4-4df7-898d-a087b028bfe0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:06.109428 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f55f9195-9fe4-4df7-898d-a087b028bfe0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:06.109844 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f55f9195-9fe4-4df7-898d-a087b028bfe0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:06.139141 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f55f9195-9fe4-4df7-898d-a087b028bfe0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044555 Oct 11 06:53:06.139704 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 716/1473] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:06 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:06.633008 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-49ba8cf6-4168-4ff3-a573-de8fc046f2e5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:06.633608 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-49ba8cf6-4168-4ff3-a573-de8fc046f2e5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:06.640202 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49ba8cf6-4168-4ff3-a573-de8fc046f2e5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:06.640675 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49ba8cf6-4168-4ff3-a573-de8fc046f2e5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:06.641097 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49ba8cf6-4168-4ff3-a573-de8fc046f2e5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:06.641774 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49ba8cf6-4168-4ff3-a573-de8fc046f2e5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:06.642213 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49ba8cf6-4168-4ff3-a573-de8fc046f2e5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:06.642625 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49ba8cf6-4168-4ff3-a573-de8fc046f2e5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:06.772178 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-49ba8cf6-4168-4ff3-a573-de8fc046f2e5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:06.780174 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-49ba8cf6-4168-4ff3-a573-de8fc046f2e5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150987 Oct 11 06:53:06.780721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 758/1474] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:06 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:07.152019 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-07a0cc33-22f5-49f3-bd55-ebc0bd4f73f5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:07.154320 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-07a0cc33-22f5-49f3-bd55-ebc0bd4f73f5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:07.160755 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-07a0cc33-22f5-49f3-bd55-ebc0bd4f73f5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:07.161236 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-07a0cc33-22f5-49f3-bd55-ebc0bd4f73f5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:07.161661 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-07a0cc33-22f5-49f3-bd55-ebc0bd4f73f5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:07.162344 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-07a0cc33-22f5-49f3-bd55-ebc0bd4f73f5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:07.162817 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-07a0cc33-22f5-49f3-bd55-ebc0bd4f73f5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:07.163233 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-07a0cc33-22f5-49f3-bd55-ebc0bd4f73f5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:07.192704 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-07a0cc33-22f5-49f3-bd55-ebc0bd4f73f5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045290 Oct 11 06:53:07.193239 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 717/1475] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:07 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:07.804880 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-233a2e94-92ed-49a4-b49f-20575e63c0ac tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:07.805407 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-233a2e94-92ed-49a4-b49f-20575e63c0ac tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:07.811990 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-233a2e94-92ed-49a4-b49f-20575e63c0ac tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:07.812466 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-233a2e94-92ed-49a4-b49f-20575e63c0ac tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:07.812897 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-233a2e94-92ed-49a4-b49f-20575e63c0ac tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:07.813584 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-233a2e94-92ed-49a4-b49f-20575e63c0ac tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:07.814032 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-233a2e94-92ed-49a4-b49f-20575e63c0ac tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:07.814482 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-233a2e94-92ed-49a4-b49f-20575e63c0ac tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:07.941527 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-233a2e94-92ed-49a4-b49f-20575e63c0ac tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:07.950153 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-233a2e94-92ed-49a4-b49f-20575e63c0ac tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149638 Oct 11 06:53:07.950712 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 759/1476] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:07 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:08.205108 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3dce22d4-d2a8-49bc-b0d3-5b92ceabc9dd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:08.207235 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3dce22d4-d2a8-49bc-b0d3-5b92ceabc9dd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:08.213876 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3dce22d4-d2a8-49bc-b0d3-5b92ceabc9dd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:08.214364 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3dce22d4-d2a8-49bc-b0d3-5b92ceabc9dd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:08.214801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3dce22d4-d2a8-49bc-b0d3-5b92ceabc9dd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:08.215529 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3dce22d4-d2a8-49bc-b0d3-5b92ceabc9dd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:08.215985 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3dce22d4-d2a8-49bc-b0d3-5b92ceabc9dd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:08.216409 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3dce22d4-d2a8-49bc-b0d3-5b92ceabc9dd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:08.246362 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3dce22d4-d2a8-49bc-b0d3-5b92ceabc9dd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045218 Oct 11 06:53:08.246901 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 718/1477] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:08 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:08.974096 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-dfd67f3f-05b3-4619-a367-1fdc33e5661e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:08.974708 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-dfd67f3f-05b3-4619-a367-1fdc33e5661e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:08.981216 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dfd67f3f-05b3-4619-a367-1fdc33e5661e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:08.981688 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dfd67f3f-05b3-4619-a367-1fdc33e5661e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:08.982115 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dfd67f3f-05b3-4619-a367-1fdc33e5661e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:08.982800 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dfd67f3f-05b3-4619-a367-1fdc33e5661e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:08.983249 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dfd67f3f-05b3-4619-a367-1fdc33e5661e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:08.983723 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dfd67f3f-05b3-4619-a367-1fdc33e5661e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:09.112872 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-dfd67f3f-05b3-4619-a367-1fdc33e5661e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:09.122561 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-dfd67f3f-05b3-4619-a367-1fdc33e5661e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.152422 Oct 11 06:53:09.123127 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 760/1478] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:08 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:09.258776 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b7c62210-4a0e-45df-926f-19bee0896033 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:09.260930 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b7c62210-4a0e-45df-926f-19bee0896033 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:09.267528 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b7c62210-4a0e-45df-926f-19bee0896033 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:09.268004 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b7c62210-4a0e-45df-926f-19bee0896033 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:09.268433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b7c62210-4a0e-45df-926f-19bee0896033 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:09.269135 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b7c62210-4a0e-45df-926f-19bee0896033 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:09.269579 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b7c62210-4a0e-45df-926f-19bee0896033 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:09.269993 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b7c62210-4a0e-45df-926f-19bee0896033 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:09.297911 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b7c62210-4a0e-45df-926f-19bee0896033 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043669 Oct 11 06:53:09.298445 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 719/1479] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:09 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:10.146374 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-528b523d-6416-498a-95ce-d16353f90b6a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:10.146972 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-528b523d-6416-498a-95ce-d16353f90b6a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:10.153821 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-528b523d-6416-498a-95ce-d16353f90b6a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:10.154293 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-528b523d-6416-498a-95ce-d16353f90b6a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:10.154721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-528b523d-6416-498a-95ce-d16353f90b6a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:10.155404 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-528b523d-6416-498a-95ce-d16353f90b6a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:10.155870 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-528b523d-6416-498a-95ce-d16353f90b6a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:10.156290 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-528b523d-6416-498a-95ce-d16353f90b6a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:10.281436 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-528b523d-6416-498a-95ce-d16353f90b6a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:10.289496 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-528b523d-6416-498a-95ce-d16353f90b6a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.146898 Oct 11 06:53:10.290047 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 761/1480] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:10 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:10.310160 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7268f660-4f1e-417f-b770-1776b3d0a452 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:10.312380 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7268f660-4f1e-417f-b770-1776b3d0a452 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:10.318630 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7268f660-4f1e-417f-b770-1776b3d0a452 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:10.319106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7268f660-4f1e-417f-b770-1776b3d0a452 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:10.320093 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7268f660-4f1e-417f-b770-1776b3d0a452 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:10.320803 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7268f660-4f1e-417f-b770-1776b3d0a452 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:10.321235 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7268f660-4f1e-417f-b770-1776b3d0a452 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:10.321652 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7268f660-4f1e-417f-b770-1776b3d0a452 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:10.350482 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7268f660-4f1e-417f-b770-1776b3d0a452 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044313 Oct 11 06:53:10.351009 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 720/1481] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:10 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:11.311834 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-934c9f7e-5bbb-4435-966b-b11042f33303 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:11.312405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-934c9f7e-5bbb-4435-966b-b11042f33303 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:11.318822 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-934c9f7e-5bbb-4435-966b-b11042f33303 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:11.319291 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-934c9f7e-5bbb-4435-966b-b11042f33303 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:11.319748 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-934c9f7e-5bbb-4435-966b-b11042f33303 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:11.320434 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-934c9f7e-5bbb-4435-966b-b11042f33303 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:11.320879 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-934c9f7e-5bbb-4435-966b-b11042f33303 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:11.321298 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-934c9f7e-5bbb-4435-966b-b11042f33303 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:11.362802 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-093319d8-fa4e-45a4-8bb8-832d5a8f273e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:11.365019 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-093319d8-fa4e-45a4-8bb8-832d5a8f273e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:11.371438 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-093319d8-fa4e-45a4-8bb8-832d5a8f273e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:11.371952 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-093319d8-fa4e-45a4-8bb8-832d5a8f273e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:11.372387 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-093319d8-fa4e-45a4-8bb8-832d5a8f273e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:11.373091 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-093319d8-fa4e-45a4-8bb8-832d5a8f273e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:11.373544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-093319d8-fa4e-45a4-8bb8-832d5a8f273e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:11.373968 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-093319d8-fa4e-45a4-8bb8-832d5a8f273e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:11.404445 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-093319d8-fa4e-45a4-8bb8-832d5a8f273e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045683 Oct 11 06:53:11.405191 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 721/1482] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:11 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:53:11.447256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-934c9f7e-5bbb-4435-966b-b11042f33303 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:11.455396 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-934c9f7e-5bbb-4435-966b-b11042f33303 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147421 Oct 11 06:53:11.455964 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 762/1483] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:11 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:12.416920 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-49067f6e-0e6f-49d3-b7ca-255d9dc32cc7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:12.419092 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-49067f6e-0e6f-49d3-b7ca-255d9dc32cc7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:12.425539 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-49067f6e-0e6f-49d3-b7ca-255d9dc32cc7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:12.426018 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-49067f6e-0e6f-49d3-b7ca-255d9dc32cc7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:12.426454 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-49067f6e-0e6f-49d3-b7ca-255d9dc32cc7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:12.427145 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-49067f6e-0e6f-49d3-b7ca-255d9dc32cc7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:12.427654 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-49067f6e-0e6f-49d3-b7ca-255d9dc32cc7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:12.428078 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-49067f6e-0e6f-49d3-b7ca-255d9dc32cc7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:12.457543 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-49067f6e-0e6f-49d3-b7ca-255d9dc32cc7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044706 Oct 11 06:53:12.458085 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 722/1484] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:12 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:12.478328 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c10b4a47-fbb4-4f3b-96bd-56a55b08d29b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:12.478937 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c10b4a47-fbb4-4f3b-96bd-56a55b08d29b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:12.485276 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c10b4a47-fbb4-4f3b-96bd-56a55b08d29b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:12.485748 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c10b4a47-fbb4-4f3b-96bd-56a55b08d29b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:12.486177 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c10b4a47-fbb4-4f3b-96bd-56a55b08d29b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:12.486863 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c10b4a47-fbb4-4f3b-96bd-56a55b08d29b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:12.487305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c10b4a47-fbb4-4f3b-96bd-56a55b08d29b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:12.487746 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c10b4a47-fbb4-4f3b-96bd-56a55b08d29b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:12.615444 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c10b4a47-fbb4-4f3b-96bd-56a55b08d29b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:12.624127 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c10b4a47-fbb4-4f3b-96bd-56a55b08d29b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150101 Oct 11 06:53:12.624683 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 763/1485] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:12 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:13.470002 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2b23c05b-78e0-4370-a6ec-c15c684ebf15 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:13.472114 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2b23c05b-78e0-4370-a6ec-c15c684ebf15 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:13.474414 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=58 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:53:13.479646 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2b23c05b-78e0-4370-a6ec-c15c684ebf15 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:13.480131 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2b23c05b-78e0-4370-a6ec-c15c684ebf15 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:13.480572 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2b23c05b-78e0-4370-a6ec-c15c684ebf15 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:13.481271 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2b23c05b-78e0-4370-a6ec-c15c684ebf15 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:13.481723 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2b23c05b-78e0-4370-a6ec-c15c684ebf15 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:13.482156 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2b23c05b-78e0-4370-a6ec-c15c684ebf15 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:13.511201 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2b23c05b-78e0-4370-a6ec-c15c684ebf15 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045209 Oct 11 06:53:13.511761 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 723/1486] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:13 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:13.647242 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-74a89680-11bb-424e-8bba-d4679f7c7c7e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:13.647871 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-74a89680-11bb-424e-8bba-d4679f7c7c7e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:13.654327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-74a89680-11bb-424e-8bba-d4679f7c7c7e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:13.654801 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-74a89680-11bb-424e-8bba-d4679f7c7c7e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:13.655537 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-74a89680-11bb-424e-8bba-d4679f7c7c7e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:13.655940 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-74a89680-11bb-424e-8bba-d4679f7c7c7e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:13.656379 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-74a89680-11bb-424e-8bba-d4679f7c7c7e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:13.656799 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-74a89680-11bb-424e-8bba-d4679f7c7c7e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:13.783284 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-74a89680-11bb-424e-8bba-d4679f7c7c7e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:13.792329 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-74a89680-11bb-424e-8bba-d4679f7c7c7e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.148979 Oct 11 06:53:13.792890 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 764/1487] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:13 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:14.524505 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1ed6ceeb-a567-467f-954f-c8f79c191934 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:14.526585 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1ed6ceeb-a567-467f-954f-c8f79c191934 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:14.532959 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1ed6ceeb-a567-467f-954f-c8f79c191934 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:14.533443 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1ed6ceeb-a567-467f-954f-c8f79c191934 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:14.533877 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1ed6ceeb-a567-467f-954f-c8f79c191934 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:14.534569 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1ed6ceeb-a567-467f-954f-c8f79c191934 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:14.535023 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1ed6ceeb-a567-467f-954f-c8f79c191934 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:14.535464 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1ed6ceeb-a567-467f-954f-c8f79c191934 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:14.564415 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1ed6ceeb-a567-467f-954f-c8f79c191934 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044388 Oct 11 06:53:14.564957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 724/1488] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:14 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:14.815889 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2574632a-d5ad-4bad-a32d-d877a2fd4841 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:14.816419 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2574632a-d5ad-4bad-a32d-d877a2fd4841 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:14.823312 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2574632a-d5ad-4bad-a32d-d877a2fd4841 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:14.823815 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2574632a-d5ad-4bad-a32d-d877a2fd4841 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:14.824245 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2574632a-d5ad-4bad-a32d-d877a2fd4841 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:14.824930 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2574632a-d5ad-4bad-a32d-d877a2fd4841 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:14.825375 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2574632a-d5ad-4bad-a32d-d877a2fd4841 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:14.825795 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2574632a-d5ad-4bad-a32d-d877a2fd4841 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:14.957066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2574632a-d5ad-4bad-a32d-d877a2fd4841 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:14.966177 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2574632a-d5ad-4bad-a32d-d877a2fd4841 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.154206 Oct 11 06:53:14.966741 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 765/1489] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:14 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:15.576471 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6d9bb3a2-0613-4079-8099-46f4ec5ce1da tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:15.578584 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6d9bb3a2-0613-4079-8099-46f4ec5ce1da tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:15.585093 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6d9bb3a2-0613-4079-8099-46f4ec5ce1da tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:15.585608 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6d9bb3a2-0613-4079-8099-46f4ec5ce1da tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:15.586039 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6d9bb3a2-0613-4079-8099-46f4ec5ce1da tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:15.586728 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6d9bb3a2-0613-4079-8099-46f4ec5ce1da tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:15.587172 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6d9bb3a2-0613-4079-8099-46f4ec5ce1da tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:15.587619 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6d9bb3a2-0613-4079-8099-46f4ec5ce1da tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:15.617489 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6d9bb3a2-0613-4079-8099-46f4ec5ce1da tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044877 Oct 11 06:53:15.618032 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 725/1490] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:15 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:15.989368 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-766b2f42-7e87-4aa1-93bb-c5fbdf999047 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:15.989957 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-766b2f42-7e87-4aa1-93bb-c5fbdf999047 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:15.996282 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-766b2f42-7e87-4aa1-93bb-c5fbdf999047 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:15.996754 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-766b2f42-7e87-4aa1-93bb-c5fbdf999047 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:15.997181 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-766b2f42-7e87-4aa1-93bb-c5fbdf999047 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:15.997856 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-766b2f42-7e87-4aa1-93bb-c5fbdf999047 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:15.998292 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-766b2f42-7e87-4aa1-93bb-c5fbdf999047 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:15.998705 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-766b2f42-7e87-4aa1-93bb-c5fbdf999047 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:16.124570 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-766b2f42-7e87-4aa1-93bb-c5fbdf999047 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:16.132677 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-766b2f42-7e87-4aa1-93bb-c5fbdf999047 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147098 Oct 11 06:53:16.133232 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 766/1491] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:15 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:16.629605 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-204a54cb-aa92-4815-81f7-9a614a86facb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:16.632503 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-204a54cb-aa92-4815-81f7-9a614a86facb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:16.638964 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-204a54cb-aa92-4815-81f7-9a614a86facb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:16.639549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-204a54cb-aa92-4815-81f7-9a614a86facb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:16.639995 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-204a54cb-aa92-4815-81f7-9a614a86facb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:16.640693 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-204a54cb-aa92-4815-81f7-9a614a86facb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:16.641148 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-204a54cb-aa92-4815-81f7-9a614a86facb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:16.641572 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-204a54cb-aa92-4815-81f7-9a614a86facb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:16.672468 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-204a54cb-aa92-4815-81f7-9a614a86facb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046671 Oct 11 06:53:16.673027 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 726/1492] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:16 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:17.156468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a09a6134-2b70-4dbb-9fb4-ea228bb5948d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:17.157071 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a09a6134-2b70-4dbb-9fb4-ea228bb5948d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:17.164045 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a09a6134-2b70-4dbb-9fb4-ea228bb5948d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:17.164520 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a09a6134-2b70-4dbb-9fb4-ea228bb5948d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:17.164950 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a09a6134-2b70-4dbb-9fb4-ea228bb5948d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:17.165641 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a09a6134-2b70-4dbb-9fb4-ea228bb5948d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:17.166084 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a09a6134-2b70-4dbb-9fb4-ea228bb5948d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:17.166501 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a09a6134-2b70-4dbb-9fb4-ea228bb5948d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:17.292965 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a09a6134-2b70-4dbb-9fb4-ea228bb5948d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:17.301119 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a09a6134-2b70-4dbb-9fb4-ea228bb5948d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.148463 Oct 11 06:53:17.301668 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 767/1493] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:17 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:17.685177 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c297c34c-32c3-4e95-86c1-846d8b54a9e9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:17.687305 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c297c34c-32c3-4e95-86c1-846d8b54a9e9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:17.693393 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c297c34c-32c3-4e95-86c1-846d8b54a9e9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:17.693867 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c297c34c-32c3-4e95-86c1-846d8b54a9e9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:17.694297 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c297c34c-32c3-4e95-86c1-846d8b54a9e9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:17.694984 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c297c34c-32c3-4e95-86c1-846d8b54a9e9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:17.695450 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c297c34c-32c3-4e95-86c1-846d8b54a9e9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:17.695877 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c297c34c-32c3-4e95-86c1-846d8b54a9e9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:17.712420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:53:17.726091 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c297c34c-32c3-4e95-86c1-846d8b54a9e9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044288 Oct 11 06:53:17.726636 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 727/1494] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:17 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:18.325347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a5d3a764-fa22-490c-939c-fafeec6ef2a0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:18.325880 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a5d3a764-fa22-490c-939c-fafeec6ef2a0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:18.332324 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a5d3a764-fa22-490c-939c-fafeec6ef2a0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:18.332818 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a5d3a764-fa22-490c-939c-fafeec6ef2a0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:18.333240 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a5d3a764-fa22-490c-939c-fafeec6ef2a0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:18.333977 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a5d3a764-fa22-490c-939c-fafeec6ef2a0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:18.334420 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a5d3a764-fa22-490c-939c-fafeec6ef2a0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:18.334837 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a5d3a764-fa22-490c-939c-fafeec6ef2a0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:18.338768 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:53:18.462834 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a5d3a764-fa22-490c-939c-fafeec6ef2a0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:18.470824 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a5d3a764-fa22-490c-939c-fafeec6ef2a0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149421 Oct 11 06:53:18.471376 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 768/1495] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:18 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:18.738065 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-80c8656b-05fa-499f-8b49-2cae5b62b234 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:18.740210 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-80c8656b-05fa-499f-8b49-2cae5b62b234 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:18.747157 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-80c8656b-05fa-499f-8b49-2cae5b62b234 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:18.747671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-80c8656b-05fa-499f-8b49-2cae5b62b234 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:18.748101 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-80c8656b-05fa-499f-8b49-2cae5b62b234 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:18.748784 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-80c8656b-05fa-499f-8b49-2cae5b62b234 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:18.749225 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-80c8656b-05fa-499f-8b49-2cae5b62b234 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:18.749639 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-80c8656b-05fa-499f-8b49-2cae5b62b234 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:18.778141 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-80c8656b-05fa-499f-8b49-2cae5b62b234 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044041 Oct 11 06:53:18.778663 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 728/1496] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:18 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:19.494062 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-feb33e0b-b0ae-420c-832a-cd40c1dcfbef tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:19.494659 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-feb33e0b-b0ae-420c-832a-cd40c1dcfbef tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:19.500982 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-feb33e0b-b0ae-420c-832a-cd40c1dcfbef tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:19.501449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-feb33e0b-b0ae-420c-832a-cd40c1dcfbef tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:19.501878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-feb33e0b-b0ae-420c-832a-cd40c1dcfbef tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:19.502555 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-feb33e0b-b0ae-420c-832a-cd40c1dcfbef tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:19.502995 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-feb33e0b-b0ae-420c-832a-cd40c1dcfbef tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:19.503407 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-feb33e0b-b0ae-420c-832a-cd40c1dcfbef tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:19.631176 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-feb33e0b-b0ae-420c-832a-cd40c1dcfbef tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:19.640271 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-feb33e0b-b0ae-420c-832a-cd40c1dcfbef tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149996 Oct 11 06:53:19.640822 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 769/1497] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:19 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:19.790223 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-eb703fad-a2b6-461b-af9b-cec41b5a1405 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:19.792308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-eb703fad-a2b6-461b-af9b-cec41b5a1405 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:19.798647 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eb703fad-a2b6-461b-af9b-cec41b5a1405 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:19.799142 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eb703fad-a2b6-461b-af9b-cec41b5a1405 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:19.799607 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eb703fad-a2b6-461b-af9b-cec41b5a1405 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:19.800288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eb703fad-a2b6-461b-af9b-cec41b5a1405 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:19.800731 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eb703fad-a2b6-461b-af9b-cec41b5a1405 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:19.801142 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eb703fad-a2b6-461b-af9b-cec41b5a1405 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:19.830206 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-eb703fad-a2b6-461b-af9b-cec41b5a1405 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044021 Oct 11 06:53:19.830735 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 729/1498] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:19 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:20.663689 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-19f033f6-2db2-45de-89bf-0452ec9cce1c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:20.664330 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-19f033f6-2db2-45de-89bf-0452ec9cce1c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:20.670466 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-19f033f6-2db2-45de-89bf-0452ec9cce1c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:20.670944 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-19f033f6-2db2-45de-89bf-0452ec9cce1c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:20.671373 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-19f033f6-2db2-45de-89bf-0452ec9cce1c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:20.672093 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-19f033f6-2db2-45de-89bf-0452ec9cce1c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:20.672540 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-19f033f6-2db2-45de-89bf-0452ec9cce1c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:20.672958 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-19f033f6-2db2-45de-89bf-0452ec9cce1c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:20.843070 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f4e166a2-8feb-48ee-956f-1eb247d04fb2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:20.845366 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f4e166a2-8feb-48ee-956f-1eb247d04fb2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:20.852116 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f4e166a2-8feb-48ee-956f-1eb247d04fb2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:20.852610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f4e166a2-8feb-48ee-956f-1eb247d04fb2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:20.853048 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f4e166a2-8feb-48ee-956f-1eb247d04fb2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:20.853762 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f4e166a2-8feb-48ee-956f-1eb247d04fb2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:20.854219 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f4e166a2-8feb-48ee-956f-1eb247d04fb2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:20.854641 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f4e166a2-8feb-48ee-956f-1eb247d04fb2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:20.886671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f4e166a2-8feb-48ee-956f-1eb247d04fb2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047402 Oct 11 06:53:20.887248 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 730/1499] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:20 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:21.048920 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-19f033f6-2db2-45de-89bf-0452ec9cce1c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:21.057017 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-19f033f6-2db2-45de-89bf-0452ec9cce1c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.397700 Oct 11 06:53:21.057577 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 770/1500] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:20 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:53:21.901865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-07d1d221-9960-4816-979a-198b6d473b05 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:21.903979 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-07d1d221-9960-4816-979a-198b6d473b05 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:21.911827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-07d1d221-9960-4816-979a-198b6d473b05 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:21.912308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-07d1d221-9960-4816-979a-198b6d473b05 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:21.912738 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-07d1d221-9960-4816-979a-198b6d473b05 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:21.914086 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-07d1d221-9960-4816-979a-198b6d473b05 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:21.914535 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-07d1d221-9960-4816-979a-198b6d473b05 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:21.914952 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-07d1d221-9960-4816-979a-198b6d473b05 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:21.943566 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-07d1d221-9960-4816-979a-198b6d473b05 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046123 Oct 11 06:53:21.944097 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 731/1501] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:21 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:22.080669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-75806c58-18b4-49f8-8d38-ea1ad4b4dae4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:22.081419 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-75806c58-18b4-49f8-8d38-ea1ad4b4dae4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:22.088391 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-75806c58-18b4-49f8-8d38-ea1ad4b4dae4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:22.088868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-75806c58-18b4-49f8-8d38-ea1ad4b4dae4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:22.089301 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-75806c58-18b4-49f8-8d38-ea1ad4b4dae4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:22.090021 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-75806c58-18b4-49f8-8d38-ea1ad4b4dae4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:22.090467 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-75806c58-18b4-49f8-8d38-ea1ad4b4dae4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:22.090889 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-75806c58-18b4-49f8-8d38-ea1ad4b4dae4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:22.217017 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-75806c58-18b4-49f8-8d38-ea1ad4b4dae4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:22.225069 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-75806c58-18b4-49f8-8d38-ea1ad4b4dae4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.148417 Oct 11 06:53:22.226268 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 771/1502] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:22 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:22.955872 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-26729600-5098-4cc1-a0e4-624eb1008210 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:22.958002 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-26729600-5098-4cc1-a0e4-624eb1008210 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:22.964342 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26729600-5098-4cc1-a0e4-624eb1008210 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:22.964814 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26729600-5098-4cc1-a0e4-624eb1008210 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:22.965241 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26729600-5098-4cc1-a0e4-624eb1008210 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:22.965919 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26729600-5098-4cc1-a0e4-624eb1008210 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:22.966360 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26729600-5098-4cc1-a0e4-624eb1008210 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:22.966772 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26729600-5098-4cc1-a0e4-624eb1008210 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:22.997314 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-26729600-5098-4cc1-a0e4-624eb1008210 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045194 Oct 11 06:53:22.998006 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 732/1503] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:22 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:23.248712 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7775af0c-1005-4e7f-8540-282fe983ce95 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:23.249248 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7775af0c-1005-4e7f-8540-282fe983ce95 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:23.255633 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7775af0c-1005-4e7f-8540-282fe983ce95 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:23.256175 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7775af0c-1005-4e7f-8540-282fe983ce95 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:23.256536 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7775af0c-1005-4e7f-8540-282fe983ce95 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:23.257220 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7775af0c-1005-4e7f-8540-282fe983ce95 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:23.257668 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7775af0c-1005-4e7f-8540-282fe983ce95 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:23.258087 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7775af0c-1005-4e7f-8540-282fe983ce95 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:23.385483 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7775af0c-1005-4e7f-8540-282fe983ce95 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:23.393890 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7775af0c-1005-4e7f-8540-282fe983ce95 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149127 Oct 11 06:53:23.394436 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 772/1504] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:23 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:24.010390 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f3682e9d-5eee-47e5-9d37-96f889dc7de6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:24.012855 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f3682e9d-5eee-47e5-9d37-96f889dc7de6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:24.020270 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3682e9d-5eee-47e5-9d37-96f889dc7de6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:24.020743 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3682e9d-5eee-47e5-9d37-96f889dc7de6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:24.021172 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3682e9d-5eee-47e5-9d37-96f889dc7de6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:24.021857 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3682e9d-5eee-47e5-9d37-96f889dc7de6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:24.022896 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3682e9d-5eee-47e5-9d37-96f889dc7de6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:24.023313 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3682e9d-5eee-47e5-9d37-96f889dc7de6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:24.052191 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f3682e9d-5eee-47e5-9d37-96f889dc7de6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046372 Oct 11 06:53:24.052736 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 733/1505] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:24 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:24.417893 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a4e64d49-3e36-4e90-8803-bf722b46228f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:24.418501 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a4e64d49-3e36-4e90-8803-bf722b46228f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:24.424955 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a4e64d49-3e36-4e90-8803-bf722b46228f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:24.425436 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a4e64d49-3e36-4e90-8803-bf722b46228f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:24.425869 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a4e64d49-3e36-4e90-8803-bf722b46228f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:24.426564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a4e64d49-3e36-4e90-8803-bf722b46228f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:24.427010 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a4e64d49-3e36-4e90-8803-bf722b46228f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:24.427453 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a4e64d49-3e36-4e90-8803-bf722b46228f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:24.551996 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a4e64d49-3e36-4e90-8803-bf722b46228f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:24.560195 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a4e64d49-3e36-4e90-8803-bf722b46228f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.146096 Oct 11 06:53:24.560754 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 773/1506] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:24 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:25.065106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5edda3f1-02c1-4b0d-b74a-1f545c89b926 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:25.067171 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5edda3f1-02c1-4b0d-b74a-1f545c89b926 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:25.073570 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5edda3f1-02c1-4b0d-b74a-1f545c89b926 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:25.074060 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5edda3f1-02c1-4b0d-b74a-1f545c89b926 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:25.074497 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5edda3f1-02c1-4b0d-b74a-1f545c89b926 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:25.075194 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5edda3f1-02c1-4b0d-b74a-1f545c89b926 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:25.075675 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5edda3f1-02c1-4b0d-b74a-1f545c89b926 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:25.076104 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5edda3f1-02c1-4b0d-b74a-1f545c89b926 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:25.105493 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5edda3f1-02c1-4b0d-b74a-1f545c89b926 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044384 Oct 11 06:53:25.106032 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 734/1507] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:25 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:25.583702 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-77460e27-7d51-4f11-b67d-ec94c203865a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:25.584307 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-77460e27-7d51-4f11-b67d-ec94c203865a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:25.591187 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77460e27-7d51-4f11-b67d-ec94c203865a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:25.591696 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77460e27-7d51-4f11-b67d-ec94c203865a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:25.592128 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77460e27-7d51-4f11-b67d-ec94c203865a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:25.592815 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77460e27-7d51-4f11-b67d-ec94c203865a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:25.593260 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77460e27-7d51-4f11-b67d-ec94c203865a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:25.593683 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77460e27-7d51-4f11-b67d-ec94c203865a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:25.720054 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-77460e27-7d51-4f11-b67d-ec94c203865a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:25.728111 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-77460e27-7d51-4f11-b67d-ec94c203865a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.148325 Oct 11 06:53:25.728670 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 774/1508] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:25 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:26.118250 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4d213c5f-c64a-48f2-b476-45009bf5f28a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:26.120422 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4d213c5f-c64a-48f2-b476-45009bf5f28a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:26.126706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4d213c5f-c64a-48f2-b476-45009bf5f28a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:26.127178 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4d213c5f-c64a-48f2-b476-45009bf5f28a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:26.127653 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4d213c5f-c64a-48f2-b476-45009bf5f28a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:26.128337 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4d213c5f-c64a-48f2-b476-45009bf5f28a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:26.128783 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4d213c5f-c64a-48f2-b476-45009bf5f28a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:26.129198 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4d213c5f-c64a-48f2-b476-45009bf5f28a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:26.157347 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4d213c5f-c64a-48f2-b476-45009bf5f28a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043683 Oct 11 06:53:26.157880 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 735/1509] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:26 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:26.752068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-09559f2b-f407-45bf-be09-bff75f05ec97 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:26.752602 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-09559f2b-f407-45bf-be09-bff75f05ec97 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:26.759255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-09559f2b-f407-45bf-be09-bff75f05ec97 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:26.759762 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-09559f2b-f407-45bf-be09-bff75f05ec97 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:26.760197 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-09559f2b-f407-45bf-be09-bff75f05ec97 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:26.760891 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-09559f2b-f407-45bf-be09-bff75f05ec97 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:26.761338 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-09559f2b-f407-45bf-be09-bff75f05ec97 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:26.761760 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-09559f2b-f407-45bf-be09-bff75f05ec97 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:26.887029 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-09559f2b-f407-45bf-be09-bff75f05ec97 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:26.895359 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-09559f2b-f407-45bf-be09-bff75f05ec97 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147343 Oct 11 06:53:26.895944 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 775/1510] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:26 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:27.170021 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cadf5beb-8246-4b8a-a56b-f7829f6d9ac7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:27.172181 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cadf5beb-8246-4b8a-a56b-f7829f6d9ac7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:27.178705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cadf5beb-8246-4b8a-a56b-f7829f6d9ac7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:27.179186 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cadf5beb-8246-4b8a-a56b-f7829f6d9ac7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:27.179655 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cadf5beb-8246-4b8a-a56b-f7829f6d9ac7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:27.180351 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cadf5beb-8246-4b8a-a56b-f7829f6d9ac7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:27.180803 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cadf5beb-8246-4b8a-a56b-f7829f6d9ac7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:27.181221 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cadf5beb-8246-4b8a-a56b-f7829f6d9ac7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:27.210224 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cadf5beb-8246-4b8a-a56b-f7829f6d9ac7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043622 Oct 11 06:53:27.210763 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 736/1511] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:27 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:27.918703 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-74bbf195-7ab4-431a-ad88-1c8ecdf4bfeb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:27.919311 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-74bbf195-7ab4-431a-ad88-1c8ecdf4bfeb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:27.925669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-74bbf195-7ab4-431a-ad88-1c8ecdf4bfeb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:27.926149 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-74bbf195-7ab4-431a-ad88-1c8ecdf4bfeb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:27.926594 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-74bbf195-7ab4-431a-ad88-1c8ecdf4bfeb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:27.927271 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-74bbf195-7ab4-431a-ad88-1c8ecdf4bfeb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:27.927746 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-74bbf195-7ab4-431a-ad88-1c8ecdf4bfeb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:27.928170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-74bbf195-7ab4-431a-ad88-1c8ecdf4bfeb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:28.057527 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-74bbf195-7ab4-431a-ad88-1c8ecdf4bfeb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:28.065801 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-74bbf195-7ab4-431a-ad88-1c8ecdf4bfeb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150937 Oct 11 06:53:28.066499 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 776/1512] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:27 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:28.222135 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d46ddbba-d8f8-4374-84a5-4be85d11d758 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:28.224229 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d46ddbba-d8f8-4374-84a5-4be85d11d758 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:28.231111 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d46ddbba-d8f8-4374-84a5-4be85d11d758 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:28.231631 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d46ddbba-d8f8-4374-84a5-4be85d11d758 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:28.232065 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d46ddbba-d8f8-4374-84a5-4be85d11d758 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:28.232753 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d46ddbba-d8f8-4374-84a5-4be85d11d758 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:28.233203 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d46ddbba-d8f8-4374-84a5-4be85d11d758 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:28.233620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d46ddbba-d8f8-4374-84a5-4be85d11d758 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:28.262232 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d46ddbba-d8f8-4374-84a5-4be85d11d758 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044068 Oct 11 06:53:28.263023 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 737/1513] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:28 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:29.088430 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7ad91193-623a-43fc-9f4d-79c7d9459a13 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:29.089164 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7ad91193-623a-43fc-9f4d-79c7d9459a13 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:29.095679 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7ad91193-623a-43fc-9f4d-79c7d9459a13 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:29.096161 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7ad91193-623a-43fc-9f4d-79c7d9459a13 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:29.096597 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7ad91193-623a-43fc-9f4d-79c7d9459a13 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:29.097294 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7ad91193-623a-43fc-9f4d-79c7d9459a13 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:29.097743 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7ad91193-623a-43fc-9f4d-79c7d9459a13 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:29.098165 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7ad91193-623a-43fc-9f4d-79c7d9459a13 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:29.228630 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7ad91193-623a-43fc-9f4d-79c7d9459a13 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:29.236735 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7ad91193-623a-43fc-9f4d-79c7d9459a13 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.152100 Oct 11 06:53:29.237292 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 777/1514] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:29 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:29.274629 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e9737862-02fc-4325-876a-ccb36d51fca1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:29.276863 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e9737862-02fc-4325-876a-ccb36d51fca1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:29.284483 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e9737862-02fc-4325-876a-ccb36d51fca1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:29.284905 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e9737862-02fc-4325-876a-ccb36d51fca1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:29.285348 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e9737862-02fc-4325-876a-ccb36d51fca1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:29.286037 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e9737862-02fc-4325-876a-ccb36d51fca1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:29.286488 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e9737862-02fc-4325-876a-ccb36d51fca1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:29.286906 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e9737862-02fc-4325-876a-ccb36d51fca1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:29.316764 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e9737862-02fc-4325-876a-ccb36d51fca1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046083 Oct 11 06:53:29.317329 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 738/1515] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:29 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:30.260796 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-69c30ac9-c0e2-4014-afd8-05b74511e885 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:30.261406 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-69c30ac9-c0e2-4014-afd8-05b74511e885 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:30.268056 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-69c30ac9-c0e2-4014-afd8-05b74511e885 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:30.268528 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-69c30ac9-c0e2-4014-afd8-05b74511e885 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:30.268958 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-69c30ac9-c0e2-4014-afd8-05b74511e885 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:30.269642 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-69c30ac9-c0e2-4014-afd8-05b74511e885 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:30.270090 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-69c30ac9-c0e2-4014-afd8-05b74511e885 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:30.270507 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-69c30ac9-c0e2-4014-afd8-05b74511e885 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:30.329115 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f86c4898-9096-42c7-b6f9-a4fb44bca872 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:30.331288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f86c4898-9096-42c7-b6f9-a4fb44bca872 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:30.337723 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f86c4898-9096-42c7-b6f9-a4fb44bca872 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:30.338145 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f86c4898-9096-42c7-b6f9-a4fb44bca872 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:30.338581 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f86c4898-9096-42c7-b6f9-a4fb44bca872 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:30.339273 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f86c4898-9096-42c7-b6f9-a4fb44bca872 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:30.339756 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f86c4898-9096-42c7-b6f9-a4fb44bca872 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:30.340182 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f86c4898-9096-42c7-b6f9-a4fb44bca872 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:30.369526 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f86c4898-9096-42c7-b6f9-a4fb44bca872 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044268 Oct 11 06:53:30.370082 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 739/1516] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:30 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:53:30.398023 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-69c30ac9-c0e2-4014-afd8-05b74511e885 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:30.406773 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-69c30ac9-c0e2-4014-afd8-05b74511e885 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150333 Oct 11 06:53:30.407797 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 778/1517] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:30 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:31.382339 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-022a4d6f-ccf6-4df7-9752-3512f910b980 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:31.384538 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-022a4d6f-ccf6-4df7-9752-3512f910b980 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:31.391051 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-022a4d6f-ccf6-4df7-9752-3512f910b980 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:31.391558 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-022a4d6f-ccf6-4df7-9752-3512f910b980 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:31.391988 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-022a4d6f-ccf6-4df7-9752-3512f910b980 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:31.392675 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-022a4d6f-ccf6-4df7-9752-3512f910b980 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:31.393119 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-022a4d6f-ccf6-4df7-9752-3512f910b980 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:31.393534 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-022a4d6f-ccf6-4df7-9752-3512f910b980 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:31.422884 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-022a4d6f-ccf6-4df7-9752-3512f910b980 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044939 Oct 11 06:53:31.423645 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 740/1518] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:31 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:31.429471 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2c61b125-c9a7-4c20-8355-33b6fb921657 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:31.430077 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2c61b125-c9a7-4c20-8355-33b6fb921657 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:31.432363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=52 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:53:31.438095 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c61b125-c9a7-4c20-8355-33b6fb921657 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:31.438572 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c61b125-c9a7-4c20-8355-33b6fb921657 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:31.439000 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c61b125-c9a7-4c20-8355-33b6fb921657 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:31.439711 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c61b125-c9a7-4c20-8355-33b6fb921657 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:31.440158 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c61b125-c9a7-4c20-8355-33b6fb921657 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:31.440576 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c61b125-c9a7-4c20-8355-33b6fb921657 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:31.568769 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2c61b125-c9a7-4c20-8355-33b6fb921657 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:31.577406 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2c61b125-c9a7-4c20-8355-33b6fb921657 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.151741 Oct 11 06:53:31.577960 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 779/1519] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:31 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:32.435252 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6fe4bc1c-dd6a-4edf-b0e4-e610aa0d9851 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:32.437390 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6fe4bc1c-dd6a-4edf-b0e4-e610aa0d9851 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:32.443784 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6fe4bc1c-dd6a-4edf-b0e4-e610aa0d9851 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:32.444277 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6fe4bc1c-dd6a-4edf-b0e4-e610aa0d9851 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:32.444705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6fe4bc1c-dd6a-4edf-b0e4-e610aa0d9851 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:32.445384 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6fe4bc1c-dd6a-4edf-b0e4-e610aa0d9851 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:32.445825 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6fe4bc1c-dd6a-4edf-b0e4-e610aa0d9851 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:32.446240 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6fe4bc1c-dd6a-4edf-b0e4-e610aa0d9851 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:32.474693 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6fe4bc1c-dd6a-4edf-b0e4-e610aa0d9851 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043303 Oct 11 06:53:32.475148 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 741/1520] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:32 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:32.600885 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f553045f-aa96-49c8-83c1-37e5adec7058 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:32.601486 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f553045f-aa96-49c8-83c1-37e5adec7058 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:32.604039 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 06:53:32.604176 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Tue Oct 11 06:53:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb (ip 10.222.0.39) !!! Oct 11 06:53:32.611428 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f553045f-aa96-49c8-83c1-37e5adec7058 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:32.611946 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f553045f-aa96-49c8-83c1-37e5adec7058 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:32.612376 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f553045f-aa96-49c8-83c1-37e5adec7058 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:32.613070 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f553045f-aa96-49c8-83c1-37e5adec7058 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:32.613516 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f553045f-aa96-49c8-83c1-37e5adec7058 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:32.613939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f553045f-aa96-49c8-83c1-37e5adec7058 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:32.738555 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f553045f-aa96-49c8-83c1-37e5adec7058 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:32.746629 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f553045f-aa96-49c8-83c1-37e5adec7058 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149565 Oct 11 06:53:32.747182 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 780/1521] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:32 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:33.487710 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ca426e8c-9664-462d-9728-16b30475f2aa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:33.489781 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ca426e8c-9664-462d-9728-16b30475f2aa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:33.496779 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca426e8c-9664-462d-9728-16b30475f2aa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:33.497255 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca426e8c-9664-462d-9728-16b30475f2aa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:33.497688 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca426e8c-9664-462d-9728-16b30475f2aa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:33.498370 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca426e8c-9664-462d-9728-16b30475f2aa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:33.498816 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca426e8c-9664-462d-9728-16b30475f2aa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:33.499234 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca426e8c-9664-462d-9728-16b30475f2aa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:33.527247 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ca426e8c-9664-462d-9728-16b30475f2aa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043555 Oct 11 06:53:33.527801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 742/1522] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:33 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:33.770297 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2f5918eb-27c5-4a33-9aaf-48d422bede81 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:33.770868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2f5918eb-27c5-4a33-9aaf-48d422bede81 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:33.777673 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f5918eb-27c5-4a33-9aaf-48d422bede81 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:33.778144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f5918eb-27c5-4a33-9aaf-48d422bede81 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:33.778567 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f5918eb-27c5-4a33-9aaf-48d422bede81 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:33.779245 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f5918eb-27c5-4a33-9aaf-48d422bede81 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:33.779716 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f5918eb-27c5-4a33-9aaf-48d422bede81 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:33.780132 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f5918eb-27c5-4a33-9aaf-48d422bede81 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:33.905316 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2f5918eb-27c5-4a33-9aaf-48d422bede81 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:33.913376 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2f5918eb-27c5-4a33-9aaf-48d422bede81 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.146986 Oct 11 06:53:33.913928 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 781/1523] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:33 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:34.538576 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8bed9b42-8985-41e2-bd39-fc02016ea049 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:34.541297 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8bed9b42-8985-41e2-bd39-fc02016ea049 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:34.547686 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8bed9b42-8985-41e2-bd39-fc02016ea049 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:34.548177 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8bed9b42-8985-41e2-bd39-fc02016ea049 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:34.548614 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8bed9b42-8985-41e2-bd39-fc02016ea049 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:34.549307 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8bed9b42-8985-41e2-bd39-fc02016ea049 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:34.549760 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8bed9b42-8985-41e2-bd39-fc02016ea049 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:34.550213 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8bed9b42-8985-41e2-bd39-fc02016ea049 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:34.578987 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8bed9b42-8985-41e2-bd39-fc02016ea049 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044352 Oct 11 06:53:34.579470 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 743/1524] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:34 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:34.936442 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1d8f0de6-405d-444b-ba1d-0a5936fd2497 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:34.937048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1d8f0de6-405d-444b-ba1d-0a5936fd2497 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:34.943362 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1d8f0de6-405d-444b-ba1d-0a5936fd2497 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:34.943865 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1d8f0de6-405d-444b-ba1d-0a5936fd2497 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:34.944298 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1d8f0de6-405d-444b-ba1d-0a5936fd2497 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:34.944987 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1d8f0de6-405d-444b-ba1d-0a5936fd2497 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:34.945429 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1d8f0de6-405d-444b-ba1d-0a5936fd2497 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:34.945847 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1d8f0de6-405d-444b-ba1d-0a5936fd2497 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:35.074961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1d8f0de6-405d-444b-ba1d-0a5936fd2497 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:35.082970 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1d8f0de6-405d-444b-ba1d-0a5936fd2497 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150449 Oct 11 06:53:35.083547 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 782/1525] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:34 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:35.590279 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5b3c7c5b-b2d2-4bf1-b9e2-96788d621737 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:35.592481 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5b3c7c5b-b2d2-4bf1-b9e2-96788d621737 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:35.599165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b3c7c5b-b2d2-4bf1-b9e2-96788d621737 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:35.599680 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b3c7c5b-b2d2-4bf1-b9e2-96788d621737 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:35.600116 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b3c7c5b-b2d2-4bf1-b9e2-96788d621737 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:35.600815 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b3c7c5b-b2d2-4bf1-b9e2-96788d621737 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:35.601268 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b3c7c5b-b2d2-4bf1-b9e2-96788d621737 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:35.601690 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b3c7c5b-b2d2-4bf1-b9e2-96788d621737 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:35.605402 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:53:35.632923 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5b3c7c5b-b2d2-4bf1-b9e2-96788d621737 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046558 Oct 11 06:53:35.633391 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 744/1526] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:35 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:36.107188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4217430f-cb9e-4ae8-9cc9-f84070acef02 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:36.107838 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4217430f-cb9e-4ae8-9cc9-f84070acef02 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:36.114196 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4217430f-cb9e-4ae8-9cc9-f84070acef02 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:36.114676 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4217430f-cb9e-4ae8-9cc9-f84070acef02 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:36.115111 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4217430f-cb9e-4ae8-9cc9-f84070acef02 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:36.115840 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4217430f-cb9e-4ae8-9cc9-f84070acef02 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:36.116286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4217430f-cb9e-4ae8-9cc9-f84070acef02 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:36.116729 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4217430f-cb9e-4ae8-9cc9-f84070acef02 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:36.242145 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4217430f-cb9e-4ae8-9cc9-f84070acef02 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:36.250241 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4217430f-cb9e-4ae8-9cc9-f84070acef02 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147537 Oct 11 06:53:36.250800 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 783/1527] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:36 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:36.645921 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a62ab2e8-8059-4d1d-b594-7d0e4eb0333d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:36.648105 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a62ab2e8-8059-4d1d-b594-7d0e4eb0333d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:36.655105 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a62ab2e8-8059-4d1d-b594-7d0e4eb0333d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:36.655629 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a62ab2e8-8059-4d1d-b594-7d0e4eb0333d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:36.656063 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a62ab2e8-8059-4d1d-b594-7d0e4eb0333d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:36.656813 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a62ab2e8-8059-4d1d-b594-7d0e4eb0333d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:36.657332 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a62ab2e8-8059-4d1d-b594-7d0e4eb0333d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:36.657697 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a62ab2e8-8059-4d1d-b594-7d0e4eb0333d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:36.685752 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a62ab2e8-8059-4d1d-b594-7d0e4eb0333d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043801 Oct 11 06:53:36.686286 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 745/1528] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:36 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:37.273323 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1a6c6a0f-e009-4e77-a19c-26215c2ea617 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:37.273933 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1a6c6a0f-e009-4e77-a19c-26215c2ea617 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:37.280333 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1a6c6a0f-e009-4e77-a19c-26215c2ea617 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:37.280808 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1a6c6a0f-e009-4e77-a19c-26215c2ea617 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:37.281265 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1a6c6a0f-e009-4e77-a19c-26215c2ea617 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:37.281958 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1a6c6a0f-e009-4e77-a19c-26215c2ea617 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:37.282410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1a6c6a0f-e009-4e77-a19c-26215c2ea617 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:37.282840 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1a6c6a0f-e009-4e77-a19c-26215c2ea617 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:37.417133 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1a6c6a0f-e009-4e77-a19c-26215c2ea617 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:37.420642 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:53:37.426192 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1a6c6a0f-e009-4e77-a19c-26215c2ea617 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.156743 Oct 11 06:53:37.426749 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 784/1529] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:37 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:37.697868 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2d87baa2-78ad-4677-80b6-003bb43585d6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:37.699974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2d87baa2-78ad-4677-80b6-003bb43585d6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:37.707022 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d87baa2-78ad-4677-80b6-003bb43585d6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:37.707556 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d87baa2-78ad-4677-80b6-003bb43585d6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:37.707996 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d87baa2-78ad-4677-80b6-003bb43585d6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:37.708686 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d87baa2-78ad-4677-80b6-003bb43585d6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:37.709140 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d87baa2-78ad-4677-80b6-003bb43585d6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:37.709562 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d87baa2-78ad-4677-80b6-003bb43585d6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:37.738778 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2d87baa2-78ad-4677-80b6-003bb43585d6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045057 Oct 11 06:53:37.739319 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 746/1530] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:37 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:53:38.450499 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a66bee67-4eef-4ede-9b02-a634516acc63 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:38.451102 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a66bee67-4eef-4ede-9b02-a634516acc63 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:38.457427 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a66bee67-4eef-4ede-9b02-a634516acc63 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:38.457900 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a66bee67-4eef-4ede-9b02-a634516acc63 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:38.458328 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a66bee67-4eef-4ede-9b02-a634516acc63 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:38.459010 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a66bee67-4eef-4ede-9b02-a634516acc63 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:38.459474 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a66bee67-4eef-4ede-9b02-a634516acc63 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:38.459897 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a66bee67-4eef-4ede-9b02-a634516acc63 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:38.585221 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a66bee67-4eef-4ede-9b02-a634516acc63 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:38.593507 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a66bee67-4eef-4ede-9b02-a634516acc63 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147647 Oct 11 06:53:38.594058 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 785/1531] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:38 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:38.751039 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e6a4895d-523d-4b2b-9a30-c1d1b5e4727e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:38.753218 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e6a4895d-523d-4b2b-9a30-c1d1b5e4727e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:38.759815 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e6a4895d-523d-4b2b-9a30-c1d1b5e4727e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:38.760295 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e6a4895d-523d-4b2b-9a30-c1d1b5e4727e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:38.760726 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e6a4895d-523d-4b2b-9a30-c1d1b5e4727e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:38.761421 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e6a4895d-523d-4b2b-9a30-c1d1b5e4727e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:38.761873 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e6a4895d-523d-4b2b-9a30-c1d1b5e4727e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:38.762294 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e6a4895d-523d-4b2b-9a30-c1d1b5e4727e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:38.791528 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e6a4895d-523d-4b2b-9a30-c1d1b5e4727e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044505 Oct 11 06:53:38.792070 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 747/1532] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:38 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:39.616215 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1057eed1-7bad-476b-9ad1-a2b5a52842f5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:39.616813 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1057eed1-7bad-476b-9ad1-a2b5a52842f5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:39.623147 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1057eed1-7bad-476b-9ad1-a2b5a52842f5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:39.623661 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1057eed1-7bad-476b-9ad1-a2b5a52842f5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:39.624084 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1057eed1-7bad-476b-9ad1-a2b5a52842f5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:39.624766 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1057eed1-7bad-476b-9ad1-a2b5a52842f5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:39.625204 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1057eed1-7bad-476b-9ad1-a2b5a52842f5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:39.625617 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1057eed1-7bad-476b-9ad1-a2b5a52842f5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:39.757061 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1057eed1-7bad-476b-9ad1-a2b5a52842f5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:39.766140 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1057eed1-7bad-476b-9ad1-a2b5a52842f5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.153682 Oct 11 06:53:39.766700 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 786/1533] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:39 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:39.803609 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c6affd1d-a54f-4695-8a56-6147b9297b85 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:39.805766 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c6affd1d-a54f-4695-8a56-6147b9297b85 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:39.812600 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c6affd1d-a54f-4695-8a56-6147b9297b85 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:39.813073 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c6affd1d-a54f-4695-8a56-6147b9297b85 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:39.813499 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c6affd1d-a54f-4695-8a56-6147b9297b85 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:39.814180 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c6affd1d-a54f-4695-8a56-6147b9297b85 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:39.814657 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c6affd1d-a54f-4695-8a56-6147b9297b85 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:39.815073 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c6affd1d-a54f-4695-8a56-6147b9297b85 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:39.843591 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c6affd1d-a54f-4695-8a56-6147b9297b85 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043903 Oct 11 06:53:39.844149 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 748/1534] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:39 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:40.789065 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3c65e44a-5391-4e5c-8c57-573f25982ca8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:40.789676 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3c65e44a-5391-4e5c-8c57-573f25982ca8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:40.797240 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3c65e44a-5391-4e5c-8c57-573f25982ca8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:40.797737 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3c65e44a-5391-4e5c-8c57-573f25982ca8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:40.798167 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3c65e44a-5391-4e5c-8c57-573f25982ca8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:40.798858 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3c65e44a-5391-4e5c-8c57-573f25982ca8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:40.799302 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3c65e44a-5391-4e5c-8c57-573f25982ca8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:40.799749 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3c65e44a-5391-4e5c-8c57-573f25982ca8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:40.855712 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4b86bc6d-be6e-4ee6-a259-20a9cd829c16 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:40.858039 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4b86bc6d-be6e-4ee6-a259-20a9cd829c16 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:40.864490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b86bc6d-be6e-4ee6-a259-20a9cd829c16 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:40.864973 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b86bc6d-be6e-4ee6-a259-20a9cd829c16 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:40.865431 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b86bc6d-be6e-4ee6-a259-20a9cd829c16 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:40.866132 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b86bc6d-be6e-4ee6-a259-20a9cd829c16 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:40.866614 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b86bc6d-be6e-4ee6-a259-20a9cd829c16 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:40.867035 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b86bc6d-be6e-4ee6-a259-20a9cd829c16 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:40.897055 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4b86bc6d-be6e-4ee6-a259-20a9cd829c16 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045888 Oct 11 06:53:40.897610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 749/1535] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:40 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:53:40.925771 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3c65e44a-5391-4e5c-8c57-573f25982ca8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:40.934090 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3c65e44a-5391-4e5c-8c57-573f25982ca8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.148821 Oct 11 06:53:40.934651 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 787/1536] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:40 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:41.909419 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bafd9cc2-10b3-489a-bc0a-98eb7392021e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:41.911523 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bafd9cc2-10b3-489a-bc0a-98eb7392021e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:41.917705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bafd9cc2-10b3-489a-bc0a-98eb7392021e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:41.918186 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bafd9cc2-10b3-489a-bc0a-98eb7392021e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:41.918623 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bafd9cc2-10b3-489a-bc0a-98eb7392021e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:41.919320 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bafd9cc2-10b3-489a-bc0a-98eb7392021e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:41.919795 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bafd9cc2-10b3-489a-bc0a-98eb7392021e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:41.920219 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bafd9cc2-10b3-489a-bc0a-98eb7392021e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:41.949605 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bafd9cc2-10b3-489a-bc0a-98eb7392021e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044199 Oct 11 06:53:41.950159 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 750/1537] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:41 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:41.957621 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2e3b9820-812f-432a-9982-f3f91188a0b9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:41.958228 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2e3b9820-812f-432a-9982-f3f91188a0b9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:41.965408 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2e3b9820-812f-432a-9982-f3f91188a0b9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:41.965885 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2e3b9820-812f-432a-9982-f3f91188a0b9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:41.966317 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2e3b9820-812f-432a-9982-f3f91188a0b9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:41.967037 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2e3b9820-812f-432a-9982-f3f91188a0b9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:41.967528 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2e3b9820-812f-432a-9982-f3f91188a0b9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:41.967947 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2e3b9820-812f-432a-9982-f3f91188a0b9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:42.093066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2e3b9820-812f-432a-9982-f3f91188a0b9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:42.101261 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2e3b9820-812f-432a-9982-f3f91188a0b9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147515 Oct 11 06:53:42.101817 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 788/1538] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:41 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:42.961749 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e2956802-1b17-42e4-954d-e00734108ef5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:42.963929 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e2956802-1b17-42e4-954d-e00734108ef5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:42.970262 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e2956802-1b17-42e4-954d-e00734108ef5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:42.970742 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e2956802-1b17-42e4-954d-e00734108ef5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:42.971170 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e2956802-1b17-42e4-954d-e00734108ef5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:42.971881 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e2956802-1b17-42e4-954d-e00734108ef5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:42.972328 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e2956802-1b17-42e4-954d-e00734108ef5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:42.972743 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e2956802-1b17-42e4-954d-e00734108ef5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:43.001560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e2956802-1b17-42e4-954d-e00734108ef5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043705 Oct 11 06:53:43.002095 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 751/1539] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:42 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:43.125161 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-75ea7ca5-21f5-47d0-8d1b-6ffdbc82738b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:43.125763 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-75ea7ca5-21f5-47d0-8d1b-6ffdbc82738b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:43.127746 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 06:53:43.127888 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Tue Oct 11 06:53:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb (ip 10.222.0.39) !!! Oct 11 06:53:43.134951 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-75ea7ca5-21f5-47d0-8d1b-6ffdbc82738b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:43.135496 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-75ea7ca5-21f5-47d0-8d1b-6ffdbc82738b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:43.135870 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-75ea7ca5-21f5-47d0-8d1b-6ffdbc82738b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:43.136559 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-75ea7ca5-21f5-47d0-8d1b-6ffdbc82738b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:43.137000 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-75ea7ca5-21f5-47d0-8d1b-6ffdbc82738b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:43.137417 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-75ea7ca5-21f5-47d0-8d1b-6ffdbc82738b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:43.267930 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-75ea7ca5-21f5-47d0-8d1b-6ffdbc82738b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:43.276053 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-75ea7ca5-21f5-47d0-8d1b-6ffdbc82738b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.154731 Oct 11 06:53:43.276618 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 789/1540] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:43 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:44.015039 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1a0dd57e-4cbe-4f64-93d0-f28ba5ee9542 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:44.017182 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1a0dd57e-4cbe-4f64-93d0-f28ba5ee9542 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:44.019496 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=58 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:53:44.025830 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1a0dd57e-4cbe-4f64-93d0-f28ba5ee9542 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:44.026321 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1a0dd57e-4cbe-4f64-93d0-f28ba5ee9542 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:44.026790 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1a0dd57e-4cbe-4f64-93d0-f28ba5ee9542 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:44.027521 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1a0dd57e-4cbe-4f64-93d0-f28ba5ee9542 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:44.027978 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1a0dd57e-4cbe-4f64-93d0-f28ba5ee9542 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:44.028403 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1a0dd57e-4cbe-4f64-93d0-f28ba5ee9542 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:44.056639 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1a0dd57e-4cbe-4f64-93d0-f28ba5ee9542 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045845 Oct 11 06:53:44.057180 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 752/1541] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:44 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:44.299495 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-09777c4f-ea72-428d-a5de-c4fe85200522 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:44.300098 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-09777c4f-ea72-428d-a5de-c4fe85200522 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:44.306936 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-09777c4f-ea72-428d-a5de-c4fe85200522 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:44.307401 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-09777c4f-ea72-428d-a5de-c4fe85200522 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:44.307847 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-09777c4f-ea72-428d-a5de-c4fe85200522 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:44.308526 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-09777c4f-ea72-428d-a5de-c4fe85200522 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:44.308964 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-09777c4f-ea72-428d-a5de-c4fe85200522 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:44.309379 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-09777c4f-ea72-428d-a5de-c4fe85200522 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:44.434017 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-09777c4f-ea72-428d-a5de-c4fe85200522 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:44.442033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-09777c4f-ea72-428d-a5de-c4fe85200522 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.146407 Oct 11 06:53:44.442580 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 790/1542] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:44 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:45.068130 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-870e13b6-dc9f-4938-90d4-dba845ef58db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:45.070262 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-870e13b6-dc9f-4938-90d4-dba845ef58db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:45.072876 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 06:53:45.073023 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Tue Oct 11 06:53:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments (ip 10.222.0.39) !!! Oct 11 06:53:45.080362 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-870e13b6-dc9f-4938-90d4-dba845ef58db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:45.080841 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-870e13b6-dc9f-4938-90d4-dba845ef58db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:45.081277 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-870e13b6-dc9f-4938-90d4-dba845ef58db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:45.081968 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-870e13b6-dc9f-4938-90d4-dba845ef58db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:45.082421 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-870e13b6-dc9f-4938-90d4-dba845ef58db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:45.082844 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-870e13b6-dc9f-4938-90d4-dba845ef58db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:45.114619 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-870e13b6-dc9f-4938-90d4-dba845ef58db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050354 Oct 11 06:53:45.115172 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 753/1543] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:45 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:45.466405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3c4cbe4d-b529-471a-a805-5d7f0091ce8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:45.466976 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3c4cbe4d-b529-471a-a805-5d7f0091ce8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:45.473556 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3c4cbe4d-b529-471a-a805-5d7f0091ce8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:45.474027 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3c4cbe4d-b529-471a-a805-5d7f0091ce8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:45.474457 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3c4cbe4d-b529-471a-a805-5d7f0091ce8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:45.475141 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3c4cbe4d-b529-471a-a805-5d7f0091ce8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:45.475627 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3c4cbe4d-b529-471a-a805-5d7f0091ce8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:45.476044 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3c4cbe4d-b529-471a-a805-5d7f0091ce8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:45.610229 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3c4cbe4d-b529-471a-a805-5d7f0091ce8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:45.618352 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3c4cbe4d-b529-471a-a805-5d7f0091ce8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.156446 Oct 11 06:53:45.618902 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 791/1544] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:45 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:46.127454 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7bb133a5-f34f-40ef-a89a-57c44c876ccb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:46.129618 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7bb133a5-f34f-40ef-a89a-57c44c876ccb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:46.136541 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7bb133a5-f34f-40ef-a89a-57c44c876ccb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:46.137023 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7bb133a5-f34f-40ef-a89a-57c44c876ccb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:46.137468 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7bb133a5-f34f-40ef-a89a-57c44c876ccb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:46.138425 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7bb133a5-f34f-40ef-a89a-57c44c876ccb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:46.138875 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7bb133a5-f34f-40ef-a89a-57c44c876ccb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:46.139297 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7bb133a5-f34f-40ef-a89a-57c44c876ccb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:46.168276 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7bb133a5-f34f-40ef-a89a-57c44c876ccb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044764 Oct 11 06:53:46.168820 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 754/1545] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:46 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:46.641739 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a6d3d41c-fa35-4d93-9192-d65c8feadf29 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:46.642342 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a6d3d41c-fa35-4d93-9192-d65c8feadf29 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:46.648563 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6d3d41c-fa35-4d93-9192-d65c8feadf29 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:46.649032 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6d3d41c-fa35-4d93-9192-d65c8feadf29 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:46.649451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6d3d41c-fa35-4d93-9192-d65c8feadf29 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:46.650137 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6d3d41c-fa35-4d93-9192-d65c8feadf29 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:46.650575 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6d3d41c-fa35-4d93-9192-d65c8feadf29 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:46.650986 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6d3d41c-fa35-4d93-9192-d65c8feadf29 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:46.775123 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a6d3d41c-fa35-4d93-9192-d65c8feadf29 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:46.783130 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a6d3d41c-fa35-4d93-9192-d65c8feadf29 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.145502 Oct 11 06:53:46.783741 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 792/1546] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:46 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:47.180752 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3cabdeee-3bfb-42a9-9cfc-e45a6000a8e6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:47.183574 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3cabdeee-3bfb-42a9-9cfc-e45a6000a8e6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:47.190041 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3cabdeee-3bfb-42a9-9cfc-e45a6000a8e6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:47.190525 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3cabdeee-3bfb-42a9-9cfc-e45a6000a8e6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:47.190964 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3cabdeee-3bfb-42a9-9cfc-e45a6000a8e6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:47.191695 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3cabdeee-3bfb-42a9-9cfc-e45a6000a8e6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:47.192163 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3cabdeee-3bfb-42a9-9cfc-e45a6000a8e6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:47.192582 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3cabdeee-3bfb-42a9-9cfc-e45a6000a8e6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:47.221204 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3cabdeee-3bfb-42a9-9cfc-e45a6000a8e6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044481 Oct 11 06:53:47.221747 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 755/1547] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:47 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:47.806172 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-96373ad1-191f-4500-ba59-093d2a06fa78 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:47.806784 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-96373ad1-191f-4500-ba59-093d2a06fa78 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:47.813187 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96373ad1-191f-4500-ba59-093d2a06fa78 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:47.813666 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96373ad1-191f-4500-ba59-093d2a06fa78 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:47.814095 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96373ad1-191f-4500-ba59-093d2a06fa78 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:47.814778 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96373ad1-191f-4500-ba59-093d2a06fa78 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:47.815226 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96373ad1-191f-4500-ba59-093d2a06fa78 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:47.815685 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96373ad1-191f-4500-ba59-093d2a06fa78 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:47.942833 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-96373ad1-191f-4500-ba59-093d2a06fa78 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:47.951314 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-96373ad1-191f-4500-ba59-093d2a06fa78 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149080 Oct 11 06:53:47.952230 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 793/1548] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:47 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:48.232942 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-68caf708-3833-4842-9a67-94fc13410b7e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:48.235010 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-68caf708-3833-4842-9a67-94fc13410b7e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:48.241190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-68caf708-3833-4842-9a67-94fc13410b7e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:48.241665 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-68caf708-3833-4842-9a67-94fc13410b7e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:48.242095 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-68caf708-3833-4842-9a67-94fc13410b7e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:48.242775 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-68caf708-3833-4842-9a67-94fc13410b7e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:48.243222 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-68caf708-3833-4842-9a67-94fc13410b7e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:48.244160 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-68caf708-3833-4842-9a67-94fc13410b7e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:48.273280 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-68caf708-3833-4842-9a67-94fc13410b7e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044339 Oct 11 06:53:48.273808 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 756/1549] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:48 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:48.974783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3b5f45f0-3f04-4203-a77a-84d7bd86190e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:48.975458 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3b5f45f0-3f04-4203-a77a-84d7bd86190e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:48.981882 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b5f45f0-3f04-4203-a77a-84d7bd86190e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:48.982354 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b5f45f0-3f04-4203-a77a-84d7bd86190e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:48.982808 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b5f45f0-3f04-4203-a77a-84d7bd86190e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:48.983546 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b5f45f0-3f04-4203-a77a-84d7bd86190e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:48.983994 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b5f45f0-3f04-4203-a77a-84d7bd86190e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:48.984409 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b5f45f0-3f04-4203-a77a-84d7bd86190e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:49.112493 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3b5f45f0-3f04-4203-a77a-84d7bd86190e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:49.121241 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3b5f45f0-3f04-4203-a77a-84d7bd86190e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150220 Oct 11 06:53:49.121797 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 794/1550] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:48 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:49.285766 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5397a2b7-db8f-4ff3-919c-493c25da0ff6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:49.287874 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5397a2b7-db8f-4ff3-919c-493c25da0ff6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:49.294712 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5397a2b7-db8f-4ff3-919c-493c25da0ff6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:49.295192 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5397a2b7-db8f-4ff3-919c-493c25da0ff6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:49.295663 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5397a2b7-db8f-4ff3-919c-493c25da0ff6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:49.296353 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5397a2b7-db8f-4ff3-919c-493c25da0ff6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:49.296803 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5397a2b7-db8f-4ff3-919c-493c25da0ff6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:49.297224 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5397a2b7-db8f-4ff3-919c-493c25da0ff6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:49.326024 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5397a2b7-db8f-4ff3-919c-493c25da0ff6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044320 Oct 11 06:53:49.326555 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 757/1551] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:49 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:50.144737 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-383128b6-ad0f-4358-b669-838826002ced tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:50.145344 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-383128b6-ad0f-4358-b669-838826002ced tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:50.152379 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-383128b6-ad0f-4358-b669-838826002ced tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:50.152856 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-383128b6-ad0f-4358-b669-838826002ced tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:50.153282 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-383128b6-ad0f-4358-b669-838826002ced tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:50.153969 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-383128b6-ad0f-4358-b669-838826002ced tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:50.154413 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-383128b6-ad0f-4358-b669-838826002ced tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:50.154832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-383128b6-ad0f-4358-b669-838826002ced tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:50.283551 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-383128b6-ad0f-4358-b669-838826002ced tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:50.291741 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-383128b6-ad0f-4358-b669-838826002ced tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150829 Oct 11 06:53:50.292371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 795/1552] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:50 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:50.337998 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-53c29402-c16d-443a-ad0e-1a85a0acb161 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:50.340430 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-53c29402-c16d-443a-ad0e-1a85a0acb161 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:50.346696 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-53c29402-c16d-443a-ad0e-1a85a0acb161 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:50.347170 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-53c29402-c16d-443a-ad0e-1a85a0acb161 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:50.347647 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-53c29402-c16d-443a-ad0e-1a85a0acb161 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:50.348327 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-53c29402-c16d-443a-ad0e-1a85a0acb161 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:50.348773 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-53c29402-c16d-443a-ad0e-1a85a0acb161 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:50.349188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-53c29402-c16d-443a-ad0e-1a85a0acb161 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:50.377782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-53c29402-c16d-443a-ad0e-1a85a0acb161 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043672 Oct 11 06:53:50.378312 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 758/1553] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:50 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:51.315296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-911ec236-d07e-4838-9893-16f573e1766b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:51.315941 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-911ec236-d07e-4838-9893-16f573e1766b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:51.322714 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-911ec236-d07e-4838-9893-16f573e1766b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:51.323437 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-911ec236-d07e-4838-9893-16f573e1766b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:51.323882 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-911ec236-d07e-4838-9893-16f573e1766b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:51.324583 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-911ec236-d07e-4838-9893-16f573e1766b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:51.325036 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-911ec236-d07e-4838-9893-16f573e1766b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:51.325462 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-911ec236-d07e-4838-9893-16f573e1766b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:51.390950 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-26cc2e90-c2f5-4896-b2ed-a034db523429 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:51.393256 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-26cc2e90-c2f5-4896-b2ed-a034db523429 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:51.399853 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26cc2e90-c2f5-4896-b2ed-a034db523429 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:51.400342 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26cc2e90-c2f5-4896-b2ed-a034db523429 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:51.400777 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26cc2e90-c2f5-4896-b2ed-a034db523429 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:51.401517 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26cc2e90-c2f5-4896-b2ed-a034db523429 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:51.401969 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26cc2e90-c2f5-4896-b2ed-a034db523429 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:51.402579 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26cc2e90-c2f5-4896-b2ed-a034db523429 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:51.433837 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-26cc2e90-c2f5-4896-b2ed-a034db523429 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047062 Oct 11 06:53:51.434397 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 759/1554] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:51 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:53:51.455770 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-911ec236-d07e-4838-9893-16f573e1766b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:51.464864 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-911ec236-d07e-4838-9893-16f573e1766b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.153688 Oct 11 06:53:51.465416 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 796/1555] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:51 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:52.445452 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0dda7351-fb61-4563-8f73-5f84ea15d4a3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:52.448147 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0dda7351-fb61-4563-8f73-5f84ea15d4a3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:52.454941 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0dda7351-fb61-4563-8f73-5f84ea15d4a3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:52.455441 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0dda7351-fb61-4563-8f73-5f84ea15d4a3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:52.455898 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0dda7351-fb61-4563-8f73-5f84ea15d4a3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:52.456597 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0dda7351-fb61-4563-8f73-5f84ea15d4a3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:52.457053 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0dda7351-fb61-4563-8f73-5f84ea15d4a3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:52.457474 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0dda7351-fb61-4563-8f73-5f84ea15d4a3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:52.482428 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:53:52.487863 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0dda7351-fb61-4563-8f73-5f84ea15d4a3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046314 Oct 11 06:53:52.488413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 760/1556] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:52 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:52.488952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-78db8abb-4d74-42aa-aea5-3c0417313969 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:52.489662 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-78db8abb-4d74-42aa-aea5-3c0417313969 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:52.496057 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-78db8abb-4d74-42aa-aea5-3c0417313969 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:52.496524 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-78db8abb-4d74-42aa-aea5-3c0417313969 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:52.496949 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-78db8abb-4d74-42aa-aea5-3c0417313969 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:52.497629 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-78db8abb-4d74-42aa-aea5-3c0417313969 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:52.498069 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-78db8abb-4d74-42aa-aea5-3c0417313969 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:52.498482 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-78db8abb-4d74-42aa-aea5-3c0417313969 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:52.624699 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-78db8abb-4d74-42aa-aea5-3c0417313969 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:52.632761 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-78db8abb-4d74-42aa-aea5-3c0417313969 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147672 Oct 11 06:53:52.633320 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 797/1557] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:52 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:53:53.500422 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c0f8a781-f984-4352-b993-d0fc8ec7c78a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:53.502563 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c0f8a781-f984-4352-b993-d0fc8ec7c78a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:53.509721 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c0f8a781-f984-4352-b993-d0fc8ec7c78a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:53.510203 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c0f8a781-f984-4352-b993-d0fc8ec7c78a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:53.510639 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c0f8a781-f984-4352-b993-d0fc8ec7c78a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:53.511331 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c0f8a781-f984-4352-b993-d0fc8ec7c78a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:53.511812 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c0f8a781-f984-4352-b993-d0fc8ec7c78a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:53.512239 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c0f8a781-f984-4352-b993-d0fc8ec7c78a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:53.541971 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c0f8a781-f984-4352-b993-d0fc8ec7c78a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045522 Oct 11 06:53:53.542510 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 761/1558] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:53 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:53.656734 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0be02925-8d4b-4917-9888-71d961677e79 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:53.657278 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0be02925-8d4b-4917-9888-71d961677e79 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:53.664245 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0be02925-8d4b-4917-9888-71d961677e79 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:53.664726 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0be02925-8d4b-4917-9888-71d961677e79 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:53.665658 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0be02925-8d4b-4917-9888-71d961677e79 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:53.666350 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0be02925-8d4b-4917-9888-71d961677e79 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:53.666791 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0be02925-8d4b-4917-9888-71d961677e79 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:53.667205 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0be02925-8d4b-4917-9888-71d961677e79 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:53.800423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0be02925-8d4b-4917-9888-71d961677e79 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:53.809199 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0be02925-8d4b-4917-9888-71d961677e79 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.156452 Oct 11 06:53:53.809755 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 798/1559] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:53 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:54.554281 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-52616f23-4499-4f08-af93-0a80927aa96d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:54.556642 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-52616f23-4499-4f08-af93-0a80927aa96d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:54.563221 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-52616f23-4499-4f08-af93-0a80927aa96d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:54.563741 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-52616f23-4499-4f08-af93-0a80927aa96d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:54.564179 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-52616f23-4499-4f08-af93-0a80927aa96d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:54.564877 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-52616f23-4499-4f08-af93-0a80927aa96d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:54.565328 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-52616f23-4499-4f08-af93-0a80927aa96d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:54.565922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-52616f23-4499-4f08-af93-0a80927aa96d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:54.596285 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-52616f23-4499-4f08-af93-0a80927aa96d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046010 Oct 11 06:53:54.596840 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 762/1560] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:54 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:54.831488 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-873406dc-53e5-4c2d-bd96-b8a1be1caeb0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:54.832019 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-873406dc-53e5-4c2d-bd96-b8a1be1caeb0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:54.838316 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-873406dc-53e5-4c2d-bd96-b8a1be1caeb0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:54.838786 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-873406dc-53e5-4c2d-bd96-b8a1be1caeb0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:54.839212 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-873406dc-53e5-4c2d-bd96-b8a1be1caeb0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:54.839928 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-873406dc-53e5-4c2d-bd96-b8a1be1caeb0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:54.840363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-873406dc-53e5-4c2d-bd96-b8a1be1caeb0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:54.840783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-873406dc-53e5-4c2d-bd96-b8a1be1caeb0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:54.966852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-873406dc-53e5-4c2d-bd96-b8a1be1caeb0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:54.974969 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-873406dc-53e5-4c2d-bd96-b8a1be1caeb0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147384 Oct 11 06:53:54.975546 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 799/1561] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:54 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:55.608879 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a59c21d0-7797-438b-a022-68aa59a63da8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:55.610999 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a59c21d0-7797-438b-a022-68aa59a63da8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:55.617317 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a59c21d0-7797-438b-a022-68aa59a63da8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:55.617791 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a59c21d0-7797-438b-a022-68aa59a63da8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:55.618226 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a59c21d0-7797-438b-a022-68aa59a63da8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:55.618921 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a59c21d0-7797-438b-a022-68aa59a63da8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:55.619365 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a59c21d0-7797-438b-a022-68aa59a63da8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:55.619817 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a59c21d0-7797-438b-a022-68aa59a63da8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:55.647992 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a59c21d0-7797-438b-a022-68aa59a63da8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043084 Oct 11 06:53:55.652542 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 763/1562] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:55 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:55.998106 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b43c68b4-b445-4ffd-8f02-e818c2fbc8b6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:55.998657 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b43c68b4-b445-4ffd-8f02-e818c2fbc8b6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:56.005009 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b43c68b4-b445-4ffd-8f02-e818c2fbc8b6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:56.005480 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b43c68b4-b445-4ffd-8f02-e818c2fbc8b6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:56.005902 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b43c68b4-b445-4ffd-8f02-e818c2fbc8b6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:56.006589 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b43c68b4-b445-4ffd-8f02-e818c2fbc8b6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:56.007028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b43c68b4-b445-4ffd-8f02-e818c2fbc8b6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:56.007459 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b43c68b4-b445-4ffd-8f02-e818c2fbc8b6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:56.213880 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b43c68b4-b445-4ffd-8f02-e818c2fbc8b6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:56.222197 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b43c68b4-b445-4ffd-8f02-e818c2fbc8b6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.227986 Oct 11 06:53:56.222765 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 800/1563] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:55 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:56.660438 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d6c014b9-2fdf-4f82-94f0-1805de9b8dab tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:56.662669 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d6c014b9-2fdf-4f82-94f0-1805de9b8dab tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:56.669043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d6c014b9-2fdf-4f82-94f0-1805de9b8dab tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:56.669526 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d6c014b9-2fdf-4f82-94f0-1805de9b8dab tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:56.669959 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d6c014b9-2fdf-4f82-94f0-1805de9b8dab tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:56.670647 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d6c014b9-2fdf-4f82-94f0-1805de9b8dab tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:56.671098 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d6c014b9-2fdf-4f82-94f0-1805de9b8dab tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:56.671550 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d6c014b9-2fdf-4f82-94f0-1805de9b8dab tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:56.700162 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d6c014b9-2fdf-4f82-94f0-1805de9b8dab tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043649 Oct 11 06:53:56.700692 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 764/1564] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:56 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:57.246355 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e45e4165-4d2d-4acb-91e1-d476e54f91d9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:57.246960 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e45e4165-4d2d-4acb-91e1-d476e54f91d9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:57.253285 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e45e4165-4d2d-4acb-91e1-d476e54f91d9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:57.253751 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e45e4165-4d2d-4acb-91e1-d476e54f91d9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:57.254175 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e45e4165-4d2d-4acb-91e1-d476e54f91d9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:57.254846 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e45e4165-4d2d-4acb-91e1-d476e54f91d9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:57.255285 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e45e4165-4d2d-4acb-91e1-d476e54f91d9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:57.255729 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e45e4165-4d2d-4acb-91e1-d476e54f91d9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:57.275180 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:53:57.385429 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e45e4165-4d2d-4acb-91e1-d476e54f91d9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:57.393820 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e45e4165-4d2d-4acb-91e1-d476e54f91d9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.151737 Oct 11 06:53:57.394380 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 801/1565] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:57 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:57.712983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c6ebc0a1-2c53-4c1a-96cc-81408b5222fe tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:57.715103 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c6ebc0a1-2c53-4c1a-96cc-81408b5222fe tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:57.721516 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c6ebc0a1-2c53-4c1a-96cc-81408b5222fe tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:57.721993 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c6ebc0a1-2c53-4c1a-96cc-81408b5222fe tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:57.722426 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c6ebc0a1-2c53-4c1a-96cc-81408b5222fe tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:57.723119 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c6ebc0a1-2c53-4c1a-96cc-81408b5222fe tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:57.723622 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c6ebc0a1-2c53-4c1a-96cc-81408b5222fe tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:57.724047 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c6ebc0a1-2c53-4c1a-96cc-81408b5222fe tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:57.752499 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c6ebc0a1-2c53-4c1a-96cc-81408b5222fe tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044136 Oct 11 06:53:57.753030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 765/1566] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:57 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:58.417332 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b898233b-7e8e-4378-95a3-34a955f0cda5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:58.417946 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b898233b-7e8e-4378-95a3-34a955f0cda5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:58.424911 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b898233b-7e8e-4378-95a3-34a955f0cda5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:58.425395 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b898233b-7e8e-4378-95a3-34a955f0cda5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:58.425860 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b898233b-7e8e-4378-95a3-34a955f0cda5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:58.426552 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b898233b-7e8e-4378-95a3-34a955f0cda5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:58.427002 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b898233b-7e8e-4378-95a3-34a955f0cda5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:58.427456 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b898233b-7e8e-4378-95a3-34a955f0cda5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:58.556604 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b898233b-7e8e-4378-95a3-34a955f0cda5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:58.564685 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b898233b-7e8e-4378-95a3-34a955f0cda5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.151695 Oct 11 06:53:58.565244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 802/1567] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:58 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:58.764919 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ff2c59ab-cbbb-434a-89bd-db2d460fcdbd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:58.766973 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ff2c59ab-cbbb-434a-89bd-db2d460fcdbd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:58.773391 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff2c59ab-cbbb-434a-89bd-db2d460fcdbd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:58.773867 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff2c59ab-cbbb-434a-89bd-db2d460fcdbd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:58.774294 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff2c59ab-cbbb-434a-89bd-db2d460fcdbd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:58.775493 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff2c59ab-cbbb-434a-89bd-db2d460fcdbd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:58.775939 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff2c59ab-cbbb-434a-89bd-db2d460fcdbd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:58.776354 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff2c59ab-cbbb-434a-89bd-db2d460fcdbd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:58.805178 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ff2c59ab-cbbb-434a-89bd-db2d460fcdbd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044484 Oct 11 06:53:58.805711 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 766/1568] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:58 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:53:59.588305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-201aecfe-735d-4740-8c90-6c35e75b27d6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:59.588840 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-201aecfe-735d-4740-8c90-6c35e75b27d6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:59.595623 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-201aecfe-735d-4740-8c90-6c35e75b27d6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:59.596097 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-201aecfe-735d-4740-8c90-6c35e75b27d6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:59.596523 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-201aecfe-735d-4740-8c90-6c35e75b27d6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:59.597200 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-201aecfe-735d-4740-8c90-6c35e75b27d6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:59.597641 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-201aecfe-735d-4740-8c90-6c35e75b27d6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:59.598053 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-201aecfe-735d-4740-8c90-6c35e75b27d6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:59.723126 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-201aecfe-735d-4740-8c90-6c35e75b27d6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:53:59.732812 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-201aecfe-735d-4740-8c90-6c35e75b27d6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.148518 Oct 11 06:53:59.733377 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 803/1569] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:53:59 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:53:59.817514 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3d21cfbd-6ddf-465c-8684-16afc95f5371 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:53:59.819728 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3d21cfbd-6ddf-465c-8684-16afc95f5371 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:53:59.826474 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3d21cfbd-6ddf-465c-8684-16afc95f5371 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:59.826946 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3d21cfbd-6ddf-465c-8684-16afc95f5371 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:59.827373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3d21cfbd-6ddf-465c-8684-16afc95f5371 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:59.828083 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3d21cfbd-6ddf-465c-8684-16afc95f5371 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:53:59.828528 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3d21cfbd-6ddf-465c-8684-16afc95f5371 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:53:59.828946 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3d21cfbd-6ddf-465c-8684-16afc95f5371 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:53:59.857486 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3d21cfbd-6ddf-465c-8684-16afc95f5371 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044014 Oct 11 06:53:59.858019 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 767/1570] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:53:59 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:00.756151 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b238fce3-c6d6-49cd-9c47-ca1c209d1e8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:00.756753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b238fce3-c6d6-49cd-9c47-ca1c209d1e8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:00.763861 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b238fce3-c6d6-49cd-9c47-ca1c209d1e8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:00.764334 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b238fce3-c6d6-49cd-9c47-ca1c209d1e8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:00.764761 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b238fce3-c6d6-49cd-9c47-ca1c209d1e8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:00.765454 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b238fce3-c6d6-49cd-9c47-ca1c209d1e8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:00.765895 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b238fce3-c6d6-49cd-9c47-ca1c209d1e8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:00.766317 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b238fce3-c6d6-49cd-9c47-ca1c209d1e8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:00.869910 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5adde378-7fb2-4862-a65c-177a24e46e5f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:00.872221 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5adde378-7fb2-4862-a65c-177a24e46e5f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:00.878463 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5adde378-7fb2-4862-a65c-177a24e46e5f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:00.878938 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5adde378-7fb2-4862-a65c-177a24e46e5f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:00.879366 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5adde378-7fb2-4862-a65c-177a24e46e5f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:00.880102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5adde378-7fb2-4862-a65c-177a24e46e5f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:00.880568 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5adde378-7fb2-4862-a65c-177a24e46e5f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:00.881105 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5adde378-7fb2-4862-a65c-177a24e46e5f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:00.897421 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b238fce3-c6d6-49cd-9c47-ca1c209d1e8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:00.906043 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b238fce3-c6d6-49cd-9c47-ca1c209d1e8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.153824 Oct 11 06:54:00.906596 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 804/1571] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:00 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:00.911102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5adde378-7fb2-4862-a65c-177a24e46e5f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045312 Oct 11 06:54:00.911674 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 768/1572] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:00 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:54:01.923784 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7916ede7-b8fe-4db6-a9c8-3fcfa3a502f5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:01.926041 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7916ede7-b8fe-4db6-a9c8-3fcfa3a502f5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:01.928690 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=52 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:54:01.929734 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-14d7048f-a210-422e-89e4-661bc32ebb04 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:01.930415 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-14d7048f-a210-422e-89e4-661bc32ebb04 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:01.934838 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7916ede7-b8fe-4db6-a9c8-3fcfa3a502f5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:01.935363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7916ede7-b8fe-4db6-a9c8-3fcfa3a502f5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:01.935863 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7916ede7-b8fe-4db6-a9c8-3fcfa3a502f5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:01.936691 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7916ede7-b8fe-4db6-a9c8-3fcfa3a502f5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:01.937000 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14d7048f-a210-422e-89e4-661bc32ebb04 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:01.937196 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7916ede7-b8fe-4db6-a9c8-3fcfa3a502f5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:01.937474 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14d7048f-a210-422e-89e4-661bc32ebb04 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:01.937621 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7916ede7-b8fe-4db6-a9c8-3fcfa3a502f5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:01.937906 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14d7048f-a210-422e-89e4-661bc32ebb04 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:01.938595 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14d7048f-a210-422e-89e4-661bc32ebb04 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:01.939040 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14d7048f-a210-422e-89e4-661bc32ebb04 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:01.939488 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14d7048f-a210-422e-89e4-661bc32ebb04 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:01.966798 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7916ede7-b8fe-4db6-a9c8-3fcfa3a502f5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046832 Oct 11 06:54:01.967353 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 805/1573] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:01 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:02.068453 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-14d7048f-a210-422e-89e4-661bc32ebb04 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:02.076493 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-14d7048f-a210-422e-89e4-661bc32ebb04 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150522 Oct 11 06:54:02.077043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 769/1574] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:01 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:54:02.978696 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8ac61af2-f5ea-4007-8be7-265405abd61c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:02.980928 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8ac61af2-f5ea-4007-8be7-265405abd61c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:02.987280 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ac61af2-f5ea-4007-8be7-265405abd61c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:02.987792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ac61af2-f5ea-4007-8be7-265405abd61c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:02.988225 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ac61af2-f5ea-4007-8be7-265405abd61c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:02.988908 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ac61af2-f5ea-4007-8be7-265405abd61c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:02.989366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ac61af2-f5ea-4007-8be7-265405abd61c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:02.989771 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ac61af2-f5ea-4007-8be7-265405abd61c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:03.018874 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8ac61af2-f5ea-4007-8be7-265405abd61c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044075 Oct 11 06:54:03.019409 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 806/1575] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:02 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:03.098900 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b22cf4af-5856-46f6-abda-78370183f521 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:03.099539 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b22cf4af-5856-46f6-abda-78370183f521 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:03.105835 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b22cf4af-5856-46f6-abda-78370183f521 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:03.106307 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b22cf4af-5856-46f6-abda-78370183f521 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:03.106738 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b22cf4af-5856-46f6-abda-78370183f521 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:03.107503 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b22cf4af-5856-46f6-abda-78370183f521 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:03.107895 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b22cf4af-5856-46f6-abda-78370183f521 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:03.108313 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b22cf4af-5856-46f6-abda-78370183f521 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:03.236813 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b22cf4af-5856-46f6-abda-78370183f521 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:03.245341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b22cf4af-5856-46f6-abda-78370183f521 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150392 Oct 11 06:54:03.245892 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 770/1576] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:03 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:04.031503 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9445e98e-d9f8-4dee-b68f-494e2d78f7f0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:04.033650 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9445e98e-d9f8-4dee-b68f-494e2d78f7f0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:04.035646 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 06:54:04.035777 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Tue Oct 11 06:54:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments (ip 10.222.0.39) !!! Oct 11 06:54:04.042766 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9445e98e-d9f8-4dee-b68f-494e2d78f7f0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:04.043247 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9445e98e-d9f8-4dee-b68f-494e2d78f7f0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:04.043708 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9445e98e-d9f8-4dee-b68f-494e2d78f7f0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:04.044394 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9445e98e-d9f8-4dee-b68f-494e2d78f7f0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:04.044840 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9445e98e-d9f8-4dee-b68f-494e2d78f7f0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:04.045263 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9445e98e-d9f8-4dee-b68f-494e2d78f7f0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:04.074472 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9445e98e-d9f8-4dee-b68f-494e2d78f7f0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046928 Oct 11 06:54:04.075008 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 807/1577] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:04 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:04.268898 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-574cb1db-d844-47e0-abee-48cc60c340a7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:04.269439 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-574cb1db-d844-47e0-abee-48cc60c340a7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:04.276445 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-574cb1db-d844-47e0-abee-48cc60c340a7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:04.276923 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-574cb1db-d844-47e0-abee-48cc60c340a7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:04.277355 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-574cb1db-d844-47e0-abee-48cc60c340a7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:04.278052 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-574cb1db-d844-47e0-abee-48cc60c340a7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:04.278499 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-574cb1db-d844-47e0-abee-48cc60c340a7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:04.278916 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-574cb1db-d844-47e0-abee-48cc60c340a7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:04.405110 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-574cb1db-d844-47e0-abee-48cc60c340a7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:04.413437 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-574cb1db-d844-47e0-abee-48cc60c340a7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.148422 Oct 11 06:54:04.414007 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 771/1578] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:04 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:05.086123 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-427015c8-b641-48af-a8ab-ceeff1a89d0a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:05.088298 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-427015c8-b641-48af-a8ab-ceeff1a89d0a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:05.094606 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-427015c8-b641-48af-a8ab-ceeff1a89d0a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:05.095083 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-427015c8-b641-48af-a8ab-ceeff1a89d0a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:05.095551 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-427015c8-b641-48af-a8ab-ceeff1a89d0a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:05.096243 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-427015c8-b641-48af-a8ab-ceeff1a89d0a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:05.096688 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-427015c8-b641-48af-a8ab-ceeff1a89d0a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:05.097107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-427015c8-b641-48af-a8ab-ceeff1a89d0a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:05.126354 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-427015c8-b641-48af-a8ab-ceeff1a89d0a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044226 Oct 11 06:54:05.126883 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 808/1579] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:05 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:05.436110 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9ef32ff8-d72e-4d59-8178-dac8f4f04ea9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:05.436715 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9ef32ff8-d72e-4d59-8178-dac8f4f04ea9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:05.443092 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9ef32ff8-d72e-4d59-8178-dac8f4f04ea9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:05.443623 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9ef32ff8-d72e-4d59-8178-dac8f4f04ea9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:05.444052 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9ef32ff8-d72e-4d59-8178-dac8f4f04ea9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:05.444743 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9ef32ff8-d72e-4d59-8178-dac8f4f04ea9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:05.445194 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9ef32ff8-d72e-4d59-8178-dac8f4f04ea9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:05.445614 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9ef32ff8-d72e-4d59-8178-dac8f4f04ea9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:05.575727 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9ef32ff8-d72e-4d59-8178-dac8f4f04ea9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:05.583755 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9ef32ff8-d72e-4d59-8178-dac8f4f04ea9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.151501 Oct 11 06:54:05.584325 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 772/1580] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:05 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:06.138796 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e7881a56-1a40-4758-8eda-ab4cae7ecd96 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:06.141040 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e7881a56-1a40-4758-8eda-ab4cae7ecd96 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:06.147313 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7881a56-1a40-4758-8eda-ab4cae7ecd96 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:06.147824 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7881a56-1a40-4758-8eda-ab4cae7ecd96 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:06.148257 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7881a56-1a40-4758-8eda-ab4cae7ecd96 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:06.148946 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7881a56-1a40-4758-8eda-ab4cae7ecd96 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:06.149394 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7881a56-1a40-4758-8eda-ab4cae7ecd96 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:06.149815 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7881a56-1a40-4758-8eda-ab4cae7ecd96 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:06.178171 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e7881a56-1a40-4758-8eda-ab4cae7ecd96 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044065 Oct 11 06:54:06.178709 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 809/1581] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:06 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:06.608073 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-33dd42e3-56ec-46dd-bd92-dfe1d81745b1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:06.608683 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-33dd42e3-56ec-46dd-bd92-dfe1d81745b1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:06.615181 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-33dd42e3-56ec-46dd-bd92-dfe1d81745b1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:06.615684 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-33dd42e3-56ec-46dd-bd92-dfe1d81745b1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:06.616120 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-33dd42e3-56ec-46dd-bd92-dfe1d81745b1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:06.616806 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-33dd42e3-56ec-46dd-bd92-dfe1d81745b1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:06.617264 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-33dd42e3-56ec-46dd-bd92-dfe1d81745b1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:06.617685 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-33dd42e3-56ec-46dd-bd92-dfe1d81745b1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:06.743536 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-33dd42e3-56ec-46dd-bd92-dfe1d81745b1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:06.751874 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-33dd42e3-56ec-46dd-bd92-dfe1d81745b1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147495 Oct 11 06:54:06.752267 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 773/1582] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:06 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:07.190204 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-029338b0-68ae-4d86-b3b3-50a9ed8c2fa3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:07.192435 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-029338b0-68ae-4d86-b3b3-50a9ed8c2fa3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:07.198867 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-029338b0-68ae-4d86-b3b3-50a9ed8c2fa3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:07.199345 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-029338b0-68ae-4d86-b3b3-50a9ed8c2fa3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:07.199897 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-029338b0-68ae-4d86-b3b3-50a9ed8c2fa3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:07.200592 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-029338b0-68ae-4d86-b3b3-50a9ed8c2fa3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:07.201042 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-029338b0-68ae-4d86-b3b3-50a9ed8c2fa3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:07.201464 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-029338b0-68ae-4d86-b3b3-50a9ed8c2fa3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:07.230776 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-029338b0-68ae-4d86-b3b3-50a9ed8c2fa3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044595 Oct 11 06:54:07.231319 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 810/1583] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:07 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:07.775310 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-07a55ae9-319f-441c-8d2e-b59fb897080a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:07.775974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-07a55ae9-319f-441c-8d2e-b59fb897080a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:07.782681 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-07a55ae9-319f-441c-8d2e-b59fb897080a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:07.783168 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-07a55ae9-319f-441c-8d2e-b59fb897080a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:07.783630 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-07a55ae9-319f-441c-8d2e-b59fb897080a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:07.784334 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-07a55ae9-319f-441c-8d2e-b59fb897080a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:07.784820 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-07a55ae9-319f-441c-8d2e-b59fb897080a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:07.785192 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-07a55ae9-319f-441c-8d2e-b59fb897080a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:07.911875 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-07a55ae9-319f-441c-8d2e-b59fb897080a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:07.921131 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-07a55ae9-319f-441c-8d2e-b59fb897080a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150121 Oct 11 06:54:07.921702 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 774/1584] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:07 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:08.242220 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e85e91bc-86c6-43c9-8e94-864621a170c6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:08.244555 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e85e91bc-86c6-43c9-8e94-864621a170c6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:08.250885 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e85e91bc-86c6-43c9-8e94-864621a170c6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:08.251364 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e85e91bc-86c6-43c9-8e94-864621a170c6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:08.251876 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e85e91bc-86c6-43c9-8e94-864621a170c6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:08.252581 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e85e91bc-86c6-43c9-8e94-864621a170c6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:08.253032 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e85e91bc-86c6-43c9-8e94-864621a170c6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:08.253456 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e85e91bc-86c6-43c9-8e94-864621a170c6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:08.283170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e85e91bc-86c6-43c9-8e94-864621a170c6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045010 Oct 11 06:54:08.283740 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 811/1585] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:08 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:08.944071 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a9df17d2-ec31-4f4f-a415-eb40d580c3ce tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:08.944676 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a9df17d2-ec31-4f4f-a415-eb40d580c3ce tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:08.951859 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a9df17d2-ec31-4f4f-a415-eb40d580c3ce tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:08.952339 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a9df17d2-ec31-4f4f-a415-eb40d580c3ce tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:08.952773 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a9df17d2-ec31-4f4f-a415-eb40d580c3ce tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:08.953466 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a9df17d2-ec31-4f4f-a415-eb40d580c3ce tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:08.953913 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a9df17d2-ec31-4f4f-a415-eb40d580c3ce tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:08.954334 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a9df17d2-ec31-4f4f-a415-eb40d580c3ce tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:09.081605 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a9df17d2-ec31-4f4f-a415-eb40d580c3ce tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:09.090170 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a9df17d2-ec31-4f4f-a415-eb40d580c3ce tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149883 Oct 11 06:54:09.090733 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 775/1586] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:08 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:09.296133 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-35fb191d-b40a-4d40-9c74-9191bb6caba1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:09.298332 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-35fb191d-b40a-4d40-9c74-9191bb6caba1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:09.304819 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-35fb191d-b40a-4d40-9c74-9191bb6caba1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:09.305289 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-35fb191d-b40a-4d40-9c74-9191bb6caba1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:09.305745 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-35fb191d-b40a-4d40-9c74-9191bb6caba1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:09.306423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-35fb191d-b40a-4d40-9c74-9191bb6caba1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:09.306865 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-35fb191d-b40a-4d40-9c74-9191bb6caba1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:09.307280 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-35fb191d-b40a-4d40-9c74-9191bb6caba1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:09.335487 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-35fb191d-b40a-4d40-9c74-9191bb6caba1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043193 Oct 11 06:54:09.335948 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 812/1587] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:09 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:10.113611 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-132e5f4d-feb0-46f0-ad2d-091bdb2d061c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:10.114193 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-132e5f4d-feb0-46f0-ad2d-091bdb2d061c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:10.121088 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-132e5f4d-feb0-46f0-ad2d-091bdb2d061c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:10.121558 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-132e5f4d-feb0-46f0-ad2d-091bdb2d061c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:10.121988 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-132e5f4d-feb0-46f0-ad2d-091bdb2d061c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:10.122672 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-132e5f4d-feb0-46f0-ad2d-091bdb2d061c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:10.123121 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-132e5f4d-feb0-46f0-ad2d-091bdb2d061c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:10.123566 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-132e5f4d-feb0-46f0-ad2d-091bdb2d061c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:10.248349 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-132e5f4d-feb0-46f0-ad2d-091bdb2d061c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:10.256406 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-132e5f4d-feb0-46f0-ad2d-091bdb2d061c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.146640 Oct 11 06:54:10.256959 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 776/1588] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:10 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:10.349033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-565244c2-1774-4d3d-bed2-146a198ac0ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:10.351167 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-565244c2-1774-4d3d-bed2-146a198ac0ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:10.358027 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-565244c2-1774-4d3d-bed2-146a198ac0ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:10.358507 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-565244c2-1774-4d3d-bed2-146a198ac0ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:10.358934 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-565244c2-1774-4d3d-bed2-146a198ac0ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:10.359657 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-565244c2-1774-4d3d-bed2-146a198ac0ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:10.360107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-565244c2-1774-4d3d-bed2-146a198ac0ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:10.360527 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-565244c2-1774-4d3d-bed2-146a198ac0ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:10.389946 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-565244c2-1774-4d3d-bed2-146a198ac0ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044875 Oct 11 06:54:10.390486 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 813/1589] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:10 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:11.280640 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7783b588-055b-45b4-a2ce-d8b0285cda46 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:11.281249 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7783b588-055b-45b4-a2ce-d8b0285cda46 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:11.287670 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7783b588-055b-45b4-a2ce-d8b0285cda46 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:11.288152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7783b588-055b-45b4-a2ce-d8b0285cda46 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:11.288589 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7783b588-055b-45b4-a2ce-d8b0285cda46 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:11.289280 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7783b588-055b-45b4-a2ce-d8b0285cda46 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:11.289734 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7783b588-055b-45b4-a2ce-d8b0285cda46 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:11.290823 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7783b588-055b-45b4-a2ce-d8b0285cda46 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:11.310333 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:54:11.402639 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-479eb312-12dc-4889-affd-0f63115b7de0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:11.405319 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-479eb312-12dc-4889-affd-0f63115b7de0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:11.411624 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-479eb312-12dc-4889-affd-0f63115b7de0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:11.412102 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-479eb312-12dc-4889-affd-0f63115b7de0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:11.412530 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-479eb312-12dc-4889-affd-0f63115b7de0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:11.413254 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-479eb312-12dc-4889-affd-0f63115b7de0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:11.413704 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-479eb312-12dc-4889-affd-0f63115b7de0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:11.414118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-479eb312-12dc-4889-affd-0f63115b7de0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:11.429414 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7783b588-055b-45b4-a2ce-d8b0285cda46 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:11.437656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7783b588-055b-45b4-a2ce-d8b0285cda46 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.160786 Oct 11 06:54:11.438227 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 777/1590] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:11 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:11.444285 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-479eb312-12dc-4889-affd-0f63115b7de0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046042 Oct 11 06:54:11.445029 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 814/1591] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:11 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:54:12.456526 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4e0042f0-cd61-48b8-a210-829fe30c2afa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:12.458673 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4e0042f0-cd61-48b8-a210-829fe30c2afa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:12.460913 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e0ec8a63-dd94-4533-86b3-ce71c2b13eb4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:12.461527 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e0ec8a63-dd94-4533-86b3-ce71c2b13eb4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:12.465237 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4e0042f0-cd61-48b8-a210-829fe30c2afa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:12.465721 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4e0042f0-cd61-48b8-a210-829fe30c2afa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:12.466155 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4e0042f0-cd61-48b8-a210-829fe30c2afa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:12.466856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4e0042f0-cd61-48b8-a210-829fe30c2afa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:12.467303 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4e0042f0-cd61-48b8-a210-829fe30c2afa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:12.467749 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4e0042f0-cd61-48b8-a210-829fe30c2afa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:12.467939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0ec8a63-dd94-4533-86b3-ce71c2b13eb4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:12.468420 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0ec8a63-dd94-4533-86b3-ce71c2b13eb4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:12.468856 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0ec8a63-dd94-4533-86b3-ce71c2b13eb4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:12.469553 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0ec8a63-dd94-4533-86b3-ce71c2b13eb4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:12.470004 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0ec8a63-dd94-4533-86b3-ce71c2b13eb4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:12.470429 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0ec8a63-dd94-4533-86b3-ce71c2b13eb4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:12.497508 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4e0042f0-cd61-48b8-a210-829fe30c2afa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044863 Oct 11 06:54:12.498060 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 778/1592] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:12 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:12.601484 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e0ec8a63-dd94-4533-86b3-ce71c2b13eb4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:12.610290 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e0ec8a63-dd94-4533-86b3-ce71c2b13eb4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.153153 Oct 11 06:54:12.610864 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 815/1593] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:12 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:54:13.509722 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1ad6d31c-c3b3-41da-9949-7ec46f1b6b2e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:13.511898 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1ad6d31c-c3b3-41da-9949-7ec46f1b6b2e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:13.518440 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1ad6d31c-c3b3-41da-9949-7ec46f1b6b2e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:13.518925 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1ad6d31c-c3b3-41da-9949-7ec46f1b6b2e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:13.519354 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1ad6d31c-c3b3-41da-9949-7ec46f1b6b2e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:13.520064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1ad6d31c-c3b3-41da-9949-7ec46f1b6b2e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:13.520514 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1ad6d31c-c3b3-41da-9949-7ec46f1b6b2e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:13.520934 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1ad6d31c-c3b3-41da-9949-7ec46f1b6b2e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:13.550120 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1ad6d31c-c3b3-41da-9949-7ec46f1b6b2e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044352 Oct 11 06:54:13.550655 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 779/1594] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:13 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:13.634146 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7285b695-835d-43f5-860d-6d7b8edad059 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:13.634758 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7285b695-835d-43f5-860d-6d7b8edad059 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:13.641359 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7285b695-835d-43f5-860d-6d7b8edad059 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:13.641831 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7285b695-835d-43f5-860d-6d7b8edad059 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:13.642259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7285b695-835d-43f5-860d-6d7b8edad059 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:13.643039 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7285b695-835d-43f5-860d-6d7b8edad059 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:13.643516 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7285b695-835d-43f5-860d-6d7b8edad059 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:13.643972 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7285b695-835d-43f5-860d-6d7b8edad059 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:13.773970 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7285b695-835d-43f5-860d-6d7b8edad059 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:13.782448 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7285b695-835d-43f5-860d-6d7b8edad059 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.152137 Oct 11 06:54:13.783002 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 816/1595] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:13 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:14.562084 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-85c470a7-5161-45c6-94f3-7be617722016 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:14.564251 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-85c470a7-5161-45c6-94f3-7be617722016 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:14.566549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=56 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:54:14.572067 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85c470a7-5161-45c6-94f3-7be617722016 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:14.572544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85c470a7-5161-45c6-94f3-7be617722016 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:14.572973 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85c470a7-5161-45c6-94f3-7be617722016 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:14.573659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85c470a7-5161-45c6-94f3-7be617722016 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:14.574107 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85c470a7-5161-45c6-94f3-7be617722016 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:14.574522 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85c470a7-5161-45c6-94f3-7be617722016 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:14.603882 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-85c470a7-5161-45c6-94f3-7be617722016 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045688 Oct 11 06:54:14.604416 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 780/1596] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:14 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:14.805972 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7641a1a0-0716-4c92-bfe5-0da9d9da917b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:14.806582 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7641a1a0-0716-4c92-bfe5-0da9d9da917b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:14.812953 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7641a1a0-0716-4c92-bfe5-0da9d9da917b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:14.813431 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7641a1a0-0716-4c92-bfe5-0da9d9da917b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:14.813862 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7641a1a0-0716-4c92-bfe5-0da9d9da917b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:14.814555 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7641a1a0-0716-4c92-bfe5-0da9d9da917b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:14.815001 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7641a1a0-0716-4c92-bfe5-0da9d9da917b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:14.815443 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7641a1a0-0716-4c92-bfe5-0da9d9da917b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:14.942836 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7641a1a0-0716-4c92-bfe5-0da9d9da917b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:14.951476 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7641a1a0-0716-4c92-bfe5-0da9d9da917b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149294 Oct 11 06:54:14.952032 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 817/1597] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:14 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:15.616086 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-34fa84b5-afdb-4e58-9654-ab497b9e4bfa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:15.618257 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-34fa84b5-afdb-4e58-9654-ab497b9e4bfa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:15.624685 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-34fa84b5-afdb-4e58-9654-ab497b9e4bfa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:15.625165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-34fa84b5-afdb-4e58-9654-ab497b9e4bfa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:15.625601 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-34fa84b5-afdb-4e58-9654-ab497b9e4bfa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:15.626296 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-34fa84b5-afdb-4e58-9654-ab497b9e4bfa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:15.626746 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-34fa84b5-afdb-4e58-9654-ab497b9e4bfa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:15.627169 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-34fa84b5-afdb-4e58-9654-ab497b9e4bfa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:15.657870 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-34fa84b5-afdb-4e58-9654-ab497b9e4bfa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045635 Oct 11 06:54:15.658348 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 781/1598] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:15 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:15.975063 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-af6932eb-d542-4946-bf46-88296c1e4e29 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:15.975627 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-af6932eb-d542-4946-bf46-88296c1e4e29 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:15.981930 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af6932eb-d542-4946-bf46-88296c1e4e29 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:15.982398 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af6932eb-d542-4946-bf46-88296c1e4e29 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:15.982820 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af6932eb-d542-4946-bf46-88296c1e4e29 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:15.983530 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af6932eb-d542-4946-bf46-88296c1e4e29 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:15.983975 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af6932eb-d542-4946-bf46-88296c1e4e29 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:15.984389 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af6932eb-d542-4946-bf46-88296c1e4e29 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:15.988333 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:54:16.110261 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-af6932eb-d542-4946-bf46-88296c1e4e29 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:16.118861 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-af6932eb-d542-4946-bf46-88296c1e4e29 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147815 Oct 11 06:54:16.119424 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 818/1599] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:15 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:16.670478 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-947f23bc-4b4a-4017-9baa-cb6372b986a3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:16.672618 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-947f23bc-4b4a-4017-9baa-cb6372b986a3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:16.679102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-947f23bc-4b4a-4017-9baa-cb6372b986a3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:16.679618 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-947f23bc-4b4a-4017-9baa-cb6372b986a3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:16.680054 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-947f23bc-4b4a-4017-9baa-cb6372b986a3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:16.680739 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-947f23bc-4b4a-4017-9baa-cb6372b986a3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:16.681185 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-947f23bc-4b4a-4017-9baa-cb6372b986a3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:16.681602 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-947f23bc-4b4a-4017-9baa-cb6372b986a3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:16.709755 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-947f23bc-4b4a-4017-9baa-cb6372b986a3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043124 Oct 11 06:54:16.710287 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 782/1600] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:16 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:17.142186 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c0f38ef9-706f-45b7-a147-9fc9e67270f1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:17.142817 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c0f38ef9-706f-45b7-a147-9fc9e67270f1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:17.149180 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c0f38ef9-706f-45b7-a147-9fc9e67270f1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:17.150243 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c0f38ef9-706f-45b7-a147-9fc9e67270f1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:17.150672 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c0f38ef9-706f-45b7-a147-9fc9e67270f1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:17.151361 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c0f38ef9-706f-45b7-a147-9fc9e67270f1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:17.151842 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c0f38ef9-706f-45b7-a147-9fc9e67270f1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:17.152265 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c0f38ef9-706f-45b7-a147-9fc9e67270f1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:17.281905 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c0f38ef9-706f-45b7-a147-9fc9e67270f1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:17.291676 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c0f38ef9-706f-45b7-a147-9fc9e67270f1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.153433 Oct 11 06:54:17.292440 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 819/1601] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:17 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:17.722124 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-eb73dde2-db17-493e-8aad-9537cf316955 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:17.724417 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-eb73dde2-db17-493e-8aad-9537cf316955 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:17.731239 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eb73dde2-db17-493e-8aad-9537cf316955 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:17.731805 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eb73dde2-db17-493e-8aad-9537cf316955 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:17.732430 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eb73dde2-db17-493e-8aad-9537cf316955 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:17.733136 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eb73dde2-db17-493e-8aad-9537cf316955 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:17.733590 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eb73dde2-db17-493e-8aad-9537cf316955 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:17.734011 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eb73dde2-db17-493e-8aad-9537cf316955 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:17.764625 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-eb73dde2-db17-493e-8aad-9537cf316955 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046310 Oct 11 06:54:17.765346 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 783/1602] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:17 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:18.315363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fc36084f-737d-4ef6-9638-d8ae15e8db9f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:18.316000 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fc36084f-737d-4ef6-9638-d8ae15e8db9f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:18.322922 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fc36084f-737d-4ef6-9638-d8ae15e8db9f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:18.323397 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fc36084f-737d-4ef6-9638-d8ae15e8db9f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:18.323844 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fc36084f-737d-4ef6-9638-d8ae15e8db9f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:18.324525 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fc36084f-737d-4ef6-9638-d8ae15e8db9f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:18.324967 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fc36084f-737d-4ef6-9638-d8ae15e8db9f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:18.325383 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fc36084f-737d-4ef6-9638-d8ae15e8db9f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:18.450807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fc36084f-737d-4ef6-9638-d8ae15e8db9f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:18.459055 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fc36084f-737d-4ef6-9638-d8ae15e8db9f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147492 Oct 11 06:54:18.459642 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 820/1603] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:18 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:18.777276 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-39a8596b-79cb-46a9-ac40-a78628497d7e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:18.779433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-39a8596b-79cb-46a9-ac40-a78628497d7e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:18.785887 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-39a8596b-79cb-46a9-ac40-a78628497d7e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:18.786376 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-39a8596b-79cb-46a9-ac40-a78628497d7e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:18.786811 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-39a8596b-79cb-46a9-ac40-a78628497d7e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:18.787540 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-39a8596b-79cb-46a9-ac40-a78628497d7e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:18.787994 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-39a8596b-79cb-46a9-ac40-a78628497d7e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:18.788413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-39a8596b-79cb-46a9-ac40-a78628497d7e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:18.817534 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-39a8596b-79cb-46a9-ac40-a78628497d7e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044745 Oct 11 06:54:18.818108 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 784/1604] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:18 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:19.481798 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d57e57a7-1d50-4fc8-ad03-c77c23b66bfe tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:19.482337 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d57e57a7-1d50-4fc8-ad03-c77c23b66bfe tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:19.488604 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d57e57a7-1d50-4fc8-ad03-c77c23b66bfe tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:19.489078 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d57e57a7-1d50-4fc8-ad03-c77c23b66bfe tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:19.489507 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d57e57a7-1d50-4fc8-ad03-c77c23b66bfe tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:19.490196 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d57e57a7-1d50-4fc8-ad03-c77c23b66bfe tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:19.490642 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d57e57a7-1d50-4fc8-ad03-c77c23b66bfe tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:19.491067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d57e57a7-1d50-4fc8-ad03-c77c23b66bfe tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:19.619030 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d57e57a7-1d50-4fc8-ad03-c77c23b66bfe tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:19.627077 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d57e57a7-1d50-4fc8-ad03-c77c23b66bfe tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149718 Oct 11 06:54:19.627658 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 821/1605] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:19 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:19.830290 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2fa4fb92-d000-4ca8-b94c-6e7b2d8dee53 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:19.832477 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2fa4fb92-d000-4ca8-b94c-6e7b2d8dee53 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:19.839363 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2fa4fb92-d000-4ca8-b94c-6e7b2d8dee53 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:19.840042 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2fa4fb92-d000-4ca8-b94c-6e7b2d8dee53 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:19.840509 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2fa4fb92-d000-4ca8-b94c-6e7b2d8dee53 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:19.841215 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2fa4fb92-d000-4ca8-b94c-6e7b2d8dee53 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:19.841666 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2fa4fb92-d000-4ca8-b94c-6e7b2d8dee53 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:19.842090 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2fa4fb92-d000-4ca8-b94c-6e7b2d8dee53 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:19.871575 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2fa4fb92-d000-4ca8-b94c-6e7b2d8dee53 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045223 Oct 11 06:54:19.872118 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 785/1606] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:19 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:20.651496 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7747b529-232c-4781-871a-be4b76a7105d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:20.652094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7747b529-232c-4781-871a-be4b76a7105d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:20.658381 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7747b529-232c-4781-871a-be4b76a7105d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:20.658788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7747b529-232c-4781-871a-be4b76a7105d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:20.659208 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7747b529-232c-4781-871a-be4b76a7105d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:20.659912 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7747b529-232c-4781-871a-be4b76a7105d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:20.660351 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7747b529-232c-4781-871a-be4b76a7105d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:20.660762 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7747b529-232c-4781-871a-be4b76a7105d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:20.790976 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7747b529-232c-4781-871a-be4b76a7105d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:20.799206 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7747b529-232c-4781-871a-be4b76a7105d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.151524 Oct 11 06:54:20.799849 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 822/1607] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:20 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:20.883101 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9647da43-7b47-4c82-aac1-fc4b42640452 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:20.885324 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9647da43-7b47-4c82-aac1-fc4b42640452 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:20.891888 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9647da43-7b47-4c82-aac1-fc4b42640452 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:20.892367 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9647da43-7b47-4c82-aac1-fc4b42640452 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:20.892798 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9647da43-7b47-4c82-aac1-fc4b42640452 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:20.893590 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9647da43-7b47-4c82-aac1-fc4b42640452 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:20.894028 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9647da43-7b47-4c82-aac1-fc4b42640452 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:20.894445 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9647da43-7b47-4c82-aac1-fc4b42640452 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:20.923957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9647da43-7b47-4c82-aac1-fc4b42640452 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044607 Oct 11 06:54:20.924421 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 786/1608] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:20 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:21.823970 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ffe7fe5c-1bf2-4344-b77f-44e65e1cf357 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:21.824519 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ffe7fe5c-1bf2-4344-b77f-44e65e1cf357 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:21.830510 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ffe7fe5c-1bf2-4344-b77f-44e65e1cf357 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:21.830994 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ffe7fe5c-1bf2-4344-b77f-44e65e1cf357 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:21.831437 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ffe7fe5c-1bf2-4344-b77f-44e65e1cf357 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:21.832118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ffe7fe5c-1bf2-4344-b77f-44e65e1cf357 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:21.832557 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ffe7fe5c-1bf2-4344-b77f-44e65e1cf357 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:21.832972 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ffe7fe5c-1bf2-4344-b77f-44e65e1cf357 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:21.937004 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b8b0936a-b0f0-4a2e-8c17-016adbb50486 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:21.939222 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b8b0936a-b0f0-4a2e-8c17-016adbb50486 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:21.946038 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8b0936a-b0f0-4a2e-8c17-016adbb50486 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:21.947102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8b0936a-b0f0-4a2e-8c17-016adbb50486 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:21.947565 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8b0936a-b0f0-4a2e-8c17-016adbb50486 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:21.948341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8b0936a-b0f0-4a2e-8c17-016adbb50486 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:21.948791 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8b0936a-b0f0-4a2e-8c17-016adbb50486 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:21.949444 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8b0936a-b0f0-4a2e-8c17-016adbb50486 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:21.958863 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ffe7fe5c-1bf2-4344-b77f-44e65e1cf357 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:21.967216 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ffe7fe5c-1bf2-4344-b77f-44e65e1cf357 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147879 Oct 11 06:54:21.967793 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 823/1609] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:21 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:21.984080 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b8b0936a-b0f0-4a2e-8c17-016adbb50486 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051240 Oct 11 06:54:21.984624 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 787/1610] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:21 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:22.989888 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f6c44416-6b76-4aae-b590-d1fab49d78eb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:22.990501 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f6c44416-6b76-4aae-b590-d1fab49d78eb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:22.996567 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-862c4c18-778d-4f5c-9747-89ede55c6b73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:22.997264 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f6c44416-6b76-4aae-b590-d1fab49d78eb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:22.997830 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f6c44416-6b76-4aae-b590-d1fab49d78eb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:22.998165 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f6c44416-6b76-4aae-b590-d1fab49d78eb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:22.998868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f6c44416-6b76-4aae-b590-d1fab49d78eb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:22.998984 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-862c4c18-778d-4f5c-9747-89ede55c6b73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:22.999322 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f6c44416-6b76-4aae-b590-d1fab49d78eb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:22.999837 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f6c44416-6b76-4aae-b590-d1fab49d78eb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:23.005486 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-862c4c18-778d-4f5c-9747-89ede55c6b73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:23.005913 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-862c4c18-778d-4f5c-9747-89ede55c6b73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:23.006386 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-862c4c18-778d-4f5c-9747-89ede55c6b73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:23.007087 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-862c4c18-778d-4f5c-9747-89ede55c6b73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:23.007696 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-862c4c18-778d-4f5c-9747-89ede55c6b73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:23.008122 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-862c4c18-778d-4f5c-9747-89ede55c6b73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:23.038965 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-862c4c18-778d-4f5c-9747-89ede55c6b73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046633 Oct 11 06:54:23.039784 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 788/1611] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:22 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:54:23.133342 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f6c44416-6b76-4aae-b590-d1fab49d78eb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:23.142102 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f6c44416-6b76-4aae-b590-d1fab49d78eb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.156019 Oct 11 06:54:23.142654 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 824/1612] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:22 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:24.051055 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5aed4fa8-57e3-4c1f-8df6-d58551b3262a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:24.053245 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5aed4fa8-57e3-4c1f-8df6-d58551b3262a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:24.059474 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5aed4fa8-57e3-4c1f-8df6-d58551b3262a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:24.059873 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5aed4fa8-57e3-4c1f-8df6-d58551b3262a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:24.060289 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5aed4fa8-57e3-4c1f-8df6-d58551b3262a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:24.060986 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5aed4fa8-57e3-4c1f-8df6-d58551b3262a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:24.061441 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5aed4fa8-57e3-4c1f-8df6-d58551b3262a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:24.061860 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5aed4fa8-57e3-4c1f-8df6-d58551b3262a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:24.091637 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5aed4fa8-57e3-4c1f-8df6-d58551b3262a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044452 Oct 11 06:54:24.092182 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 789/1613] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:24 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:24.166534 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-02c97b5a-a927-4b3e-b7ab-ca019dab7243 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:24.167135 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-02c97b5a-a927-4b3e-b7ab-ca019dab7243 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:24.173464 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02c97b5a-a927-4b3e-b7ab-ca019dab7243 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:24.173936 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02c97b5a-a927-4b3e-b7ab-ca019dab7243 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:24.174365 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02c97b5a-a927-4b3e-b7ab-ca019dab7243 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:24.175046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02c97b5a-a927-4b3e-b7ab-ca019dab7243 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:24.175514 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02c97b5a-a927-4b3e-b7ab-ca019dab7243 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:24.175932 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02c97b5a-a927-4b3e-b7ab-ca019dab7243 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:24.303012 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-02c97b5a-a927-4b3e-b7ab-ca019dab7243 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:24.311050 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-02c97b5a-a927-4b3e-b7ab-ca019dab7243 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149230 Oct 11 06:54:24.311637 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 825/1614] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:24 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:25.103667 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9fa8d920-30ee-41c5-9c6b-221874ae819d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:25.105819 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9fa8d920-30ee-41c5-9c6b-221874ae819d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:25.112133 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9fa8d920-30ee-41c5-9c6b-221874ae819d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:25.112606 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9fa8d920-30ee-41c5-9c6b-221874ae819d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:25.113039 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9fa8d920-30ee-41c5-9c6b-221874ae819d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:25.113722 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9fa8d920-30ee-41c5-9c6b-221874ae819d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:25.114169 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9fa8d920-30ee-41c5-9c6b-221874ae819d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:25.114612 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9fa8d920-30ee-41c5-9c6b-221874ae819d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:25.145577 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9fa8d920-30ee-41c5-9c6b-221874ae819d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045831 Oct 11 06:54:25.146271 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 790/1615] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:25 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:25.334070 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8f674913-e67c-4a5d-80ab-716b197f7ead tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:25.334681 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8f674913-e67c-4a5d-80ab-716b197f7ead tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:25.341042 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f674913-e67c-4a5d-80ab-716b197f7ead tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:25.341515 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f674913-e67c-4a5d-80ab-716b197f7ead tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:25.341939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f674913-e67c-4a5d-80ab-716b197f7ead tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:25.342625 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f674913-e67c-4a5d-80ab-716b197f7ead tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:25.343124 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f674913-e67c-4a5d-80ab-716b197f7ead tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:25.343514 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f674913-e67c-4a5d-80ab-716b197f7ead tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:25.470405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8f674913-e67c-4a5d-80ab-716b197f7ead tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:25.478954 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8f674913-e67c-4a5d-80ab-716b197f7ead tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.148929 Oct 11 06:54:25.479526 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 826/1616] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:25 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:26.156926 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bc13153d-4b36-48d8-8e61-3efd334ce31a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:26.159067 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bc13153d-4b36-48d8-8e61-3efd334ce31a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:26.165223 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bc13153d-4b36-48d8-8e61-3efd334ce31a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:26.165722 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bc13153d-4b36-48d8-8e61-3efd334ce31a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:26.166141 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bc13153d-4b36-48d8-8e61-3efd334ce31a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:26.166834 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bc13153d-4b36-48d8-8e61-3efd334ce31a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:26.167286 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bc13153d-4b36-48d8-8e61-3efd334ce31a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:26.167733 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bc13153d-4b36-48d8-8e61-3efd334ce31a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:26.196660 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bc13153d-4b36-48d8-8e61-3efd334ce31a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043114 Oct 11 06:54:26.197202 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 791/1617] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:26 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:26.502097 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6f912b39-b3ef-4214-983e-88738ef6f2b4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:26.502708 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6f912b39-b3ef-4214-983e-88738ef6f2b4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:26.509200 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f912b39-b3ef-4214-983e-88738ef6f2b4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:26.510352 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f912b39-b3ef-4214-983e-88738ef6f2b4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:26.510783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f912b39-b3ef-4214-983e-88738ef6f2b4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:26.511491 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f912b39-b3ef-4214-983e-88738ef6f2b4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:26.511941 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f912b39-b3ef-4214-983e-88738ef6f2b4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:26.512359 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f912b39-b3ef-4214-983e-88738ef6f2b4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:26.640666 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6f912b39-b3ef-4214-983e-88738ef6f2b4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:26.648721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6f912b39-b3ef-4214-983e-88738ef6f2b4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150446 Oct 11 06:54:26.649274 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 827/1618] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:26 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:27.209115 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a66b965c-7d17-4dbc-976c-30a720d83eed tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:27.211288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a66b965c-7d17-4dbc-976c-30a720d83eed tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:27.217479 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a66b965c-7d17-4dbc-976c-30a720d83eed tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:27.217968 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a66b965c-7d17-4dbc-976c-30a720d83eed tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:27.218435 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a66b965c-7d17-4dbc-976c-30a720d83eed tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:27.219143 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a66b965c-7d17-4dbc-976c-30a720d83eed tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:27.219623 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a66b965c-7d17-4dbc-976c-30a720d83eed tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:27.220046 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a66b965c-7d17-4dbc-976c-30a720d83eed tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:27.250500 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a66b965c-7d17-4dbc-976c-30a720d83eed tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045486 Oct 11 06:54:27.251065 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 792/1619] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:27 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:27.671461 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3d892786-fc1c-42b2-aff7-0ec9423ed2aa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:27.672104 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3d892786-fc1c-42b2-aff7-0ec9423ed2aa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:27.678441 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3d892786-fc1c-42b2-aff7-0ec9423ed2aa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:27.678914 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3d892786-fc1c-42b2-aff7-0ec9423ed2aa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:27.679345 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3d892786-fc1c-42b2-aff7-0ec9423ed2aa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:27.680150 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3d892786-fc1c-42b2-aff7-0ec9423ed2aa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:27.680595 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3d892786-fc1c-42b2-aff7-0ec9423ed2aa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:27.681017 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3d892786-fc1c-42b2-aff7-0ec9423ed2aa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:27.809349 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3d892786-fc1c-42b2-aff7-0ec9423ed2aa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:27.817487 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3d892786-fc1c-42b2-aff7-0ec9423ed2aa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149885 Oct 11 06:54:27.818037 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 828/1620] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:27 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:28.264093 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-779d2e2c-5162-4b19-afd2-f8dfada5b8b7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:28.266312 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-779d2e2c-5162-4b19-afd2-f8dfada5b8b7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:28.272765 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-779d2e2c-5162-4b19-afd2-f8dfada5b8b7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:28.273245 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-779d2e2c-5162-4b19-afd2-f8dfada5b8b7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:28.273673 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-779d2e2c-5162-4b19-afd2-f8dfada5b8b7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:28.274422 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-779d2e2c-5162-4b19-afd2-f8dfada5b8b7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:28.275071 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-779d2e2c-5162-4b19-afd2-f8dfada5b8b7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:28.276101 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-779d2e2c-5162-4b19-afd2-f8dfada5b8b7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:28.305762 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-779d2e2c-5162-4b19-afd2-f8dfada5b8b7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046532 Oct 11 06:54:28.306308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 793/1621] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:28 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:28.841007 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0ba0000f-305c-495b-ac44-73b0bb5ae9c5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:28.841604 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0ba0000f-305c-495b-ac44-73b0bb5ae9c5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:28.847969 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0ba0000f-305c-495b-ac44-73b0bb5ae9c5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:28.848436 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0ba0000f-305c-495b-ac44-73b0bb5ae9c5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:28.848859 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0ba0000f-305c-495b-ac44-73b0bb5ae9c5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:28.849535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0ba0000f-305c-495b-ac44-73b0bb5ae9c5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:28.849979 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0ba0000f-305c-495b-ac44-73b0bb5ae9c5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:28.850392 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0ba0000f-305c-495b-ac44-73b0bb5ae9c5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:28.981010 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0ba0000f-305c-495b-ac44-73b0bb5ae9c5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:28.989231 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0ba0000f-305c-495b-ac44-73b0bb5ae9c5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.152553 Oct 11 06:54:28.989790 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 829/1622] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:28 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:29.318170 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a1b251a4-48cf-45f1-a729-8acc12cd5f46 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:29.320364 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a1b251a4-48cf-45f1-a729-8acc12cd5f46 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:29.327311 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a1b251a4-48cf-45f1-a729-8acc12cd5f46 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:29.327821 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a1b251a4-48cf-45f1-a729-8acc12cd5f46 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:29.328256 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a1b251a4-48cf-45f1-a729-8acc12cd5f46 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:29.328948 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a1b251a4-48cf-45f1-a729-8acc12cd5f46 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:29.329405 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a1b251a4-48cf-45f1-a729-8acc12cd5f46 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:29.329826 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a1b251a4-48cf-45f1-a729-8acc12cd5f46 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:29.343610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:54:29.359306 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a1b251a4-48cf-45f1-a729-8acc12cd5f46 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045082 Oct 11 06:54:29.359885 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 794/1623] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:29 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:30.012404 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fc0a7bb9-6abf-405a-ab47-d9831023d63a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:30.013008 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fc0a7bb9-6abf-405a-ab47-d9831023d63a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:30.019353 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fc0a7bb9-6abf-405a-ab47-d9831023d63a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:30.019846 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fc0a7bb9-6abf-405a-ab47-d9831023d63a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:30.020275 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fc0a7bb9-6abf-405a-ab47-d9831023d63a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:30.020956 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fc0a7bb9-6abf-405a-ab47-d9831023d63a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:30.021396 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fc0a7bb9-6abf-405a-ab47-d9831023d63a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:30.021810 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fc0a7bb9-6abf-405a-ab47-d9831023d63a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:30.145848 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fc0a7bb9-6abf-405a-ab47-d9831023d63a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:30.153906 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fc0a7bb9-6abf-405a-ab47-d9831023d63a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.146076 Oct 11 06:54:30.154460 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 830/1624] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:30 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:30.372235 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2bd5a1a3-11f6-4cd5-9b52-14adca43c396 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:30.374384 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2bd5a1a3-11f6-4cd5-9b52-14adca43c396 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:30.380855 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2bd5a1a3-11f6-4cd5-9b52-14adca43c396 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:30.381274 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2bd5a1a3-11f6-4cd5-9b52-14adca43c396 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:30.381701 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2bd5a1a3-11f6-4cd5-9b52-14adca43c396 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:30.382383 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2bd5a1a3-11f6-4cd5-9b52-14adca43c396 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:30.382828 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2bd5a1a3-11f6-4cd5-9b52-14adca43c396 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:30.383245 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2bd5a1a3-11f6-4cd5-9b52-14adca43c396 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:30.418216 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2bd5a1a3-11f6-4cd5-9b52-14adca43c396 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050360 Oct 11 06:54:30.418776 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 795/1625] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:30 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:31.176772 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b682bc14-f044-48b9-821c-14ae40f512dc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:31.177419 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b682bc14-f044-48b9-821c-14ae40f512dc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:31.184393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b682bc14-f044-48b9-821c-14ae40f512dc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:31.184871 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b682bc14-f044-48b9-821c-14ae40f512dc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:31.185303 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b682bc14-f044-48b9-821c-14ae40f512dc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:31.185991 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b682bc14-f044-48b9-821c-14ae40f512dc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:31.186440 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b682bc14-f044-48b9-821c-14ae40f512dc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:31.186860 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b682bc14-f044-48b9-821c-14ae40f512dc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:31.315145 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b682bc14-f044-48b9-821c-14ae40f512dc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:31.323267 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b682bc14-f044-48b9-821c-14ae40f512dc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150307 Oct 11 06:54:31.323852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 831/1626] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:31 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:31.430323 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-71250a41-f22f-4a20-a47f-9d0cea7cf670 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:31.432513 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-71250a41-f22f-4a20-a47f-9d0cea7cf670 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:31.438891 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-71250a41-f22f-4a20-a47f-9d0cea7cf670 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:31.439354 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-71250a41-f22f-4a20-a47f-9d0cea7cf670 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:31.440074 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-71250a41-f22f-4a20-a47f-9d0cea7cf670 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:31.440776 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-71250a41-f22f-4a20-a47f-9d0cea7cf670 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:31.441230 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-71250a41-f22f-4a20-a47f-9d0cea7cf670 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:31.441654 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-71250a41-f22f-4a20-a47f-9d0cea7cf670 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:31.471821 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-71250a41-f22f-4a20-a47f-9d0cea7cf670 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045308 Oct 11 06:54:31.472245 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 796/1627] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:31 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:32.346362 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d8a5d2fc-fc5e-4d37-a750-69cd43fe282b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:32.346873 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d8a5d2fc-fc5e-4d37-a750-69cd43fe282b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:32.349278 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=54 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:54:32.354493 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8a5d2fc-fc5e-4d37-a750-69cd43fe282b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:32.354959 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8a5d2fc-fc5e-4d37-a750-69cd43fe282b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:32.355386 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8a5d2fc-fc5e-4d37-a750-69cd43fe282b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:32.356088 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8a5d2fc-fc5e-4d37-a750-69cd43fe282b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:32.356528 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8a5d2fc-fc5e-4d37-a750-69cd43fe282b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:32.356941 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8a5d2fc-fc5e-4d37-a750-69cd43fe282b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:32.482142 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d8a5d2fc-fc5e-4d37-a750-69cd43fe282b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:32.484269 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-261ca7a7-e7d4-4c6e-93ee-02b3bfd1c417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:32.486418 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-261ca7a7-e7d4-4c6e-93ee-02b3bfd1c417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:32.490314 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d8a5d2fc-fc5e-4d37-a750-69cd43fe282b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147837 Oct 11 06:54:32.490872 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 832/1628] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:32 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:32.492754 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-261ca7a7-e7d4-4c6e-93ee-02b3bfd1c417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:32.493228 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-261ca7a7-e7d4-4c6e-93ee-02b3bfd1c417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:32.493654 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-261ca7a7-e7d4-4c6e-93ee-02b3bfd1c417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:32.494348 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-261ca7a7-e7d4-4c6e-93ee-02b3bfd1c417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:32.494792 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-261ca7a7-e7d4-4c6e-93ee-02b3bfd1c417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:32.495210 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-261ca7a7-e7d4-4c6e-93ee-02b3bfd1c417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:32.525776 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-261ca7a7-e7d4-4c6e-93ee-02b3bfd1c417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044743 Oct 11 06:54:32.526328 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 797/1629] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:32 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:54:33.514039 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5f00a2b3-1d88-4e40-842d-046bdad2c249 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:33.514688 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5f00a2b3-1d88-4e40-842d-046bdad2c249 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:33.521204 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5f00a2b3-1d88-4e40-842d-046bdad2c249 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:33.521684 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5f00a2b3-1d88-4e40-842d-046bdad2c249 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:33.522119 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5f00a2b3-1d88-4e40-842d-046bdad2c249 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:33.522810 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5f00a2b3-1d88-4e40-842d-046bdad2c249 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:33.523299 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5f00a2b3-1d88-4e40-842d-046bdad2c249 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:33.523758 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5f00a2b3-1d88-4e40-842d-046bdad2c249 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:33.537997 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d854c243-640d-457a-8ccc-7cdd46484aac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:33.540202 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d854c243-640d-457a-8ccc-7cdd46484aac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:33.547226 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d854c243-640d-457a-8ccc-7cdd46484aac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:33.547742 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d854c243-640d-457a-8ccc-7cdd46484aac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:33.548176 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d854c243-640d-457a-8ccc-7cdd46484aac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:33.548880 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d854c243-640d-457a-8ccc-7cdd46484aac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:33.549331 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d854c243-640d-457a-8ccc-7cdd46484aac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:33.549752 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d854c243-640d-457a-8ccc-7cdd46484aac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:33.579569 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d854c243-640d-457a-8ccc-7cdd46484aac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045436 Oct 11 06:54:33.580317 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 798/1630] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:33 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:54:33.654529 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5f00a2b3-1d88-4e40-842d-046bdad2c249 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:33.663048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5f00a2b3-1d88-4e40-842d-046bdad2c249 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.153051 Oct 11 06:54:33.663947 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 833/1631] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:33 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:34.592495 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c3725f8a-864f-42bd-b082-80b0f8ac29f1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:34.594538 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c3725f8a-864f-42bd-b082-80b0f8ac29f1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:34.600843 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c3725f8a-864f-42bd-b082-80b0f8ac29f1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:34.601316 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c3725f8a-864f-42bd-b082-80b0f8ac29f1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:34.601742 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c3725f8a-864f-42bd-b082-80b0f8ac29f1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:34.602424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c3725f8a-864f-42bd-b082-80b0f8ac29f1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:34.602870 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c3725f8a-864f-42bd-b082-80b0f8ac29f1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:34.603289 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c3725f8a-864f-42bd-b082-80b0f8ac29f1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:34.633545 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c3725f8a-864f-42bd-b082-80b0f8ac29f1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045408 Oct 11 06:54:34.634100 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 799/1632] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:34 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:34.687555 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-35f7367b-3ab8-43fb-b460-03ab8bd5b46e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:34.688163 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-35f7367b-3ab8-43fb-b460-03ab8bd5b46e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:34.694511 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-35f7367b-3ab8-43fb-b460-03ab8bd5b46e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:34.695000 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-35f7367b-3ab8-43fb-b460-03ab8bd5b46e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:34.695484 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-35f7367b-3ab8-43fb-b460-03ab8bd5b46e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:34.696208 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-35f7367b-3ab8-43fb-b460-03ab8bd5b46e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:34.696661 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-35f7367b-3ab8-43fb-b460-03ab8bd5b46e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:34.697084 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-35f7367b-3ab8-43fb-b460-03ab8bd5b46e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:34.827375 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-35f7367b-3ab8-43fb-b460-03ab8bd5b46e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:34.830800 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:54:34.836819 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-35f7367b-3ab8-43fb-b460-03ab8bd5b46e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.153193 Oct 11 06:54:34.837389 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 834/1633] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:34 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:35.645743 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bd20ee73-5077-482e-b35e-db352849e8b1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:35.647905 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bd20ee73-5077-482e-b35e-db352849e8b1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:35.654648 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bd20ee73-5077-482e-b35e-db352849e8b1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:35.655123 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bd20ee73-5077-482e-b35e-db352849e8b1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:35.655588 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bd20ee73-5077-482e-b35e-db352849e8b1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:35.656270 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bd20ee73-5077-482e-b35e-db352849e8b1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:35.656716 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bd20ee73-5077-482e-b35e-db352849e8b1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:35.657131 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bd20ee73-5077-482e-b35e-db352849e8b1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:35.687140 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bd20ee73-5077-482e-b35e-db352849e8b1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045316 Oct 11 06:54:35.687709 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 800/1634] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:35 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:35.859272 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-29decba9-4f9f-48f9-ab6d-013157f84bc4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:35.859910 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-29decba9-4f9f-48f9-ab6d-013157f84bc4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:35.866255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-29decba9-4f9f-48f9-ab6d-013157f84bc4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:35.866728 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-29decba9-4f9f-48f9-ab6d-013157f84bc4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:35.867159 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-29decba9-4f9f-48f9-ab6d-013157f84bc4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:35.867878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-29decba9-4f9f-48f9-ab6d-013157f84bc4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:35.868326 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-29decba9-4f9f-48f9-ab6d-013157f84bc4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:35.868745 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-29decba9-4f9f-48f9-ab6d-013157f84bc4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:35.997141 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-29decba9-4f9f-48f9-ab6d-013157f84bc4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:36.005199 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-29decba9-4f9f-48f9-ab6d-013157f84bc4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149982 Oct 11 06:54:36.005754 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 835/1635] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:35 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:36.699441 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e0bfa2aa-3ac7-49bf-acd3-d1b49c027d88 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:36.701613 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e0bfa2aa-3ac7-49bf-acd3-d1b49c027d88 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:36.708073 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e0bfa2aa-3ac7-49bf-acd3-d1b49c027d88 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:36.708554 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e0bfa2aa-3ac7-49bf-acd3-d1b49c027d88 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:36.708985 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e0bfa2aa-3ac7-49bf-acd3-d1b49c027d88 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:36.709675 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e0bfa2aa-3ac7-49bf-acd3-d1b49c027d88 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:36.710192 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e0bfa2aa-3ac7-49bf-acd3-d1b49c027d88 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:36.710551 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e0bfa2aa-3ac7-49bf-acd3-d1b49c027d88 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:36.740759 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e0bfa2aa-3ac7-49bf-acd3-d1b49c027d88 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045274 Oct 11 06:54:36.741323 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 801/1636] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:36 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:37.028197 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-34beaba7-b9c3-4592-a27d-e155e9ef2327 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:37.028807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-34beaba7-b9c3-4592-a27d-e155e9ef2327 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:37.035241 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-34beaba7-b9c3-4592-a27d-e155e9ef2327 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:37.035754 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-34beaba7-b9c3-4592-a27d-e155e9ef2327 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:37.036189 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-34beaba7-b9c3-4592-a27d-e155e9ef2327 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:37.036887 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-34beaba7-b9c3-4592-a27d-e155e9ef2327 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:37.037333 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-34beaba7-b9c3-4592-a27d-e155e9ef2327 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:37.037791 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-34beaba7-b9c3-4592-a27d-e155e9ef2327 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:37.167305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-34beaba7-b9c3-4592-a27d-e155e9ef2327 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:37.175457 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-34beaba7-b9c3-4592-a27d-e155e9ef2327 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.151640 Oct 11 06:54:37.176017 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 836/1637] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:37 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:37.753064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-af415b61-2c7b-4ea9-b606-77b96dc36a4a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:37.755240 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-af415b61-2c7b-4ea9-b606-77b96dc36a4a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:37.761720 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-af415b61-2c7b-4ea9-b606-77b96dc36a4a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:37.762206 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-af415b61-2c7b-4ea9-b606-77b96dc36a4a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:37.762649 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-af415b61-2c7b-4ea9-b606-77b96dc36a4a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:37.763354 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-af415b61-2c7b-4ea9-b606-77b96dc36a4a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:37.764126 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-af415b61-2c7b-4ea9-b606-77b96dc36a4a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:37.764553 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-af415b61-2c7b-4ea9-b606-77b96dc36a4a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:37.794050 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-af415b61-2c7b-4ea9-b606-77b96dc36a4a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044794 Oct 11 06:54:37.794839 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 802/1638] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:37 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:38.198890 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a601e14f-d977-44bb-a3fa-66cac7606fe7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:38.199519 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a601e14f-d977-44bb-a3fa-66cac7606fe7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:38.205938 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a601e14f-d977-44bb-a3fa-66cac7606fe7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:38.206416 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a601e14f-d977-44bb-a3fa-66cac7606fe7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:38.206846 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a601e14f-d977-44bb-a3fa-66cac7606fe7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:38.207566 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a601e14f-d977-44bb-a3fa-66cac7606fe7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:38.208020 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a601e14f-d977-44bb-a3fa-66cac7606fe7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:38.208443 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a601e14f-d977-44bb-a3fa-66cac7606fe7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:38.333960 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a601e14f-d977-44bb-a3fa-66cac7606fe7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:38.342810 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a601e14f-d977-44bb-a3fa-66cac7606fe7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147803 Oct 11 06:54:38.343369 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 837/1639] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:38 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:38.806186 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-14fba8ae-9e9e-4110-be0b-1580a1b2420b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:38.808278 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-14fba8ae-9e9e-4110-be0b-1580a1b2420b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:38.815103 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14fba8ae-9e9e-4110-be0b-1580a1b2420b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:38.815609 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14fba8ae-9e9e-4110-be0b-1580a1b2420b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:38.816040 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14fba8ae-9e9e-4110-be0b-1580a1b2420b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:38.816720 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14fba8ae-9e9e-4110-be0b-1580a1b2420b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:38.817163 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14fba8ae-9e9e-4110-be0b-1580a1b2420b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:38.817575 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14fba8ae-9e9e-4110-be0b-1580a1b2420b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:38.846470 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-14fba8ae-9e9e-4110-be0b-1580a1b2420b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044293 Oct 11 06:54:38.846996 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 803/1640] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:38 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:39.366325 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7d246fc6-bc60-443f-a095-da4e869fdef9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:39.366952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7d246fc6-bc60-443f-a095-da4e869fdef9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:39.373301 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d246fc6-bc60-443f-a095-da4e869fdef9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:39.373776 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d246fc6-bc60-443f-a095-da4e869fdef9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:39.374207 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d246fc6-bc60-443f-a095-da4e869fdef9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:39.374897 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d246fc6-bc60-443f-a095-da4e869fdef9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:39.375342 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d246fc6-bc60-443f-a095-da4e869fdef9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:39.375787 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d246fc6-bc60-443f-a095-da4e869fdef9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:39.504851 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7d246fc6-bc60-443f-a095-da4e869fdef9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:39.512994 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7d246fc6-bc60-443f-a095-da4e869fdef9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150493 Oct 11 06:54:39.513805 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 838/1641] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:39 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:39.858605 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-42a3be52-a0ba-4f5b-b850-bb159fa71821 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:39.860847 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-42a3be52-a0ba-4f5b-b850-bb159fa71821 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:39.867135 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42a3be52-a0ba-4f5b-b850-bb159fa71821 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:39.867652 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42a3be52-a0ba-4f5b-b850-bb159fa71821 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:39.868084 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42a3be52-a0ba-4f5b-b850-bb159fa71821 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:39.868766 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42a3be52-a0ba-4f5b-b850-bb159fa71821 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:39.869208 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42a3be52-a0ba-4f5b-b850-bb159fa71821 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:39.869621 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42a3be52-a0ba-4f5b-b850-bb159fa71821 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:39.899850 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-42a3be52-a0ba-4f5b-b850-bb159fa71821 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045175 Oct 11 06:54:39.900390 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 804/1642] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:39 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:40.537067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4a401739-02a6-4a35-9042-a5c58db6b18b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:40.537731 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4a401739-02a6-4a35-9042-a5c58db6b18b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:40.544706 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4a401739-02a6-4a35-9042-a5c58db6b18b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:40.545179 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4a401739-02a6-4a35-9042-a5c58db6b18b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:40.545608 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4a401739-02a6-4a35-9042-a5c58db6b18b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:40.546290 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4a401739-02a6-4a35-9042-a5c58db6b18b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:40.546736 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4a401739-02a6-4a35-9042-a5c58db6b18b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:40.547154 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4a401739-02a6-4a35-9042-a5c58db6b18b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:40.676495 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4a401739-02a6-4a35-9042-a5c58db6b18b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:40.685567 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4a401739-02a6-4a35-9042-a5c58db6b18b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.152313 Oct 11 06:54:40.686120 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 839/1643] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:40 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:40.912965 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-eec344f1-33b4-43c7-98d0-6beae2f07961 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:40.915140 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-eec344f1-33b4-43c7-98d0-6beae2f07961 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:40.922413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eec344f1-33b4-43c7-98d0-6beae2f07961 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:40.922894 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eec344f1-33b4-43c7-98d0-6beae2f07961 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:40.923389 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eec344f1-33b4-43c7-98d0-6beae2f07961 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:40.924058 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eec344f1-33b4-43c7-98d0-6beae2f07961 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:40.924514 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eec344f1-33b4-43c7-98d0-6beae2f07961 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:40.924938 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eec344f1-33b4-43c7-98d0-6beae2f07961 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:40.953239 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-eec344f1-33b4-43c7-98d0-6beae2f07961 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044279 Oct 11 06:54:40.953777 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 805/1644] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:40 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:41.708423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a6b84548-ac18-4082-9262-9fcb86af2063 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:41.709053 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a6b84548-ac18-4082-9262-9fcb86af2063 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:41.716057 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6b84548-ac18-4082-9262-9fcb86af2063 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:41.716529 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6b84548-ac18-4082-9262-9fcb86af2063 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:41.716956 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6b84548-ac18-4082-9262-9fcb86af2063 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:41.717635 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6b84548-ac18-4082-9262-9fcb86af2063 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:41.718076 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6b84548-ac18-4082-9262-9fcb86af2063 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:41.718492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6b84548-ac18-4082-9262-9fcb86af2063 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:41.844024 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a6b84548-ac18-4082-9262-9fcb86af2063 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:41.852117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a6b84548-ac18-4082-9262-9fcb86af2063 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147460 Oct 11 06:54:41.852677 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 840/1645] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:41 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:41.965898 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b6006e86-732a-455a-8c3f-7f8a2631a63b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:41.968026 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b6006e86-732a-455a-8c3f-7f8a2631a63b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:41.974417 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b6006e86-732a-455a-8c3f-7f8a2631a63b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:41.974903 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b6006e86-732a-455a-8c3f-7f8a2631a63b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:41.975339 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b6006e86-732a-455a-8c3f-7f8a2631a63b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:41.976057 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b6006e86-732a-455a-8c3f-7f8a2631a63b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:41.976511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b6006e86-732a-455a-8c3f-7f8a2631a63b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:41.976934 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b6006e86-732a-455a-8c3f-7f8a2631a63b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:42.005867 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b6006e86-732a-455a-8c3f-7f8a2631a63b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044698 Oct 11 06:54:42.006407 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 806/1646] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:41 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:42.877220 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a37dff97-6807-49c1-8bfc-3a74454777a3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:42.877813 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a37dff97-6807-49c1-8bfc-3a74454777a3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:42.884295 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a37dff97-6807-49c1-8bfc-3a74454777a3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:42.884765 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a37dff97-6807-49c1-8bfc-3a74454777a3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:42.885186 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a37dff97-6807-49c1-8bfc-3a74454777a3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:42.885862 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a37dff97-6807-49c1-8bfc-3a74454777a3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:42.886302 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a37dff97-6807-49c1-8bfc-3a74454777a3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:42.886799 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a37dff97-6807-49c1-8bfc-3a74454777a3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:43.017578 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a37dff97-6807-49c1-8bfc-3a74454777a3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:43.019155 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6da803a3-f165-45de-b903-a13ab7e276d8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:43.021366 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6da803a3-f165-45de-b903-a13ab7e276d8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:43.025844 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a37dff97-6807-49c1-8bfc-3a74454777a3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.152581 Oct 11 06:54:43.026420 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 841/1647] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:42 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:43.028293 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6da803a3-f165-45de-b903-a13ab7e276d8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:43.028781 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6da803a3-f165-45de-b903-a13ab7e276d8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:43.029243 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6da803a3-f165-45de-b903-a13ab7e276d8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:43.029951 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6da803a3-f165-45de-b903-a13ab7e276d8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:43.030406 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6da803a3-f165-45de-b903-a13ab7e276d8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:43.030833 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6da803a3-f165-45de-b903-a13ab7e276d8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:43.059581 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6da803a3-f165-45de-b903-a13ab7e276d8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044283 Oct 11 06:54:43.060124 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 807/1648] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:43 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:54:44.049932 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4b9af0c6-6e01-4095-994b-8083fad5b82d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:44.050448 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4b9af0c6-6e01-4095-994b-8083fad5b82d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:44.056822 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4b9af0c6-6e01-4095-994b-8083fad5b82d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:44.057291 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4b9af0c6-6e01-4095-994b-8083fad5b82d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:44.057720 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4b9af0c6-6e01-4095-994b-8083fad5b82d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:44.058898 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4b9af0c6-6e01-4095-994b-8083fad5b82d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:44.059341 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4b9af0c6-6e01-4095-994b-8083fad5b82d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:44.059778 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4b9af0c6-6e01-4095-994b-8083fad5b82d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:44.071048 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-57a40dc1-4646-4237-9e09-bbccbc0da963 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:44.073260 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-57a40dc1-4646-4237-9e09-bbccbc0da963 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:44.080285 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57a40dc1-4646-4237-9e09-bbccbc0da963 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:44.080762 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57a40dc1-4646-4237-9e09-bbccbc0da963 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:44.081195 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57a40dc1-4646-4237-9e09-bbccbc0da963 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:44.081889 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57a40dc1-4646-4237-9e09-bbccbc0da963 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:44.082340 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57a40dc1-4646-4237-9e09-bbccbc0da963 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:44.082762 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57a40dc1-4646-4237-9e09-bbccbc0da963 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:44.111777 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-57a40dc1-4646-4237-9e09-bbccbc0da963 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044587 Oct 11 06:54:44.112336 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 808/1649] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:44 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:54:44.188646 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4b9af0c6-6e01-4095-994b-8083fad5b82d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:44.196774 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4b9af0c6-6e01-4095-994b-8083fad5b82d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150817 Oct 11 06:54:44.197326 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 842/1650] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:44 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:45.123284 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b7225760-ba7f-4eef-b2c8-502ec32cdcff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:45.125486 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b7225760-ba7f-4eef-b2c8-502ec32cdcff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:45.128071 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=58 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:54:45.133350 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b7225760-ba7f-4eef-b2c8-502ec32cdcff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:45.133838 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b7225760-ba7f-4eef-b2c8-502ec32cdcff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:45.134285 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b7225760-ba7f-4eef-b2c8-502ec32cdcff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:45.134974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b7225760-ba7f-4eef-b2c8-502ec32cdcff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:45.135448 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b7225760-ba7f-4eef-b2c8-502ec32cdcff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:45.135870 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b7225760-ba7f-4eef-b2c8-502ec32cdcff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:45.165808 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b7225760-ba7f-4eef-b2c8-502ec32cdcff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046465 Oct 11 06:54:45.166355 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 809/1651] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:45 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:45.220653 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c43e239d-d6e3-47f9-91e5-0ac349fc543a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:45.221260 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c43e239d-d6e3-47f9-91e5-0ac349fc543a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:45.227626 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c43e239d-d6e3-47f9-91e5-0ac349fc543a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:45.228104 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c43e239d-d6e3-47f9-91e5-0ac349fc543a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:45.228530 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c43e239d-d6e3-47f9-91e5-0ac349fc543a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:45.229222 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c43e239d-d6e3-47f9-91e5-0ac349fc543a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:45.229667 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c43e239d-d6e3-47f9-91e5-0ac349fc543a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:45.230085 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c43e239d-d6e3-47f9-91e5-0ac349fc543a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:45.359474 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c43e239d-d6e3-47f9-91e5-0ac349fc543a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:45.367571 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c43e239d-d6e3-47f9-91e5-0ac349fc543a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150727 Oct 11 06:54:45.368159 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 843/1652] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:45 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:46.178160 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-66ad7fda-8d1e-4ba2-b6a9-40420ba3b8c8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:46.180374 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-66ad7fda-8d1e-4ba2-b6a9-40420ba3b8c8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:46.187235 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-66ad7fda-8d1e-4ba2-b6a9-40420ba3b8c8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:46.187748 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-66ad7fda-8d1e-4ba2-b6a9-40420ba3b8c8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:46.188177 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-66ad7fda-8d1e-4ba2-b6a9-40420ba3b8c8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:46.188857 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-66ad7fda-8d1e-4ba2-b6a9-40420ba3b8c8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:46.189302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-66ad7fda-8d1e-4ba2-b6a9-40420ba3b8c8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:46.189725 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-66ad7fda-8d1e-4ba2-b6a9-40420ba3b8c8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:46.214207 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:54:46.219441 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-66ad7fda-8d1e-4ba2-b6a9-40420ba3b8c8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045315 Oct 11 06:54:46.219975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 810/1653] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:46 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:46.391846 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-613b2402-3e9b-4e4a-aed8-9af641181db2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:46.392454 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-613b2402-3e9b-4e4a-aed8-9af641181db2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:46.398737 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-613b2402-3e9b-4e4a-aed8-9af641181db2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:46.399213 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-613b2402-3e9b-4e4a-aed8-9af641181db2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:46.399678 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-613b2402-3e9b-4e4a-aed8-9af641181db2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:46.400366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-613b2402-3e9b-4e4a-aed8-9af641181db2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:46.400807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-613b2402-3e9b-4e4a-aed8-9af641181db2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:46.401327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-613b2402-3e9b-4e4a-aed8-9af641181db2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:46.527728 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-613b2402-3e9b-4e4a-aed8-9af641181db2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:46.535832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-613b2402-3e9b-4e4a-aed8-9af641181db2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.148013 Oct 11 06:54:46.536390 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 844/1654] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:46 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:47.231382 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bbab53eb-aff8-4175-88ca-e9b351e326c2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:47.233562 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bbab53eb-aff8-4175-88ca-e9b351e326c2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:47.240159 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bbab53eb-aff8-4175-88ca-e9b351e326c2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:47.240659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bbab53eb-aff8-4175-88ca-e9b351e326c2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:47.241096 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bbab53eb-aff8-4175-88ca-e9b351e326c2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:47.241783 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bbab53eb-aff8-4175-88ca-e9b351e326c2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:47.242233 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bbab53eb-aff8-4175-88ca-e9b351e326c2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:47.242652 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bbab53eb-aff8-4175-88ca-e9b351e326c2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:47.271476 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bbab53eb-aff8-4175-88ca-e9b351e326c2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044062 Oct 11 06:54:47.272017 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 811/1655] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:47 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:47.559142 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f1512851-a10e-4a8c-918d-6960ce3149db tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:47.559791 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f1512851-a10e-4a8c-918d-6960ce3149db tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:47.566555 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1512851-a10e-4a8c-918d-6960ce3149db tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:47.567041 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1512851-a10e-4a8c-918d-6960ce3149db tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:47.567585 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1512851-a10e-4a8c-918d-6960ce3149db tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:47.568291 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1512851-a10e-4a8c-918d-6960ce3149db tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:47.568742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1512851-a10e-4a8c-918d-6960ce3149db tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:47.569164 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1512851-a10e-4a8c-918d-6960ce3149db tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:47.693938 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f1512851-a10e-4a8c-918d-6960ce3149db tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:47.702674 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f1512851-a10e-4a8c-918d-6960ce3149db tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147280 Oct 11 06:54:47.703234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 845/1656] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:47 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:48.284099 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6d9a1df4-8d50-4c04-8d00-885386e06b28 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:48.286164 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6d9a1df4-8d50-4c04-8d00-885386e06b28 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:48.292070 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6d9a1df4-8d50-4c04-8d00-885386e06b28 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:48.293035 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6d9a1df4-8d50-4c04-8d00-885386e06b28 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:48.293467 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6d9a1df4-8d50-4c04-8d00-885386e06b28 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:48.294146 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6d9a1df4-8d50-4c04-8d00-885386e06b28 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:48.294591 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6d9a1df4-8d50-4c04-8d00-885386e06b28 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:48.295009 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6d9a1df4-8d50-4c04-8d00-885386e06b28 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:48.323611 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6d9a1df4-8d50-4c04-8d00-885386e06b28 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043730 Oct 11 06:54:48.324191 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 812/1657] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:48 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:48.725856 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-63dc2307-a9b0-4aca-bac2-81c7a90153f9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:48.726525 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-63dc2307-a9b0-4aca-bac2-81c7a90153f9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:48.733442 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-63dc2307-a9b0-4aca-bac2-81c7a90153f9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:48.733915 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-63dc2307-a9b0-4aca-bac2-81c7a90153f9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:48.734344 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-63dc2307-a9b0-4aca-bac2-81c7a90153f9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:48.735029 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-63dc2307-a9b0-4aca-bac2-81c7a90153f9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:48.735564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-63dc2307-a9b0-4aca-bac2-81c7a90153f9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:48.735989 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-63dc2307-a9b0-4aca-bac2-81c7a90153f9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:48.863443 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-63dc2307-a9b0-4aca-bac2-81c7a90153f9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:48.872220 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-63dc2307-a9b0-4aca-bac2-81c7a90153f9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150142 Oct 11 06:54:48.872785 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 846/1658] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:48 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:49.336112 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-552be02e-dc9b-499c-bf2a-226aa4360002 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:49.338280 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-552be02e-dc9b-499c-bf2a-226aa4360002 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:49.345158 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-552be02e-dc9b-499c-bf2a-226aa4360002 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:49.345637 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-552be02e-dc9b-499c-bf2a-226aa4360002 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:49.346070 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-552be02e-dc9b-499c-bf2a-226aa4360002 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:49.346761 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-552be02e-dc9b-499c-bf2a-226aa4360002 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:49.347214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-552be02e-dc9b-499c-bf2a-226aa4360002 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:49.347669 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-552be02e-dc9b-499c-bf2a-226aa4360002 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:49.377093 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-552be02e-dc9b-499c-bf2a-226aa4360002 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044942 Oct 11 06:54:49.377640 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 813/1659] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:49 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:49.894434 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-27cb9f04-2391-4815-9d91-ec3751bef2aa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:49.895042 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-27cb9f04-2391-4815-9d91-ec3751bef2aa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:49.901449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-27cb9f04-2391-4815-9d91-ec3751bef2aa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:49.901919 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-27cb9f04-2391-4815-9d91-ec3751bef2aa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:49.902349 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-27cb9f04-2391-4815-9d91-ec3751bef2aa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:49.903035 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-27cb9f04-2391-4815-9d91-ec3751bef2aa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:49.903506 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-27cb9f04-2391-4815-9d91-ec3751bef2aa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:49.903927 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-27cb9f04-2391-4815-9d91-ec3751bef2aa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:50.031269 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-27cb9f04-2391-4815-9d91-ec3751bef2aa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:50.039381 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-27cb9f04-2391-4815-9d91-ec3751bef2aa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.148784 Oct 11 06:54:50.039968 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 847/1660] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:49 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:50.389743 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-fbbd0a23-dd50-42a1-b835-f9f376cdb1e1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:50.391835 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-fbbd0a23-dd50-42a1-b835-f9f376cdb1e1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:50.398204 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fbbd0a23-dd50-42a1-b835-f9f376cdb1e1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:50.398680 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fbbd0a23-dd50-42a1-b835-f9f376cdb1e1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:50.399116 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fbbd0a23-dd50-42a1-b835-f9f376cdb1e1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:50.399831 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fbbd0a23-dd50-42a1-b835-f9f376cdb1e1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:50.400281 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fbbd0a23-dd50-42a1-b835-f9f376cdb1e1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:50.400699 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fbbd0a23-dd50-42a1-b835-f9f376cdb1e1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:50.430134 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-fbbd0a23-dd50-42a1-b835-f9f376cdb1e1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044654 Oct 11 06:54:50.430680 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 814/1661] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:50 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:51.062109 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cc5f9208-a971-4946-803c-ac9cc0b23385 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:51.062648 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cc5f9208-a971-4946-803c-ac9cc0b23385 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:51.068900 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc5f9208-a971-4946-803c-ac9cc0b23385 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:51.069379 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc5f9208-a971-4946-803c-ac9cc0b23385 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:51.069803 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc5f9208-a971-4946-803c-ac9cc0b23385 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:51.070493 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc5f9208-a971-4946-803c-ac9cc0b23385 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:51.070935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc5f9208-a971-4946-803c-ac9cc0b23385 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:51.071499 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc5f9208-a971-4946-803c-ac9cc0b23385 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:51.200869 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cc5f9208-a971-4946-803c-ac9cc0b23385 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:51.208931 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cc5f9208-a971-4946-803c-ac9cc0b23385 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150898 Oct 11 06:54:51.209475 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 848/1662] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:51 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:51.443015 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1f4ecd36-ba6c-4856-a7a1-a4adf4ee7afe tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:51.445224 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1f4ecd36-ba6c-4856-a7a1-a4adf4ee7afe tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:51.452362 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1f4ecd36-ba6c-4856-a7a1-a4adf4ee7afe tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:51.452837 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1f4ecd36-ba6c-4856-a7a1-a4adf4ee7afe tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:51.453266 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1f4ecd36-ba6c-4856-a7a1-a4adf4ee7afe tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:51.453979 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1f4ecd36-ba6c-4856-a7a1-a4adf4ee7afe tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:51.454421 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1f4ecd36-ba6c-4856-a7a1-a4adf4ee7afe tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:51.454859 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1f4ecd36-ba6c-4856-a7a1-a4adf4ee7afe tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:51.486133 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1f4ecd36-ba6c-4856-a7a1-a4adf4ee7afe tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047016 Oct 11 06:54:51.486695 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 815/1663] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:51 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:52.233044 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c9f862cd-0582-4a6b-b4d8-09ac42058b44 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:52.233652 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c9f862cd-0582-4a6b-b4d8-09ac42058b44 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:52.240064 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c9f862cd-0582-4a6b-b4d8-09ac42058b44 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:52.240538 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c9f862cd-0582-4a6b-b4d8-09ac42058b44 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:52.240968 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c9f862cd-0582-4a6b-b4d8-09ac42058b44 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:52.241654 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c9f862cd-0582-4a6b-b4d8-09ac42058b44 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:52.242100 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c9f862cd-0582-4a6b-b4d8-09ac42058b44 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:52.242518 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c9f862cd-0582-4a6b-b4d8-09ac42058b44 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:52.367655 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c9f862cd-0582-4a6b-b4d8-09ac42058b44 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:52.375787 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c9f862cd-0582-4a6b-b4d8-09ac42058b44 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147235 Oct 11 06:54:52.376343 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 849/1664] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:52 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:52.498411 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2106a261-7cb2-432d-9f64-d25851ceace0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:52.500589 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2106a261-7cb2-432d-9f64-d25851ceace0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:52.506873 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2106a261-7cb2-432d-9f64-d25851ceace0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:52.507346 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2106a261-7cb2-432d-9f64-d25851ceace0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:52.507811 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2106a261-7cb2-432d-9f64-d25851ceace0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:52.508498 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2106a261-7cb2-432d-9f64-d25851ceace0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:52.508944 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2106a261-7cb2-432d-9f64-d25851ceace0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:52.509358 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2106a261-7cb2-432d-9f64-d25851ceace0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:52.538668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2106a261-7cb2-432d-9f64-d25851ceace0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044219 Oct 11 06:54:52.539207 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 816/1665] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:52 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:53.399046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-380217b4-4c96-4495-b649-4ac6f9753a96 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:53.399681 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-380217b4-4c96-4495-b649-4ac6f9753a96 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:53.406291 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-380217b4-4c96-4495-b649-4ac6f9753a96 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:53.406779 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-380217b4-4c96-4495-b649-4ac6f9753a96 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:53.407211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-380217b4-4c96-4495-b649-4ac6f9753a96 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:53.407935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-380217b4-4c96-4495-b649-4ac6f9753a96 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:53.408388 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-380217b4-4c96-4495-b649-4ac6f9753a96 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:53.408815 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-380217b4-4c96-4495-b649-4ac6f9753a96 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:53.533762 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-380217b4-4c96-4495-b649-4ac6f9753a96 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:53.541914 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-380217b4-4c96-4495-b649-4ac6f9753a96 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.146681 Oct 11 06:54:53.543002 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 850/1666] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:53 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:53.550060 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-918b718a-8f13-4b03-981f-fd7fb7ac0627 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:53.552210 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-918b718a-8f13-4b03-981f-fd7fb7ac0627 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:53.559162 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-918b718a-8f13-4b03-981f-fd7fb7ac0627 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:53.559673 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-918b718a-8f13-4b03-981f-fd7fb7ac0627 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:53.560108 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-918b718a-8f13-4b03-981f-fd7fb7ac0627 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:53.560796 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-918b718a-8f13-4b03-981f-fd7fb7ac0627 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:53.561249 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-918b718a-8f13-4b03-981f-fd7fb7ac0627 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:53.561676 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-918b718a-8f13-4b03-981f-fd7fb7ac0627 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:53.590515 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-918b718a-8f13-4b03-981f-fd7fb7ac0627 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044370 Oct 11 06:54:53.591052 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 817/1667] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:53 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:54.564684 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-91262757-3feb-49bb-a8b8-65b53d8304e1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:54.565218 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-91262757-3feb-49bb-a8b8-65b53d8304e1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:54.571672 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-91262757-3feb-49bb-a8b8-65b53d8304e1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:54.572136 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-91262757-3feb-49bb-a8b8-65b53d8304e1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:54.572562 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-91262757-3feb-49bb-a8b8-65b53d8304e1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:54.573237 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-91262757-3feb-49bb-a8b8-65b53d8304e1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:54.573737 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-91262757-3feb-49bb-a8b8-65b53d8304e1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:54.574150 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-91262757-3feb-49bb-a8b8-65b53d8304e1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:54.592315 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:54:54.602470 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ec606caa-50e5-4217-b9ec-cd18bf92e239 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:54.604682 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ec606caa-50e5-4217-b9ec-cd18bf92e239 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:54.611802 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ec606caa-50e5-4217-b9ec-cd18bf92e239 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:54.612288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ec606caa-50e5-4217-b9ec-cd18bf92e239 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:54.612724 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ec606caa-50e5-4217-b9ec-cd18bf92e239 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:54.613427 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ec606caa-50e5-4217-b9ec-cd18bf92e239 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:54.613881 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ec606caa-50e5-4217-b9ec-cd18bf92e239 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:54.614308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ec606caa-50e5-4217-b9ec-cd18bf92e239 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:54.643743 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ec606caa-50e5-4217-b9ec-cd18bf92e239 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045089 Oct 11 06:54:54.644302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 818/1668] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:54 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:54:54.704058 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-91262757-3feb-49bb-a8b8-65b53d8304e1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:54.712147 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-91262757-3feb-49bb-a8b8-65b53d8304e1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.151384 Oct 11 06:54:54.712705 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 851/1669] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:54 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:55.656791 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b9979a0a-bded-4e67-a7ed-e4da25221a8d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:55.658905 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b9979a0a-bded-4e67-a7ed-e4da25221a8d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:55.665204 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b9979a0a-bded-4e67-a7ed-e4da25221a8d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:55.665676 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b9979a0a-bded-4e67-a7ed-e4da25221a8d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:55.666101 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b9979a0a-bded-4e67-a7ed-e4da25221a8d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:55.666781 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b9979a0a-bded-4e67-a7ed-e4da25221a8d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:55.667225 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b9979a0a-bded-4e67-a7ed-e4da25221a8d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:55.667680 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b9979a0a-bded-4e67-a7ed-e4da25221a8d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:55.695706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b9979a0a-bded-4e67-a7ed-e4da25221a8d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043380 Oct 11 06:54:55.696241 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 819/1670] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:55 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:55.736868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-67709c69-d18f-49fe-b2c0-766b2f2ad75f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:55.737476 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-67709c69-d18f-49fe-b2c0-766b2f2ad75f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:55.743932 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67709c69-d18f-49fe-b2c0-766b2f2ad75f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:55.744407 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67709c69-d18f-49fe-b2c0-766b2f2ad75f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:55.744842 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67709c69-d18f-49fe-b2c0-766b2f2ad75f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:55.745547 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67709c69-d18f-49fe-b2c0-766b2f2ad75f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:55.746001 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67709c69-d18f-49fe-b2c0-766b2f2ad75f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:55.746418 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67709c69-d18f-49fe-b2c0-766b2f2ad75f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:55.873233 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-67709c69-d18f-49fe-b2c0-766b2f2ad75f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:55.881423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-67709c69-d18f-49fe-b2c0-766b2f2ad75f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.148366 Oct 11 06:54:55.881984 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 852/1671] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:55 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:56.708635 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-70ae78b4-cb2d-4b22-8e13-27a5be631f1d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:56.710730 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-70ae78b4-cb2d-4b22-8e13-27a5be631f1d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:56.717166 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-70ae78b4-cb2d-4b22-8e13-27a5be631f1d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:56.717637 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-70ae78b4-cb2d-4b22-8e13-27a5be631f1d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:56.718065 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-70ae78b4-cb2d-4b22-8e13-27a5be631f1d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:56.718745 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-70ae78b4-cb2d-4b22-8e13-27a5be631f1d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:56.719193 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-70ae78b4-cb2d-4b22-8e13-27a5be631f1d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:56.719638 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-70ae78b4-cb2d-4b22-8e13-27a5be631f1d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:56.748482 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-70ae78b4-cb2d-4b22-8e13-27a5be631f1d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043802 Oct 11 06:54:56.749012 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 820/1672] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:56 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:56.905102 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d7baa0a4-3fc9-44a5-9b81-26c4586e4150 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:56.905711 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d7baa0a4-3fc9-44a5-9b81-26c4586e4150 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:56.912019 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7baa0a4-3fc9-44a5-9b81-26c4586e4150 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:56.912488 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7baa0a4-3fc9-44a5-9b81-26c4586e4150 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:56.912930 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7baa0a4-3fc9-44a5-9b81-26c4586e4150 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:56.913589 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7baa0a4-3fc9-44a5-9b81-26c4586e4150 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:56.914058 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7baa0a4-3fc9-44a5-9b81-26c4586e4150 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:56.914481 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7baa0a4-3fc9-44a5-9b81-26c4586e4150 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:57.041512 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d7baa0a4-3fc9-44a5-9b81-26c4586e4150 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:57.051643 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d7baa0a4-3fc9-44a5-9b81-26c4586e4150 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150189 Oct 11 06:54:57.062569 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 853/1673] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:56 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:57.761249 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1da882f7-7962-4b26-914c-e66878b0f9cd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:57.763356 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1da882f7-7962-4b26-914c-e66878b0f9cd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:57.770064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1da882f7-7962-4b26-914c-e66878b0f9cd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:57.770552 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1da882f7-7962-4b26-914c-e66878b0f9cd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:57.770984 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1da882f7-7962-4b26-914c-e66878b0f9cd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:57.771725 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1da882f7-7962-4b26-914c-e66878b0f9cd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:57.772177 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1da882f7-7962-4b26-914c-e66878b0f9cd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:57.772599 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1da882f7-7962-4b26-914c-e66878b0f9cd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:57.802753 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1da882f7-7962-4b26-914c-e66878b0f9cd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045560 Oct 11 06:54:57.803310 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 821/1674] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:57 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:58.075694 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-299deff4-2a8f-42f9-9a7a-6aa289650919 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:58.076314 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-299deff4-2a8f-42f9-9a7a-6aa289650919 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:58.082756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-299deff4-2a8f-42f9-9a7a-6aa289650919 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:58.083238 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-299deff4-2a8f-42f9-9a7a-6aa289650919 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:58.083707 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-299deff4-2a8f-42f9-9a7a-6aa289650919 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:58.084408 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-299deff4-2a8f-42f9-9a7a-6aa289650919 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:58.084860 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-299deff4-2a8f-42f9-9a7a-6aa289650919 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:58.085285 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-299deff4-2a8f-42f9-9a7a-6aa289650919 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:58.297363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-299deff4-2a8f-42f9-9a7a-6aa289650919 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:58.305663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-299deff4-2a8f-42f9-9a7a-6aa289650919 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.233810 Oct 11 06:54:58.306159 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 854/1675] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:58 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:58.815377 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ad16ebd0-b25b-4c7f-919c-e65a05a74fb1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:58.817480 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ad16ebd0-b25b-4c7f-919c-e65a05a74fb1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:58.824424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ad16ebd0-b25b-4c7f-919c-e65a05a74fb1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:58.824904 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ad16ebd0-b25b-4c7f-919c-e65a05a74fb1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:58.825340 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ad16ebd0-b25b-4c7f-919c-e65a05a74fb1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:58.826030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ad16ebd0-b25b-4c7f-919c-e65a05a74fb1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:58.826483 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ad16ebd0-b25b-4c7f-919c-e65a05a74fb1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:58.826906 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ad16ebd0-b25b-4c7f-919c-e65a05a74fb1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:58.855733 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ad16ebd0-b25b-4c7f-919c-e65a05a74fb1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044520 Oct 11 06:54:58.856300 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 822/1676] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:58 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:54:59.328618 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-358580c0-41f8-4913-a498-0a769ef9d766 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:59.329223 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-358580c0-41f8-4913-a498-0a769ef9d766 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:59.335670 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-358580c0-41f8-4913-a498-0a769ef9d766 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:59.336144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-358580c0-41f8-4913-a498-0a769ef9d766 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:59.336573 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-358580c0-41f8-4913-a498-0a769ef9d766 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:59.337255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-358580c0-41f8-4913-a498-0a769ef9d766 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:59.337700 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-358580c0-41f8-4913-a498-0a769ef9d766 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:59.338120 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-358580c0-41f8-4913-a498-0a769ef9d766 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:59.464429 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-358580c0-41f8-4913-a498-0a769ef9d766 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:54:59.472488 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-358580c0-41f8-4913-a498-0a769ef9d766 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147663 Oct 11 06:54:59.473050 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 855/1677] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:54:59 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:54:59.868425 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6abfd5c6-18b7-42e8-91ee-fac47258c8e6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:54:59.871075 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6abfd5c6-18b7-42e8-91ee-fac47258c8e6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:54:59.877444 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6abfd5c6-18b7-42e8-91ee-fac47258c8e6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:59.877917 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6abfd5c6-18b7-42e8-91ee-fac47258c8e6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:59.878345 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6abfd5c6-18b7-42e8-91ee-fac47258c8e6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:59.879027 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6abfd5c6-18b7-42e8-91ee-fac47258c8e6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:54:59.879499 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6abfd5c6-18b7-42e8-91ee-fac47258c8e6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:54:59.879920 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6abfd5c6-18b7-42e8-91ee-fac47258c8e6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:54:59.909006 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6abfd5c6-18b7-42e8-91ee-fac47258c8e6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044451 Oct 11 06:54:59.909530 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 823/1678] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:54:59 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:00.496457 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a9ccc404-aa60-423b-bca5-1d6b8c715b4a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:00.496992 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a9ccc404-aa60-423b-bca5-1d6b8c715b4a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:00.503333 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9ccc404-aa60-423b-bca5-1d6b8c715b4a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:00.503836 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9ccc404-aa60-423b-bca5-1d6b8c715b4a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:00.504261 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9ccc404-aa60-423b-bca5-1d6b8c715b4a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:00.504937 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9ccc404-aa60-423b-bca5-1d6b8c715b4a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:00.505375 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9ccc404-aa60-423b-bca5-1d6b8c715b4a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:00.505789 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9ccc404-aa60-423b-bca5-1d6b8c715b4a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:00.629769 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a9ccc404-aa60-423b-bca5-1d6b8c715b4a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:00.638443 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a9ccc404-aa60-423b-bca5-1d6b8c715b4a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.146324 Oct 11 06:55:00.639627 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 856/1679] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:00 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:00.921239 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7d6cd918-95f7-40ea-916e-5df453ebebc3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:00.923378 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7d6cd918-95f7-40ea-916e-5df453ebebc3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:00.929723 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7d6cd918-95f7-40ea-916e-5df453ebebc3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:00.930204 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7d6cd918-95f7-40ea-916e-5df453ebebc3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:00.930635 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7d6cd918-95f7-40ea-916e-5df453ebebc3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:00.931319 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7d6cd918-95f7-40ea-916e-5df453ebebc3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:00.931798 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7d6cd918-95f7-40ea-916e-5df453ebebc3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:00.932217 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7d6cd918-95f7-40ea-916e-5df453ebebc3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:00.960779 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7d6cd918-95f7-40ea-916e-5df453ebebc3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043548 Oct 11 06:55:00.961314 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 824/1680] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:00 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:01.661974 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ea15744e-09b4-4a3a-8570-0c50e133c02f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:01.662581 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ea15744e-09b4-4a3a-8570-0c50e133c02f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:01.669902 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ea15744e-09b4-4a3a-8570-0c50e133c02f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:01.670376 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ea15744e-09b4-4a3a-8570-0c50e133c02f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:01.670808 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ea15744e-09b4-4a3a-8570-0c50e133c02f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:01.671527 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ea15744e-09b4-4a3a-8570-0c50e133c02f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:01.671980 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ea15744e-09b4-4a3a-8570-0c50e133c02f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:01.672403 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ea15744e-09b4-4a3a-8570-0c50e133c02f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:01.803536 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ea15744e-09b4-4a3a-8570-0c50e133c02f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:01.812198 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ea15744e-09b4-4a3a-8570-0c50e133c02f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.154082 Oct 11 06:55:01.812755 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 857/1681] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:01 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:01.973175 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e82a2a22-6e8a-41f6-a0dc-4e9fa8502d91 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:01.975459 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e82a2a22-6e8a-41f6-a0dc-4e9fa8502d91 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:01.982520 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e82a2a22-6e8a-41f6-a0dc-4e9fa8502d91 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:01.982990 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e82a2a22-6e8a-41f6-a0dc-4e9fa8502d91 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:01.983444 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e82a2a22-6e8a-41f6-a0dc-4e9fa8502d91 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:01.984144 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e82a2a22-6e8a-41f6-a0dc-4e9fa8502d91 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:01.984591 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e82a2a22-6e8a-41f6-a0dc-4e9fa8502d91 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:01.985008 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e82a2a22-6e8a-41f6-a0dc-4e9fa8502d91 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:02.013669 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e82a2a22-6e8a-41f6-a0dc-4e9fa8502d91 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044474 Oct 11 06:55:02.014470 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 825/1682] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:01 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:02.835141 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f8802df1-d97c-4bdd-a670-4936cc9898a3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:02.836618 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f8802df1-d97c-4bdd-a670-4936cc9898a3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:02.838453 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=52 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:55:02.845642 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f8802df1-d97c-4bdd-a670-4936cc9898a3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:02.846114 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f8802df1-d97c-4bdd-a670-4936cc9898a3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:02.846540 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f8802df1-d97c-4bdd-a670-4936cc9898a3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:02.847223 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f8802df1-d97c-4bdd-a670-4936cc9898a3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:02.847698 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f8802df1-d97c-4bdd-a670-4936cc9898a3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:02.848109 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f8802df1-d97c-4bdd-a670-4936cc9898a3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:02.972988 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f8802df1-d97c-4bdd-a670-4936cc9898a3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:02.981066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f8802df1-d97c-4bdd-a670-4936cc9898a3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149714 Oct 11 06:55:02.981628 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 858/1683] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:02 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:03.025732 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-23b781a8-c177-4f68-b5e5-ea01ae4918f5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:03.028456 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-23b781a8-c177-4f68-b5e5-ea01ae4918f5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:03.034730 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23b781a8-c177-4f68-b5e5-ea01ae4918f5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:03.035213 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23b781a8-c177-4f68-b5e5-ea01ae4918f5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:03.035688 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23b781a8-c177-4f68-b5e5-ea01ae4918f5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:03.036383 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23b781a8-c177-4f68-b5e5-ea01ae4918f5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:03.036841 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23b781a8-c177-4f68-b5e5-ea01ae4918f5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:03.037260 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23b781a8-c177-4f68-b5e5-ea01ae4918f5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:03.065610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-23b781a8-c177-4f68-b5e5-ea01ae4918f5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043773 Oct 11 06:55:03.066092 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 826/1684] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:03 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:04.004113 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-405b9443-6142-4090-b081-9b240c5c3d24 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:04.004719 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-405b9443-6142-4090-b081-9b240c5c3d24 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:04.011579 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-405b9443-6142-4090-b081-9b240c5c3d24 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:04.012052 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-405b9443-6142-4090-b081-9b240c5c3d24 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:04.012479 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-405b9443-6142-4090-b081-9b240c5c3d24 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:04.013158 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-405b9443-6142-4090-b081-9b240c5c3d24 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:04.013602 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-405b9443-6142-4090-b081-9b240c5c3d24 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:04.014277 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-405b9443-6142-4090-b081-9b240c5c3d24 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:04.078568 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c1ea0423-05e9-4bdc-a9c2-cd5e710d8ec3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:04.080774 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c1ea0423-05e9-4bdc-a9c2-cd5e710d8ec3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:04.087174 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1ea0423-05e9-4bdc-a9c2-cd5e710d8ec3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:04.087769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1ea0423-05e9-4bdc-a9c2-cd5e710d8ec3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:04.088272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1ea0423-05e9-4bdc-a9c2-cd5e710d8ec3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:04.089043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1ea0423-05e9-4bdc-a9c2-cd5e710d8ec3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:04.090234 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1ea0423-05e9-4bdc-a9c2-cd5e710d8ec3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:04.090949 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1ea0423-05e9-4bdc-a9c2-cd5e710d8ec3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:04.107553 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:55:04.121651 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c1ea0423-05e9-4bdc-a9c2-cd5e710d8ec3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047155 Oct 11 06:55:04.122207 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 827/1685] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:04 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:55:04.145183 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-405b9443-6142-4090-b081-9b240c5c3d24 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:04.153284 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-405b9443-6142-4090-b081-9b240c5c3d24 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.152953 Oct 11 06:55:04.153833 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 859/1686] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:03 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:05.133889 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c5bd83a4-5590-4439-92c1-e6fb252e48e3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:05.136632 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c5bd83a4-5590-4439-92c1-e6fb252e48e3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:05.143165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c5bd83a4-5590-4439-92c1-e6fb252e48e3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:05.143670 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c5bd83a4-5590-4439-92c1-e6fb252e48e3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:05.144102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c5bd83a4-5590-4439-92c1-e6fb252e48e3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:05.144781 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c5bd83a4-5590-4439-92c1-e6fb252e48e3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:05.145222 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c5bd83a4-5590-4439-92c1-e6fb252e48e3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:05.145638 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c5bd83a4-5590-4439-92c1-e6fb252e48e3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:05.173775 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c5bd83a4-5590-4439-92c1-e6fb252e48e3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043917 Oct 11 06:55:05.174316 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 828/1687] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:05 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:05.176633 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-30ddd48a-0a0f-42e1-94e2-7fcf1ec9dc8f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:05.177241 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-30ddd48a-0a0f-42e1-94e2-7fcf1ec9dc8f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:05.184159 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-30ddd48a-0a0f-42e1-94e2-7fcf1ec9dc8f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:05.184629 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-30ddd48a-0a0f-42e1-94e2-7fcf1ec9dc8f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:05.185057 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-30ddd48a-0a0f-42e1-94e2-7fcf1ec9dc8f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:05.185743 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-30ddd48a-0a0f-42e1-94e2-7fcf1ec9dc8f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:05.186188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-30ddd48a-0a0f-42e1-94e2-7fcf1ec9dc8f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:05.186604 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-30ddd48a-0a0f-42e1-94e2-7fcf1ec9dc8f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:05.315460 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-30ddd48a-0a0f-42e1-94e2-7fcf1ec9dc8f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:05.323924 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-30ddd48a-0a0f-42e1-94e2-7fcf1ec9dc8f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.151175 Oct 11 06:55:05.324678 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 860/1688] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:05 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:55:06.185661 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-082f401d-2863-4460-89a3-67925003656f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:06.187822 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-082f401d-2863-4460-89a3-67925003656f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:06.194504 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-082f401d-2863-4460-89a3-67925003656f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:06.194982 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-082f401d-2863-4460-89a3-67925003656f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:06.195440 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-082f401d-2863-4460-89a3-67925003656f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:06.196146 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-082f401d-2863-4460-89a3-67925003656f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:06.196587 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-082f401d-2863-4460-89a3-67925003656f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:06.197007 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-082f401d-2863-4460-89a3-67925003656f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:06.226499 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-082f401d-2863-4460-89a3-67925003656f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044775 Oct 11 06:55:06.227078 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 829/1689] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:06 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:06.347281 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-64b52da4-dbdc-4b82-9af7-15268e07d31b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:06.347907 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-64b52da4-dbdc-4b82-9af7-15268e07d31b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:06.354263 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-64b52da4-dbdc-4b82-9af7-15268e07d31b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:06.354737 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-64b52da4-dbdc-4b82-9af7-15268e07d31b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:06.355162 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-64b52da4-dbdc-4b82-9af7-15268e07d31b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:06.355883 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-64b52da4-dbdc-4b82-9af7-15268e07d31b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:06.356325 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-64b52da4-dbdc-4b82-9af7-15268e07d31b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:06.356738 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-64b52da4-dbdc-4b82-9af7-15268e07d31b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:06.480928 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-64b52da4-dbdc-4b82-9af7-15268e07d31b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:06.488923 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-64b52da4-dbdc-4b82-9af7-15268e07d31b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.145615 Oct 11 06:55:06.489485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 861/1690] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:06 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:07.238531 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5858827c-467b-4351-b2e9-95c6cd7821ee tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:07.240688 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5858827c-467b-4351-b2e9-95c6cd7821ee tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:07.247759 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5858827c-467b-4351-b2e9-95c6cd7821ee tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:07.248181 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5858827c-467b-4351-b2e9-95c6cd7821ee tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:07.248613 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5858827c-467b-4351-b2e9-95c6cd7821ee tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:07.249296 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5858827c-467b-4351-b2e9-95c6cd7821ee tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:07.249742 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5858827c-467b-4351-b2e9-95c6cd7821ee tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:07.250159 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5858827c-467b-4351-b2e9-95c6cd7821ee tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:07.279179 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5858827c-467b-4351-b2e9-95c6cd7821ee tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044580 Oct 11 06:55:07.279729 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 830/1691] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:07 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:07.512576 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1a743238-f6ab-47cb-be86-e83b9229589c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:07.513116 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1a743238-f6ab-47cb-be86-e83b9229589c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:07.519699 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1a743238-f6ab-47cb-be86-e83b9229589c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:07.520173 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1a743238-f6ab-47cb-be86-e83b9229589c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:07.520604 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1a743238-f6ab-47cb-be86-e83b9229589c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:07.521286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1a743238-f6ab-47cb-be86-e83b9229589c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:07.521733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1a743238-f6ab-47cb-be86-e83b9229589c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:07.522152 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1a743238-f6ab-47cb-be86-e83b9229589c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:07.649465 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1a743238-f6ab-47cb-be86-e83b9229589c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:07.657610 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1a743238-f6ab-47cb-be86-e83b9229589c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.148926 Oct 11 06:55:07.658375 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 862/1692] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:07 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:08.291631 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-dfdfa53d-6a8f-429e-913f-4ef7bca63e6a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:08.294275 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-dfdfa53d-6a8f-429e-913f-4ef7bca63e6a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:08.300675 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dfdfa53d-6a8f-429e-913f-4ef7bca63e6a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:08.301155 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dfdfa53d-6a8f-429e-913f-4ef7bca63e6a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:08.301600 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dfdfa53d-6a8f-429e-913f-4ef7bca63e6a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:08.302290 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dfdfa53d-6a8f-429e-913f-4ef7bca63e6a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:08.302749 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dfdfa53d-6a8f-429e-913f-4ef7bca63e6a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:08.303176 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dfdfa53d-6a8f-429e-913f-4ef7bca63e6a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:08.332481 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-dfdfa53d-6a8f-429e-913f-4ef7bca63e6a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044917 Oct 11 06:55:08.333023 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 831/1693] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:08 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:08.681005 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c57f7d99-731e-4c68-bac2-b1875d7c13bb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:08.681615 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c57f7d99-731e-4c68-bac2-b1875d7c13bb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:08.687954 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c57f7d99-731e-4c68-bac2-b1875d7c13bb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:08.688426 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c57f7d99-731e-4c68-bac2-b1875d7c13bb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:08.688863 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c57f7d99-731e-4c68-bac2-b1875d7c13bb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:08.689543 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c57f7d99-731e-4c68-bac2-b1875d7c13bb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:08.689985 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c57f7d99-731e-4c68-bac2-b1875d7c13bb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:08.690411 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c57f7d99-731e-4c68-bac2-b1875d7c13bb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:08.816694 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c57f7d99-731e-4c68-bac2-b1875d7c13bb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:08.824937 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c57f7d99-731e-4c68-bac2-b1875d7c13bb tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147746 Oct 11 06:55:08.825495 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 863/1694] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:08 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:09.345573 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-65cdefef-a356-40b5-a7cf-355f5396eeac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:09.347774 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-65cdefef-a356-40b5-a7cf-355f5396eeac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:09.354186 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65cdefef-a356-40b5-a7cf-355f5396eeac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:09.354718 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65cdefef-a356-40b5-a7cf-355f5396eeac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:09.355162 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65cdefef-a356-40b5-a7cf-355f5396eeac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:09.355890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65cdefef-a356-40b5-a7cf-355f5396eeac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:09.356348 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65cdefef-a356-40b5-a7cf-355f5396eeac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:09.356789 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65cdefef-a356-40b5-a7cf-355f5396eeac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:09.385530 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-65cdefef-a356-40b5-a7cf-355f5396eeac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043905 Oct 11 06:55:09.386627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 832/1695] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:09 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:09.848281 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-036f15cd-27a9-49eb-8037-6c3119941bb7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:09.848889 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-036f15cd-27a9-49eb-8037-6c3119941bb7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:09.855935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-036f15cd-27a9-49eb-8037-6c3119941bb7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:09.856410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-036f15cd-27a9-49eb-8037-6c3119941bb7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:09.856833 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-036f15cd-27a9-49eb-8037-6c3119941bb7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:09.857542 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-036f15cd-27a9-49eb-8037-6c3119941bb7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:09.857984 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-036f15cd-27a9-49eb-8037-6c3119941bb7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:09.858426 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-036f15cd-27a9-49eb-8037-6c3119941bb7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:09.985551 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-036f15cd-27a9-49eb-8037-6c3119941bb7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:09.993616 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-036f15cd-27a9-49eb-8037-6c3119941bb7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149131 Oct 11 06:55:09.994168 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 864/1696] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:09 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:10.398189 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d85997eb-c0ca-49dd-b916-f7b683108a83 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:10.400521 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d85997eb-c0ca-49dd-b916-f7b683108a83 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:10.407480 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d85997eb-c0ca-49dd-b916-f7b683108a83 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:10.408463 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d85997eb-c0ca-49dd-b916-f7b683108a83 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:10.408463 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d85997eb-c0ca-49dd-b916-f7b683108a83 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:10.409102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d85997eb-c0ca-49dd-b916-f7b683108a83 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:10.409552 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d85997eb-c0ca-49dd-b916-f7b683108a83 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:10.409970 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d85997eb-c0ca-49dd-b916-f7b683108a83 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:10.439752 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d85997eb-c0ca-49dd-b916-f7b683108a83 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045430 Oct 11 06:55:10.440229 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 833/1697] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:10 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:11.018198 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f9c4df54-f2db-4f5c-8df4-e96a4b1d50b8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:11.018757 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f9c4df54-f2db-4f5c-8df4-e96a4b1d50b8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:11.025161 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f9c4df54-f2db-4f5c-8df4-e96a4b1d50b8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:11.025635 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f9c4df54-f2db-4f5c-8df4-e96a4b1d50b8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:11.026065 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f9c4df54-f2db-4f5c-8df4-e96a4b1d50b8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:11.026753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f9c4df54-f2db-4f5c-8df4-e96a4b1d50b8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:11.027202 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f9c4df54-f2db-4f5c-8df4-e96a4b1d50b8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:11.027652 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f9c4df54-f2db-4f5c-8df4-e96a4b1d50b8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:11.152566 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f9c4df54-f2db-4f5c-8df4-e96a4b1d50b8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:11.160663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f9c4df54-f2db-4f5c-8df4-e96a4b1d50b8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.146733 Oct 11 06:55:11.161223 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 865/1698] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:11 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:11.451711 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cef27d77-cba9-4570-83ad-5b5264486451 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:11.453870 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cef27d77-cba9-4570-83ad-5b5264486451 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:11.460228 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cef27d77-cba9-4570-83ad-5b5264486451 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:11.460717 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cef27d77-cba9-4570-83ad-5b5264486451 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:11.461148 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cef27d77-cba9-4570-83ad-5b5264486451 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:11.461841 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cef27d77-cba9-4570-83ad-5b5264486451 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:11.462290 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cef27d77-cba9-4570-83ad-5b5264486451 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:11.462711 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cef27d77-cba9-4570-83ad-5b5264486451 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:11.491971 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cef27d77-cba9-4570-83ad-5b5264486451 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044212 Oct 11 06:55:11.492517 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 834/1699] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:11 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:12.183479 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a746f640-0fe6-496b-af1e-136b9b530a1f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:12.184031 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a746f640-0fe6-496b-af1e-136b9b530a1f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:12.190370 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a746f640-0fe6-496b-af1e-136b9b530a1f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:12.190840 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a746f640-0fe6-496b-af1e-136b9b530a1f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:12.191267 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a746f640-0fe6-496b-af1e-136b9b530a1f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:12.191993 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a746f640-0fe6-496b-af1e-136b9b530a1f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:12.192442 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a746f640-0fe6-496b-af1e-136b9b530a1f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:12.192858 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a746f640-0fe6-496b-af1e-136b9b530a1f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:12.319719 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a746f640-0fe6-496b-af1e-136b9b530a1f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:12.328383 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a746f640-0fe6-496b-af1e-136b9b530a1f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.148895 Oct 11 06:55:12.328934 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 866/1700] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:12 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:12.504861 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a5857d82-92f6-4ee1-b99c-21ed78acdf3d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:12.506942 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a5857d82-92f6-4ee1-b99c-21ed78acdf3d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:12.513422 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a5857d82-92f6-4ee1-b99c-21ed78acdf3d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:12.514152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a5857d82-92f6-4ee1-b99c-21ed78acdf3d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:12.514583 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a5857d82-92f6-4ee1-b99c-21ed78acdf3d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:12.515266 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a5857d82-92f6-4ee1-b99c-21ed78acdf3d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:12.515738 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a5857d82-92f6-4ee1-b99c-21ed78acdf3d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:12.516153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a5857d82-92f6-4ee1-b99c-21ed78acdf3d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:12.545170 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a5857d82-92f6-4ee1-b99c-21ed78acdf3d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044306 Oct 11 06:55:12.545792 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 835/1701] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:12 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:13.351323 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-321a988e-0813-431c-8c75-347838f689d7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:13.351992 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-321a988e-0813-431c-8c75-347838f689d7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:13.359469 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-321a988e-0813-431c-8c75-347838f689d7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:13.359955 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-321a988e-0813-431c-8c75-347838f689d7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:13.360386 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-321a988e-0813-431c-8c75-347838f689d7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:13.361164 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-321a988e-0813-431c-8c75-347838f689d7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:13.361614 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-321a988e-0813-431c-8c75-347838f689d7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:13.362028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-321a988e-0813-431c-8c75-347838f689d7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:13.490493 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-321a988e-0813-431c-8c75-347838f689d7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:13.498589 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-321a988e-0813-431c-8c75-347838f689d7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.151052 Oct 11 06:55:13.499141 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 867/1702] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:13 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:13.557505 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4d81c4b6-cb6b-4b15-aca4-4427caaab9bd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:13.559699 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4d81c4b6-cb6b-4b15-aca4-4427caaab9bd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:13.566119 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4d81c4b6-cb6b-4b15-aca4-4427caaab9bd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:13.566598 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4d81c4b6-cb6b-4b15-aca4-4427caaab9bd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:13.567033 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4d81c4b6-cb6b-4b15-aca4-4427caaab9bd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:13.567763 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4d81c4b6-cb6b-4b15-aca4-4427caaab9bd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:13.568219 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4d81c4b6-cb6b-4b15-aca4-4427caaab9bd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:13.568640 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4d81c4b6-cb6b-4b15-aca4-4427caaab9bd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:13.598278 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4d81c4b6-cb6b-4b15-aca4-4427caaab9bd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044729 Oct 11 06:55:13.598821 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 836/1703] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:13 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:14.522222 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e4d6295a-ec83-4ea8-aecd-f1febd12d3c1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:14.522833 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e4d6295a-ec83-4ea8-aecd-f1febd12d3c1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:14.529358 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e4d6295a-ec83-4ea8-aecd-f1febd12d3c1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:14.529829 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e4d6295a-ec83-4ea8-aecd-f1febd12d3c1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:14.530259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e4d6295a-ec83-4ea8-aecd-f1febd12d3c1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:14.531254 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e4d6295a-ec83-4ea8-aecd-f1febd12d3c1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:14.531744 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e4d6295a-ec83-4ea8-aecd-f1febd12d3c1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:14.532164 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e4d6295a-ec83-4ea8-aecd-f1febd12d3c1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:14.536352 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:55:14.610738 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-db39b4d4-0269-4d91-986e-dc87b7f5653e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:14.612934 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-db39b4d4-0269-4d91-986e-dc87b7f5653e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:14.619397 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db39b4d4-0269-4d91-986e-dc87b7f5653e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:14.619907 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db39b4d4-0269-4d91-986e-dc87b7f5653e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:14.620340 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db39b4d4-0269-4d91-986e-dc87b7f5653e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:14.621040 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db39b4d4-0269-4d91-986e-dc87b7f5653e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:14.621490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db39b4d4-0269-4d91-986e-dc87b7f5653e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:14.621911 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db39b4d4-0269-4d91-986e-dc87b7f5653e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:14.652125 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-db39b4d4-0269-4d91-986e-dc87b7f5653e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044645 Oct 11 06:55:14.652608 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 837/1704] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:14 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:55:14.658532 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e4d6295a-ec83-4ea8-aecd-f1febd12d3c1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:14.666771 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e4d6295a-ec83-4ea8-aecd-f1febd12d3c1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.148322 Oct 11 06:55:14.668011 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 868/1705] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:14 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:15.664747 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0741ab1f-b027-4539-b7b6-6d55ee3b45e1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:15.666818 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0741ab1f-b027-4539-b7b6-6d55ee3b45e1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:15.669422 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 06:55:15.669558 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Tue Oct 11 06:55:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments (ip 10.222.0.39) !!! Oct 11 06:55:15.671838 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=58 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:55:15.679224 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0741ab1f-b027-4539-b7b6-6d55ee3b45e1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:15.679904 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0741ab1f-b027-4539-b7b6-6d55ee3b45e1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:15.680344 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0741ab1f-b027-4539-b7b6-6d55ee3b45e1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:15.681051 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0741ab1f-b027-4539-b7b6-6d55ee3b45e1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:15.681506 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0741ab1f-b027-4539-b7b6-6d55ee3b45e1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:15.681934 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0741ab1f-b027-4539-b7b6-6d55ee3b45e1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:15.690044 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e241ab29-97c6-479f-b655-49b5e1f846c0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:15.690698 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e241ab29-97c6-479f-b655-49b5e1f846c0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:15.697075 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e241ab29-97c6-479f-b655-49b5e1f846c0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:15.697545 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e241ab29-97c6-479f-b655-49b5e1f846c0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:15.697970 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e241ab29-97c6-479f-b655-49b5e1f846c0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:15.699175 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e241ab29-97c6-479f-b655-49b5e1f846c0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:15.699649 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e241ab29-97c6-479f-b655-49b5e1f846c0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:15.700064 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e241ab29-97c6-479f-b655-49b5e1f846c0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:15.713220 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0741ab1f-b027-4539-b7b6-6d55ee3b45e1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052675 Oct 11 06:55:15.713779 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 838/1706] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:15 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:15.828774 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e241ab29-97c6-479f-b655-49b5e1f846c0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:15.836883 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e241ab29-97c6-479f-b655-49b5e1f846c0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150757 Oct 11 06:55:15.837429 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 869/1707] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:15 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:55:16.725680 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f4fde8fd-f40c-4a4a-afd6-30b97cbd1f1c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:16.727864 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f4fde8fd-f40c-4a4a-afd6-30b97cbd1f1c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:16.734243 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f4fde8fd-f40c-4a4a-afd6-30b97cbd1f1c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:16.734722 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f4fde8fd-f40c-4a4a-afd6-30b97cbd1f1c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:16.735155 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f4fde8fd-f40c-4a4a-afd6-30b97cbd1f1c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:16.735897 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f4fde8fd-f40c-4a4a-afd6-30b97cbd1f1c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:16.736354 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f4fde8fd-f40c-4a4a-afd6-30b97cbd1f1c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:16.736773 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f4fde8fd-f40c-4a4a-afd6-30b97cbd1f1c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:16.765813 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f4fde8fd-f40c-4a4a-afd6-30b97cbd1f1c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044118 Oct 11 06:55:16.766369 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 839/1708] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:16 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:16.860949 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-885589ea-4c5c-4e70-a733-948ba6ccca34 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:16.861553 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-885589ea-4c5c-4e70-a733-948ba6ccca34 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:16.868004 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-885589ea-4c5c-4e70-a733-948ba6ccca34 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:16.868454 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-885589ea-4c5c-4e70-a733-948ba6ccca34 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:16.868882 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-885589ea-4c5c-4e70-a733-948ba6ccca34 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:16.869557 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-885589ea-4c5c-4e70-a733-948ba6ccca34 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:16.869997 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-885589ea-4c5c-4e70-a733-948ba6ccca34 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:16.870899 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-885589ea-4c5c-4e70-a733-948ba6ccca34 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:16.996087 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-885589ea-4c5c-4e70-a733-948ba6ccca34 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:17.004160 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-885589ea-4c5c-4e70-a733-948ba6ccca34 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147103 Oct 11 06:55:17.004716 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 870/1709] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:16 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:17.778552 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a0dbff06-f0e3-4c77-8a3e-f834ac820c69 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:17.780735 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a0dbff06-f0e3-4c77-8a3e-f834ac820c69 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:17.786651 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a0dbff06-f0e3-4c77-8a3e-f834ac820c69 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:17.787132 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a0dbff06-f0e3-4c77-8a3e-f834ac820c69 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:17.787600 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a0dbff06-f0e3-4c77-8a3e-f834ac820c69 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:17.788292 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a0dbff06-f0e3-4c77-8a3e-f834ac820c69 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:17.788738 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a0dbff06-f0e3-4c77-8a3e-f834ac820c69 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:17.789159 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a0dbff06-f0e3-4c77-8a3e-f834ac820c69 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:17.818134 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a0dbff06-f0e3-4c77-8a3e-f834ac820c69 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043754 Oct 11 06:55:17.818681 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 840/1710] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:17 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:18.028393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-43a0e13a-c9e2-4481-84d9-4480f707a3d7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:18.029693 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-43a0e13a-c9e2-4481-84d9-4480f707a3d7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:18.036380 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-43a0e13a-c9e2-4481-84d9-4480f707a3d7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:18.036945 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-43a0e13a-c9e2-4481-84d9-4480f707a3d7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:18.037325 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-43a0e13a-c9e2-4481-84d9-4480f707a3d7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:18.038019 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-43a0e13a-c9e2-4481-84d9-4480f707a3d7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:18.038580 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-43a0e13a-c9e2-4481-84d9-4480f707a3d7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:18.039006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-43a0e13a-c9e2-4481-84d9-4480f707a3d7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:18.170056 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-43a0e13a-c9e2-4481-84d9-4480f707a3d7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:18.178217 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-43a0e13a-c9e2-4481-84d9-4480f707a3d7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.154035 Oct 11 06:55:18.178782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 871/1711] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:18 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:18.830347 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7839dd1f-0a65-4655-b66c-0e2e013a7920 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:18.832556 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7839dd1f-0a65-4655-b66c-0e2e013a7920 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:18.839607 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7839dd1f-0a65-4655-b66c-0e2e013a7920 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:18.840092 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7839dd1f-0a65-4655-b66c-0e2e013a7920 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:18.840531 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7839dd1f-0a65-4655-b66c-0e2e013a7920 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:18.841228 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7839dd1f-0a65-4655-b66c-0e2e013a7920 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:18.841685 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7839dd1f-0a65-4655-b66c-0e2e013a7920 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:18.842114 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7839dd1f-0a65-4655-b66c-0e2e013a7920 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:18.870539 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7839dd1f-0a65-4655-b66c-0e2e013a7920 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044169 Oct 11 06:55:18.871077 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 841/1712] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:18 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:19.201608 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-08a921b3-cb73-4cbf-994a-5098190542fc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:19.202219 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-08a921b3-cb73-4cbf-994a-5098190542fc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:19.208575 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-08a921b3-cb73-4cbf-994a-5098190542fc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:19.209049 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-08a921b3-cb73-4cbf-994a-5098190542fc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:19.209478 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-08a921b3-cb73-4cbf-994a-5098190542fc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:19.210164 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-08a921b3-cb73-4cbf-994a-5098190542fc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:19.210609 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-08a921b3-cb73-4cbf-994a-5098190542fc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:19.211025 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-08a921b3-cb73-4cbf-994a-5098190542fc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:19.337466 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-08a921b3-cb73-4cbf-994a-5098190542fc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:19.345578 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-08a921b3-cb73-4cbf-994a-5098190542fc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.148392 Oct 11 06:55:19.346137 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 872/1713] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:19 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:19.883012 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-93fb973d-51d2-4255-a10f-bd47f8e98fc8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:19.885191 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-93fb973d-51d2-4255-a10f-bd47f8e98fc8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:19.891846 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93fb973d-51d2-4255-a10f-bd47f8e98fc8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:19.892325 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93fb973d-51d2-4255-a10f-bd47f8e98fc8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:19.892760 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93fb973d-51d2-4255-a10f-bd47f8e98fc8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:19.893460 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93fb973d-51d2-4255-a10f-bd47f8e98fc8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:19.893921 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93fb973d-51d2-4255-a10f-bd47f8e98fc8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:19.894344 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93fb973d-51d2-4255-a10f-bd47f8e98fc8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:19.923793 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-93fb973d-51d2-4255-a10f-bd47f8e98fc8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044683 Oct 11 06:55:19.924332 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 842/1714] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:19 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:20.368425 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e89a407f-c9a0-473d-af6f-cd8f13542d4b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:20.369030 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e89a407f-c9a0-473d-af6f-cd8f13542d4b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:20.375951 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e89a407f-c9a0-473d-af6f-cd8f13542d4b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:20.376425 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e89a407f-c9a0-473d-af6f-cd8f13542d4b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:20.376855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e89a407f-c9a0-473d-af6f-cd8f13542d4b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:20.377541 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e89a407f-c9a0-473d-af6f-cd8f13542d4b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:20.377983 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e89a407f-c9a0-473d-af6f-cd8f13542d4b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:20.378404 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e89a407f-c9a0-473d-af6f-cd8f13542d4b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:20.505583 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e89a407f-c9a0-473d-af6f-cd8f13542d4b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:20.514402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e89a407f-c9a0-473d-af6f-cd8f13542d4b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149614 Oct 11 06:55:20.514959 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 873/1715] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:20 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:55:20.936438 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0029d8a4-d9b7-44ee-902e-06f31125dc16 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:20.938585 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0029d8a4-d9b7-44ee-902e-06f31125dc16 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:20.944963 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0029d8a4-d9b7-44ee-902e-06f31125dc16 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:20.945447 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0029d8a4-d9b7-44ee-902e-06f31125dc16 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:20.945884 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0029d8a4-d9b7-44ee-902e-06f31125dc16 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:20.946581 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0029d8a4-d9b7-44ee-902e-06f31125dc16 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:20.947036 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0029d8a4-d9b7-44ee-902e-06f31125dc16 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:20.947491 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0029d8a4-d9b7-44ee-902e-06f31125dc16 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:20.976383 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0029d8a4-d9b7-44ee-902e-06f31125dc16 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044361 Oct 11 06:55:20.976927 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 843/1716] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:20 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:21.538077 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fcac763f-80d9-4c93-b397-56a7898f66d4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:21.538659 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fcac763f-80d9-4c93-b397-56a7898f66d4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:21.544601 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fcac763f-80d9-4c93-b397-56a7898f66d4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:21.545074 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fcac763f-80d9-4c93-b397-56a7898f66d4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:21.545501 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fcac763f-80d9-4c93-b397-56a7898f66d4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:21.546186 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fcac763f-80d9-4c93-b397-56a7898f66d4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:21.546631 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fcac763f-80d9-4c93-b397-56a7898f66d4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:21.547047 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fcac763f-80d9-4c93-b397-56a7898f66d4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:21.675476 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fcac763f-80d9-4c93-b397-56a7898f66d4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:21.684039 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fcac763f-80d9-4c93-b397-56a7898f66d4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149913 Oct 11 06:55:21.684589 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 874/1717] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:21 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:21.989187 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c78da76f-6212-4e47-95dc-0ecd2c5ab533 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:21.991247 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c78da76f-6212-4e47-95dc-0ecd2c5ab533 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:21.998234 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c78da76f-6212-4e47-95dc-0ecd2c5ab533 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:21.998715 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c78da76f-6212-4e47-95dc-0ecd2c5ab533 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:21.999153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c78da76f-6212-4e47-95dc-0ecd2c5ab533 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:21.999883 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c78da76f-6212-4e47-95dc-0ecd2c5ab533 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:22.000340 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c78da76f-6212-4e47-95dc-0ecd2c5ab533 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:22.000766 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c78da76f-6212-4e47-95dc-0ecd2c5ab533 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:22.004429 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:55:22.029758 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c78da76f-6212-4e47-95dc-0ecd2c5ab533 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044552 Oct 11 06:55:22.030309 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 844/1718] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:21 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:22.707723 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-225b4851-4c65-46eb-9c0c-25e6b40bdb4f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:22.708328 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-225b4851-4c65-46eb-9c0c-25e6b40bdb4f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:22.715284 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-225b4851-4c65-46eb-9c0c-25e6b40bdb4f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:22.715798 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-225b4851-4c65-46eb-9c0c-25e6b40bdb4f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:22.716235 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-225b4851-4c65-46eb-9c0c-25e6b40bdb4f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:22.716919 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-225b4851-4c65-46eb-9c0c-25e6b40bdb4f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:22.717395 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-225b4851-4c65-46eb-9c0c-25e6b40bdb4f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:22.717815 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-225b4851-4c65-46eb-9c0c-25e6b40bdb4f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:22.843623 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-225b4851-4c65-46eb-9c0c-25e6b40bdb4f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:22.851677 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-225b4851-4c65-46eb-9c0c-25e6b40bdb4f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147767 Oct 11 06:55:22.852229 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 875/1719] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:22 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:23.041977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9b6e5f89-bfe4-418b-9a32-f9c759714dd5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:23.044082 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9b6e5f89-bfe4-418b-9a32-f9c759714dd5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:23.050566 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9b6e5f89-bfe4-418b-9a32-f9c759714dd5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:23.051051 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9b6e5f89-bfe4-418b-9a32-f9c759714dd5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:23.051523 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9b6e5f89-bfe4-418b-9a32-f9c759714dd5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:23.052221 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9b6e5f89-bfe4-418b-9a32-f9c759714dd5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:23.052679 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9b6e5f89-bfe4-418b-9a32-f9c759714dd5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:23.053108 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9b6e5f89-bfe4-418b-9a32-f9c759714dd5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:23.082777 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9b6e5f89-bfe4-418b-9a32-f9c759714dd5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044769 Oct 11 06:55:23.083319 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 845/1720] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:23 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:23.874163 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6d47ecbd-7136-41f7-8390-3c05b204e996 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:23.874771 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6d47ecbd-7136-41f7-8390-3c05b204e996 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:23.881570 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6d47ecbd-7136-41f7-8390-3c05b204e996 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:23.882039 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6d47ecbd-7136-41f7-8390-3c05b204e996 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:23.882465 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6d47ecbd-7136-41f7-8390-3c05b204e996 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:23.883146 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6d47ecbd-7136-41f7-8390-3c05b204e996 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:23.883634 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6d47ecbd-7136-41f7-8390-3c05b204e996 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:23.884048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6d47ecbd-7136-41f7-8390-3c05b204e996 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:24.095049 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8439dee0-fcb2-42d1-bf19-8e8ed00a4983 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:24.097223 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8439dee0-fcb2-42d1-bf19-8e8ed00a4983 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:24.103936 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8439dee0-fcb2-42d1-bf19-8e8ed00a4983 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:24.104420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8439dee0-fcb2-42d1-bf19-8e8ed00a4983 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:24.104849 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8439dee0-fcb2-42d1-bf19-8e8ed00a4983 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:24.105551 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8439dee0-fcb2-42d1-bf19-8e8ed00a4983 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:24.105998 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8439dee0-fcb2-42d1-bf19-8e8ed00a4983 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:24.106414 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8439dee0-fcb2-42d1-bf19-8e8ed00a4983 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:24.137633 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8439dee0-fcb2-42d1-bf19-8e8ed00a4983 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046375 Oct 11 06:55:24.138112 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 846/1721] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:24 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:55:24.260129 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6d47ecbd-7136-41f7-8390-3c05b204e996 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:24.268921 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6d47ecbd-7136-41f7-8390-3c05b204e996 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.398638 Oct 11 06:55:24.269471 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 876/1722] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:23 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:25.150126 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-34638a5a-6317-4d4e-a935-027441b5f3f3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:25.152839 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-34638a5a-6317-4d4e-a935-027441b5f3f3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:25.159454 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-34638a5a-6317-4d4e-a935-027441b5f3f3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:25.159925 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-34638a5a-6317-4d4e-a935-027441b5f3f3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:25.160351 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-34638a5a-6317-4d4e-a935-027441b5f3f3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:25.161035 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-34638a5a-6317-4d4e-a935-027441b5f3f3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:25.161480 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-34638a5a-6317-4d4e-a935-027441b5f3f3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:25.161923 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-34638a5a-6317-4d4e-a935-027441b5f3f3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:25.192364 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-34638a5a-6317-4d4e-a935-027441b5f3f3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046105 Oct 11 06:55:25.192918 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 847/1723] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:25 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:25.293044 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-87a5493f-48f7-4041-a90c-e801d3903769 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:25.293646 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-87a5493f-48f7-4041-a90c-e801d3903769 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:25.300306 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-87a5493f-48f7-4041-a90c-e801d3903769 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:25.300791 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-87a5493f-48f7-4041-a90c-e801d3903769 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:25.301224 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-87a5493f-48f7-4041-a90c-e801d3903769 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:25.301939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-87a5493f-48f7-4041-a90c-e801d3903769 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:25.302395 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-87a5493f-48f7-4041-a90c-e801d3903769 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:25.302816 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-87a5493f-48f7-4041-a90c-e801d3903769 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:25.428164 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-87a5493f-48f7-4041-a90c-e801d3903769 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:25.436368 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-87a5493f-48f7-4041-a90c-e801d3903769 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147725 Oct 11 06:55:25.436911 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 877/1724] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:25 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:26.205484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bfe15fc3-031e-4f5e-ab78-9c008f83abef tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:26.207722 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bfe15fc3-031e-4f5e-ab78-9c008f83abef tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:26.214473 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bfe15fc3-031e-4f5e-ab78-9c008f83abef tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:26.214951 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bfe15fc3-031e-4f5e-ab78-9c008f83abef tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:26.215390 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bfe15fc3-031e-4f5e-ab78-9c008f83abef tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:26.216104 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bfe15fc3-031e-4f5e-ab78-9c008f83abef tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:26.216553 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bfe15fc3-031e-4f5e-ab78-9c008f83abef tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:26.216971 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bfe15fc3-031e-4f5e-ab78-9c008f83abef tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:26.246920 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bfe15fc3-031e-4f5e-ab78-9c008f83abef tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045621 Oct 11 06:55:26.247672 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 848/1725] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:26 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:26.460159 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-aa25c020-487c-4b0e-8591-48df377ddf04 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:26.460742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-aa25c020-487c-4b0e-8591-48df377ddf04 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:26.467202 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aa25c020-487c-4b0e-8591-48df377ddf04 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:26.467710 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aa25c020-487c-4b0e-8591-48df377ddf04 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:26.468135 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aa25c020-487c-4b0e-8591-48df377ddf04 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:26.468826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aa25c020-487c-4b0e-8591-48df377ddf04 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:26.469272 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aa25c020-487c-4b0e-8591-48df377ddf04 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:26.469693 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aa25c020-487c-4b0e-8591-48df377ddf04 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:26.598463 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-aa25c020-487c-4b0e-8591-48df377ddf04 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:26.607043 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-aa25c020-487c-4b0e-8591-48df377ddf04 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150729 Oct 11 06:55:26.607631 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 878/1726] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:26 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:27.259190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1631a9a1-a3b9-4bde-ba06-b6364c8a2507 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:27.261857 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1631a9a1-a3b9-4bde-ba06-b6364c8a2507 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:27.268598 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1631a9a1-a3b9-4bde-ba06-b6364c8a2507 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:27.269077 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1631a9a1-a3b9-4bde-ba06-b6364c8a2507 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:27.269511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1631a9a1-a3b9-4bde-ba06-b6364c8a2507 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:27.270196 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1631a9a1-a3b9-4bde-ba06-b6364c8a2507 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:27.270648 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1631a9a1-a3b9-4bde-ba06-b6364c8a2507 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:27.271068 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1631a9a1-a3b9-4bde-ba06-b6364c8a2507 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:27.300421 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1631a9a1-a3b9-4bde-ba06-b6364c8a2507 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045023 Oct 11 06:55:27.300979 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 849/1727] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:27 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:27.629950 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-693d9a93-a002-4720-98a9-8095e2828153 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:27.630568 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-693d9a93-a002-4720-98a9-8095e2828153 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:27.637624 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-693d9a93-a002-4720-98a9-8095e2828153 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:27.638095 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-693d9a93-a002-4720-98a9-8095e2828153 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:27.638523 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-693d9a93-a002-4720-98a9-8095e2828153 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:27.639506 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-693d9a93-a002-4720-98a9-8095e2828153 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:27.639955 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-693d9a93-a002-4720-98a9-8095e2828153 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:27.640373 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-693d9a93-a002-4720-98a9-8095e2828153 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:27.763524 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-693d9a93-a002-4720-98a9-8095e2828153 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:27.772018 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-693d9a93-a002-4720-98a9-8095e2828153 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.146033 Oct 11 06:55:27.772582 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 879/1728] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:27 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:28.313647 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-46c0db0c-f61c-4375-acb4-783a20af24be tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:28.315875 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-46c0db0c-f61c-4375-acb4-783a20af24be tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:28.322165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-46c0db0c-f61c-4375-acb4-783a20af24be tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:28.322642 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-46c0db0c-f61c-4375-acb4-783a20af24be tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:28.323125 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-46c0db0c-f61c-4375-acb4-783a20af24be tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:28.323834 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-46c0db0c-f61c-4375-acb4-783a20af24be tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:28.324281 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-46c0db0c-f61c-4375-acb4-783a20af24be tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:28.324695 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-46c0db0c-f61c-4375-acb4-783a20af24be tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:28.353624 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-46c0db0c-f61c-4375-acb4-783a20af24be tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043915 Oct 11 06:55:28.354164 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 850/1729] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:28 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:28.795087 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a49138d1-03ef-4e2d-b642-5e06ec43886b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:28.795654 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a49138d1-03ef-4e2d-b642-5e06ec43886b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:28.801964 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a49138d1-03ef-4e2d-b642-5e06ec43886b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:28.802438 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a49138d1-03ef-4e2d-b642-5e06ec43886b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:28.802864 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a49138d1-03ef-4e2d-b642-5e06ec43886b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:28.803591 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a49138d1-03ef-4e2d-b642-5e06ec43886b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:28.804038 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a49138d1-03ef-4e2d-b642-5e06ec43886b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:28.804456 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a49138d1-03ef-4e2d-b642-5e06ec43886b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:28.934783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a49138d1-03ef-4e2d-b642-5e06ec43886b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:28.942831 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a49138d1-03ef-4e2d-b642-5e06ec43886b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.151635 Oct 11 06:55:28.943390 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 880/1730] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:28 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:29.366000 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-fcc5d80f-5aad-429f-bb28-aec30df701de tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:29.368208 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-fcc5d80f-5aad-429f-bb28-aec30df701de tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:29.375096 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fcc5d80f-5aad-429f-bb28-aec30df701de tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:29.375613 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fcc5d80f-5aad-429f-bb28-aec30df701de tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:29.376066 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fcc5d80f-5aad-429f-bb28-aec30df701de tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:29.376740 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fcc5d80f-5aad-429f-bb28-aec30df701de tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:29.377184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fcc5d80f-5aad-429f-bb28-aec30df701de tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:29.377594 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fcc5d80f-5aad-429f-bb28-aec30df701de tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:29.405938 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-fcc5d80f-5aad-429f-bb28-aec30df701de tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043745 Oct 11 06:55:29.406416 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 851/1731] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:29 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:29.966382 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0b70c864-3196-4262-b4e4-a99b71ba0e45 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:29.967012 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0b70c864-3196-4262-b4e4-a99b71ba0e45 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:29.973434 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b70c864-3196-4262-b4e4-a99b71ba0e45 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:29.973908 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b70c864-3196-4262-b4e4-a99b71ba0e45 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:29.974335 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b70c864-3196-4262-b4e4-a99b71ba0e45 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:29.975027 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b70c864-3196-4262-b4e4-a99b71ba0e45 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:29.975489 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b70c864-3196-4262-b4e4-a99b71ba0e45 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:29.975936 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b70c864-3196-4262-b4e4-a99b71ba0e45 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:30.099379 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0b70c864-3196-4262-b4e4-a99b71ba0e45 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:30.107511 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0b70c864-3196-4262-b4e4-a99b71ba0e45 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.145559 Oct 11 06:55:30.108051 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 881/1732] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:29 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:30.418359 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5ebdbe82-bd96-416c-9269-37d663a9ce8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:30.420584 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5ebdbe82-bd96-416c-9269-37d663a9ce8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:30.426898 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ebdbe82-bd96-416c-9269-37d663a9ce8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:30.427371 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ebdbe82-bd96-416c-9269-37d663a9ce8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:30.427827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ebdbe82-bd96-416c-9269-37d663a9ce8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:30.428505 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ebdbe82-bd96-416c-9269-37d663a9ce8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:30.428954 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ebdbe82-bd96-416c-9269-37d663a9ce8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:30.429367 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ebdbe82-bd96-416c-9269-37d663a9ce8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:30.458601 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5ebdbe82-bd96-416c-9269-37d663a9ce8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044296 Oct 11 06:55:30.459134 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 852/1733] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:30 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:31.130640 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f80531df-d6c9-4fb6-8d23-c6ccf82037cc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:31.131276 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f80531df-d6c9-4fb6-8d23-c6ccf82037cc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:31.137716 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f80531df-d6c9-4fb6-8d23-c6ccf82037cc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:31.138204 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f80531df-d6c9-4fb6-8d23-c6ccf82037cc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:31.138645 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f80531df-d6c9-4fb6-8d23-c6ccf82037cc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:31.139635 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f80531df-d6c9-4fb6-8d23-c6ccf82037cc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:31.140081 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f80531df-d6c9-4fb6-8d23-c6ccf82037cc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:31.140499 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f80531df-d6c9-4fb6-8d23-c6ccf82037cc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:31.264484 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f80531df-d6c9-4fb6-8d23-c6ccf82037cc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:31.272627 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f80531df-d6c9-4fb6-8d23-c6ccf82037cc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.145803 Oct 11 06:55:31.273180 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 882/1734] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:31 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:31.471029 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5b099d1d-5847-4f9f-b36d-60d89e10075c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:31.473171 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5b099d1d-5847-4f9f-b36d-60d89e10075c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:31.479560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b099d1d-5847-4f9f-b36d-60d89e10075c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:31.480034 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b099d1d-5847-4f9f-b36d-60d89e10075c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:31.480464 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b099d1d-5847-4f9f-b36d-60d89e10075c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:31.481143 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b099d1d-5847-4f9f-b36d-60d89e10075c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:31.481588 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b099d1d-5847-4f9f-b36d-60d89e10075c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:31.482006 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b099d1d-5847-4f9f-b36d-60d89e10075c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:31.510102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5b099d1d-5847-4f9f-b36d-60d89e10075c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043098 Oct 11 06:55:31.511147 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 853/1735] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:31 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:32.296635 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b04b252c-3184-4ffa-b483-1b0622f977e7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:32.297167 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b04b252c-3184-4ffa-b483-1b0622f977e7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:32.303532 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b04b252c-3184-4ffa-b483-1b0622f977e7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:32.304006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b04b252c-3184-4ffa-b483-1b0622f977e7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:32.304435 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b04b252c-3184-4ffa-b483-1b0622f977e7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:32.305119 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b04b252c-3184-4ffa-b483-1b0622f977e7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:32.305563 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b04b252c-3184-4ffa-b483-1b0622f977e7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:32.305981 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b04b252c-3184-4ffa-b483-1b0622f977e7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:32.436481 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b04b252c-3184-4ffa-b483-1b0622f977e7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:32.444644 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b04b252c-3184-4ffa-b483-1b0622f977e7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.151897 Oct 11 06:55:32.445196 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 883/1736] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:32 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:32.522633 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e63dc381-6ea0-469e-8314-9e75859053b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:32.524812 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e63dc381-6ea0-469e-8314-9e75859053b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:32.531115 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e63dc381-6ea0-469e-8314-9e75859053b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:32.531637 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e63dc381-6ea0-469e-8314-9e75859053b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:32.532078 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e63dc381-6ea0-469e-8314-9e75859053b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:32.532773 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e63dc381-6ea0-469e-8314-9e75859053b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:32.533230 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e63dc381-6ea0-469e-8314-9e75859053b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:32.533656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e63dc381-6ea0-469e-8314-9e75859053b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:32.563044 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e63dc381-6ea0-469e-8314-9e75859053b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044272 Oct 11 06:55:32.563533 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 854/1737] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:32 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:33.466696 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f7b0cb52-ac30-4bfb-82bc-51dfaaad8cb1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:33.467361 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f7b0cb52-ac30-4bfb-82bc-51dfaaad8cb1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:33.469718 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=52 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:55:33.474757 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f7b0cb52-ac30-4bfb-82bc-51dfaaad8cb1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:33.475301 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f7b0cb52-ac30-4bfb-82bc-51dfaaad8cb1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:33.475772 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f7b0cb52-ac30-4bfb-82bc-51dfaaad8cb1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:33.476457 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f7b0cb52-ac30-4bfb-82bc-51dfaaad8cb1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:33.476906 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f7b0cb52-ac30-4bfb-82bc-51dfaaad8cb1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:33.477314 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f7b0cb52-ac30-4bfb-82bc-51dfaaad8cb1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:33.576601 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-01fae211-a1ce-4831-8344-67bd5befc9d7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:33.578821 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-01fae211-a1ce-4831-8344-67bd5befc9d7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:33.585311 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-01fae211-a1ce-4831-8344-67bd5befc9d7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:33.585790 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-01fae211-a1ce-4831-8344-67bd5befc9d7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:33.586224 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-01fae211-a1ce-4831-8344-67bd5befc9d7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:33.586922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-01fae211-a1ce-4831-8344-67bd5befc9d7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:33.587371 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-01fae211-a1ce-4831-8344-67bd5befc9d7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:33.587813 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-01fae211-a1ce-4831-8344-67bd5befc9d7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:33.602444 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f7b0cb52-ac30-4bfb-82bc-51dfaaad8cb1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:33.605919 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:55:33.611438 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f7b0cb52-ac30-4bfb-82bc-51dfaaad8cb1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.148453 Oct 11 06:55:33.611999 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 884/1738] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:33 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:33.618210 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-01fae211-a1ce-4831-8344-67bd5befc9d7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046866 Oct 11 06:55:33.618757 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 855/1739] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:33 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:55:34.634541 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ed468b21-b5a1-4c59-aab9-c17c41dac64f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:34.635121 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8879be26-4061-4f4e-ad38-c376e23bf24c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:34.636049 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8879be26-4061-4f4e-ad38-c376e23bf24c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:34.637226 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ed468b21-b5a1-4c59-aab9-c17c41dac64f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:34.642402 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8879be26-4061-4f4e-ad38-c376e23bf24c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:34.642881 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8879be26-4061-4f4e-ad38-c376e23bf24c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:34.643319 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8879be26-4061-4f4e-ad38-c376e23bf24c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:34.644047 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ed468b21-b5a1-4c59-aab9-c17c41dac64f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:34.644192 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8879be26-4061-4f4e-ad38-c376e23bf24c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:34.644494 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8879be26-4061-4f4e-ad38-c376e23bf24c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:34.644620 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ed468b21-b5a1-4c59-aab9-c17c41dac64f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:34.644915 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8879be26-4061-4f4e-ad38-c376e23bf24c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:34.645017 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ed468b21-b5a1-4c59-aab9-c17c41dac64f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:34.645619 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ed468b21-b5a1-4c59-aab9-c17c41dac64f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:34.646066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ed468b21-b5a1-4c59-aab9-c17c41dac64f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:34.646483 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ed468b21-b5a1-4c59-aab9-c17c41dac64f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:34.676108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ed468b21-b5a1-4c59-aab9-c17c41dac64f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045338 Oct 11 06:55:34.676680 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 885/1740] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:34 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:34.770993 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8879be26-4061-4f4e-ad38-c376e23bf24c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:34.779908 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8879be26-4061-4f4e-ad38-c376e23bf24c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149110 Oct 11 06:55:34.780457 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 856/1741] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:34 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:55:35.688292 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d4bbb327-ef11-4728-bc5e-ac2137a76ec4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:35.690494 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d4bbb327-ef11-4728-bc5e-ac2137a76ec4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:35.696899 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d4bbb327-ef11-4728-bc5e-ac2137a76ec4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:35.697648 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d4bbb327-ef11-4728-bc5e-ac2137a76ec4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:35.698221 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d4bbb327-ef11-4728-bc5e-ac2137a76ec4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:35.698896 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d4bbb327-ef11-4728-bc5e-ac2137a76ec4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:35.699353 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d4bbb327-ef11-4728-bc5e-ac2137a76ec4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:35.699797 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d4bbb327-ef11-4728-bc5e-ac2137a76ec4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:35.731725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d4bbb327-ef11-4728-bc5e-ac2137a76ec4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047503 Oct 11 06:55:35.732301 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 886/1742] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:35 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:35.803306 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ba950fb1-2063-4a11-a6c1-d8106a1d9733 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:35.803870 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ba950fb1-2063-4a11-a6c1-d8106a1d9733 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:35.810212 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba950fb1-2063-4a11-a6c1-d8106a1d9733 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:35.810688 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba950fb1-2063-4a11-a6c1-d8106a1d9733 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:35.811118 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba950fb1-2063-4a11-a6c1-d8106a1d9733 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:35.811840 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba950fb1-2063-4a11-a6c1-d8106a1d9733 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:35.812286 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba950fb1-2063-4a11-a6c1-d8106a1d9733 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:35.812701 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba950fb1-2063-4a11-a6c1-d8106a1d9733 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:35.942297 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ba950fb1-2063-4a11-a6c1-d8106a1d9733 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:35.950802 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ba950fb1-2063-4a11-a6c1-d8106a1d9733 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.151341 Oct 11 06:55:35.951357 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 857/1743] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:35 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:36.744049 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-302110f6-3520-4eb2-aca7-496df3a555c9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:36.748196 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-302110f6-3520-4eb2-aca7-496df3a555c9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:36.754570 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-302110f6-3520-4eb2-aca7-496df3a555c9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:36.755042 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-302110f6-3520-4eb2-aca7-496df3a555c9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:36.755496 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-302110f6-3520-4eb2-aca7-496df3a555c9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:36.756182 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-302110f6-3520-4eb2-aca7-496df3a555c9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:36.756626 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-302110f6-3520-4eb2-aca7-496df3a555c9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:36.757039 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-302110f6-3520-4eb2-aca7-496df3a555c9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:36.786038 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-302110f6-3520-4eb2-aca7-496df3a555c9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045897 Oct 11 06:55:36.786568 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 887/1744] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:36 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:36.974624 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-faa397b7-9e38-4bc5-b02a-65cc8b93e3fc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:36.975160 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-faa397b7-9e38-4bc5-b02a-65cc8b93e3fc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:36.982122 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-faa397b7-9e38-4bc5-b02a-65cc8b93e3fc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:36.982594 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-faa397b7-9e38-4bc5-b02a-65cc8b93e3fc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:36.983020 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-faa397b7-9e38-4bc5-b02a-65cc8b93e3fc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:36.983745 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-faa397b7-9e38-4bc5-b02a-65cc8b93e3fc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:36.984189 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-faa397b7-9e38-4bc5-b02a-65cc8b93e3fc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:36.984602 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-faa397b7-9e38-4bc5-b02a-65cc8b93e3fc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:37.111223 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-faa397b7-9e38-4bc5-b02a-65cc8b93e3fc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:37.119250 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-faa397b7-9e38-4bc5-b02a-65cc8b93e3fc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.148637 Oct 11 06:55:37.119826 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 858/1745] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:36 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:37.798355 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-86e067a8-51a6-4ed3-91ed-0331c976337e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:37.800482 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-86e067a8-51a6-4ed3-91ed-0331c976337e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:37.806779 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-86e067a8-51a6-4ed3-91ed-0331c976337e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:37.807245 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-86e067a8-51a6-4ed3-91ed-0331c976337e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:37.807703 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-86e067a8-51a6-4ed3-91ed-0331c976337e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:37.808381 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-86e067a8-51a6-4ed3-91ed-0331c976337e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:37.808822 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-86e067a8-51a6-4ed3-91ed-0331c976337e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:37.809235 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-86e067a8-51a6-4ed3-91ed-0331c976337e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:37.840422 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-86e067a8-51a6-4ed3-91ed-0331c976337e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046047 Oct 11 06:55:37.840955 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 888/1746] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:37 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:38.142558 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f0e6bf99-80a7-43ac-8840-c75a82a8b73f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:38.143253 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f0e6bf99-80a7-43ac-8840-c75a82a8b73f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:38.149680 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f0e6bf99-80a7-43ac-8840-c75a82a8b73f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:38.150157 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f0e6bf99-80a7-43ac-8840-c75a82a8b73f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:38.150591 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f0e6bf99-80a7-43ac-8840-c75a82a8b73f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:38.151279 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f0e6bf99-80a7-43ac-8840-c75a82a8b73f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:38.151761 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f0e6bf99-80a7-43ac-8840-c75a82a8b73f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:38.152185 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f0e6bf99-80a7-43ac-8840-c75a82a8b73f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:38.276081 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f0e6bf99-80a7-43ac-8840-c75a82a8b73f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:38.284170 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f0e6bf99-80a7-43ac-8840-c75a82a8b73f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.145718 Oct 11 06:55:38.284720 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 859/1747] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:38 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:38.852606 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2fa31683-027e-40b7-b608-318694e343d5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:38.855484 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2fa31683-027e-40b7-b608-318694e343d5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:38.861806 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2fa31683-027e-40b7-b608-318694e343d5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:38.862282 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2fa31683-027e-40b7-b608-318694e343d5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:38.862713 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2fa31683-027e-40b7-b608-318694e343d5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:38.863397 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2fa31683-027e-40b7-b608-318694e343d5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:38.863866 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2fa31683-027e-40b7-b608-318694e343d5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:38.864285 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2fa31683-027e-40b7-b608-318694e343d5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:38.892843 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2fa31683-027e-40b7-b608-318694e343d5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044192 Oct 11 06:55:38.893372 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 889/1748] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:38 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:39.307534 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-42300aa0-40db-4358-a2f2-b9c83540044d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:39.308144 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-42300aa0-40db-4358-a2f2-b9c83540044d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:39.314595 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42300aa0-40db-4358-a2f2-b9c83540044d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:39.315074 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42300aa0-40db-4358-a2f2-b9c83540044d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:39.315534 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42300aa0-40db-4358-a2f2-b9c83540044d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:39.316229 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42300aa0-40db-4358-a2f2-b9c83540044d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:39.316676 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42300aa0-40db-4358-a2f2-b9c83540044d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:39.317098 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42300aa0-40db-4358-a2f2-b9c83540044d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:39.457817 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-42300aa0-40db-4358-a2f2-b9c83540044d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:39.461655 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:55:39.470035 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-42300aa0-40db-4358-a2f2-b9c83540044d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.166406 Oct 11 06:55:39.470606 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 860/1749] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:39 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:39.905276 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5644e9ac-6765-42ec-8c12-98e369dab435 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:39.908124 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5644e9ac-6765-42ec-8c12-98e369dab435 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:39.914632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5644e9ac-6765-42ec-8c12-98e369dab435 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:39.915111 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5644e9ac-6765-42ec-8c12-98e369dab435 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:39.915567 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5644e9ac-6765-42ec-8c12-98e369dab435 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:39.916256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5644e9ac-6765-42ec-8c12-98e369dab435 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:39.917522 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5644e9ac-6765-42ec-8c12-98e369dab435 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:39.917939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5644e9ac-6765-42ec-8c12-98e369dab435 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:39.949521 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5644e9ac-6765-42ec-8c12-98e369dab435 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048274 Oct 11 06:55:39.950071 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 890/1750] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:39 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:40.493485 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0b0f0305-40af-4561-ae74-1c97a91abc79 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:40.494178 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0b0f0305-40af-4561-ae74-1c97a91abc79 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:40.501406 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b0f0305-40af-4561-ae74-1c97a91abc79 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:40.501888 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b0f0305-40af-4561-ae74-1c97a91abc79 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:40.502325 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b0f0305-40af-4561-ae74-1c97a91abc79 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:40.503028 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b0f0305-40af-4561-ae74-1c97a91abc79 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:40.503505 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b0f0305-40af-4561-ae74-1c97a91abc79 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:40.503932 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b0f0305-40af-4561-ae74-1c97a91abc79 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:40.629659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0b0f0305-40af-4561-ae74-1c97a91abc79 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:40.637866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0b0f0305-40af-4561-ae74-1c97a91abc79 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.148160 Oct 11 06:55:40.638425 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 861/1751] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:40 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:40.961996 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-684f43a4-6230-4fc7-9c26-de1b5a6936de tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:40.964638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-684f43a4-6230-4fc7-9c26-de1b5a6936de tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:40.970981 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-684f43a4-6230-4fc7-9c26-de1b5a6936de tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:40.971481 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-684f43a4-6230-4fc7-9c26-de1b5a6936de tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:40.971912 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-684f43a4-6230-4fc7-9c26-de1b5a6936de tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:40.972601 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-684f43a4-6230-4fc7-9c26-de1b5a6936de tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:40.973048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-684f43a4-6230-4fc7-9c26-de1b5a6936de tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:40.973467 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-684f43a4-6230-4fc7-9c26-de1b5a6936de tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:41.002139 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-684f43a4-6230-4fc7-9c26-de1b5a6936de tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044194 Oct 11 06:55:41.002673 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 891/1752] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:40 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:41.661644 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-efbd8816-b24b-465d-ba81-89c06825e463 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:41.662255 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-efbd8816-b24b-465d-ba81-89c06825e463 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:41.668762 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-efbd8816-b24b-465d-ba81-89c06825e463 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:41.669245 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-efbd8816-b24b-465d-ba81-89c06825e463 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:41.669680 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-efbd8816-b24b-465d-ba81-89c06825e463 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:41.670377 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-efbd8816-b24b-465d-ba81-89c06825e463 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:41.670831 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-efbd8816-b24b-465d-ba81-89c06825e463 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:41.671254 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-efbd8816-b24b-465d-ba81-89c06825e463 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:41.799817 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-efbd8816-b24b-465d-ba81-89c06825e463 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:41.808520 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-efbd8816-b24b-465d-ba81-89c06825e463 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150685 Oct 11 06:55:41.809072 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 862/1753] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:41 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:42.014551 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-108af470-ac21-4e5f-8ae8-2e24bee52001 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:42.017273 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-108af470-ac21-4e5f-8ae8-2e24bee52001 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:42.023537 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-108af470-ac21-4e5f-8ae8-2e24bee52001 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:42.024008 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-108af470-ac21-4e5f-8ae8-2e24bee52001 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:42.024430 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-108af470-ac21-4e5f-8ae8-2e24bee52001 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:42.025111 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-108af470-ac21-4e5f-8ae8-2e24bee52001 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:42.025551 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-108af470-ac21-4e5f-8ae8-2e24bee52001 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:42.026027 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-108af470-ac21-4e5f-8ae8-2e24bee52001 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:42.054742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-108af470-ac21-4e5f-8ae8-2e24bee52001 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044305 Oct 11 06:55:42.055209 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 892/1754] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:42 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:42.832191 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f6994179-3096-4239-bfc2-6417f3c97793 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:42.832719 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f6994179-3096-4239-bfc2-6417f3c97793 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:42.839117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f6994179-3096-4239-bfc2-6417f3c97793 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:42.839629 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f6994179-3096-4239-bfc2-6417f3c97793 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:42.840066 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f6994179-3096-4239-bfc2-6417f3c97793 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:42.840764 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f6994179-3096-4239-bfc2-6417f3c97793 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:42.841214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f6994179-3096-4239-bfc2-6417f3c97793 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:42.841636 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f6994179-3096-4239-bfc2-6417f3c97793 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:42.969343 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f6994179-3096-4239-bfc2-6417f3c97793 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:42.978013 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f6994179-3096-4239-bfc2-6417f3c97793 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149677 Oct 11 06:55:42.978575 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 863/1755] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:42 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:43.066480 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e0cac12c-1a36-4144-acf4-2165366ebddd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:43.068653 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e0cac12c-1a36-4144-acf4-2165366ebddd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:43.075533 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0cac12c-1a36-4144-acf4-2165366ebddd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:43.076010 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0cac12c-1a36-4144-acf4-2165366ebddd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:43.076439 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0cac12c-1a36-4144-acf4-2165366ebddd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:43.077131 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0cac12c-1a36-4144-acf4-2165366ebddd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:43.077574 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0cac12c-1a36-4144-acf4-2165366ebddd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:43.078016 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0cac12c-1a36-4144-acf4-2165366ebddd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:43.107039 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e0cac12c-1a36-4144-acf4-2165366ebddd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044445 Oct 11 06:55:43.107595 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 893/1756] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:43 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:44.001171 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ae9209e0-f6ca-418f-8c8a-6ea1244c5726 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:44.001726 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ae9209e0-f6ca-418f-8c8a-6ea1244c5726 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:44.008470 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ae9209e0-f6ca-418f-8c8a-6ea1244c5726 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:44.008953 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ae9209e0-f6ca-418f-8c8a-6ea1244c5726 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:44.009390 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ae9209e0-f6ca-418f-8c8a-6ea1244c5726 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:44.010088 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ae9209e0-f6ca-418f-8c8a-6ea1244c5726 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:44.010538 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ae9209e0-f6ca-418f-8c8a-6ea1244c5726 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:44.010961 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ae9209e0-f6ca-418f-8c8a-6ea1244c5726 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:44.118491 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4dc8105d-503a-41c9-ab9b-97236e7e6b9a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:44.120689 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4dc8105d-503a-41c9-ab9b-97236e7e6b9a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:44.127236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4dc8105d-503a-41c9-ab9b-97236e7e6b9a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:44.127746 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4dc8105d-503a-41c9-ab9b-97236e7e6b9a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:44.128171 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4dc8105d-503a-41c9-ab9b-97236e7e6b9a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:44.128861 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4dc8105d-503a-41c9-ab9b-97236e7e6b9a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:44.129303 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4dc8105d-503a-41c9-ab9b-97236e7e6b9a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:44.129718 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4dc8105d-503a-41c9-ab9b-97236e7e6b9a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:44.140802 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ae9209e0-f6ca-418f-8c8a-6ea1244c5726 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:44.148970 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ae9209e0-f6ca-418f-8c8a-6ea1244c5726 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.151734 Oct 11 06:55:44.149532 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 864/1757] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:43 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:44.159774 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4dc8105d-503a-41c9-ab9b-97236e7e6b9a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045093 Oct 11 06:55:44.160319 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 894/1758] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:44 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:55:45.172786 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-221926d5-27a6-4b8f-bdf4-eab2007d0661 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:45.173304 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e0bfe91d-3809-4ba0-8e00-358549575bb2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:45.173689 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e0bfe91d-3809-4ba0-8e00-358549575bb2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:45.175045 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-221926d5-27a6-4b8f-bdf4-eab2007d0661 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:45.180137 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0bfe91d-3809-4ba0-8e00-358549575bb2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:45.180611 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0bfe91d-3809-4ba0-8e00-358549575bb2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:45.181037 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0bfe91d-3809-4ba0-8e00-358549575bb2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:45.181384 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-221926d5-27a6-4b8f-bdf4-eab2007d0661 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:45.181722 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0bfe91d-3809-4ba0-8e00-358549575bb2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:45.181870 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-221926d5-27a6-4b8f-bdf4-eab2007d0661 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:45.182821 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0bfe91d-3809-4ba0-8e00-358549575bb2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:45.182966 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-221926d5-27a6-4b8f-bdf4-eab2007d0661 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:45.183239 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0bfe91d-3809-4ba0-8e00-358549575bb2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:45.183594 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-221926d5-27a6-4b8f-bdf4-eab2007d0661 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:45.184038 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-221926d5-27a6-4b8f-bdf4-eab2007d0661 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:45.184455 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-221926d5-27a6-4b8f-bdf4-eab2007d0661 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:45.212903 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-221926d5-27a6-4b8f-bdf4-eab2007d0661 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044035 Oct 11 06:55:45.213441 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 865/1759] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:45 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:45.310994 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e0bfe91d-3809-4ba0-8e00-358549575bb2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:45.319108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e0bfe91d-3809-4ba0-8e00-358549575bb2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149789 Oct 11 06:55:45.319638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 895/1760] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:45 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:55:46.225190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d8590295-6b58-468c-8f06-0827dc0d8217 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:46.227334 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d8590295-6b58-468c-8f06-0827dc0d8217 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:46.229645 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=56 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:55:46.234872 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8590295-6b58-468c-8f06-0827dc0d8217 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:46.235356 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8590295-6b58-468c-8f06-0827dc0d8217 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:46.235831 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8590295-6b58-468c-8f06-0827dc0d8217 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:46.236526 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8590295-6b58-468c-8f06-0827dc0d8217 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:46.236983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8590295-6b58-468c-8f06-0827dc0d8217 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:46.237404 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8590295-6b58-468c-8f06-0827dc0d8217 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:46.267593 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d8590295-6b58-468c-8f06-0827dc0d8217 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046337 Oct 11 06:55:46.268135 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 866/1761] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:46 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:46.341657 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1af74ec2-c07d-4b03-82e8-1e409286fa5b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:46.342271 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1af74ec2-c07d-4b03-82e8-1e409286fa5b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:46.348720 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1af74ec2-c07d-4b03-82e8-1e409286fa5b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:46.349196 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1af74ec2-c07d-4b03-82e8-1e409286fa5b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:46.349630 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1af74ec2-c07d-4b03-82e8-1e409286fa5b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:46.350321 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1af74ec2-c07d-4b03-82e8-1e409286fa5b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:46.350779 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1af74ec2-c07d-4b03-82e8-1e409286fa5b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:46.351201 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1af74ec2-c07d-4b03-82e8-1e409286fa5b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:46.476286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1af74ec2-c07d-4b03-82e8-1e409286fa5b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:46.484916 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1af74ec2-c07d-4b03-82e8-1e409286fa5b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147263 Oct 11 06:55:46.485471 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 896/1762] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:46 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:47.279470 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bf857dcb-b86e-4964-9bdd-aa08818c5ecc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:47.281605 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bf857dcb-b86e-4964-9bdd-aa08818c5ecc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:47.288009 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bf857dcb-b86e-4964-9bdd-aa08818c5ecc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:47.288491 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bf857dcb-b86e-4964-9bdd-aa08818c5ecc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:47.288929 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bf857dcb-b86e-4964-9bdd-aa08818c5ecc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:47.289621 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bf857dcb-b86e-4964-9bdd-aa08818c5ecc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:47.290071 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bf857dcb-b86e-4964-9bdd-aa08818c5ecc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:47.290492 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bf857dcb-b86e-4964-9bdd-aa08818c5ecc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:47.319362 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bf857dcb-b86e-4964-9bdd-aa08818c5ecc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044327 Oct 11 06:55:47.319930 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 867/1763] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:47 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:47.507797 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-62d7c4f1-71fa-400c-8abc-010ef05bc669 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:47.508339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-62d7c4f1-71fa-400c-8abc-010ef05bc669 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:47.515649 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62d7c4f1-71fa-400c-8abc-010ef05bc669 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:47.516148 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62d7c4f1-71fa-400c-8abc-010ef05bc669 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:47.516581 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62d7c4f1-71fa-400c-8abc-010ef05bc669 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:47.517262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62d7c4f1-71fa-400c-8abc-010ef05bc669 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:47.517707 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62d7c4f1-71fa-400c-8abc-010ef05bc669 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:47.518122 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62d7c4f1-71fa-400c-8abc-010ef05bc669 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:47.645308 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-62d7c4f1-71fa-400c-8abc-010ef05bc669 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:47.653413 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-62d7c4f1-71fa-400c-8abc-010ef05bc669 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149574 Oct 11 06:55:47.654002 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 897/1764] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:47 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:48.332008 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b2755aec-6180-4bbd-8af6-35ea16a2e454 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:48.334132 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b2755aec-6180-4bbd-8af6-35ea16a2e454 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:48.340639 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b2755aec-6180-4bbd-8af6-35ea16a2e454 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:48.341109 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b2755aec-6180-4bbd-8af6-35ea16a2e454 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:48.341544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b2755aec-6180-4bbd-8af6-35ea16a2e454 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:48.342221 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b2755aec-6180-4bbd-8af6-35ea16a2e454 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:48.342667 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b2755aec-6180-4bbd-8af6-35ea16a2e454 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:48.343078 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b2755aec-6180-4bbd-8af6-35ea16a2e454 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:48.371547 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b2755aec-6180-4bbd-8af6-35ea16a2e454 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043353 Oct 11 06:55:48.372073 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 868/1765] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:48 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:48.676668 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e3de9b68-bded-47a3-a843-6795b1dae8d6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:48.677277 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e3de9b68-bded-47a3-a843-6795b1dae8d6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:48.683616 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e3de9b68-bded-47a3-a843-6795b1dae8d6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:48.684089 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e3de9b68-bded-47a3-a843-6795b1dae8d6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:48.684518 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e3de9b68-bded-47a3-a843-6795b1dae8d6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:48.685200 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e3de9b68-bded-47a3-a843-6795b1dae8d6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:48.685643 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e3de9b68-bded-47a3-a843-6795b1dae8d6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:48.686061 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e3de9b68-bded-47a3-a843-6795b1dae8d6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:48.814002 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e3de9b68-bded-47a3-a843-6795b1dae8d6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:48.822084 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e3de9b68-bded-47a3-a843-6795b1dae8d6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149238 Oct 11 06:55:48.823164 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 898/1766] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:48 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:49.383371 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d5cad41b-a12e-45fb-ad2d-7f19262b2c46 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:49.386166 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d5cad41b-a12e-45fb-ad2d-7f19262b2c46 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:49.393100 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d5cad41b-a12e-45fb-ad2d-7f19262b2c46 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:49.393579 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d5cad41b-a12e-45fb-ad2d-7f19262b2c46 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:49.394009 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d5cad41b-a12e-45fb-ad2d-7f19262b2c46 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:49.394698 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d5cad41b-a12e-45fb-ad2d-7f19262b2c46 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:49.395154 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d5cad41b-a12e-45fb-ad2d-7f19262b2c46 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:49.395634 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d5cad41b-a12e-45fb-ad2d-7f19262b2c46 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:49.424734 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d5cad41b-a12e-45fb-ad2d-7f19262b2c46 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045275 Oct 11 06:55:49.425280 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 869/1767] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:49 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:49.846270 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-28df03b5-360b-4cd6-a1a0-bb753324f229 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:49.846872 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-28df03b5-360b-4cd6-a1a0-bb753324f229 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:49.853402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28df03b5-360b-4cd6-a1a0-bb753324f229 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:49.853886 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28df03b5-360b-4cd6-a1a0-bb753324f229 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:49.854325 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28df03b5-360b-4cd6-a1a0-bb753324f229 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:49.855023 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28df03b5-360b-4cd6-a1a0-bb753324f229 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:49.855525 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28df03b5-360b-4cd6-a1a0-bb753324f229 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:49.855953 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28df03b5-360b-4cd6-a1a0-bb753324f229 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:49.980629 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-28df03b5-360b-4cd6-a1a0-bb753324f229 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:49.988773 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-28df03b5-360b-4cd6-a1a0-bb753324f229 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.146307 Oct 11 06:55:49.989342 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 899/1768] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:49 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:50.437891 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-70249390-fdec-4587-9dbd-2a272cf4a653 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:50.440035 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-70249390-fdec-4587-9dbd-2a272cf4a653 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:50.446307 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-70249390-fdec-4587-9dbd-2a272cf4a653 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:50.446774 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-70249390-fdec-4587-9dbd-2a272cf4a653 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:50.447199 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-70249390-fdec-4587-9dbd-2a272cf4a653 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:50.447906 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-70249390-fdec-4587-9dbd-2a272cf4a653 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:50.448351 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-70249390-fdec-4587-9dbd-2a272cf4a653 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:50.448766 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-70249390-fdec-4587-9dbd-2a272cf4a653 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:50.476733 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-70249390-fdec-4587-9dbd-2a272cf4a653 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042935 Oct 11 06:55:50.477258 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 870/1769] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:50 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:51.012581 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f85aa4dd-4d59-4efd-b675-5636c6438a8a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:51.013240 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f85aa4dd-4d59-4efd-b675-5636c6438a8a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:51.019504 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f85aa4dd-4d59-4efd-b675-5636c6438a8a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:51.019983 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f85aa4dd-4d59-4efd-b675-5636c6438a8a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:51.020414 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f85aa4dd-4d59-4efd-b675-5636c6438a8a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:51.021101 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f85aa4dd-4d59-4efd-b675-5636c6438a8a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:51.021547 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f85aa4dd-4d59-4efd-b675-5636c6438a8a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:51.021967 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f85aa4dd-4d59-4efd-b675-5636c6438a8a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:51.151559 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f85aa4dd-4d59-4efd-b675-5636c6438a8a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:51.159783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f85aa4dd-4d59-4efd-b675-5636c6438a8a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.151482 Oct 11 06:55:51.160343 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 900/1770] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:51 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:51.489422 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7163f832-10a4-40d6-9840-f123461dc500 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:51.491626 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7163f832-10a4-40d6-9840-f123461dc500 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:51.498402 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7163f832-10a4-40d6-9840-f123461dc500 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:51.498874 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7163f832-10a4-40d6-9840-f123461dc500 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:51.499305 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7163f832-10a4-40d6-9840-f123461dc500 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:51.500011 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7163f832-10a4-40d6-9840-f123461dc500 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:51.500461 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7163f832-10a4-40d6-9840-f123461dc500 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:51.500878 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7163f832-10a4-40d6-9840-f123461dc500 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:51.529830 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7163f832-10a4-40d6-9840-f123461dc500 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044314 Oct 11 06:55:51.530367 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 871/1771] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:51 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:52.182937 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d0552af7-70a0-416c-9df6-29be3b05424a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:52.183593 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d0552af7-70a0-416c-9df6-29be3b05424a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:52.189924 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0552af7-70a0-416c-9df6-29be3b05424a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:52.190399 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0552af7-70a0-416c-9df6-29be3b05424a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:52.190830 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0552af7-70a0-416c-9df6-29be3b05424a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:52.191557 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0552af7-70a0-416c-9df6-29be3b05424a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:52.192009 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0552af7-70a0-416c-9df6-29be3b05424a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:52.192431 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d0552af7-70a0-416c-9df6-29be3b05424a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:52.210637 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:55:52.318582 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d0552af7-70a0-416c-9df6-29be3b05424a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:52.327401 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d0552af7-70a0-416c-9df6-29be3b05424a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.148764 Oct 11 06:55:52.327970 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 901/1772] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:52 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:52.542524 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1d22bfb6-51c7-4bd6-91aa-a67899b9a358 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:52.544752 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1d22bfb6-51c7-4bd6-91aa-a67899b9a358 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:52.551102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d22bfb6-51c7-4bd6-91aa-a67899b9a358 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:52.551622 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d22bfb6-51c7-4bd6-91aa-a67899b9a358 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:52.552059 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d22bfb6-51c7-4bd6-91aa-a67899b9a358 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:52.552749 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d22bfb6-51c7-4bd6-91aa-a67899b9a358 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:52.553197 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d22bfb6-51c7-4bd6-91aa-a67899b9a358 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:52.553620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d22bfb6-51c7-4bd6-91aa-a67899b9a358 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:52.582356 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1d22bfb6-51c7-4bd6-91aa-a67899b9a358 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044311 Oct 11 06:55:52.582895 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 872/1773] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:52 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:53.349872 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-14a914bc-198c-472c-9ded-fc0d758b1f7f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:53.350481 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-14a914bc-198c-472c-9ded-fc0d758b1f7f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:53.357391 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-14a914bc-198c-472c-9ded-fc0d758b1f7f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:53.357867 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-14a914bc-198c-472c-9ded-fc0d758b1f7f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:53.358295 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-14a914bc-198c-472c-9ded-fc0d758b1f7f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:53.358987 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-14a914bc-198c-472c-9ded-fc0d758b1f7f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:53.359485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-14a914bc-198c-472c-9ded-fc0d758b1f7f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:53.359906 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-14a914bc-198c-472c-9ded-fc0d758b1f7f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:53.487395 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-14a914bc-198c-472c-9ded-fc0d758b1f7f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:53.496069 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-14a914bc-198c-472c-9ded-fc0d758b1f7f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150085 Oct 11 06:55:53.496627 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 902/1774] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:53 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:53.594496 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-529cbe1d-6843-40e7-98e9-128c2a1b9ee5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:53.596670 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-529cbe1d-6843-40e7-98e9-128c2a1b9ee5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:53.602986 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-529cbe1d-6843-40e7-98e9-128c2a1b9ee5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:53.603488 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-529cbe1d-6843-40e7-98e9-128c2a1b9ee5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:53.604495 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-529cbe1d-6843-40e7-98e9-128c2a1b9ee5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:53.605179 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-529cbe1d-6843-40e7-98e9-128c2a1b9ee5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:53.605639 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-529cbe1d-6843-40e7-98e9-128c2a1b9ee5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:53.606058 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-529cbe1d-6843-40e7-98e9-128c2a1b9ee5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:53.634201 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-529cbe1d-6843-40e7-98e9-128c2a1b9ee5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043583 Oct 11 06:55:53.634744 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 873/1775] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:53 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:54.519857 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-96062483-d85d-4e0e-bd0d-db9753c8d35d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:54.520401 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-96062483-d85d-4e0e-bd0d-db9753c8d35d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:54.526818 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96062483-d85d-4e0e-bd0d-db9753c8d35d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:54.527289 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96062483-d85d-4e0e-bd0d-db9753c8d35d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:54.527748 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96062483-d85d-4e0e-bd0d-db9753c8d35d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:54.528430 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96062483-d85d-4e0e-bd0d-db9753c8d35d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:54.528872 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96062483-d85d-4e0e-bd0d-db9753c8d35d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:54.529285 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96062483-d85d-4e0e-bd0d-db9753c8d35d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:54.646241 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e63946fd-0119-4130-b7ec-0a1739c11a80 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:54.648415 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e63946fd-0119-4130-b7ec-0a1739c11a80 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:54.654927 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e63946fd-0119-4130-b7ec-0a1739c11a80 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:54.655405 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e63946fd-0119-4130-b7ec-0a1739c11a80 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:54.655860 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e63946fd-0119-4130-b7ec-0a1739c11a80 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:54.656562 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e63946fd-0119-4130-b7ec-0a1739c11a80 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:54.657004 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e63946fd-0119-4130-b7ec-0a1739c11a80 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:54.657418 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e63946fd-0119-4130-b7ec-0a1739c11a80 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:54.659089 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-96062483-d85d-4e0e-bd0d-db9753c8d35d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:54.667498 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-96062483-d85d-4e0e-bd0d-db9753c8d35d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.151452 Oct 11 06:55:54.668061 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 903/1776] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:54 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:54.687005 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e63946fd-0119-4130-b7ec-0a1739c11a80 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044697 Oct 11 06:55:54.687652 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 874/1777] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:54 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:55:55.690324 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cc547b99-72a0-4a8f-ad23-f94619090bc0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:55.690960 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cc547b99-72a0-4a8f-ad23-f94619090bc0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:55.698019 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc547b99-72a0-4a8f-ad23-f94619090bc0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:55.698495 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc547b99-72a0-4a8f-ad23-f94619090bc0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:55.698917 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc547b99-72a0-4a8f-ad23-f94619090bc0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:55.699623 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc547b99-72a0-4a8f-ad23-f94619090bc0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:55.699732 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-63d87560-f927-4852-b2c2-1bcedf149088 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:55.700140 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc547b99-72a0-4a8f-ad23-f94619090bc0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:55.700463 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc547b99-72a0-4a8f-ad23-f94619090bc0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:55.701799 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-63d87560-f927-4852-b2c2-1bcedf149088 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:55.708442 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-63d87560-f927-4852-b2c2-1bcedf149088 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:55.708918 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-63d87560-f927-4852-b2c2-1bcedf149088 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:55.709354 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-63d87560-f927-4852-b2c2-1bcedf149088 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:55.710045 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-63d87560-f927-4852-b2c2-1bcedf149088 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:55.710490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-63d87560-f927-4852-b2c2-1bcedf149088 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:55.710904 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-63d87560-f927-4852-b2c2-1bcedf149088 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:55.744172 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-63d87560-f927-4852-b2c2-1bcedf149088 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048892 Oct 11 06:55:55.744760 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 875/1778] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:55 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:55:55.829814 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cc547b99-72a0-4a8f-ad23-f94619090bc0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:55.837856 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cc547b99-72a0-4a8f-ad23-f94619090bc0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.151277 Oct 11 06:55:55.839041 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 904/1779] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:55 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:56.755763 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c1bcf238-c84c-4820-a785-04267334f7b2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:56.757949 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c1bcf238-c84c-4820-a785-04267334f7b2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:56.764821 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1bcf238-c84c-4820-a785-04267334f7b2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:56.765398 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1bcf238-c84c-4820-a785-04267334f7b2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:56.765834 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1bcf238-c84c-4820-a785-04267334f7b2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:56.766521 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1bcf238-c84c-4820-a785-04267334f7b2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:56.766969 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1bcf238-c84c-4820-a785-04267334f7b2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:56.767827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1bcf238-c84c-4820-a785-04267334f7b2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:56.798089 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c1bcf238-c84c-4820-a785-04267334f7b2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046157 Oct 11 06:55:56.798634 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 876/1780] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:56 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:56.861305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-97c7d0ab-60fa-400f-938b-2c32d5337351 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:56.861903 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-97c7d0ab-60fa-400f-938b-2c32d5337351 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:56.868243 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-97c7d0ab-60fa-400f-938b-2c32d5337351 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:56.868717 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-97c7d0ab-60fa-400f-938b-2c32d5337351 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:56.869248 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-97c7d0ab-60fa-400f-938b-2c32d5337351 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:56.869929 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-97c7d0ab-60fa-400f-938b-2c32d5337351 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:56.870369 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-97c7d0ab-60fa-400f-938b-2c32d5337351 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:56.870786 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-97c7d0ab-60fa-400f-938b-2c32d5337351 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:56.999123 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-97c7d0ab-60fa-400f-938b-2c32d5337351 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:57.007223 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-97c7d0ab-60fa-400f-938b-2c32d5337351 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149657 Oct 11 06:55:57.007810 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 905/1781] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:56 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:57.810690 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4580b7e3-30c7-41a5-9ca4-1ccc15b12088 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:57.812878 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4580b7e3-30c7-41a5-9ca4-1ccc15b12088 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:57.819240 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4580b7e3-30c7-41a5-9ca4-1ccc15b12088 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:57.819760 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4580b7e3-30c7-41a5-9ca4-1ccc15b12088 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:57.820188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4580b7e3-30c7-41a5-9ca4-1ccc15b12088 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:57.820872 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4580b7e3-30c7-41a5-9ca4-1ccc15b12088 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:57.821314 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4580b7e3-30c7-41a5-9ca4-1ccc15b12088 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:57.821728 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4580b7e3-30c7-41a5-9ca4-1ccc15b12088 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:57.837710 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:55:57.850708 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4580b7e3-30c7-41a5-9ca4-1ccc15b12088 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044571 Oct 11 06:55:57.851241 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 877/1782] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:57 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:58.030797 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-909ce681-1db7-41a2-b45f-4466566e4ecd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:58.031319 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-909ce681-1db7-41a2-b45f-4466566e4ecd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:58.037840 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-909ce681-1db7-41a2-b45f-4466566e4ecd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:58.038312 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-909ce681-1db7-41a2-b45f-4466566e4ecd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:58.038762 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-909ce681-1db7-41a2-b45f-4466566e4ecd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:58.039469 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-909ce681-1db7-41a2-b45f-4466566e4ecd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:58.039946 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-909ce681-1db7-41a2-b45f-4466566e4ecd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:58.040363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-909ce681-1db7-41a2-b45f-4466566e4ecd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:58.172285 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-909ce681-1db7-41a2-b45f-4466566e4ecd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:58.181530 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-909ce681-1db7-41a2-b45f-4466566e4ecd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.154657 Oct 11 06:55:58.182415 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 906/1783] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:58 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:58.863554 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-43d1f65b-2ae0-4297-b757-6abf94f91baf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:58.865745 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-43d1f65b-2ae0-4297-b757-6abf94f91baf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:58.872622 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-43d1f65b-2ae0-4297-b757-6abf94f91baf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:58.873047 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-43d1f65b-2ae0-4297-b757-6abf94f91baf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:58.873480 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-43d1f65b-2ae0-4297-b757-6abf94f91baf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:58.874168 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-43d1f65b-2ae0-4297-b757-6abf94f91baf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:58.874620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-43d1f65b-2ae0-4297-b757-6abf94f91baf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:58.875048 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-43d1f65b-2ae0-4297-b757-6abf94f91baf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:58.904341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-43d1f65b-2ae0-4297-b757-6abf94f91baf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044679 Oct 11 06:55:58.904925 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 878/1784] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:58 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:55:59.204572 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-21a8fa8f-3393-4caa-b3b6-e89e659af32b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:59.205113 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-21a8fa8f-3393-4caa-b3b6-e89e659af32b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:59.211466 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21a8fa8f-3393-4caa-b3b6-e89e659af32b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:59.211940 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21a8fa8f-3393-4caa-b3b6-e89e659af32b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:59.212359 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21a8fa8f-3393-4caa-b3b6-e89e659af32b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:59.213032 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21a8fa8f-3393-4caa-b3b6-e89e659af32b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:59.213469 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21a8fa8f-3393-4caa-b3b6-e89e659af32b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:59.213881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21a8fa8f-3393-4caa-b3b6-e89e659af32b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:59.343266 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-21a8fa8f-3393-4caa-b3b6-e89e659af32b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:55:59.351327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-21a8fa8f-3393-4caa-b3b6-e89e659af32b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150718 Oct 11 06:55:59.351906 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 907/1785] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:55:59 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:55:59.917174 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8f1e279a-db33-445e-9cb0-bca4de6a60ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:55:59.919947 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8f1e279a-db33-445e-9cb0-bca4de6a60ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:55:59.926286 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f1e279a-db33-445e-9cb0-bca4de6a60ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:59.926767 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f1e279a-db33-445e-9cb0-bca4de6a60ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:59.927199 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f1e279a-db33-445e-9cb0-bca4de6a60ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:59.927919 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f1e279a-db33-445e-9cb0-bca4de6a60ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:55:59.928372 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f1e279a-db33-445e-9cb0-bca4de6a60ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:55:59.928795 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f1e279a-db33-445e-9cb0-bca4de6a60ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:55:59.958683 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8f1e279a-db33-445e-9cb0-bca4de6a60ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046107 Oct 11 06:55:59.959249 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 879/1786] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:55:59 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:00.374618 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f3d1070f-04d4-4d1b-9ed9-501c562c5c7a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:00.375229 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f3d1070f-04d4-4d1b-9ed9-501c562c5c7a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:00.381735 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f3d1070f-04d4-4d1b-9ed9-501c562c5c7a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:00.382143 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f3d1070f-04d4-4d1b-9ed9-501c562c5c7a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:00.382572 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f3d1070f-04d4-4d1b-9ed9-501c562c5c7a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:00.383276 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f3d1070f-04d4-4d1b-9ed9-501c562c5c7a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:00.383733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f3d1070f-04d4-4d1b-9ed9-501c562c5c7a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:00.384151 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f3d1070f-04d4-4d1b-9ed9-501c562c5c7a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:00.607882 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f3d1070f-04d4-4d1b-9ed9-501c562c5c7a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:00.616068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f3d1070f-04d4-4d1b-9ed9-501c562c5c7a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.245332 Oct 11 06:56:00.616634 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 908/1787] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:00 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:00.971431 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-98ce097f-87c0-49ef-8529-d619e5bfbb31 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:00.973580 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-98ce097f-87c0-49ef-8529-d619e5bfbb31 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:00.980448 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-98ce097f-87c0-49ef-8529-d619e5bfbb31 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:00.980940 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-98ce097f-87c0-49ef-8529-d619e5bfbb31 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:00.981372 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-98ce097f-87c0-49ef-8529-d619e5bfbb31 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:00.982063 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-98ce097f-87c0-49ef-8529-d619e5bfbb31 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:00.982517 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-98ce097f-87c0-49ef-8529-d619e5bfbb31 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:00.982939 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-98ce097f-87c0-49ef-8529-d619e5bfbb31 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:01.011746 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-98ce097f-87c0-49ef-8529-d619e5bfbb31 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044281 Oct 11 06:56:01.012282 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 880/1788] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:00 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:01.640444 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-49a612b4-c786-4188-89b1-23e6fa1935ba tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:01.641049 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-49a612b4-c786-4188-89b1-23e6fa1935ba tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:01.647464 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49a612b4-c786-4188-89b1-23e6fa1935ba tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:01.647948 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49a612b4-c786-4188-89b1-23e6fa1935ba tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:01.648379 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49a612b4-c786-4188-89b1-23e6fa1935ba tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:01.649073 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49a612b4-c786-4188-89b1-23e6fa1935ba tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:01.649523 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49a612b4-c786-4188-89b1-23e6fa1935ba tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:01.649947 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49a612b4-c786-4188-89b1-23e6fa1935ba tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:01.781921 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-49a612b4-c786-4188-89b1-23e6fa1935ba tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:01.790716 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-49a612b4-c786-4188-89b1-23e6fa1935ba tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.154358 Oct 11 06:56:01.791276 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 909/1789] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:01 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:56:02.024388 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c78756bd-551a-4d56-86f0-de611de3a74d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:02.026513 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c78756bd-551a-4d56-86f0-de611de3a74d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:02.032780 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c78756bd-551a-4d56-86f0-de611de3a74d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:02.033259 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c78756bd-551a-4d56-86f0-de611de3a74d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:02.033707 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c78756bd-551a-4d56-86f0-de611de3a74d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:02.034392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c78756bd-551a-4d56-86f0-de611de3a74d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:02.034836 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c78756bd-551a-4d56-86f0-de611de3a74d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:02.035254 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c78756bd-551a-4d56-86f0-de611de3a74d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:02.063763 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c78756bd-551a-4d56-86f0-de611de3a74d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043231 Oct 11 06:56:02.064304 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 881/1790] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:02 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:02.813585 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7a0992c8-7d21-44fa-adb8-db149f185f92 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:02.814196 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7a0992c8-7d21-44fa-adb8-db149f185f92 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:02.820556 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7a0992c8-7d21-44fa-adb8-db149f185f92 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:02.821038 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7a0992c8-7d21-44fa-adb8-db149f185f92 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:02.821468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7a0992c8-7d21-44fa-adb8-db149f185f92 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:02.822156 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7a0992c8-7d21-44fa-adb8-db149f185f92 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:02.822602 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7a0992c8-7d21-44fa-adb8-db149f185f92 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:02.823023 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7a0992c8-7d21-44fa-adb8-db149f185f92 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:02.950612 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7a0992c8-7d21-44fa-adb8-db149f185f92 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:02.958830 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7a0992c8-7d21-44fa-adb8-db149f185f92 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149009 Oct 11 06:56:02.959389 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 910/1791] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:02 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:03.076610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-76f8b4ff-b964-4f2b-a23c-baec1d3ef278 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:03.079056 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-76f8b4ff-b964-4f2b-a23c-baec1d3ef278 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:03.085355 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-76f8b4ff-b964-4f2b-a23c-baec1d3ef278 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:03.085829 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-76f8b4ff-b964-4f2b-a23c-baec1d3ef278 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:03.086261 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-76f8b4ff-b964-4f2b-a23c-baec1d3ef278 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:03.086946 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-76f8b4ff-b964-4f2b-a23c-baec1d3ef278 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:03.087390 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-76f8b4ff-b964-4f2b-a23c-baec1d3ef278 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:03.088428 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-76f8b4ff-b964-4f2b-a23c-baec1d3ef278 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:03.117736 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-76f8b4ff-b964-4f2b-a23c-baec1d3ef278 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045755 Oct 11 06:56:03.118269 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 882/1792] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:03 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:03.983118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-224a1220-2c77-4318-af3e-c83e16198290 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:03.983672 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-224a1220-2c77-4318-af3e-c83e16198290 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:03.986089 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=54 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:56:03.991303 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-224a1220-2c77-4318-af3e-c83e16198290 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:03.991817 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-224a1220-2c77-4318-af3e-c83e16198290 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:03.992252 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-224a1220-2c77-4318-af3e-c83e16198290 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:03.992940 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-224a1220-2c77-4318-af3e-c83e16198290 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:03.993389 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-224a1220-2c77-4318-af3e-c83e16198290 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:03.993817 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-224a1220-2c77-4318-af3e-c83e16198290 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:04.124289 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-224a1220-2c77-4318-af3e-c83e16198290 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:04.130447 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2681dd5f-f74d-49d6-9815-d0b983c43770 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:04.132503 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-224a1220-2c77-4318-af3e-c83e16198290 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.153217 Oct 11 06:56:04.133234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 911/1793] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:03 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:04.134261 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2681dd5f-f74d-49d6-9815-d0b983c43770 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:04.141428 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2681dd5f-f74d-49d6-9815-d0b983c43770 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:04.141915 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2681dd5f-f74d-49d6-9815-d0b983c43770 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:04.142347 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2681dd5f-f74d-49d6-9815-d0b983c43770 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:04.143054 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2681dd5f-f74d-49d6-9815-d0b983c43770 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:04.143532 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2681dd5f-f74d-49d6-9815-d0b983c43770 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:04.144217 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2681dd5f-f74d-49d6-9815-d0b983c43770 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:04.172917 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2681dd5f-f74d-49d6-9815-d0b983c43770 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046789 Oct 11 06:56:04.173488 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 883/1794] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:04 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:56:05.157098 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4a4128b9-b03a-46df-abdd-bdaca80ef16c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:05.157799 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4a4128b9-b03a-46df-abdd-bdaca80ef16c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:05.164659 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4a4128b9-b03a-46df-abdd-bdaca80ef16c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:05.165141 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4a4128b9-b03a-46df-abdd-bdaca80ef16c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:05.165573 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4a4128b9-b03a-46df-abdd-bdaca80ef16c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:05.166271 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4a4128b9-b03a-46df-abdd-bdaca80ef16c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:05.166718 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4a4128b9-b03a-46df-abdd-bdaca80ef16c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:05.167737 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4a4128b9-b03a-46df-abdd-bdaca80ef16c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:05.185409 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7c8c77ec-3a62-4638-a90c-d83ccf8daf8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:05.188203 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7c8c77ec-3a62-4638-a90c-d83ccf8daf8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:05.194686 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7c8c77ec-3a62-4638-a90c-d83ccf8daf8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:05.195169 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7c8c77ec-3a62-4638-a90c-d83ccf8daf8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:05.195640 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7c8c77ec-3a62-4638-a90c-d83ccf8daf8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:05.201772 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7c8c77ec-3a62-4638-a90c-d83ccf8daf8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:05.202270 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7c8c77ec-3a62-4638-a90c-d83ccf8daf8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:05.202710 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7c8c77ec-3a62-4638-a90c-d83ccf8daf8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:05.232916 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7c8c77ec-3a62-4638-a90c-d83ccf8daf8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051490 Oct 11 06:56:05.233705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 884/1795] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:05 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:05.297826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4a4128b9-b03a-46df-abdd-bdaca80ef16c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:05.305864 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4a4128b9-b03a-46df-abdd-bdaca80ef16c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.152546 Oct 11 06:56:05.306413 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 912/1796] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:05 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:06.245092 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-44f5fe8c-60db-48a3-b480-315bcd25cf7a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:06.247262 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-44f5fe8c-60db-48a3-b480-315bcd25cf7a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:06.254041 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-44f5fe8c-60db-48a3-b480-315bcd25cf7a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:06.254535 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-44f5fe8c-60db-48a3-b480-315bcd25cf7a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:06.254973 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-44f5fe8c-60db-48a3-b480-315bcd25cf7a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:06.255705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-44f5fe8c-60db-48a3-b480-315bcd25cf7a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:06.256162 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-44f5fe8c-60db-48a3-b480-315bcd25cf7a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:06.256586 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-44f5fe8c-60db-48a3-b480-315bcd25cf7a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:06.287107 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-44f5fe8c-60db-48a3-b480-315bcd25cf7a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045869 Oct 11 06:56:06.287685 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 885/1797] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:06 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:06.329358 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b588e5ac-1122-4e1c-980e-1048ea2c1dff tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:06.329963 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b588e5ac-1122-4e1c-980e-1048ea2c1dff tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:06.336255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b588e5ac-1122-4e1c-980e-1048ea2c1dff tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:06.336726 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b588e5ac-1122-4e1c-980e-1048ea2c1dff tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:06.337152 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b588e5ac-1122-4e1c-980e-1048ea2c1dff tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:06.337836 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b588e5ac-1122-4e1c-980e-1048ea2c1dff tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:06.338281 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b588e5ac-1122-4e1c-980e-1048ea2c1dff tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:06.338700 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b588e5ac-1122-4e1c-980e-1048ea2c1dff tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:06.466891 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b588e5ac-1122-4e1c-980e-1048ea2c1dff tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:06.474981 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b588e5ac-1122-4e1c-980e-1048ea2c1dff tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149350 Oct 11 06:56:06.475559 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 913/1798] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:06 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:07.299152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8d79f11d-d9e1-4215-a46f-962f8a95a29b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:07.301322 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8d79f11d-d9e1-4215-a46f-962f8a95a29b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:07.307785 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d79f11d-d9e1-4215-a46f-962f8a95a29b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:07.308303 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d79f11d-d9e1-4215-a46f-962f8a95a29b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:07.308702 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d79f11d-d9e1-4215-a46f-962f8a95a29b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:07.309400 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d79f11d-d9e1-4215-a46f-962f8a95a29b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:07.309895 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d79f11d-d9e1-4215-a46f-962f8a95a29b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:07.310445 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d79f11d-d9e1-4215-a46f-962f8a95a29b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:07.339977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8d79f11d-d9e1-4215-a46f-962f8a95a29b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044656 Oct 11 06:56:07.340513 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 886/1799] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:07 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:07.498009 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2b00f4a3-f347-45a9-ae42-98ae5d3246e8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:07.498618 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2b00f4a3-f347-45a9-ae42-98ae5d3246e8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:07.505175 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2b00f4a3-f347-45a9-ae42-98ae5d3246e8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:07.505596 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2b00f4a3-f347-45a9-ae42-98ae5d3246e8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:07.506030 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2b00f4a3-f347-45a9-ae42-98ae5d3246e8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:07.506721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2b00f4a3-f347-45a9-ae42-98ae5d3246e8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:07.507168 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2b00f4a3-f347-45a9-ae42-98ae5d3246e8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:07.507637 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2b00f4a3-f347-45a9-ae42-98ae5d3246e8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:07.631947 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2b00f4a3-f347-45a9-ae42-98ae5d3246e8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:07.641113 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2b00f4a3-f347-45a9-ae42-98ae5d3246e8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.146927 Oct 11 06:56:07.641680 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 914/1800] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:07 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:08.352178 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-267a8ae3-5ece-4112-bc71-1b84fc2031f7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:08.354796 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-267a8ae3-5ece-4112-bc71-1b84fc2031f7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:08.361732 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-267a8ae3-5ece-4112-bc71-1b84fc2031f7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:08.362222 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-267a8ae3-5ece-4112-bc71-1b84fc2031f7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:08.363075 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-267a8ae3-5ece-4112-bc71-1b84fc2031f7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:08.363814 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-267a8ae3-5ece-4112-bc71-1b84fc2031f7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:08.364268 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-267a8ae3-5ece-4112-bc71-1b84fc2031f7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:08.364692 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-267a8ae3-5ece-4112-bc71-1b84fc2031f7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:08.395523 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-267a8ae3-5ece-4112-bc71-1b84fc2031f7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047303 Oct 11 06:56:08.396084 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 887/1801] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:08 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:08.664813 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6fd04777-62b6-4861-97ed-76414b585570 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:08.665427 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6fd04777-62b6-4861-97ed-76414b585570 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:08.672435 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fd04777-62b6-4861-97ed-76414b585570 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:08.672912 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fd04777-62b6-4861-97ed-76414b585570 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:08.673348 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fd04777-62b6-4861-97ed-76414b585570 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:08.674036 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fd04777-62b6-4861-97ed-76414b585570 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:08.674484 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fd04777-62b6-4861-97ed-76414b585570 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:08.674907 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fd04777-62b6-4861-97ed-76414b585570 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:08.801505 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6fd04777-62b6-4861-97ed-76414b585570 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:08.809995 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6fd04777-62b6-4861-97ed-76414b585570 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149180 Oct 11 06:56:08.810541 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 915/1802] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:08 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:09.408033 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-57094e2f-5001-4598-88c1-9b25f8161335 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:09.409875 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-57094e2f-5001-4598-88c1-9b25f8161335 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:09.416492 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57094e2f-5001-4598-88c1-9b25f8161335 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:09.416971 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57094e2f-5001-4598-88c1-9b25f8161335 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:09.417400 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57094e2f-5001-4598-88c1-9b25f8161335 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:09.418144 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57094e2f-5001-4598-88c1-9b25f8161335 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:09.418523 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57094e2f-5001-4598-88c1-9b25f8161335 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:09.418938 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57094e2f-5001-4598-88c1-9b25f8161335 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:09.449777 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-57094e2f-5001-4598-88c1-9b25f8161335 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045914 Oct 11 06:56:09.450322 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 888/1803] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:09 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:09.832653 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1b3508e2-fd6f-46cb-a44b-19f845dc4f3e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:09.833340 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1b3508e2-fd6f-46cb-a44b-19f845dc4f3e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:09.839641 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b3508e2-fd6f-46cb-a44b-19f845dc4f3e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:09.840113 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b3508e2-fd6f-46cb-a44b-19f845dc4f3e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:09.840542 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b3508e2-fd6f-46cb-a44b-19f845dc4f3e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:09.841224 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b3508e2-fd6f-46cb-a44b-19f845dc4f3e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:09.841670 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b3508e2-fd6f-46cb-a44b-19f845dc4f3e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:09.842103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b3508e2-fd6f-46cb-a44b-19f845dc4f3e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:09.972165 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1b3508e2-fd6f-46cb-a44b-19f845dc4f3e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:09.980697 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1b3508e2-fd6f-46cb-a44b-19f845dc4f3e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.151873 Oct 11 06:56:09.981252 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 916/1804] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:09 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:10.462006 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8e867c6c-62ea-4153-bc73-f727b3ac7232 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:10.464903 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8e867c6c-62ea-4153-bc73-f727b3ac7232 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:10.471215 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e867c6c-62ea-4153-bc73-f727b3ac7232 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:10.471735 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e867c6c-62ea-4153-bc73-f727b3ac7232 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:10.472173 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e867c6c-62ea-4153-bc73-f727b3ac7232 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:10.472877 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e867c6c-62ea-4153-bc73-f727b3ac7232 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:10.473329 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e867c6c-62ea-4153-bc73-f727b3ac7232 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:10.473752 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e867c6c-62ea-4153-bc73-f727b3ac7232 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:10.502672 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8e867c6c-62ea-4153-bc73-f727b3ac7232 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044607 Oct 11 06:56:10.503215 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 889/1805] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:10 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:11.004100 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ca00b82d-cc8a-4195-bdd1-0c73518db4df tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:11.004635 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ca00b82d-cc8a-4195-bdd1-0c73518db4df tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:11.011639 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ca00b82d-cc8a-4195-bdd1-0c73518db4df tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:11.012107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ca00b82d-cc8a-4195-bdd1-0c73518db4df tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:11.012526 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ca00b82d-cc8a-4195-bdd1-0c73518db4df tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:11.013229 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ca00b82d-cc8a-4195-bdd1-0c73518db4df tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:11.013667 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ca00b82d-cc8a-4195-bdd1-0c73518db4df tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:11.014076 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ca00b82d-cc8a-4195-bdd1-0c73518db4df tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:11.139069 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ca00b82d-cc8a-4195-bdd1-0c73518db4df tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:11.147352 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ca00b82d-cc8a-4195-bdd1-0c73518db4df tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147178 Oct 11 06:56:11.147935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 917/1806] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:10 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:11.514693 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8bb7cdf2-a390-411f-8334-86ef05eafa20 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:11.516867 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8bb7cdf2-a390-411f-8334-86ef05eafa20 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:11.523308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8bb7cdf2-a390-411f-8334-86ef05eafa20 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:11.523827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8bb7cdf2-a390-411f-8334-86ef05eafa20 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:11.524266 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8bb7cdf2-a390-411f-8334-86ef05eafa20 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:11.524960 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8bb7cdf2-a390-411f-8334-86ef05eafa20 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:11.525407 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8bb7cdf2-a390-411f-8334-86ef05eafa20 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:11.525826 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8bb7cdf2-a390-411f-8334-86ef05eafa20 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:11.554816 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8bb7cdf2-a390-411f-8334-86ef05eafa20 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044302 Oct 11 06:56:11.555361 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 890/1807] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:11 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:12.169963 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-dc1aefde-ea34-4aad-9f9a-24e4f2973c69 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:12.170578 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-dc1aefde-ea34-4aad-9f9a-24e4f2973c69 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:12.176878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc1aefde-ea34-4aad-9f9a-24e4f2973c69 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:12.177349 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc1aefde-ea34-4aad-9f9a-24e4f2973c69 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:12.177774 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc1aefde-ea34-4aad-9f9a-24e4f2973c69 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:12.178453 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc1aefde-ea34-4aad-9f9a-24e4f2973c69 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:12.178892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc1aefde-ea34-4aad-9f9a-24e4f2973c69 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:12.179335 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc1aefde-ea34-4aad-9f9a-24e4f2973c69 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:12.183262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:56:12.311722 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-dc1aefde-ea34-4aad-9f9a-24e4f2973c69 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:12.319873 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-dc1aefde-ea34-4aad-9f9a-24e4f2973c69 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.153712 Oct 11 06:56:12.320428 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 918/1808] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:12 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:12.567832 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5a0a6dfe-8837-49a1-a09a-1a3e271d8573 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:12.570674 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5a0a6dfe-8837-49a1-a09a-1a3e271d8573 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:12.577808 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a0a6dfe-8837-49a1-a09a-1a3e271d8573 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:12.578326 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a0a6dfe-8837-49a1-a09a-1a3e271d8573 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:12.578862 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a0a6dfe-8837-49a1-a09a-1a3e271d8573 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:12.579607 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a0a6dfe-8837-49a1-a09a-1a3e271d8573 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:12.580066 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a0a6dfe-8837-49a1-a09a-1a3e271d8573 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:12.581349 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a0a6dfe-8837-49a1-a09a-1a3e271d8573 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:12.610333 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5a0a6dfe-8837-49a1-a09a-1a3e271d8573 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046651 Oct 11 06:56:12.615022 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 891/1809] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:12 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:13.344322 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4380333a-f463-4fc4-ad28-5327f434d6fa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:13.344930 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4380333a-f463-4fc4-ad28-5327f434d6fa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:13.351283 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4380333a-f463-4fc4-ad28-5327f434d6fa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:13.351810 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4380333a-f463-4fc4-ad28-5327f434d6fa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:13.352241 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4380333a-f463-4fc4-ad28-5327f434d6fa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:13.352926 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4380333a-f463-4fc4-ad28-5327f434d6fa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:13.353372 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4380333a-f463-4fc4-ad28-5327f434d6fa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:13.353791 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4380333a-f463-4fc4-ad28-5327f434d6fa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:13.480023 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4380333a-f463-4fc4-ad28-5327f434d6fa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:13.488078 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4380333a-f463-4fc4-ad28-5327f434d6fa tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147544 Oct 11 06:56:13.488630 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 919/1810] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:13 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:13.622580 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5ed4327c-b0fd-4bc5-81ef-e6f2be7dc6a9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:13.624796 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5ed4327c-b0fd-4bc5-81ef-e6f2be7dc6a9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:13.631190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ed4327c-b0fd-4bc5-81ef-e6f2be7dc6a9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:13.631697 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ed4327c-b0fd-4bc5-81ef-e6f2be7dc6a9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:13.632131 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ed4327c-b0fd-4bc5-81ef-e6f2be7dc6a9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:13.632824 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ed4327c-b0fd-4bc5-81ef-e6f2be7dc6a9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:13.633264 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ed4327c-b0fd-4bc5-81ef-e6f2be7dc6a9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:13.633723 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ed4327c-b0fd-4bc5-81ef-e6f2be7dc6a9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:13.663934 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5ed4327c-b0fd-4bc5-81ef-e6f2be7dc6a9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045272 Oct 11 06:56:13.664492 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 892/1811] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:13 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:14.511702 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e9ee6068-1099-472a-88f2-4baaa7b9bc7b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:14.512309 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e9ee6068-1099-472a-88f2-4baaa7b9bc7b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:14.518877 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e9ee6068-1099-472a-88f2-4baaa7b9bc7b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:14.519348 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e9ee6068-1099-472a-88f2-4baaa7b9bc7b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:14.519810 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e9ee6068-1099-472a-88f2-4baaa7b9bc7b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:14.520495 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e9ee6068-1099-472a-88f2-4baaa7b9bc7b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:14.520939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e9ee6068-1099-472a-88f2-4baaa7b9bc7b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:14.521362 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e9ee6068-1099-472a-88f2-4baaa7b9bc7b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:14.645509 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e9ee6068-1099-472a-88f2-4baaa7b9bc7b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:14.654165 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e9ee6068-1099-472a-88f2-4baaa7b9bc7b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.146823 Oct 11 06:56:14.654727 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 920/1812] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:14 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:14.676125 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-30d44b40-e066-4619-a4b3-35106287e38e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:14.678270 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-30d44b40-e066-4619-a4b3-35106287e38e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:14.684560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30d44b40-e066-4619-a4b3-35106287e38e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:14.685039 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30d44b40-e066-4619-a4b3-35106287e38e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:14.685500 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30d44b40-e066-4619-a4b3-35106287e38e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:14.686193 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30d44b40-e066-4619-a4b3-35106287e38e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:14.686644 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30d44b40-e066-4619-a4b3-35106287e38e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:14.687065 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30d44b40-e066-4619-a4b3-35106287e38e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:14.716606 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-30d44b40-e066-4619-a4b3-35106287e38e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044322 Oct 11 06:56:14.717168 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 893/1813] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:14 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:15.677946 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6ebf6a17-b4f2-463a-b833-7db80c84ff8a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:15.678609 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6ebf6a17-b4f2-463a-b833-7db80c84ff8a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:15.687054 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6ebf6a17-b4f2-463a-b833-7db80c84ff8a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:15.687696 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6ebf6a17-b4f2-463a-b833-7db80c84ff8a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:15.688168 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6ebf6a17-b4f2-463a-b833-7db80c84ff8a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:15.688886 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6ebf6a17-b4f2-463a-b833-7db80c84ff8a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:15.689331 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6ebf6a17-b4f2-463a-b833-7db80c84ff8a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:15.689744 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6ebf6a17-b4f2-463a-b833-7db80c84ff8a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:15.728851 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1a18e471-634b-496a-a15b-5e962baa792d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:15.731593 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1a18e471-634b-496a-a15b-5e962baa792d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:15.738187 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1a18e471-634b-496a-a15b-5e962baa792d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:15.738680 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1a18e471-634b-496a-a15b-5e962baa792d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:15.739117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1a18e471-634b-496a-a15b-5e962baa792d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:15.739856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1a18e471-634b-496a-a15b-5e962baa792d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:15.740313 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1a18e471-634b-496a-a15b-5e962baa792d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:15.740759 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1a18e471-634b-496a-a15b-5e962baa792d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:15.744837 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:56:15.774649 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1a18e471-634b-496a-a15b-5e962baa792d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049477 Oct 11 06:56:15.774928 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 894/1814] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:15 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:56:15.830585 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6ebf6a17-b4f2-463a-b833-7db80c84ff8a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:15.838848 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6ebf6a17-b4f2-463a-b833-7db80c84ff8a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.164864 Oct 11 06:56:15.839429 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 921/1815] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:15 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:16.786698 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3dece3a2-6a10-4871-825c-1fc4b7857b95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:16.788775 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3dece3a2-6a10-4871-825c-1fc4b7857b95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:16.791056 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=58 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:56:16.796817 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3dece3a2-6a10-4871-825c-1fc4b7857b95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:16.797292 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3dece3a2-6a10-4871-825c-1fc4b7857b95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:16.797720 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3dece3a2-6a10-4871-825c-1fc4b7857b95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:16.798402 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3dece3a2-6a10-4871-825c-1fc4b7857b95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:16.798847 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3dece3a2-6a10-4871-825c-1fc4b7857b95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:16.799265 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3dece3a2-6a10-4871-825c-1fc4b7857b95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:16.828883 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3dece3a2-6a10-4871-825c-1fc4b7857b95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046180 Oct 11 06:56:16.829429 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 895/1816] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:16 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:16.861907 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-421d04dd-a4a7-475e-bd71-4f50c335ef45 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:16.862599 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-421d04dd-a4a7-475e-bd71-4f50c335ef45 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:16.869190 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-421d04dd-a4a7-475e-bd71-4f50c335ef45 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:16.869744 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-421d04dd-a4a7-475e-bd71-4f50c335ef45 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:16.870248 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-421d04dd-a4a7-475e-bd71-4f50c335ef45 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:16.870945 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-421d04dd-a4a7-475e-bd71-4f50c335ef45 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:16.871398 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-421d04dd-a4a7-475e-bd71-4f50c335ef45 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:16.871847 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-421d04dd-a4a7-475e-bd71-4f50c335ef45 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:16.995747 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-421d04dd-a4a7-475e-bd71-4f50c335ef45 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:17.003799 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-421d04dd-a4a7-475e-bd71-4f50c335ef45 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.145695 Oct 11 06:56:17.004356 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 922/1817] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:16 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:17.840631 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0f9bc2b0-aa4c-4cac-8bea-752233a5c9a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:17.842699 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0f9bc2b0-aa4c-4cac-8bea-752233a5c9a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:17.848677 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0f9bc2b0-aa4c-4cac-8bea-752233a5c9a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:17.849157 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0f9bc2b0-aa4c-4cac-8bea-752233a5c9a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:17.849592 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0f9bc2b0-aa4c-4cac-8bea-752233a5c9a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:17.850288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0f9bc2b0-aa4c-4cac-8bea-752233a5c9a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:17.850744 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0f9bc2b0-aa4c-4cac-8bea-752233a5c9a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:17.851167 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0f9bc2b0-aa4c-4cac-8bea-752233a5c9a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:17.880460 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0f9bc2b0-aa4c-4cac-8bea-752233a5c9a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044059 Oct 11 06:56:17.881016 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 896/1818] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:17 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:18.027538 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f1dd163a-edc2-43e5-a694-1c7c817b02d1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:18.028150 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f1dd163a-edc2-43e5-a694-1c7c817b02d1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:18.034569 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1dd163a-edc2-43e5-a694-1c7c817b02d1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:18.035065 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1dd163a-edc2-43e5-a694-1c7c817b02d1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:18.035495 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1dd163a-edc2-43e5-a694-1c7c817b02d1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:18.036192 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1dd163a-edc2-43e5-a694-1c7c817b02d1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:18.036639 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1dd163a-edc2-43e5-a694-1c7c817b02d1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:18.037059 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f1dd163a-edc2-43e5-a694-1c7c817b02d1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:18.178249 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f1dd163a-edc2-43e5-a694-1c7c817b02d1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:18.187223 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f1dd163a-edc2-43e5-a694-1c7c817b02d1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.163761 Oct 11 06:56:18.187811 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 923/1819] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:18 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:18.893214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-845cb6dd-8d32-4aff-a2db-14f145ec2488 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:18.895438 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-845cb6dd-8d32-4aff-a2db-14f145ec2488 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:18.901868 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-845cb6dd-8d32-4aff-a2db-14f145ec2488 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:18.902353 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-845cb6dd-8d32-4aff-a2db-14f145ec2488 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:18.902792 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-845cb6dd-8d32-4aff-a2db-14f145ec2488 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:18.903520 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-845cb6dd-8d32-4aff-a2db-14f145ec2488 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:18.903977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-845cb6dd-8d32-4aff-a2db-14f145ec2488 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:18.904404 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-845cb6dd-8d32-4aff-a2db-14f145ec2488 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:18.934209 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-845cb6dd-8d32-4aff-a2db-14f145ec2488 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045178 Oct 11 06:56:18.934914 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 897/1820] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:18 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:19.209901 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-05d5cfd3-c9ef-4afe-a968-24ec8c4d6e5e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:19.210435 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-05d5cfd3-c9ef-4afe-a968-24ec8c4d6e5e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:19.217413 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05d5cfd3-c9ef-4afe-a968-24ec8c4d6e5e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:19.217881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05d5cfd3-c9ef-4afe-a968-24ec8c4d6e5e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:19.218303 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05d5cfd3-c9ef-4afe-a968-24ec8c4d6e5e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:19.218978 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05d5cfd3-c9ef-4afe-a968-24ec8c4d6e5e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:19.219447 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05d5cfd3-c9ef-4afe-a968-24ec8c4d6e5e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:19.219856 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05d5cfd3-c9ef-4afe-a968-24ec8c4d6e5e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:19.345210 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-05d5cfd3-c9ef-4afe-a968-24ec8c4d6e5e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:19.353498 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-05d5cfd3-c9ef-4afe-a968-24ec8c4d6e5e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147413 Oct 11 06:56:19.354098 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 924/1821] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:19 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:19.945988 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a659413d-0473-425e-ba4b-d619835d5384 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:19.948644 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a659413d-0473-425e-ba4b-d619835d5384 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:19.955046 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a659413d-0473-425e-ba4b-d619835d5384 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:19.955567 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a659413d-0473-425e-ba4b-d619835d5384 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:19.956004 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a659413d-0473-425e-ba4b-d619835d5384 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:19.956697 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a659413d-0473-425e-ba4b-d619835d5384 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:19.957150 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a659413d-0473-425e-ba4b-d619835d5384 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:19.957570 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a659413d-0473-425e-ba4b-d619835d5384 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:19.985761 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a659413d-0473-425e-ba4b-d619835d5384 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043816 Oct 11 06:56:19.986300 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 898/1822] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:19 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:20.377104 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-86b573fd-f993-457d-bb4b-72376611c93f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:20.377705 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-86b573fd-f993-457d-bb4b-72376611c93f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:20.384148 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-86b573fd-f993-457d-bb4b-72376611c93f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:20.384616 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-86b573fd-f993-457d-bb4b-72376611c93f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:20.385040 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-86b573fd-f993-457d-bb4b-72376611c93f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:20.385780 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-86b573fd-f993-457d-bb4b-72376611c93f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:20.386220 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-86b573fd-f993-457d-bb4b-72376611c93f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:20.386635 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-86b573fd-f993-457d-bb4b-72376611c93f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:20.517049 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-86b573fd-f993-457d-bb4b-72376611c93f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:20.525108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-86b573fd-f993-457d-bb4b-72376611c93f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.151836 Oct 11 06:56:20.525670 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 925/1823] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:20 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:20.997461 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-811155ef-5073-4717-a1b1-6bffefa7061e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:20.999575 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-811155ef-5073-4717-a1b1-6bffefa7061e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:21.005969 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-811155ef-5073-4717-a1b1-6bffefa7061e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:21.006448 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-811155ef-5073-4717-a1b1-6bffefa7061e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:21.006884 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-811155ef-5073-4717-a1b1-6bffefa7061e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:21.007610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-811155ef-5073-4717-a1b1-6bffefa7061e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:21.008068 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-811155ef-5073-4717-a1b1-6bffefa7061e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:21.008491 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-811155ef-5073-4717-a1b1-6bffefa7061e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:21.038964 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-811155ef-5073-4717-a1b1-6bffefa7061e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045534 Oct 11 06:56:21.039547 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 899/1824] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:20 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:21.548207 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5716c1f3-8b32-4d51-8b24-3210d52bcd0f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:21.548753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5716c1f3-8b32-4d51-8b24-3210d52bcd0f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:21.554625 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5716c1f3-8b32-4d51-8b24-3210d52bcd0f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:21.555098 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5716c1f3-8b32-4d51-8b24-3210d52bcd0f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:21.555563 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5716c1f3-8b32-4d51-8b24-3210d52bcd0f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:21.556248 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5716c1f3-8b32-4d51-8b24-3210d52bcd0f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:21.556724 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5716c1f3-8b32-4d51-8b24-3210d52bcd0f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:21.557632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5716c1f3-8b32-4d51-8b24-3210d52bcd0f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:21.681740 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5716c1f3-8b32-4d51-8b24-3210d52bcd0f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:21.690337 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5716c1f3-8b32-4d51-8b24-3210d52bcd0f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.146170 Oct 11 06:56:21.690887 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 926/1825] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:21 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:22.051308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a8a0f476-454d-47b9-ac89-538661c67d28 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:22.053418 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a8a0f476-454d-47b9-ac89-538661c67d28 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:22.060282 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a8a0f476-454d-47b9-ac89-538661c67d28 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:22.060761 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a8a0f476-454d-47b9-ac89-538661c67d28 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:22.061198 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a8a0f476-454d-47b9-ac89-538661c67d28 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:22.061889 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a8a0f476-454d-47b9-ac89-538661c67d28 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:22.062338 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a8a0f476-454d-47b9-ac89-538661c67d28 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:22.062756 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a8a0f476-454d-47b9-ac89-538661c67d28 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:22.091552 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a8a0f476-454d-47b9-ac89-538661c67d28 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044259 Oct 11 06:56:22.092084 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 900/1826] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:22 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:22.713950 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ce41541b-e57c-490a-906d-ee87ce08182e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:22.714481 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ce41541b-e57c-490a-906d-ee87ce08182e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:22.720824 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ce41541b-e57c-490a-906d-ee87ce08182e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:22.721294 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ce41541b-e57c-490a-906d-ee87ce08182e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:22.721718 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ce41541b-e57c-490a-906d-ee87ce08182e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:22.722398 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ce41541b-e57c-490a-906d-ee87ce08182e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:22.722864 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ce41541b-e57c-490a-906d-ee87ce08182e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:22.723277 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ce41541b-e57c-490a-906d-ee87ce08182e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:22.848440 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ce41541b-e57c-490a-906d-ee87ce08182e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:22.857147 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ce41541b-e57c-490a-906d-ee87ce08182e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147059 Oct 11 06:56:22.857717 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 927/1827] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:22 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:23.103055 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-65fc8111-c577-4525-99c6-576d684a02f7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:23.105857 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-65fc8111-c577-4525-99c6-576d684a02f7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:23.112176 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65fc8111-c577-4525-99c6-576d684a02f7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:23.112647 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65fc8111-c577-4525-99c6-576d684a02f7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:23.113077 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65fc8111-c577-4525-99c6-576d684a02f7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:23.113759 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65fc8111-c577-4525-99c6-576d684a02f7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:23.114228 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65fc8111-c577-4525-99c6-576d684a02f7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:23.114676 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65fc8111-c577-4525-99c6-576d684a02f7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:23.142860 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-65fc8111-c577-4525-99c6-576d684a02f7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043677 Oct 11 06:56:23.143387 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 901/1828] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:23 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:23.880144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d3cb389f-3de2-472e-8c4f-bde0c54c3b1e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:23.880747 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d3cb389f-3de2-472e-8c4f-bde0c54c3b1e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:23.887149 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d3cb389f-3de2-472e-8c4f-bde0c54c3b1e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:23.887648 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d3cb389f-3de2-472e-8c4f-bde0c54c3b1e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:23.888092 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d3cb389f-3de2-472e-8c4f-bde0c54c3b1e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:23.888742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d3cb389f-3de2-472e-8c4f-bde0c54c3b1e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:23.889186 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d3cb389f-3de2-472e-8c4f-bde0c54c3b1e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:23.889875 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d3cb389f-3de2-472e-8c4f-bde0c54c3b1e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:24.019210 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d3cb389f-3de2-472e-8c4f-bde0c54c3b1e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:24.027907 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d3cb389f-3de2-472e-8c4f-bde0c54c3b1e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.151560 Oct 11 06:56:24.028466 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 928/1829] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:23 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:24.155786 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e7ce9037-67cd-4b8f-8b30-846f790519b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:24.157891 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e7ce9037-67cd-4b8f-8b30-846f790519b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:24.164239 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7ce9037-67cd-4b8f-8b30-846f790519b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:24.164716 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7ce9037-67cd-4b8f-8b30-846f790519b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:24.165156 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7ce9037-67cd-4b8f-8b30-846f790519b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:24.165843 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7ce9037-67cd-4b8f-8b30-846f790519b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:24.166293 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7ce9037-67cd-4b8f-8b30-846f790519b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:24.166711 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7ce9037-67cd-4b8f-8b30-846f790519b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:24.195112 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e7ce9037-67cd-4b8f-8b30-846f790519b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043943 Oct 11 06:56:24.195923 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 902/1830] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:24 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:25.050137 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-11599fd4-b01a-4c6c-8a7d-4bcda18f76fc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:25.050764 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-11599fd4-b01a-4c6c-8a7d-4bcda18f76fc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:25.057566 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-11599fd4-b01a-4c6c-8a7d-4bcda18f76fc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:25.058037 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-11599fd4-b01a-4c6c-8a7d-4bcda18f76fc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:25.058463 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-11599fd4-b01a-4c6c-8a7d-4bcda18f76fc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:25.059145 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-11599fd4-b01a-4c6c-8a7d-4bcda18f76fc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:25.059616 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-11599fd4-b01a-4c6c-8a7d-4bcda18f76fc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:25.060031 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-11599fd4-b01a-4c6c-8a7d-4bcda18f76fc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:25.184844 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-11599fd4-b01a-4c6c-8a7d-4bcda18f76fc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:25.192900 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-11599fd4-b01a-4c6c-8a7d-4bcda18f76fc tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.146526 Oct 11 06:56:25.193454 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 929/1831] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:25 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:25.208189 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cf6e50c3-5a7d-4105-a710-42643eeffa97 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:25.210390 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cf6e50c3-5a7d-4105-a710-42643eeffa97 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:25.216792 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf6e50c3-5a7d-4105-a710-42643eeffa97 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:25.217269 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf6e50c3-5a7d-4105-a710-42643eeffa97 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:25.217700 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf6e50c3-5a7d-4105-a710-42643eeffa97 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:25.218390 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf6e50c3-5a7d-4105-a710-42643eeffa97 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:25.218843 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf6e50c3-5a7d-4105-a710-42643eeffa97 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:25.219263 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf6e50c3-5a7d-4105-a710-42643eeffa97 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:25.247938 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cf6e50c3-5a7d-4105-a710-42643eeffa97 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043775 Oct 11 06:56:25.248473 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 903/1832] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:25 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:26.217010 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-54d43b13-92e1-4f2a-8a9c-c2d754e1c3a2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:26.217664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-54d43b13-92e1-4f2a-8a9c-c2d754e1c3a2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:26.224012 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54d43b13-92e1-4f2a-8a9c-c2d754e1c3a2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:26.224490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54d43b13-92e1-4f2a-8a9c-c2d754e1c3a2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:26.224919 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54d43b13-92e1-4f2a-8a9c-c2d754e1c3a2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:26.225601 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54d43b13-92e1-4f2a-8a9c-c2d754e1c3a2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:26.226046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54d43b13-92e1-4f2a-8a9c-c2d754e1c3a2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:26.226463 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54d43b13-92e1-4f2a-8a9c-c2d754e1c3a2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:26.260688 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a54c75b7-9852-4b2a-9dbc-db2557377a7f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:26.262836 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a54c75b7-9852-4b2a-9dbc-db2557377a7f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:26.269634 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a54c75b7-9852-4b2a-9dbc-db2557377a7f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:26.270110 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a54c75b7-9852-4b2a-9dbc-db2557377a7f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:26.270538 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a54c75b7-9852-4b2a-9dbc-db2557377a7f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:26.271229 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a54c75b7-9852-4b2a-9dbc-db2557377a7f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:26.271705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a54c75b7-9852-4b2a-9dbc-db2557377a7f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:26.272128 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a54c75b7-9852-4b2a-9dbc-db2557377a7f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:26.301466 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a54c75b7-9852-4b2a-9dbc-db2557377a7f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045147 Oct 11 06:56:26.302230 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 904/1833] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:26 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:56:26.357586 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-54d43b13-92e1-4f2a-8a9c-c2d754e1c3a2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:26.365688 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-54d43b13-92e1-4f2a-8a9c-c2d754e1c3a2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.153206 Oct 11 06:56:26.366249 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 930/1834] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:26 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:27.314174 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-17ef1285-0093-435d-8d49-8575c4987ddf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:27.316314 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-17ef1285-0093-435d-8d49-8575c4987ddf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:27.323880 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17ef1285-0093-435d-8d49-8575c4987ddf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:27.324356 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17ef1285-0093-435d-8d49-8575c4987ddf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:27.324786 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17ef1285-0093-435d-8d49-8575c4987ddf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:27.325506 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17ef1285-0093-435d-8d49-8575c4987ddf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:27.325950 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17ef1285-0093-435d-8d49-8575c4987ddf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:27.326381 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17ef1285-0093-435d-8d49-8575c4987ddf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:27.356803 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-17ef1285-0093-435d-8d49-8575c4987ddf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046619 Oct 11 06:56:27.357347 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 905/1835] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:27 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:27.389784 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-795875ed-7446-49b5-82fd-3faf6306655a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:27.390386 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-795875ed-7446-49b5-82fd-3faf6306655a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:27.396825 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-795875ed-7446-49b5-82fd-3faf6306655a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:27.397297 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-795875ed-7446-49b5-82fd-3faf6306655a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:27.397750 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-795875ed-7446-49b5-82fd-3faf6306655a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:27.398438 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-795875ed-7446-49b5-82fd-3faf6306655a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:27.398875 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-795875ed-7446-49b5-82fd-3faf6306655a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:27.399289 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-795875ed-7446-49b5-82fd-3faf6306655a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:27.525970 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-795875ed-7446-49b5-82fd-3faf6306655a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:27.534088 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-795875ed-7446-49b5-82fd-3faf6306655a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.148964 Oct 11 06:56:27.534671 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 931/1836] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:27 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:28.368935 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6359bd15-b30b-4514-9312-506ebdd0b55e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:28.371102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6359bd15-b30b-4514-9312-506ebdd0b55e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:28.377375 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6359bd15-b30b-4514-9312-506ebdd0b55e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:28.377849 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6359bd15-b30b-4514-9312-506ebdd0b55e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:28.378278 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6359bd15-b30b-4514-9312-506ebdd0b55e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:28.378958 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6359bd15-b30b-4514-9312-506ebdd0b55e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:28.379403 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6359bd15-b30b-4514-9312-506ebdd0b55e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:28.379839 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6359bd15-b30b-4514-9312-506ebdd0b55e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:28.408912 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6359bd15-b30b-4514-9312-506ebdd0b55e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043850 Oct 11 06:56:28.409675 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 906/1837] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:28 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:28.556924 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c0bc8970-61ab-4077-ac39-e8f0739461e2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:28.557534 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c0bc8970-61ab-4077-ac39-e8f0739461e2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:28.563945 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c0bc8970-61ab-4077-ac39-e8f0739461e2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:28.564420 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c0bc8970-61ab-4077-ac39-e8f0739461e2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:28.564851 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c0bc8970-61ab-4077-ac39-e8f0739461e2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:28.565549 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c0bc8970-61ab-4077-ac39-e8f0739461e2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:28.565979 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c0bc8970-61ab-4077-ac39-e8f0739461e2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:28.566400 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c0bc8970-61ab-4077-ac39-e8f0739461e2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:28.691618 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c0bc8970-61ab-4077-ac39-e8f0739461e2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:28.700219 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c0bc8970-61ab-4077-ac39-e8f0739461e2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147168 Oct 11 06:56:28.700781 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 932/1838] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:28 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:29.421578 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cfd11716-6ba7-4bb7-826b-ec9bfc3fd3f3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:29.423747 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cfd11716-6ba7-4bb7-826b-ec9bfc3fd3f3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:29.430172 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cfd11716-6ba7-4bb7-826b-ec9bfc3fd3f3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:29.430592 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cfd11716-6ba7-4bb7-826b-ec9bfc3fd3f3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:29.431020 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cfd11716-6ba7-4bb7-826b-ec9bfc3fd3f3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:29.431735 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cfd11716-6ba7-4bb7-826b-ec9bfc3fd3f3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:29.432764 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cfd11716-6ba7-4bb7-826b-ec9bfc3fd3f3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:29.433184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cfd11716-6ba7-4bb7-826b-ec9bfc3fd3f3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:29.462181 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cfd11716-6ba7-4bb7-826b-ec9bfc3fd3f3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044398 Oct 11 06:56:29.462838 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 907/1839] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:29 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:29.724443 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c3614e49-7a64-4f43-8fa9-7e6407fbddf3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:29.724988 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c3614e49-7a64-4f43-8fa9-7e6407fbddf3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:29.731456 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c3614e49-7a64-4f43-8fa9-7e6407fbddf3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:29.731934 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c3614e49-7a64-4f43-8fa9-7e6407fbddf3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:29.732392 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c3614e49-7a64-4f43-8fa9-7e6407fbddf3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:29.733107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c3614e49-7a64-4f43-8fa9-7e6407fbddf3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:29.733545 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c3614e49-7a64-4f43-8fa9-7e6407fbddf3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:29.733962 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c3614e49-7a64-4f43-8fa9-7e6407fbddf3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:29.863708 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c3614e49-7a64-4f43-8fa9-7e6407fbddf3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:29.872282 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c3614e49-7a64-4f43-8fa9-7e6407fbddf3 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.151718 Oct 11 06:56:29.872840 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 933/1840] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:29 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:30.475847 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f9c4432f-fbbe-4b50-bc8e-13d149b2728f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:30.478015 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f9c4432f-fbbe-4b50-bc8e-13d149b2728f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:30.484504 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f9c4432f-fbbe-4b50-bc8e-13d149b2728f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:30.484976 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f9c4432f-fbbe-4b50-bc8e-13d149b2728f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:30.485450 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f9c4432f-fbbe-4b50-bc8e-13d149b2728f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:30.486082 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f9c4432f-fbbe-4b50-bc8e-13d149b2728f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:30.486525 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f9c4432f-fbbe-4b50-bc8e-13d149b2728f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:30.486941 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f9c4432f-fbbe-4b50-bc8e-13d149b2728f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:30.516615 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f9c4432f-fbbe-4b50-bc8e-13d149b2728f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044752 Oct 11 06:56:30.517148 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 908/1841] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:30 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:30.896000 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2c9a61d6-332d-4c86-ac66-632a78d7b69e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:30.896617 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2c9a61d6-332d-4c86-ac66-632a78d7b69e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:30.902961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c9a61d6-332d-4c86-ac66-632a78d7b69e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:30.903466 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c9a61d6-332d-4c86-ac66-632a78d7b69e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:30.903902 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c9a61d6-332d-4c86-ac66-632a78d7b69e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:30.904592 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c9a61d6-332d-4c86-ac66-632a78d7b69e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:30.905039 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c9a61d6-332d-4c86-ac66-632a78d7b69e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:30.905459 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c9a61d6-332d-4c86-ac66-632a78d7b69e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:31.033100 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2c9a61d6-332d-4c86-ac66-632a78d7b69e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:31.036513 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:56:31.042598 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2c9a61d6-332d-4c86-ac66-632a78d7b69e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150378 Oct 11 06:56:31.043151 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 934/1842] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:30 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:31.529467 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ca2dfd4f-5f98-44fa-9f93-cb3bd1c7b4ac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:31.531601 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ca2dfd4f-5f98-44fa-9f93-cb3bd1c7b4ac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:31.537961 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca2dfd4f-5f98-44fa-9f93-cb3bd1c7b4ac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:31.538437 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca2dfd4f-5f98-44fa-9f93-cb3bd1c7b4ac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:31.538868 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca2dfd4f-5f98-44fa-9f93-cb3bd1c7b4ac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:31.539582 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca2dfd4f-5f98-44fa-9f93-cb3bd1c7b4ac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:31.540029 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca2dfd4f-5f98-44fa-9f93-cb3bd1c7b4ac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:31.540448 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca2dfd4f-5f98-44fa-9f93-cb3bd1c7b4ac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:31.568531 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ca2dfd4f-5f98-44fa-9f93-cb3bd1c7b4ac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043707 Oct 11 06:56:31.569053 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 909/1843] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:31 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:32.066067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-657ebe12-73a5-4dfa-b8e5-ce98b098e2d8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:32.066673 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-657ebe12-73a5-4dfa-b8e5-ce98b098e2d8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:32.073657 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-657ebe12-73a5-4dfa-b8e5-ce98b098e2d8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:32.074149 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-657ebe12-73a5-4dfa-b8e5-ce98b098e2d8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:32.074568 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-657ebe12-73a5-4dfa-b8e5-ce98b098e2d8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:32.075259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-657ebe12-73a5-4dfa-b8e5-ce98b098e2d8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:32.075743 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-657ebe12-73a5-4dfa-b8e5-ce98b098e2d8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:32.076166 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-657ebe12-73a5-4dfa-b8e5-ce98b098e2d8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:32.203522 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-657ebe12-73a5-4dfa-b8e5-ce98b098e2d8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:32.211628 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-657ebe12-73a5-4dfa-b8e5-ce98b098e2d8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149568 Oct 11 06:56:32.212197 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 935/1844] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:32 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:32.581747 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cc008e94-3127-481a-97b7-34f7e72929db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:32.583923 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cc008e94-3127-481a-97b7-34f7e72929db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:32.590739 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc008e94-3127-481a-97b7-34f7e72929db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:32.591215 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc008e94-3127-481a-97b7-34f7e72929db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:32.591666 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc008e94-3127-481a-97b7-34f7e72929db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:32.592347 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc008e94-3127-481a-97b7-34f7e72929db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:32.592792 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc008e94-3127-481a-97b7-34f7e72929db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:32.593207 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc008e94-3127-481a-97b7-34f7e72929db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:32.620638 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:56:32.625905 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cc008e94-3127-481a-97b7-34f7e72929db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048155 Oct 11 06:56:32.626462 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 910/1845] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:32 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:33.234402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5eae6782-0476-4154-ab62-8ecdd5b5e4a9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:33.235008 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5eae6782-0476-4154-ab62-8ecdd5b5e4a9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:33.241386 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5eae6782-0476-4154-ab62-8ecdd5b5e4a9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:33.241863 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5eae6782-0476-4154-ab62-8ecdd5b5e4a9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:33.242296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5eae6782-0476-4154-ab62-8ecdd5b5e4a9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:33.242985 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5eae6782-0476-4154-ab62-8ecdd5b5e4a9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:33.243449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5eae6782-0476-4154-ab62-8ecdd5b5e4a9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:33.243871 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5eae6782-0476-4154-ab62-8ecdd5b5e4a9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:33.371352 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5eae6782-0476-4154-ab62-8ecdd5b5e4a9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:33.379532 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5eae6782-0476-4154-ab62-8ecdd5b5e4a9 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.148920 Oct 11 06:56:33.380100 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 936/1846] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:33 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:33.638229 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-78149b0f-d3eb-4992-92f7-f50a2182343d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:33.640725 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-78149b0f-d3eb-4992-92f7-f50a2182343d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:33.647299 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78149b0f-d3eb-4992-92f7-f50a2182343d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:33.647839 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78149b0f-d3eb-4992-92f7-f50a2182343d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:33.648306 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78149b0f-d3eb-4992-92f7-f50a2182343d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:33.649010 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78149b0f-d3eb-4992-92f7-f50a2182343d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:33.649468 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78149b0f-d3eb-4992-92f7-f50a2182343d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:33.649892 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78149b0f-d3eb-4992-92f7-f50a2182343d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:33.682467 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-78149b0f-d3eb-4992-92f7-f50a2182343d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048139 Oct 11 06:56:33.683034 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 911/1847] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:33 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:34.402027 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-eae42c83-d687-473b-9eae-1497b30a1b92 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:34.402571 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-eae42c83-d687-473b-9eae-1497b30a1b92 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:34.405039 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=52 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:56:34.410545 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eae42c83-d687-473b-9eae-1497b30a1b92 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:34.411029 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eae42c83-d687-473b-9eae-1497b30a1b92 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:34.411522 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eae42c83-d687-473b-9eae-1497b30a1b92 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:34.412226 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eae42c83-d687-473b-9eae-1497b30a1b92 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:34.412677 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eae42c83-d687-473b-9eae-1497b30a1b92 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:34.413099 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eae42c83-d687-473b-9eae-1497b30a1b92 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:34.544666 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-eae42c83-d687-473b-9eae-1497b30a1b92 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:34.552836 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-eae42c83-d687-473b-9eae-1497b30a1b92 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.154740 Oct 11 06:56:34.553393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 937/1848] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:34 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:34.694280 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b5020802-9a67-47b9-87a9-da00df03f2be tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:34.696361 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b5020802-9a67-47b9-87a9-da00df03f2be tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:34.702630 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b5020802-9a67-47b9-87a9-da00df03f2be tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:34.703095 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b5020802-9a67-47b9-87a9-da00df03f2be tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:34.703567 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b5020802-9a67-47b9-87a9-da00df03f2be tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:34.704252 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b5020802-9a67-47b9-87a9-da00df03f2be tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:34.704696 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b5020802-9a67-47b9-87a9-da00df03f2be tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:34.705116 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b5020802-9a67-47b9-87a9-da00df03f2be tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:34.734017 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b5020802-9a67-47b9-87a9-da00df03f2be tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043737 Oct 11 06:56:34.734558 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 912/1849] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:34 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:35.577121 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ca530352-e44b-4efe-b3d8-9a1771c6f538 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:35.577733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ca530352-e44b-4efe-b3d8-9a1771c6f538 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:35.584175 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ca530352-e44b-4efe-b3d8-9a1771c6f538 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:35.584641 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ca530352-e44b-4efe-b3d8-9a1771c6f538 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:35.585071 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ca530352-e44b-4efe-b3d8-9a1771c6f538 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:35.585760 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ca530352-e44b-4efe-b3d8-9a1771c6f538 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:35.586211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ca530352-e44b-4efe-b3d8-9a1771c6f538 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:35.586633 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ca530352-e44b-4efe-b3d8-9a1771c6f538 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:35.715506 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ca530352-e44b-4efe-b3d8-9a1771c6f538 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:35.723901 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ca530352-e44b-4efe-b3d8-9a1771c6f538 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.151268 Oct 11 06:56:35.724661 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 938/1850] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:35 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:35.746822 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9ee83035-231e-4345-8179-76288a77b233 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:35.749049 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9ee83035-231e-4345-8179-76288a77b233 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:35.755392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9ee83035-231e-4345-8179-76288a77b233 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:35.755897 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9ee83035-231e-4345-8179-76288a77b233 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:35.756329 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9ee83035-231e-4345-8179-76288a77b233 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:35.757020 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9ee83035-231e-4345-8179-76288a77b233 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:35.757474 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9ee83035-231e-4345-8179-76288a77b233 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:35.757923 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9ee83035-231e-4345-8179-76288a77b233 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:35.787331 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9ee83035-231e-4345-8179-76288a77b233 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045021 Oct 11 06:56:35.787835 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 913/1851] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:35 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:36.748099 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f9f7b90c-a41b-429c-89b6-74b30fee1a8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:36.748708 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f9f7b90c-a41b-429c-89b6-74b30fee1a8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:36.755105 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f9f7b90c-a41b-429c-89b6-74b30fee1a8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:36.755642 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f9f7b90c-a41b-429c-89b6-74b30fee1a8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:36.756080 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f9f7b90c-a41b-429c-89b6-74b30fee1a8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:36.756767 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f9f7b90c-a41b-429c-89b6-74b30fee1a8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:36.757221 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f9f7b90c-a41b-429c-89b6-74b30fee1a8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:36.757688 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f9f7b90c-a41b-429c-89b6-74b30fee1a8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:36.799739 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ca9adf7a-684a-436a-9b74-a5d60159408a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:36.801907 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ca9adf7a-684a-436a-9b74-a5d60159408a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:36.808465 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca9adf7a-684a-436a-9b74-a5d60159408a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:36.808952 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca9adf7a-684a-436a-9b74-a5d60159408a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:36.809389 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca9adf7a-684a-436a-9b74-a5d60159408a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:36.810097 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca9adf7a-684a-436a-9b74-a5d60159408a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:36.810552 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca9adf7a-684a-436a-9b74-a5d60159408a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:36.810976 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca9adf7a-684a-436a-9b74-a5d60159408a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:36.841416 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ca9adf7a-684a-436a-9b74-a5d60159408a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045540 Oct 11 06:56:36.841984 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 914/1852] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:36 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:56:36.884878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f9f7b90c-a41b-429c-89b6-74b30fee1a8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:36.893743 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f9f7b90c-a41b-429c-89b6-74b30fee1a8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149851 Oct 11 06:56:36.894297 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 939/1853] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:36 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:56:37.853717 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-14acd0fb-e6a8-4f94-8614-368bf9c04d85 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:37.856147 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-14acd0fb-e6a8-4f94-8614-368bf9c04d85 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:37.862571 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14acd0fb-e6a8-4f94-8614-368bf9c04d85 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:37.863057 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14acd0fb-e6a8-4f94-8614-368bf9c04d85 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:37.863533 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14acd0fb-e6a8-4f94-8614-368bf9c04d85 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:37.864232 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14acd0fb-e6a8-4f94-8614-368bf9c04d85 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:37.864690 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14acd0fb-e6a8-4f94-8614-368bf9c04d85 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:37.865117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14acd0fb-e6a8-4f94-8614-368bf9c04d85 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:37.898693 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-14acd0fb-e6a8-4f94-8614-368bf9c04d85 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048926 Oct 11 06:56:37.899238 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 915/1854] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:37 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:37.917127 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2ac6f402-a263-491b-88a3-03d64bfd2af4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:37.917779 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2ac6f402-a263-491b-88a3-03d64bfd2af4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:37.925137 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ac6f402-a263-491b-88a3-03d64bfd2af4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:37.925661 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ac6f402-a263-491b-88a3-03d64bfd2af4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:37.926182 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ac6f402-a263-491b-88a3-03d64bfd2af4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:37.926923 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ac6f402-a263-491b-88a3-03d64bfd2af4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:37.927446 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ac6f402-a263-491b-88a3-03d64bfd2af4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:37.927896 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ac6f402-a263-491b-88a3-03d64bfd2af4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:38.061461 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2ac6f402-a263-491b-88a3-03d64bfd2af4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:38.069524 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2ac6f402-a263-491b-88a3-03d64bfd2af4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.156235 Oct 11 06:56:38.070080 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 940/1855] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:37 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:38.910801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-12d168eb-cfe5-49aa-ac4c-b46c5765969c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:38.913090 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-12d168eb-cfe5-49aa-ac4c-b46c5765969c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:38.920073 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-12d168eb-cfe5-49aa-ac4c-b46c5765969c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:38.920557 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-12d168eb-cfe5-49aa-ac4c-b46c5765969c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:38.920998 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-12d168eb-cfe5-49aa-ac4c-b46c5765969c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:38.921725 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-12d168eb-cfe5-49aa-ac4c-b46c5765969c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:38.922181 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-12d168eb-cfe5-49aa-ac4c-b46c5765969c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:38.922606 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-12d168eb-cfe5-49aa-ac4c-b46c5765969c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:38.951409 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-12d168eb-cfe5-49aa-ac4c-b46c5765969c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044531 Oct 11 06:56:38.951917 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 916/1856] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:38 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:39.092772 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6f23b018-1236-49e1-af85-5386ddba2f3f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:39.093497 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6f23b018-1236-49e1-af85-5386ddba2f3f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:39.099882 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f23b018-1236-49e1-af85-5386ddba2f3f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:39.100354 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f23b018-1236-49e1-af85-5386ddba2f3f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:39.100859 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f23b018-1236-49e1-af85-5386ddba2f3f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:39.101546 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f23b018-1236-49e1-af85-5386ddba2f3f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:39.101976 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f23b018-1236-49e1-af85-5386ddba2f3f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:39.102386 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f23b018-1236-49e1-af85-5386ddba2f3f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:39.227118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6f23b018-1236-49e1-af85-5386ddba2f3f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:39.235628 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6f23b018-1236-49e1-af85-5386ddba2f3f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.146538 Oct 11 06:56:39.236174 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 941/1857] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:39 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:39.962755 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8964cb99-a5c7-4f4b-a856-1f903448ecc3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:39.965520 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8964cb99-a5c7-4f4b-a856-1f903448ecc3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:39.971879 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8964cb99-a5c7-4f4b-a856-1f903448ecc3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:39.972353 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8964cb99-a5c7-4f4b-a856-1f903448ecc3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:39.972789 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8964cb99-a5c7-4f4b-a856-1f903448ecc3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:39.973457 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8964cb99-a5c7-4f4b-a856-1f903448ecc3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:39.973904 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8964cb99-a5c7-4f4b-a856-1f903448ecc3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:39.974318 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8964cb99-a5c7-4f4b-a856-1f903448ecc3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:40.002768 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8964cb99-a5c7-4f4b-a856-1f903448ecc3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044060 Oct 11 06:56:40.003303 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 917/1858] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:39 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:40.259151 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2943dcdd-6de9-4b17-88ec-f3d494dbce6a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:40.259781 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2943dcdd-6de9-4b17-88ec-f3d494dbce6a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:40.267206 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2943dcdd-6de9-4b17-88ec-f3d494dbce6a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:40.267707 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2943dcdd-6de9-4b17-88ec-f3d494dbce6a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:40.268142 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2943dcdd-6de9-4b17-88ec-f3d494dbce6a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:40.268827 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2943dcdd-6de9-4b17-88ec-f3d494dbce6a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:40.269274 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2943dcdd-6de9-4b17-88ec-f3d494dbce6a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:40.269690 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2943dcdd-6de9-4b17-88ec-f3d494dbce6a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:40.397585 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2943dcdd-6de9-4b17-88ec-f3d494dbce6a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:40.406076 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2943dcdd-6de9-4b17-88ec-f3d494dbce6a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150651 Oct 11 06:56:40.406900 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 942/1859] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:40 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:41.015606 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-48213b71-737f-4ef2-a087-7d41d834c720 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:41.017693 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-48213b71-737f-4ef2-a087-7d41d834c720 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:41.024180 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-48213b71-737f-4ef2-a087-7d41d834c720 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:41.024654 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-48213b71-737f-4ef2-a087-7d41d834c720 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:41.025083 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-48213b71-737f-4ef2-a087-7d41d834c720 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:41.025772 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-48213b71-737f-4ef2-a087-7d41d834c720 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:41.026220 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-48213b71-737f-4ef2-a087-7d41d834c720 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:41.027131 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-48213b71-737f-4ef2-a087-7d41d834c720 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:41.057910 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-48213b71-737f-4ef2-a087-7d41d834c720 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047591 Oct 11 06:56:41.058458 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 918/1860] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:41 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:41.429518 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4dc59da0-1fb2-4338-8331-274b4a903e0d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:41.430115 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4dc59da0-1fb2-4338-8331-274b4a903e0d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:41.437641 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4dc59da0-1fb2-4338-8331-274b4a903e0d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:41.438115 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4dc59da0-1fb2-4338-8331-274b4a903e0d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:41.438549 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4dc59da0-1fb2-4338-8331-274b4a903e0d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:41.439260 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4dc59da0-1fb2-4338-8331-274b4a903e0d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:41.439744 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4dc59da0-1fb2-4338-8331-274b4a903e0d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:41.440158 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4dc59da0-1fb2-4338-8331-274b4a903e0d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:41.567526 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4dc59da0-1fb2-4338-8331-274b4a903e0d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:41.575733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4dc59da0-1fb2-4338-8331-274b4a903e0d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150006 Oct 11 06:56:41.576286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 943/1861] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:41 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:42.069266 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1321faa5-2419-4f1d-b43f-4ef5936aee5b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:42.071439 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1321faa5-2419-4f1d-b43f-4ef5936aee5b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:42.078310 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1321faa5-2419-4f1d-b43f-4ef5936aee5b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:42.078794 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1321faa5-2419-4f1d-b43f-4ef5936aee5b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:42.079232 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1321faa5-2419-4f1d-b43f-4ef5936aee5b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:42.079972 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1321faa5-2419-4f1d-b43f-4ef5936aee5b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:42.080428 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1321faa5-2419-4f1d-b43f-4ef5936aee5b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:42.080856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1321faa5-2419-4f1d-b43f-4ef5936aee5b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:42.110146 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1321faa5-2419-4f1d-b43f-4ef5936aee5b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044772 Oct 11 06:56:42.110689 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 919/1862] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:42 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:42.598526 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-faa4b4f5-935f-4cf8-b520-bb82333dbbab tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:42.599133 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-faa4b4f5-935f-4cf8-b520-bb82333dbbab tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:42.605413 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-faa4b4f5-935f-4cf8-b520-bb82333dbbab tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:42.605891 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-faa4b4f5-935f-4cf8-b520-bb82333dbbab tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:42.606320 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-faa4b4f5-935f-4cf8-b520-bb82333dbbab tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:42.607008 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-faa4b4f5-935f-4cf8-b520-bb82333dbbab tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:42.607478 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-faa4b4f5-935f-4cf8-b520-bb82333dbbab tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:42.607903 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-faa4b4f5-935f-4cf8-b520-bb82333dbbab tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:42.732449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-faa4b4f5-935f-4cf8-b520-bb82333dbbab tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:42.740613 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-faa4b4f5-935f-4cf8-b520-bb82333dbbab tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.145874 Oct 11 06:56:42.741169 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 944/1863] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:42 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:43.122242 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-eed6f282-ecf6-441e-ae90-7967fb710bd9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:43.124433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-eed6f282-ecf6-441e-ae90-7967fb710bd9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:43.130734 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eed6f282-ecf6-441e-ae90-7967fb710bd9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:43.131224 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eed6f282-ecf6-441e-ae90-7967fb710bd9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:43.131694 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eed6f282-ecf6-441e-ae90-7967fb710bd9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:43.132397 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eed6f282-ecf6-441e-ae90-7967fb710bd9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:43.132853 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eed6f282-ecf6-441e-ae90-7967fb710bd9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:43.133280 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eed6f282-ecf6-441e-ae90-7967fb710bd9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:43.162784 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-eed6f282-ecf6-441e-ae90-7967fb710bd9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044474 Oct 11 06:56:43.163327 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 920/1864] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:43 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:43.763586 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ea915f10-8705-433b-9500-cd7d1b321278 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:43.764192 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ea915f10-8705-433b-9500-cd7d1b321278 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:43.770744 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ea915f10-8705-433b-9500-cd7d1b321278 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:43.771210 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ea915f10-8705-433b-9500-cd7d1b321278 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:43.771664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ea915f10-8705-433b-9500-cd7d1b321278 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:43.772340 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ea915f10-8705-433b-9500-cd7d1b321278 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:43.772778 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ea915f10-8705-433b-9500-cd7d1b321278 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:43.773187 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ea915f10-8705-433b-9500-cd7d1b321278 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:43.900341 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ea915f10-8705-433b-9500-cd7d1b321278 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:43.908937 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ea915f10-8705-433b-9500-cd7d1b321278 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149131 Oct 11 06:56:43.909492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 945/1865] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:43 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:44.175600 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-50b0a3ce-deaf-4f78-8b8c-9b1f1766dc8b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:44.177671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-50b0a3ce-deaf-4f78-8b8c-9b1f1766dc8b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:44.184078 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-50b0a3ce-deaf-4f78-8b8c-9b1f1766dc8b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:44.184555 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-50b0a3ce-deaf-4f78-8b8c-9b1f1766dc8b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:44.185049 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-50b0a3ce-deaf-4f78-8b8c-9b1f1766dc8b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:44.185759 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-50b0a3ce-deaf-4f78-8b8c-9b1f1766dc8b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:44.186208 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-50b0a3ce-deaf-4f78-8b8c-9b1f1766dc8b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:44.186628 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-50b0a3ce-deaf-4f78-8b8c-9b1f1766dc8b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:44.216039 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-50b0a3ce-deaf-4f78-8b8c-9b1f1766dc8b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044418 Oct 11 06:56:44.216618 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 921/1866] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:44 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:44.933112 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-dc665160-ecd5-4268-931c-a3722fc96521 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:44.933968 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-dc665160-ecd5-4268-931c-a3722fc96521 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:44.940356 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc665160-ecd5-4268-931c-a3722fc96521 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:44.940828 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc665160-ecd5-4268-931c-a3722fc96521 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:44.941259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc665160-ecd5-4268-931c-a3722fc96521 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:44.941937 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc665160-ecd5-4268-931c-a3722fc96521 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:44.942379 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc665160-ecd5-4268-931c-a3722fc96521 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:44.942794 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc665160-ecd5-4268-931c-a3722fc96521 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:45.069095 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-dc665160-ecd5-4268-931c-a3722fc96521 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:45.077282 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-dc665160-ecd5-4268-931c-a3722fc96521 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.148608 Oct 11 06:56:45.077843 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 946/1867] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:44 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:45.228250 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-650e4bb5-f6ca-48cf-a5c7-f1996320fea9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:45.230910 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-650e4bb5-f6ca-48cf-a5c7-f1996320fea9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:45.237301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-650e4bb5-f6ca-48cf-a5c7-f1996320fea9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:45.237784 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-650e4bb5-f6ca-48cf-a5c7-f1996320fea9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:45.238222 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-650e4bb5-f6ca-48cf-a5c7-f1996320fea9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:45.238915 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-650e4bb5-f6ca-48cf-a5c7-f1996320fea9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:45.239371 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-650e4bb5-f6ca-48cf-a5c7-f1996320fea9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:45.239818 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-650e4bb5-f6ca-48cf-a5c7-f1996320fea9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:45.269337 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-650e4bb5-f6ca-48cf-a5c7-f1996320fea9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044951 Oct 11 06:56:45.269819 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 922/1868] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:45 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:46.100235 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-76c21150-7d71-484f-b7d4-48b4a29ed06d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:46.100841 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-76c21150-7d71-484f-b7d4-48b4a29ed06d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:46.107138 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-76c21150-7d71-484f-b7d4-48b4a29ed06d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:46.107643 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-76c21150-7d71-484f-b7d4-48b4a29ed06d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:46.108069 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-76c21150-7d71-484f-b7d4-48b4a29ed06d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:46.108764 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-76c21150-7d71-484f-b7d4-48b4a29ed06d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:46.109189 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-76c21150-7d71-484f-b7d4-48b4a29ed06d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:46.109603 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-76c21150-7d71-484f-b7d4-48b4a29ed06d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:46.240289 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-76c21150-7d71-484f-b7d4-48b4a29ed06d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:46.249023 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-76c21150-7d71-484f-b7d4-48b4a29ed06d tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.152648 Oct 11 06:56:46.249580 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 947/1869] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:46 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:46.281475 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-fdb3a7f3-8af9-445f-a714-95b69beaa21f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:46.283665 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-fdb3a7f3-8af9-445f-a714-95b69beaa21f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:46.290021 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fdb3a7f3-8af9-445f-a714-95b69beaa21f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:46.290504 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fdb3a7f3-8af9-445f-a714-95b69beaa21f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:46.290938 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fdb3a7f3-8af9-445f-a714-95b69beaa21f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:46.291658 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fdb3a7f3-8af9-445f-a714-95b69beaa21f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:46.292112 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fdb3a7f3-8af9-445f-a714-95b69beaa21f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:46.292536 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fdb3a7f3-8af9-445f-a714-95b69beaa21f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:46.322026 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-fdb3a7f3-8af9-445f-a714-95b69beaa21f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044521 Oct 11 06:56:46.322577 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 923/1870] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:46 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:47.272775 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4d259c92-1f9b-4e84-8c3a-aba9c0dd4047 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:47.273404 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4d259c92-1f9b-4e84-8c3a-aba9c0dd4047 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:47.280373 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4d259c92-1f9b-4e84-8c3a-aba9c0dd4047 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:47.280841 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4d259c92-1f9b-4e84-8c3a-aba9c0dd4047 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:47.281265 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4d259c92-1f9b-4e84-8c3a-aba9c0dd4047 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:47.281939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4d259c92-1f9b-4e84-8c3a-aba9c0dd4047 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:47.282378 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4d259c92-1f9b-4e84-8c3a-aba9c0dd4047 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:47.282788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4d259c92-1f9b-4e84-8c3a-aba9c0dd4047 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:47.335289 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-089805dd-7522-4434-a3b2-196ca33d5101 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:47.337694 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-089805dd-7522-4434-a3b2-196ca33d5101 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:47.344316 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=58 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:56:47.346015 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-089805dd-7522-4434-a3b2-196ca33d5101 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:47.346500 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-089805dd-7522-4434-a3b2-196ca33d5101 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:47.347122 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-089805dd-7522-4434-a3b2-196ca33d5101 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:47.347942 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-089805dd-7522-4434-a3b2-196ca33d5101 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:47.348400 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-089805dd-7522-4434-a3b2-196ca33d5101 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:47.348806 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-089805dd-7522-4434-a3b2-196ca33d5101 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:47.379121 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-089805dd-7522-4434-a3b2-196ca33d5101 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048557 Oct 11 06:56:47.379710 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 924/1871] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:47 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:47.411888 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4d259c92-1f9b-4e84-8c3a-aba9c0dd4047 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:47.420163 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4d259c92-1f9b-4e84-8c3a-aba9c0dd4047 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.151215 Oct 11 06:56:47.420721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 948/1872] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:47 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:48.391930 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cc6981d0-2ff2-4078-8d35-3dcc9ab2f9f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:48.394082 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cc6981d0-2ff2-4078-8d35-3dcc9ab2f9f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:48.399955 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc6981d0-2ff2-4078-8d35-3dcc9ab2f9f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:48.400429 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc6981d0-2ff2-4078-8d35-3dcc9ab2f9f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:48.400881 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc6981d0-2ff2-4078-8d35-3dcc9ab2f9f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:48.402227 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc6981d0-2ff2-4078-8d35-3dcc9ab2f9f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:48.402677 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc6981d0-2ff2-4078-8d35-3dcc9ab2f9f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:48.403097 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc6981d0-2ff2-4078-8d35-3dcc9ab2f9f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:48.432399 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cc6981d0-2ff2-4078-8d35-3dcc9ab2f9f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044775 Oct 11 06:56:48.432937 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 925/1873] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:48 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:48.443183 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b5fa1409-6a59-4989-a4c5-c5949c69ff5f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:48.443826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b5fa1409-6a59-4989-a4c5-c5949c69ff5f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:48.450145 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b5fa1409-6a59-4989-a4c5-c5949c69ff5f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:48.450621 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b5fa1409-6a59-4989-a4c5-c5949c69ff5f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:48.451053 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b5fa1409-6a59-4989-a4c5-c5949c69ff5f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:48.451771 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b5fa1409-6a59-4989-a4c5-c5949c69ff5f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:48.452227 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b5fa1409-6a59-4989-a4c5-c5949c69ff5f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:48.452646 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b5fa1409-6a59-4989-a4c5-c5949c69ff5f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:48.626537 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b5fa1409-6a59-4989-a4c5-c5949c69ff5f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:48.634691 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b5fa1409-6a59-4989-a4c5-c5949c69ff5f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.195401 Oct 11 06:56:48.635252 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 949/1874] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:48 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:49.444649 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7da689ec-3e84-46e3-a983-1cfa31712809 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:49.446774 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7da689ec-3e84-46e3-a983-1cfa31712809 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:49.453614 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7da689ec-3e84-46e3-a983-1cfa31712809 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:49.454097 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7da689ec-3e84-46e3-a983-1cfa31712809 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:49.454532 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7da689ec-3e84-46e3-a983-1cfa31712809 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:49.455243 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7da689ec-3e84-46e3-a983-1cfa31712809 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:49.455718 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7da689ec-3e84-46e3-a983-1cfa31712809 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:49.456163 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7da689ec-3e84-46e3-a983-1cfa31712809 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:49.486492 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7da689ec-3e84-46e3-a983-1cfa31712809 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045765 Oct 11 06:56:49.487017 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 926/1875] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:49 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:49.658280 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b0ffc2a4-5850-473b-aaf1-5fe8ca682015 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:49.659006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b0ffc2a4-5850-473b-aaf1-5fe8ca682015 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:49.665400 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b0ffc2a4-5850-473b-aaf1-5fe8ca682015 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:49.665872 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b0ffc2a4-5850-473b-aaf1-5fe8ca682015 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:49.666299 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b0ffc2a4-5850-473b-aaf1-5fe8ca682015 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:49.666981 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b0ffc2a4-5850-473b-aaf1-5fe8ca682015 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:49.667439 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b0ffc2a4-5850-473b-aaf1-5fe8ca682015 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:49.667871 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b0ffc2a4-5850-473b-aaf1-5fe8ca682015 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:49.791551 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b0ffc2a4-5850-473b-aaf1-5fe8ca682015 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:49.799637 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b0ffc2a4-5850-473b-aaf1-5fe8ca682015 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.145136 Oct 11 06:56:49.800189 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 950/1876] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:49 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:50.548807 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0a4d241d-2022-4e50-a9d5-22d45a433776 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:50.551064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0a4d241d-2022-4e50-a9d5-22d45a433776 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:50.557036 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0a4d241d-2022-4e50-a9d5-22d45a433776 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:50.557586 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0a4d241d-2022-4e50-a9d5-22d45a433776 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:50.558019 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0a4d241d-2022-4e50-a9d5-22d45a433776 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:50.558708 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0a4d241d-2022-4e50-a9d5-22d45a433776 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:50.559156 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0a4d241d-2022-4e50-a9d5-22d45a433776 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:50.559614 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0a4d241d-2022-4e50-a9d5-22d45a433776 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:50.575803 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:56:50.590222 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0a4d241d-2022-4e50-a9d5-22d45a433776 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095503 Oct 11 06:56:50.590771 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 927/1877] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:50 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:50.823323 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-864321ec-f652-42c8-9cb6-ab931f7a5074 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:50.823962 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-864321ec-f652-42c8-9cb6-ab931f7a5074 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:50.830373 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-864321ec-f652-42c8-9cb6-ab931f7a5074 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:50.830846 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-864321ec-f652-42c8-9cb6-ab931f7a5074 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:50.831276 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-864321ec-f652-42c8-9cb6-ab931f7a5074 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:50.831991 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-864321ec-f652-42c8-9cb6-ab931f7a5074 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:50.832443 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-864321ec-f652-42c8-9cb6-ab931f7a5074 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:50.832867 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-864321ec-f652-42c8-9cb6-ab931f7a5074 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:50.850888 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:56:50.958443 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-864321ec-f652-42c8-9cb6-ab931f7a5074 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:50.967033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-864321ec-f652-42c8-9cb6-ab931f7a5074 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147602 Oct 11 06:56:50.967611 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 951/1878] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:50 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:51.602125 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-87af3047-78d2-4c78-88b0-cbbd95a21cea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:51.604456 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-87af3047-78d2-4c78-88b0-cbbd95a21cea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:51.611054 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87af3047-78d2-4c78-88b0-cbbd95a21cea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:51.611561 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87af3047-78d2-4c78-88b0-cbbd95a21cea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:51.611990 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87af3047-78d2-4c78-88b0-cbbd95a21cea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:51.612669 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87af3047-78d2-4c78-88b0-cbbd95a21cea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:51.613113 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87af3047-78d2-4c78-88b0-cbbd95a21cea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:51.613526 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87af3047-78d2-4c78-88b0-cbbd95a21cea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:51.643069 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-87af3047-78d2-4c78-88b0-cbbd95a21cea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044931 Oct 11 06:56:51.643632 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 928/1879] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:51 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:51.990703 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1f7b0447-e421-41c5-9e0b-685a74491f4f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:51.991261 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1f7b0447-e421-41c5-9e0b-685a74491f4f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:51.998220 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1f7b0447-e421-41c5-9e0b-685a74491f4f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:51.998696 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1f7b0447-e421-41c5-9e0b-685a74491f4f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:51.999127 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1f7b0447-e421-41c5-9e0b-685a74491f4f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:51.999844 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1f7b0447-e421-41c5-9e0b-685a74491f4f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:52.000293 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1f7b0447-e421-41c5-9e0b-685a74491f4f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:52.000711 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1f7b0447-e421-41c5-9e0b-685a74491f4f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:52.129689 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1f7b0447-e421-41c5-9e0b-685a74491f4f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:52.138482 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1f7b0447-e421-41c5-9e0b-685a74491f4f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.152290 Oct 11 06:56:52.139048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 952/1880] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:51 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:52.656031 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8bd6618b-96b7-4826-9e49-101536e50852 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:52.658255 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8bd6618b-96b7-4826-9e49-101536e50852 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:52.664631 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8bd6618b-96b7-4826-9e49-101536e50852 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:52.665114 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8bd6618b-96b7-4826-9e49-101536e50852 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:52.665553 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8bd6618b-96b7-4826-9e49-101536e50852 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:52.666248 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8bd6618b-96b7-4826-9e49-101536e50852 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:52.666702 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8bd6618b-96b7-4826-9e49-101536e50852 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:52.667123 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8bd6618b-96b7-4826-9e49-101536e50852 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:52.696208 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8bd6618b-96b7-4826-9e49-101536e50852 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044596 Oct 11 06:56:52.696739 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 929/1881] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:52 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:53.161974 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e1686bb8-45ad-4fc4-8def-0dbce1a96143 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:53.162608 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e1686bb8-45ad-4fc4-8def-0dbce1a96143 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:53.169549 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e1686bb8-45ad-4fc4-8def-0dbce1a96143 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:53.170027 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e1686bb8-45ad-4fc4-8def-0dbce1a96143 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:53.170454 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e1686bb8-45ad-4fc4-8def-0dbce1a96143 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:53.171142 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e1686bb8-45ad-4fc4-8def-0dbce1a96143 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:53.171618 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e1686bb8-45ad-4fc4-8def-0dbce1a96143 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:53.172037 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e1686bb8-45ad-4fc4-8def-0dbce1a96143 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:53.299086 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e1686bb8-45ad-4fc4-8def-0dbce1a96143 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:53.307177 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e1686bb8-45ad-4fc4-8def-0dbce1a96143 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149084 Oct 11 06:56:53.307754 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 953/1882] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:53 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:53.708259 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-57c7c113-1eba-46e3-8909-066e4ed8e6f7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:53.710365 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-57c7c113-1eba-46e3-8909-066e4ed8e6f7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:53.717400 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57c7c113-1eba-46e3-8909-066e4ed8e6f7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:53.717876 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57c7c113-1eba-46e3-8909-066e4ed8e6f7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:53.718308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57c7c113-1eba-46e3-8909-066e4ed8e6f7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:53.718988 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57c7c113-1eba-46e3-8909-066e4ed8e6f7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:53.719451 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57c7c113-1eba-46e3-8909-066e4ed8e6f7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:53.719873 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57c7c113-1eba-46e3-8909-066e4ed8e6f7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:53.748162 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-57c7c113-1eba-46e3-8909-066e4ed8e6f7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043926 Oct 11 06:56:53.748697 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 930/1883] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:53 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:54.330400 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b3fe1a34-85ad-4086-8172-d53449606187 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:54.331044 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b3fe1a34-85ad-4086-8172-d53449606187 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:54.333080 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 06:56:54.333245 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Tue Oct 11 06:56:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb (ip 10.222.0.39) !!! Oct 11 06:56:54.339745 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b3fe1a34-85ad-4086-8172-d53449606187 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:54.340222 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b3fe1a34-85ad-4086-8172-d53449606187 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:54.340650 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b3fe1a34-85ad-4086-8172-d53449606187 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:54.341335 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b3fe1a34-85ad-4086-8172-d53449606187 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:54.341784 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b3fe1a34-85ad-4086-8172-d53449606187 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:54.342202 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b3fe1a34-85ad-4086-8172-d53449606187 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:54.471784 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b3fe1a34-85ad-4086-8172-d53449606187 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:54.479845 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b3fe1a34-85ad-4086-8172-d53449606187 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.153191 Oct 11 06:56:54.480404 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 954/1884] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:54 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:54.760527 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a695bd9f-41c4-49c6-8725-01b3e95a7361 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:54.762781 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a695bd9f-41c4-49c6-8725-01b3e95a7361 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:54.769472 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a695bd9f-41c4-49c6-8725-01b3e95a7361 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:54.769945 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a695bd9f-41c4-49c6-8725-01b3e95a7361 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:54.770373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a695bd9f-41c4-49c6-8725-01b3e95a7361 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:54.771056 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a695bd9f-41c4-49c6-8725-01b3e95a7361 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:54.771531 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a695bd9f-41c4-49c6-8725-01b3e95a7361 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:54.771948 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a695bd9f-41c4-49c6-8725-01b3e95a7361 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:54.801294 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a695bd9f-41c4-49c6-8725-01b3e95a7361 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044679 Oct 11 06:56:54.801826 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 931/1885] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:54 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:55.503287 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-450c725d-a7b0-4611-95d1-a1ee0fa07d91 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:55.503926 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-450c725d-a7b0-4611-95d1-a1ee0fa07d91 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:55.510324 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-450c725d-a7b0-4611-95d1-a1ee0fa07d91 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:55.510804 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-450c725d-a7b0-4611-95d1-a1ee0fa07d91 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:55.511236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-450c725d-a7b0-4611-95d1-a1ee0fa07d91 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:55.512449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-450c725d-a7b0-4611-95d1-a1ee0fa07d91 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:55.512900 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-450c725d-a7b0-4611-95d1-a1ee0fa07d91 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:55.513324 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-450c725d-a7b0-4611-95d1-a1ee0fa07d91 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:55.638362 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-450c725d-a7b0-4611-95d1-a1ee0fa07d91 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:55.646868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-450c725d-a7b0-4611-95d1-a1ee0fa07d91 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147419 Oct 11 06:56:55.647449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 955/1886] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:55 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:55.814059 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5a48f954-e0d1-420f-9fe1-a364de0eac62 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:55.816210 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5a48f954-e0d1-420f-9fe1-a364de0eac62 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:55.822922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a48f954-e0d1-420f-9fe1-a364de0eac62 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:55.823398 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a48f954-e0d1-420f-9fe1-a364de0eac62 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:55.823852 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a48f954-e0d1-420f-9fe1-a364de0eac62 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:55.825165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a48f954-e0d1-420f-9fe1-a364de0eac62 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:55.825626 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a48f954-e0d1-420f-9fe1-a364de0eac62 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:55.826027 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a48f954-e0d1-420f-9fe1-a364de0eac62 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:55.854501 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5a48f954-e0d1-420f-9fe1-a364de0eac62 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044433 Oct 11 06:56:55.855029 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 932/1887] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:55 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:56.669632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9ff49d4c-fa7b-449b-a32d-5aff9ff7f9a7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:56.670167 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9ff49d4c-fa7b-449b-a32d-5aff9ff7f9a7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:56.676578 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9ff49d4c-fa7b-449b-a32d-5aff9ff7f9a7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:56.677051 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9ff49d4c-fa7b-449b-a32d-5aff9ff7f9a7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:56.677478 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9ff49d4c-fa7b-449b-a32d-5aff9ff7f9a7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:56.678162 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9ff49d4c-fa7b-449b-a32d-5aff9ff7f9a7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:56.678605 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9ff49d4c-fa7b-449b-a32d-5aff9ff7f9a7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:56.679022 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9ff49d4c-fa7b-449b-a32d-5aff9ff7f9a7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:56.805539 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9ff49d4c-fa7b-449b-a32d-5aff9ff7f9a7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:56.813649 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9ff49d4c-fa7b-449b-a32d-5aff9ff7f9a7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.148501 Oct 11 06:56:56.814208 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 956/1888] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:56 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:56.866881 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-243626ee-8ec5-42eb-bf86-70060ee91559 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:56.869046 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-243626ee-8ec5-42eb-bf86-70060ee91559 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:56.875387 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-243626ee-8ec5-42eb-bf86-70060ee91559 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:56.875901 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-243626ee-8ec5-42eb-bf86-70060ee91559 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:56.876334 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-243626ee-8ec5-42eb-bf86-70060ee91559 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:56.877021 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-243626ee-8ec5-42eb-bf86-70060ee91559 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:56.877474 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-243626ee-8ec5-42eb-bf86-70060ee91559 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:56.877890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-243626ee-8ec5-42eb-bf86-70060ee91559 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:56.907143 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-243626ee-8ec5-42eb-bf86-70060ee91559 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044261 Oct 11 06:56:56.907719 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 933/1889] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:56 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:57.881271 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7d78c78d-d5b2-4517-91c8-1fcb570db4fd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:57.881910 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7d78c78d-d5b2-4517-91c8-1fcb570db4fd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:57.888612 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d78c78d-d5b2-4517-91c8-1fcb570db4fd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:57.889092 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d78c78d-d5b2-4517-91c8-1fcb570db4fd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:57.889789 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d78c78d-d5b2-4517-91c8-1fcb570db4fd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:57.890490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d78c78d-d5b2-4517-91c8-1fcb570db4fd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:57.890939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d78c78d-d5b2-4517-91c8-1fcb570db4fd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:57.891361 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d78c78d-d5b2-4517-91c8-1fcb570db4fd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:57.918890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-550f59eb-eb88-40fd-9468-172e644c4bee tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:57.921083 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-550f59eb-eb88-40fd-9468-172e644c4bee tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:57.927699 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-550f59eb-eb88-40fd-9468-172e644c4bee tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:57.928440 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-550f59eb-eb88-40fd-9468-172e644c4bee tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:57.928907 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-550f59eb-eb88-40fd-9468-172e644c4bee tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:57.929902 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-550f59eb-eb88-40fd-9468-172e644c4bee tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:57.930361 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-550f59eb-eb88-40fd-9468-172e644c4bee tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:57.930814 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-550f59eb-eb88-40fd-9468-172e644c4bee tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:57.963266 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-550f59eb-eb88-40fd-9468-172e644c4bee tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048404 Oct 11 06:56:57.963851 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 934/1890] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:57 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:56:58.029721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7d78c78d-d5b2-4517-91c8-1fcb570db4fd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:58.038963 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7d78c78d-d5b2-4517-91c8-1fcb570db4fd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.205688 Oct 11 06:56:58.039566 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 957/1891] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:57 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:56:58.975686 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-468b8567-689b-40e4-82eb-efc27f6639d4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:58.977827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-468b8567-689b-40e4-82eb-efc27f6639d4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:58.984171 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-468b8567-689b-40e4-82eb-efc27f6639d4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:58.984650 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-468b8567-689b-40e4-82eb-efc27f6639d4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:58.985078 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-468b8567-689b-40e4-82eb-efc27f6639d4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:58.985765 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-468b8567-689b-40e4-82eb-efc27f6639d4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:58.986223 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-468b8567-689b-40e4-82eb-efc27f6639d4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:58.986643 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-468b8567-689b-40e4-82eb-efc27f6639d4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:59.015743 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-468b8567-689b-40e4-82eb-efc27f6639d4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043948 Oct 11 06:56:59.016295 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 935/1892] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:56:58 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:56:59.061811 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-71f3f3a0-095f-49cc-af3a-c399ba50510f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:56:59.062442 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-71f3f3a0-095f-49cc-af3a-c399ba50510f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:56:59.068826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-71f3f3a0-095f-49cc-af3a-c399ba50510f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:59.069237 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-71f3f3a0-095f-49cc-af3a-c399ba50510f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:59.069660 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-71f3f3a0-095f-49cc-af3a-c399ba50510f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:59.070344 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-71f3f3a0-095f-49cc-af3a-c399ba50510f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:56:59.070813 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-71f3f3a0-095f-49cc-af3a-c399ba50510f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:56:59.071228 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-71f3f3a0-095f-49cc-af3a-c399ba50510f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:56:59.196010 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-71f3f3a0-095f-49cc-af3a-c399ba50510f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:56:59.204514 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-71f3f3a0-095f-49cc-af3a-c399ba50510f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.146422 Oct 11 06:56:59.205071 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 958/1893] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:56:59 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:00.028535 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-15ea8ac6-5fce-49fc-8482-fb7ed3568bef tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:00.030673 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-15ea8ac6-5fce-49fc-8482-fb7ed3568bef tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:00.037097 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15ea8ac6-5fce-49fc-8482-fb7ed3568bef tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:00.037580 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15ea8ac6-5fce-49fc-8482-fb7ed3568bef tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:00.038015 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15ea8ac6-5fce-49fc-8482-fb7ed3568bef tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:00.038710 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15ea8ac6-5fce-49fc-8482-fb7ed3568bef tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:00.039160 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15ea8ac6-5fce-49fc-8482-fb7ed3568bef tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:00.039622 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15ea8ac6-5fce-49fc-8482-fb7ed3568bef tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:00.068706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-15ea8ac6-5fce-49fc-8482-fb7ed3568bef tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044661 Oct 11 06:57:00.069252 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 936/1894] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:57:00 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:57:00.228591 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c5753f99-ccda-4ed4-8c58-702aeb460809 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:00.229175 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c5753f99-ccda-4ed4-8c58-702aeb460809 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:00.236384 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c5753f99-ccda-4ed4-8c58-702aeb460809 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:00.236867 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c5753f99-ccda-4ed4-8c58-702aeb460809 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:00.237300 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c5753f99-ccda-4ed4-8c58-702aeb460809 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:00.237998 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c5753f99-ccda-4ed4-8c58-702aeb460809 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:00.238447 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c5753f99-ccda-4ed4-8c58-702aeb460809 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:00.238871 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c5753f99-ccda-4ed4-8c58-702aeb460809 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:00.365901 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c5753f99-ccda-4ed4-8c58-702aeb460809 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:00.374085 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c5753f99-ccda-4ed4-8c58-702aeb460809 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149367 Oct 11 06:57:00.374654 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 959/1895] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:00 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:01.081868 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-93dcd440-8be0-469b-bf83-35f0ba095c4c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:01.084078 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-93dcd440-8be0-469b-bf83-35f0ba095c4c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:01.090402 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93dcd440-8be0-469b-bf83-35f0ba095c4c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:01.090886 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93dcd440-8be0-469b-bf83-35f0ba095c4c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:01.091318 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93dcd440-8be0-469b-bf83-35f0ba095c4c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:01.092045 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93dcd440-8be0-469b-bf83-35f0ba095c4c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:01.092499 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93dcd440-8be0-469b-bf83-35f0ba095c4c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:01.092922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93dcd440-8be0-469b-bf83-35f0ba095c4c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:01.122249 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-93dcd440-8be0-469b-bf83-35f0ba095c4c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044374 Oct 11 06:57:01.122804 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 937/1896] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:57:01 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:57:01.397092 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ef3ae617-bcca-4999-a7f7-feb926a7a8fd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:01.397763 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ef3ae617-bcca-4999-a7f7-feb926a7a8fd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:01.404416 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef3ae617-bcca-4999-a7f7-feb926a7a8fd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:01.404905 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef3ae617-bcca-4999-a7f7-feb926a7a8fd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:01.405357 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef3ae617-bcca-4999-a7f7-feb926a7a8fd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:01.406201 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef3ae617-bcca-4999-a7f7-feb926a7a8fd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:01.406642 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef3ae617-bcca-4999-a7f7-feb926a7a8fd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:01.407081 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef3ae617-bcca-4999-a7f7-feb926a7a8fd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:01.534585 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ef3ae617-bcca-4999-a7f7-feb926a7a8fd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:01.542775 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ef3ae617-bcca-4999-a7f7-feb926a7a8fd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149620 Oct 11 06:57:01.543919 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 960/1897] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:01 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:02.134122 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-61af54aa-6e3a-4d80-b626-3e18bcc84c2c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:02.136314 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-61af54aa-6e3a-4d80-b626-3e18bcc84c2c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:02.143401 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-61af54aa-6e3a-4d80-b626-3e18bcc84c2c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:02.143905 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-61af54aa-6e3a-4d80-b626-3e18bcc84c2c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:02.144335 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-61af54aa-6e3a-4d80-b626-3e18bcc84c2c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:02.145059 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-61af54aa-6e3a-4d80-b626-3e18bcc84c2c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:02.145511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-61af54aa-6e3a-4d80-b626-3e18bcc84c2c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:02.145931 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-61af54aa-6e3a-4d80-b626-3e18bcc84c2c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:02.175885 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-61af54aa-6e3a-4d80-b626-3e18bcc84c2c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045584 Oct 11 06:57:02.176356 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 938/1898] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:57:02 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:57:02.566010 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3da8b36b-093d-4a64-83ee-b526b599ac15 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:02.566550 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3da8b36b-093d-4a64-83ee-b526b599ac15 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:02.572955 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3da8b36b-093d-4a64-83ee-b526b599ac15 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:02.573429 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3da8b36b-093d-4a64-83ee-b526b599ac15 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:02.573858 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3da8b36b-093d-4a64-83ee-b526b599ac15 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:02.575158 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3da8b36b-093d-4a64-83ee-b526b599ac15 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:02.575646 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3da8b36b-093d-4a64-83ee-b526b599ac15 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:02.576068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3da8b36b-093d-4a64-83ee-b526b599ac15 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:02.702530 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3da8b36b-093d-4a64-83ee-b526b599ac15 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:02.710645 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3da8b36b-093d-4a64-83ee-b526b599ac15 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.148561 Oct 11 06:57:02.711199 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 961/1899] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:02 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:03.188535 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3b53b0a8-b11c-4065-bc75-7ba4a0b3d537 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:03.190717 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3b53b0a8-b11c-4065-bc75-7ba4a0b3d537 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:03.197086 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3b53b0a8-b11c-4065-bc75-7ba4a0b3d537 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:03.197569 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3b53b0a8-b11c-4065-bc75-7ba4a0b3d537 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:03.198002 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3b53b0a8-b11c-4065-bc75-7ba4a0b3d537 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:03.198692 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3b53b0a8-b11c-4065-bc75-7ba4a0b3d537 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:03.199148 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3b53b0a8-b11c-4065-bc75-7ba4a0b3d537 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:03.200158 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3b53b0a8-b11c-4065-bc75-7ba4a0b3d537 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:03.229255 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3b53b0a8-b11c-4065-bc75-7ba4a0b3d537 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044633 Oct 11 06:57:03.229793 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 939/1900] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:57:03 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:57:03.733888 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5bfd076b-b66f-4a30-96f6-fc912eb71529 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:03.734534 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5bfd076b-b66f-4a30-96f6-fc912eb71529 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:03.740843 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5bfd076b-b66f-4a30-96f6-fc912eb71529 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:03.741320 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5bfd076b-b66f-4a30-96f6-fc912eb71529 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:03.741756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5bfd076b-b66f-4a30-96f6-fc912eb71529 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:03.742453 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5bfd076b-b66f-4a30-96f6-fc912eb71529 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:03.742905 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5bfd076b-b66f-4a30-96f6-fc912eb71529 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:03.743323 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5bfd076b-b66f-4a30-96f6-fc912eb71529 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:03.872839 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5bfd076b-b66f-4a30-96f6-fc912eb71529 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:03.879075 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 06:57:03.879238 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Tue Oct 11 06:57:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb (ip 10.222.0.39) !!! Oct 11 06:57:03.883666 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5bfd076b-b66f-4a30-96f6-fc912eb71529 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.153610 Oct 11 06:57:03.884236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 962/1901] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:03 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:04.241523 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bb9c250d-17c8-4c6b-8aee-ae3bc0d6c77c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:04.243754 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bb9c250d-17c8-4c6b-8aee-ae3bc0d6c77c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:04.250852 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb9c250d-17c8-4c6b-8aee-ae3bc0d6c77c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:04.251324 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb9c250d-17c8-4c6b-8aee-ae3bc0d6c77c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:04.251779 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb9c250d-17c8-4c6b-8aee-ae3bc0d6c77c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:04.252464 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb9c250d-17c8-4c6b-8aee-ae3bc0d6c77c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:04.252912 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb9c250d-17c8-4c6b-8aee-ae3bc0d6c77c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:04.253328 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb9c250d-17c8-4c6b-8aee-ae3bc0d6c77c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:04.281746 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bb9c250d-17c8-4c6b-8aee-ae3bc0d6c77c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044205 Oct 11 06:57:04.282270 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 940/1902] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:57:04 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:57:04.908312 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c158e4f2-bd0c-407f-90c5-fa186a0eac83 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:04.908920 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c158e4f2-bd0c-407f-90c5-fa186a0eac83 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:04.911723 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=52 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:04.917551 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c158e4f2-bd0c-407f-90c5-fa186a0eac83 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:04.918606 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c158e4f2-bd0c-407f-90c5-fa186a0eac83 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:04.919043 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c158e4f2-bd0c-407f-90c5-fa186a0eac83 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:04.919750 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c158e4f2-bd0c-407f-90c5-fa186a0eac83 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:04.920199 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c158e4f2-bd0c-407f-90c5-fa186a0eac83 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:04.920615 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c158e4f2-bd0c-407f-90c5-fa186a0eac83 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:05.045876 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c158e4f2-bd0c-407f-90c5-fa186a0eac83 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:05.053975 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c158e4f2-bd0c-407f-90c5-fa186a0eac83 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149470 Oct 11 06:57:05.054531 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 963/1903] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:04 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:05.293450 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-42a9cafc-48c0-4ea7-ba51-295bafb8e687 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:05.295688 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-42a9cafc-48c0-4ea7-ba51-295bafb8e687 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:05.297725 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 06:57:05.297870 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Tue Oct 11 06:57:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments (ip 10.222.0.39) !!! Oct 11 06:57:05.303828 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42a9cafc-48c0-4ea7-ba51-295bafb8e687 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:05.304308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42a9cafc-48c0-4ea7-ba51-295bafb8e687 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:05.304745 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42a9cafc-48c0-4ea7-ba51-295bafb8e687 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:05.305438 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42a9cafc-48c0-4ea7-ba51-295bafb8e687 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:05.305893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42a9cafc-48c0-4ea7-ba51-295bafb8e687 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:05.306319 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42a9cafc-48c0-4ea7-ba51-295bafb8e687 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:05.337197 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-42a9cafc-48c0-4ea7-ba51-295bafb8e687 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047709 Oct 11 06:57:05.337740 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 941/1904] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:57:05 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:57:06.077128 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-57defca6-e775-4342-8870-0d648f8a91bf tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:06.077742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-57defca6-e775-4342-8870-0d648f8a91bf tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:06.084339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-57defca6-e775-4342-8870-0d648f8a91bf tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:06.084836 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-57defca6-e775-4342-8870-0d648f8a91bf tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:06.085254 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-57defca6-e775-4342-8870-0d648f8a91bf tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:06.085952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-57defca6-e775-4342-8870-0d648f8a91bf tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:06.086404 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-57defca6-e775-4342-8870-0d648f8a91bf tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:06.086833 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-57defca6-e775-4342-8870-0d648f8a91bf tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:06.221131 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-57defca6-e775-4342-8870-0d648f8a91bf tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:06.229277 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-57defca6-e775-4342-8870-0d648f8a91bf tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.155996 Oct 11 06:57:06.229844 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 964/1905] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:06 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:06.349269 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a3252a49-7738-4dff-a82e-7d1e81c6c61d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:06.351440 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a3252a49-7738-4dff-a82e-7d1e81c6c61d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:06.358447 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a3252a49-7738-4dff-a82e-7d1e81c6c61d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:06.358918 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a3252a49-7738-4dff-a82e-7d1e81c6c61d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:06.359343 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a3252a49-7738-4dff-a82e-7d1e81c6c61d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:06.360050 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a3252a49-7738-4dff-a82e-7d1e81c6c61d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:06.360495 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a3252a49-7738-4dff-a82e-7d1e81c6c61d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:06.360909 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a3252a49-7738-4dff-a82e-7d1e81c6c61d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:06.389372 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a3252a49-7738-4dff-a82e-7d1e81c6c61d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043991 Oct 11 06:57:06.390169 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 942/1906] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:57:06 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:57:07.252309 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-14c6bb83-bf4f-4cc3-a6f4-8a72b42d80d7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:07.252840 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-14c6bb83-bf4f-4cc3-a6f4-8a72b42d80d7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:07.259326 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-14c6bb83-bf4f-4cc3-a6f4-8a72b42d80d7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:07.259835 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-14c6bb83-bf4f-4cc3-a6f4-8a72b42d80d7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:07.260264 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-14c6bb83-bf4f-4cc3-a6f4-8a72b42d80d7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:07.260948 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-14c6bb83-bf4f-4cc3-a6f4-8a72b42d80d7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:07.261394 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-14c6bb83-bf4f-4cc3-a6f4-8a72b42d80d7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:07.261814 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-14c6bb83-bf4f-4cc3-a6f4-8a72b42d80d7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:07.391867 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-14c6bb83-bf4f-4cc3-a6f4-8a72b42d80d7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:07.400047 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-14c6bb83-bf4f-4cc3-a6f4-8a72b42d80d7 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.151610 Oct 11 06:57:07.400598 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 965/1907] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:07 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:07.402062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3ed1707f-dab8-4c8f-91bb-8b30198150fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:07.404345 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3ed1707f-dab8-4c8f-91bb-8b30198150fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:07.410858 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3ed1707f-dab8-4c8f-91bb-8b30198150fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:07.411336 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3ed1707f-dab8-4c8f-91bb-8b30198150fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:07.411800 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3ed1707f-dab8-4c8f-91bb-8b30198150fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:07.412491 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3ed1707f-dab8-4c8f-91bb-8b30198150fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:07.412958 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3ed1707f-dab8-4c8f-91bb-8b30198150fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:07.413563 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3ed1707f-dab8-4c8f-91bb-8b30198150fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:07.443321 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3ed1707f-dab8-4c8f-91bb-8b30198150fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045316 Oct 11 06:57:07.443887 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 943/1908] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:57:07 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:57:08.421970 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b4584fc3-06db-4b99-855b-4dfd55873c2b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:08.422577 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b4584fc3-06db-4b99-855b-4dfd55873c2b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:08.428977 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b4584fc3-06db-4b99-855b-4dfd55873c2b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:08.429449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b4584fc3-06db-4b99-855b-4dfd55873c2b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:08.429880 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b4584fc3-06db-4b99-855b-4dfd55873c2b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:08.430563 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b4584fc3-06db-4b99-855b-4dfd55873c2b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:08.431004 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b4584fc3-06db-4b99-855b-4dfd55873c2b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:08.431439 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b4584fc3-06db-4b99-855b-4dfd55873c2b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:08.454870 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-38e568f6-61b8-4a29-8f55-7011e905632b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:08.457987 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-38e568f6-61b8-4a29-8f55-7011e905632b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:08.465671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38e568f6-61b8-4a29-8f55-7011e905632b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:08.466435 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38e568f6-61b8-4a29-8f55-7011e905632b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:08.466885 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38e568f6-61b8-4a29-8f55-7011e905632b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:08.467821 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38e568f6-61b8-4a29-8f55-7011e905632b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:08.468382 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38e568f6-61b8-4a29-8f55-7011e905632b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:08.468809 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38e568f6-61b8-4a29-8f55-7011e905632b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:08.474278 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:08.506368 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-38e568f6-61b8-4a29-8f55-7011e905632b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055385 Oct 11 06:57:08.506943 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 944/1909] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:57:08 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:57:08.564182 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b4584fc3-06db-4b99-855b-4dfd55873c2b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:08.572264 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b4584fc3-06db-4b99-855b-4dfd55873c2b tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.154145 Oct 11 06:57:08.572861 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 966/1910] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:08 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:09.521693 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5a8f65a3-9b62-4cac-83a2-482af3be1f80 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:09.524003 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5a8f65a3-9b62-4cac-83a2-482af3be1f80 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:09.530852 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a8f65a3-9b62-4cac-83a2-482af3be1f80 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:09.531331 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a8f65a3-9b62-4cac-83a2-482af3be1f80 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:09.531791 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a8f65a3-9b62-4cac-83a2-482af3be1f80 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:09.532508 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a8f65a3-9b62-4cac-83a2-482af3be1f80 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:09.532966 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a8f65a3-9b62-4cac-83a2-482af3be1f80 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:09.533386 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a8f65a3-9b62-4cac-83a2-482af3be1f80 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:09.561672 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5a8f65a3-9b62-4cac-83a2-482af3be1f80 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044019 Oct 11 06:57:09.562410 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 945/1911] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:57:09 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:57:09.596235 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c8a1c321-6a10-4f97-ac7c-08c4f9d82e60 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:09.596847 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c8a1c321-6a10-4f97-ac7c-08c4f9d82e60 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:09.603197 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c8a1c321-6a10-4f97-ac7c-08c4f9d82e60 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:09.603717 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c8a1c321-6a10-4f97-ac7c-08c4f9d82e60 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:09.604162 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c8a1c321-6a10-4f97-ac7c-08c4f9d82e60 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:09.604852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c8a1c321-6a10-4f97-ac7c-08c4f9d82e60 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:09.605330 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c8a1c321-6a10-4f97-ac7c-08c4f9d82e60 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:09.605752 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c8a1c321-6a10-4f97-ac7c-08c4f9d82e60 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:09.729660 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c8a1c321-6a10-4f97-ac7c-08c4f9d82e60 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:09.737743 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c8a1c321-6a10-4f97-ac7c-08c4f9d82e60 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.145282 Oct 11 06:57:09.738308 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 967/1912] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:09 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:10.574209 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ade9def0-34dd-436c-8bb6-962304d0c21d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:10.576372 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ade9def0-34dd-436c-8bb6-962304d0c21d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:10.582644 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ade9def0-34dd-436c-8bb6-962304d0c21d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:10.583120 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ade9def0-34dd-436c-8bb6-962304d0c21d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:10.583583 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ade9def0-34dd-436c-8bb6-962304d0c21d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:10.584268 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ade9def0-34dd-436c-8bb6-962304d0c21d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:10.584715 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ade9def0-34dd-436c-8bb6-962304d0c21d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:10.585133 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ade9def0-34dd-436c-8bb6-962304d0c21d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:10.614425 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ade9def0-34dd-436c-8bb6-962304d0c21d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044184 Oct 11 06:57:10.614957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 946/1913] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:57:10 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:57:10.761699 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3a9d33cb-0fab-4446-a13c-41198aae5c51 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:10.762534 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3a9d33cb-0fab-4446-a13c-41198aae5c51 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:10.771150 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3a9d33cb-0fab-4446-a13c-41198aae5c51 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:10.771675 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3a9d33cb-0fab-4446-a13c-41198aae5c51 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:10.772112 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3a9d33cb-0fab-4446-a13c-41198aae5c51 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:10.772802 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3a9d33cb-0fab-4446-a13c-41198aae5c51 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:10.773246 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3a9d33cb-0fab-4446-a13c-41198aae5c51 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:10.773660 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3a9d33cb-0fab-4446-a13c-41198aae5c51 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:10.778419 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:10.903070 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3a9d33cb-0fab-4446-a13c-41198aae5c51 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:10.911169 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3a9d33cb-0fab-4446-a13c-41198aae5c51 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.154182 Oct 11 06:57:10.911758 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 968/1914] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:10 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:11.627202 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-41d8dab3-b615-4385-9186-78df7745db95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:11.629371 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-41d8dab3-b615-4385-9186-78df7745db95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:11.635763 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41d8dab3-b615-4385-9186-78df7745db95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:11.636249 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41d8dab3-b615-4385-9186-78df7745db95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:11.637313 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41d8dab3-b615-4385-9186-78df7745db95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:11.638009 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41d8dab3-b615-4385-9186-78df7745db95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:11.638464 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41d8dab3-b615-4385-9186-78df7745db95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:11.638887 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41d8dab3-b615-4385-9186-78df7745db95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:11.667486 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-41d8dab3-b615-4385-9186-78df7745db95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044307 Oct 11 06:57:11.668537 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 947/1915] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:57:11 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:57:11.935290 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-89ec8c1c-59ff-440d-b4fb-0dcc53fdef35 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:11.935932 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-89ec8c1c-59ff-440d-b4fb-0dcc53fdef35 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:11.942289 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89ec8c1c-59ff-440d-b4fb-0dcc53fdef35 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:11.942761 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89ec8c1c-59ff-440d-b4fb-0dcc53fdef35 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:11.943223 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89ec8c1c-59ff-440d-b4fb-0dcc53fdef35 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:11.943936 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89ec8c1c-59ff-440d-b4fb-0dcc53fdef35 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:11.944386 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89ec8c1c-59ff-440d-b4fb-0dcc53fdef35 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:11.944802 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89ec8c1c-59ff-440d-b4fb-0dcc53fdef35 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:12.077403 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-89ec8c1c-59ff-440d-b4fb-0dcc53fdef35 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:12.085450 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-89ec8c1c-59ff-440d-b4fb-0dcc53fdef35 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.154738 Oct 11 06:57:12.086002 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 969/1916] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:11 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:12.680302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8e601eea-4a86-49ef-91b3-742fc8461ea3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:12.682500 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8e601eea-4a86-49ef-91b3-742fc8461ea3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:12.689398 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e601eea-4a86-49ef-91b3-742fc8461ea3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:12.689873 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e601eea-4a86-49ef-91b3-742fc8461ea3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:12.690302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e601eea-4a86-49ef-91b3-742fc8461ea3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:12.690988 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e601eea-4a86-49ef-91b3-742fc8461ea3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:12.691442 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e601eea-4a86-49ef-91b3-742fc8461ea3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:12.691878 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e601eea-4a86-49ef-91b3-742fc8461ea3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:12.720082 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8e601eea-4a86-49ef-91b3-742fc8461ea3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043722 Oct 11 06:57:12.720611 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 948/1917] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 06:57:12 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:57:13.109159 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-dd56dae2-71be-4cc3-9b8e-a904a38e9a71 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:13.109758 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-dd56dae2-71be-4cc3-9b8e-a904a38e9a71 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:13.116117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dd56dae2-71be-4cc3-9b8e-a904a38e9a71 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:13.116586 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dd56dae2-71be-4cc3-9b8e-a904a38e9a71 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:13.117019 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dd56dae2-71be-4cc3-9b8e-a904a38e9a71 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:13.117693 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dd56dae2-71be-4cc3-9b8e-a904a38e9a71 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:13.118133 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dd56dae2-71be-4cc3-9b8e-a904a38e9a71 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:13.118544 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dd56dae2-71be-4cc3-9b8e-a904a38e9a71 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:13.244677 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-dd56dae2-71be-4cc3-9b8e-a904a38e9a71 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:13.252827 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-dd56dae2-71be-4cc3-9b8e-a904a38e9a71 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.148077 Oct 11 06:57:13.253386 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 970/1918] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:13 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:13.732316 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5ad2ddd7-1fa5-4cba-81c3-56269795b949 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:57:13.734540 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5ad2ddd7-1fa5-4cba-81c3-56269795b949 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:13.740940 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ad2ddd7-1fa5-4cba-81c3-56269795b949 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:13.741417 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ad2ddd7-1fa5-4cba-81c3-56269795b949 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:13.741850 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ad2ddd7-1fa5-4cba-81c3-56269795b949 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:13.742535 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ad2ddd7-1fa5-4cba-81c3-56269795b949 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:13.742982 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ad2ddd7-1fa5-4cba-81c3-56269795b949 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:13.743404 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ad2ddd7-1fa5-4cba-81c3-56269795b949 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:13.770014 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5ad2ddd7-1fa5-4cba-81c3-56269795b949 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [31862551-f504-4950-9f72-f9caac7c7e30] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 06:57:14.276715 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-088b470e-dfec-4f23-81a9-f929ac31333c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:14.277835 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-088b470e-dfec-4f23-81a9-f929ac31333c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:14.284263 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-088b470e-dfec-4f23-81a9-f929ac31333c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:14.284738 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-088b470e-dfec-4f23-81a9-f929ac31333c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:14.285168 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-088b470e-dfec-4f23-81a9-f929ac31333c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:14.285851 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-088b470e-dfec-4f23-81a9-f929ac31333c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:14.286294 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-088b470e-dfec-4f23-81a9-f929ac31333c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:14.286711 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-088b470e-dfec-4f23-81a9-f929ac31333c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:14.417052 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-088b470e-dfec-4f23-81a9-f929ac31333c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:14.425214 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-088b470e-dfec-4f23-81a9-f929ac31333c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.152447 Oct 11 06:57:14.425759 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 971/1919] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:14 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:14.776665 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [None req-5ad2ddd7-1fa5-4cba-81c3-56269795b949 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [31862551-f504-4950-9f72-f9caac7c7e30] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 43864. Oct 11 06:57:14.853643 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5ad2ddd7-1fa5-4cba-81c3-56269795b949 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "POST /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/action" status: 200 len: 75663 microversion: 2.1 time: 1.125256 Oct 11 06:57:14.854301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 949/1920] 10.222.0.39 () {60 vars in 1278 bytes} [Tue Oct 11 06:57:13 2022] POST /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d/action => generated 75663 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 06:57:15.448375 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b42573fa-5bc3-4c37-8723-5889796448ef tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:15.449705 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b42573fa-5bc3-4c37-8723-5889796448ef tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:15.456108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b42573fa-5bc3-4c37-8723-5889796448ef tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:15.456583 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b42573fa-5bc3-4c37-8723-5889796448ef tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:15.457007 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b42573fa-5bc3-4c37-8723-5889796448ef tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:15.457695 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b42573fa-5bc3-4c37-8723-5889796448ef tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:15.458138 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b42573fa-5bc3-4c37-8723-5889796448ef tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:15.458551 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b42573fa-5bc3-4c37-8723-5889796448ef tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:15.581562 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b42573fa-5bc3-4c37-8723-5889796448ef tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:15.590117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b42573fa-5bc3-4c37-8723-5889796448ef tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.144918 Oct 11 06:57:15.590666 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 972/1921] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:15 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:15.816466 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ef75301a-01ec-48f9-b0a0-fb12f4ad329b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:15.817047 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ef75301a-01ec-48f9-b0a0-fb12f4ad329b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:15.824653 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ef75301a-01ec-48f9-b0a0-fb12f4ad329b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:15.825129 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ef75301a-01ec-48f9-b0a0-fb12f4ad329b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:15.825560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ef75301a-01ec-48f9-b0a0-fb12f4ad329b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:15.826245 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ef75301a-01ec-48f9-b0a0-fb12f4ad329b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:15.826694 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ef75301a-01ec-48f9-b0a0-fb12f4ad329b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:15.827113 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ef75301a-01ec-48f9-b0a0-fb12f4ad329b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:15.851972 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ef75301a-01ec-48f9-b0a0-fb12f4ad329b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Going to try to terminate instance {{(pid=125267) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 06:57:15.926328 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ef75301a-01ec-48f9-b0a0-fb12f4ad329b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 204 len: 0 microversion: 2.1 time: 0.113755 Oct 11 06:57:15.927127 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 950/1922] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Oct 11 06:57:15 2022] DELETE /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 06:57:15.936382 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d4d0fbfb-1658-4345-ba51-92cb9f7f85e4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:15.937240 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d4d0fbfb-1658-4345-ba51-92cb9f7f85e4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:15.943283 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d4d0fbfb-1658-4345-ba51-92cb9f7f85e4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:15.943844 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d4d0fbfb-1658-4345-ba51-92cb9f7f85e4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:15.944212 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d4d0fbfb-1658-4345-ba51-92cb9f7f85e4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:15.944902 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d4d0fbfb-1658-4345-ba51-92cb9f7f85e4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:15.945342 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d4d0fbfb-1658-4345-ba51-92cb9f7f85e4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:15.945947 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d4d0fbfb-1658-4345-ba51-92cb9f7f85e4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:16.072679 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d4d0fbfb-1658-4345-ba51-92cb9f7f85e4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:16.080945 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d4d0fbfb-1658-4345-ba51-92cb9f7f85e4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.149064 Oct 11 06:57:16.081529 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 973/1923] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:15 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:16.613592 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c752faa8-d352-4b76-b379-87b3999d1e8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:16.614289 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c752faa8-d352-4b76-b379-87b3999d1e8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:16.621171 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c752faa8-d352-4b76-b379-87b3999d1e8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:16.621656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c752faa8-d352-4b76-b379-87b3999d1e8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:16.622097 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c752faa8-d352-4b76-b379-87b3999d1e8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:16.622796 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c752faa8-d352-4b76-b379-87b3999d1e8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:16.623256 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c752faa8-d352-4b76-b379-87b3999d1e8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:16.623716 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c752faa8-d352-4b76-b379-87b3999d1e8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:16.802193 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c752faa8-d352-4b76-b379-87b3999d1e8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:16.810820 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c752faa8-d352-4b76-b379-87b3999d1e8c tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.201414 Oct 11 06:57:16.811589 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 951/1924] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:16 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:17.104095 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-70310aad-563d-467e-a736-85ae226ade83 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:17.104702 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-70310aad-563d-467e-a736-85ae226ade83 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:17.111553 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-70310aad-563d-467e-a736-85ae226ade83 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:17.112023 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-70310aad-563d-467e-a736-85ae226ade83 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:17.112448 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-70310aad-563d-467e-a736-85ae226ade83 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:17.113129 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-70310aad-563d-467e-a736-85ae226ade83 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:17.113569 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-70310aad-563d-467e-a736-85ae226ade83 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:17.113984 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-70310aad-563d-467e-a736-85ae226ade83 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:17.239448 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-70310aad-563d-467e-a736-85ae226ade83 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:17.247610 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-70310aad-563d-467e-a736-85ae226ade83 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.147280 Oct 11 06:57:17.248165 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 974/1925] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:17 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:17.834557 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f18561f1-27f3-440b-90b0-6bd52e3953a1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:17.835083 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f18561f1-27f3-440b-90b0-6bd52e3953a1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:17.837535 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:17.843369 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f18561f1-27f3-440b-90b0-6bd52e3953a1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:17.843883 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f18561f1-27f3-440b-90b0-6bd52e3953a1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:17.844317 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f18561f1-27f3-440b-90b0-6bd52e3953a1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:17.845016 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f18561f1-27f3-440b-90b0-6bd52e3953a1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:17.845469 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f18561f1-27f3-440b-90b0-6bd52e3953a1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:17.845893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f18561f1-27f3-440b-90b0-6bd52e3953a1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:17.974201 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f18561f1-27f3-440b-90b0-6bd52e3953a1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:17.982360 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f18561f1-27f3-440b-90b0-6bd52e3953a1 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.151701 Oct 11 06:57:17.982915 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 952/1926] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:17 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:18.269591 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-34c2bc23-aeff-4ba2-94dc-a60ad7a57cf6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:18.270114 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-34c2bc23-aeff-4ba2-94dc-a60ad7a57cf6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:18.270240 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6732cbef-9567-4087-82ec-5c1997e88848 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:18.270800 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6732cbef-9567-4087-82ec-5c1997e88848 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:18.277213 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6732cbef-9567-4087-82ec-5c1997e88848 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:18.277739 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6732cbef-9567-4087-82ec-5c1997e88848 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:18.278177 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6732cbef-9567-4087-82ec-5c1997e88848 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:18.278292 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-34c2bc23-aeff-4ba2-94dc-a60ad7a57cf6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:18.278653 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-34c2bc23-aeff-4ba2-94dc-a60ad7a57cf6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:18.278869 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6732cbef-9567-4087-82ec-5c1997e88848 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:18.279074 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-34c2bc23-aeff-4ba2-94dc-a60ad7a57cf6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:18.279526 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6732cbef-9567-4087-82ec-5c1997e88848 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:18.279949 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6732cbef-9567-4087-82ec-5c1997e88848 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:18.280165 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-34c2bc23-aeff-4ba2-94dc-a60ad7a57cf6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:18.280679 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-34c2bc23-aeff-4ba2-94dc-a60ad7a57cf6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:18.281158 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-34c2bc23-aeff-4ba2-94dc-a60ad7a57cf6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:18.307523 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-34c2bc23-aeff-4ba2-94dc-a60ad7a57cf6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Going to try to terminate instance {{(pid=125266) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 06:57:18.381215 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR oslo.messaging._drivers.impl_rabbit [None req-34c2bc23-aeff-4ba2-94dc-a60ad7a57cf6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [a16afc89-c289-4a57-90cc-4b4e3ebdbdd8] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 06:57:18.424359 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6732cbef-9567-4087-82ec-5c1997e88848 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:18.433884 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6732cbef-9567-4087-82ec-5c1997e88848 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.166906 Oct 11 06:57:18.434447 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 953/1927] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:18 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:19.005831 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-94e517a4-8e4f-4011-93d9-c34d1cac62e4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:19.006485 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-94e517a4-8e4f-4011-93d9-c34d1cac62e4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:19.012572 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-94e517a4-8e4f-4011-93d9-c34d1cac62e4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:19.013046 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-94e517a4-8e4f-4011-93d9-c34d1cac62e4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:19.013473 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-94e517a4-8e4f-4011-93d9-c34d1cac62e4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:19.014157 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-94e517a4-8e4f-4011-93d9-c34d1cac62e4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:19.014867 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-94e517a4-8e4f-4011-93d9-c34d1cac62e4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:19.015286 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-94e517a4-8e4f-4011-93d9-c34d1cac62e4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:19.142792 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-94e517a4-8e4f-4011-93d9-c34d1cac62e4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:19.150909 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-94e517a4-8e4f-4011-93d9-c34d1cac62e4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.148938 Oct 11 06:57:19.151471 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 954/1928] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:19 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:19.388504 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO oslo.messaging._drivers.impl_rabbit [None req-34c2bc23-aeff-4ba2-94dc-a60ad7a57cf6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [a16afc89-c289-4a57-90cc-4b4e3ebdbdd8] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 43918. Oct 11 06:57:19.409995 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-34c2bc23-aeff-4ba2-94dc-a60ad7a57cf6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 204 len: 0 microversion: 2.1 time: 1.143976 Oct 11 06:57:19.410591 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 975/1929] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Oct 11 06:57:18 2022] DELETE /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 0 bytes in 1146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 06:57:19.419678 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-fcba2ffd-6161-4594-8d03-0ca18da11246 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:19.420294 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-fcba2ffd-6161-4594-8d03-0ca18da11246 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:19.426995 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fcba2ffd-6161-4594-8d03-0ca18da11246 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:19.427496 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fcba2ffd-6161-4594-8d03-0ca18da11246 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:19.427938 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fcba2ffd-6161-4594-8d03-0ca18da11246 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:19.428634 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fcba2ffd-6161-4594-8d03-0ca18da11246 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:19.429093 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fcba2ffd-6161-4594-8d03-0ca18da11246 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:19.429519 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fcba2ffd-6161-4594-8d03-0ca18da11246 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:19.457323 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b80193a2-5a80-4365-ac19-7069799eadff tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:19.458132 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b80193a2-5a80-4365-ac19-7069799eadff tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:19.464201 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b80193a2-5a80-4365-ac19-7069799eadff tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:19.465224 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b80193a2-5a80-4365-ac19-7069799eadff tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:19.465666 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b80193a2-5a80-4365-ac19-7069799eadff tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:19.466371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b80193a2-5a80-4365-ac19-7069799eadff tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:19.466817 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b80193a2-5a80-4365-ac19-7069799eadff tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:19.467237 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b80193a2-5a80-4365-ac19-7069799eadff tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:19.564781 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-fcba2ffd-6161-4594-8d03-0ca18da11246 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:19.573012 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-fcba2ffd-6161-4594-8d03-0ca18da11246 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.157724 Oct 11 06:57:19.573569 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 955/1930] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:19 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:19.599961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b80193a2-5a80-4365-ac19-7069799eadff tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:19.608812 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b80193a2-5a80-4365-ac19-7069799eadff tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.155668 Oct 11 06:57:19.609367 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 976/1931] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:19 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:20.174531 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c8237349-4dfb-4fa1-86b9-8c6b8aa105ca tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:20.175006 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c8237349-4dfb-4fa1-86b9-8c6b8aa105ca tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:20.180926 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8237349-4dfb-4fa1-86b9-8c6b8aa105ca tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:20.181401 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8237349-4dfb-4fa1-86b9-8c6b8aa105ca tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:20.181826 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8237349-4dfb-4fa1-86b9-8c6b8aa105ca tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:20.182510 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8237349-4dfb-4fa1-86b9-8c6b8aa105ca tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:20.182952 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8237349-4dfb-4fa1-86b9-8c6b8aa105ca tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:20.183987 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8237349-4dfb-4fa1-86b9-8c6b8aa105ca tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:20.309379 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c8237349-4dfb-4fa1-86b9-8c6b8aa105ca tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:20.317407 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c8237349-4dfb-4fa1-86b9-8c6b8aa105ca tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.146862 Oct 11 06:57:20.317956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 956/1932] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:20 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:20.596562 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b683c16e-4f5d-4287-8f62-eb702898cc69 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:20.597167 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b683c16e-4f5d-4287-8f62-eb702898cc69 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:20.603668 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b683c16e-4f5d-4287-8f62-eb702898cc69 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:20.604141 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b683c16e-4f5d-4287-8f62-eb702898cc69 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:20.604569 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b683c16e-4f5d-4287-8f62-eb702898cc69 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:20.605837 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b683c16e-4f5d-4287-8f62-eb702898cc69 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:20.606261 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b683c16e-4f5d-4287-8f62-eb702898cc69 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:20.606685 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b683c16e-4f5d-4287-8f62-eb702898cc69 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:20.631449 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7b225bd3-683f-4555-9d48-1faac3d48f87 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:20.632038 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7b225bd3-683f-4555-9d48-1faac3d48f87 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:20.638362 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b225bd3-683f-4555-9d48-1faac3d48f87 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:20.638835 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b225bd3-683f-4555-9d48-1faac3d48f87 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:20.639260 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b225bd3-683f-4555-9d48-1faac3d48f87 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:20.640241 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b225bd3-683f-4555-9d48-1faac3d48f87 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:20.640684 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b225bd3-683f-4555-9d48-1faac3d48f87 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:20.641100 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7b225bd3-683f-4555-9d48-1faac3d48f87 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:20.738108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b683c16e-4f5d-4287-8f62-eb702898cc69 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:20.746405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b683c16e-4f5d-4287-8f62-eb702898cc69 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.153768 Oct 11 06:57:20.748046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 977/1933] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:20 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:20.783939 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7b225bd3-683f-4555-9d48-1faac3d48f87 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:20.792050 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7b225bd3-683f-4555-9d48-1faac3d48f87 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.164417 Oct 11 06:57:20.793122 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 957/1934] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:20 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:21.340782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8cccbabc-1070-4c0d-93cb-5d9a75d26ab4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:21.341392 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8cccbabc-1070-4c0d-93cb-5d9a75d26ab4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:21.347513 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8cccbabc-1070-4c0d-93cb-5d9a75d26ab4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:21.347991 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8cccbabc-1070-4c0d-93cb-5d9a75d26ab4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:21.348425 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8cccbabc-1070-4c0d-93cb-5d9a75d26ab4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:21.349112 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8cccbabc-1070-4c0d-93cb-5d9a75d26ab4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:21.349559 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8cccbabc-1070-4c0d-93cb-5d9a75d26ab4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:21.349983 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8cccbabc-1070-4c0d-93cb-5d9a75d26ab4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:21.476147 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8cccbabc-1070-4c0d-93cb-5d9a75d26ab4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:21.484227 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8cccbabc-1070-4c0d-93cb-5d9a75d26ab4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147975 Oct 11 06:57:21.484787 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 978/1935] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:21 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:21.770223 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-53604c0b-b2ba-483c-9edc-5b65a5aa616d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:21.770836 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-53604c0b-b2ba-483c-9edc-5b65a5aa616d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:21.777738 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-53604c0b-b2ba-483c-9edc-5b65a5aa616d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:21.778222 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-53604c0b-b2ba-483c-9edc-5b65a5aa616d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:21.778659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-53604c0b-b2ba-483c-9edc-5b65a5aa616d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:21.779361 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-53604c0b-b2ba-483c-9edc-5b65a5aa616d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:21.779841 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-53604c0b-b2ba-483c-9edc-5b65a5aa616d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:21.780268 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-53604c0b-b2ba-483c-9edc-5b65a5aa616d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:21.815364 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2b477e6a-b16a-43f0-8e56-d4b3830bac34 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:21.815988 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2b477e6a-b16a-43f0-8e56-d4b3830bac34 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:21.822352 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2b477e6a-b16a-43f0-8e56-d4b3830bac34 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:21.822827 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2b477e6a-b16a-43f0-8e56-d4b3830bac34 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:21.823254 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2b477e6a-b16a-43f0-8e56-d4b3830bac34 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:21.824048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2b477e6a-b16a-43f0-8e56-d4b3830bac34 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:21.824485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2b477e6a-b16a-43f0-8e56-d4b3830bac34 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:21.824907 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2b477e6a-b16a-43f0-8e56-d4b3830bac34 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:21.911238 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-53604c0b-b2ba-483c-9edc-5b65a5aa616d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:21.920200 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-53604c0b-b2ba-483c-9edc-5b65a5aa616d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.153882 Oct 11 06:57:21.920766 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 958/1936] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:21 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:21.954784 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2b477e6a-b16a-43f0-8e56-d4b3830bac34 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:21.963165 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2b477e6a-b16a-43f0-8e56-d4b3830bac34 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.151679 Oct 11 06:57:21.963776 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 979/1937] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:21 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:22.507604 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-da39f41f-69c9-429c-9ee3-7c9ec45f8dc0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:22.508214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-da39f41f-69c9-429c-9ee3-7c9ec45f8dc0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:22.515248 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-da39f41f-69c9-429c-9ee3-7c9ec45f8dc0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:22.515772 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-da39f41f-69c9-429c-9ee3-7c9ec45f8dc0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:22.516249 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-da39f41f-69c9-429c-9ee3-7c9ec45f8dc0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:22.516916 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-da39f41f-69c9-429c-9ee3-7c9ec45f8dc0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:22.517367 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-da39f41f-69c9-429c-9ee3-7c9ec45f8dc0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:22.517785 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-da39f41f-69c9-429c-9ee3-7c9ec45f8dc0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:22.535692 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:22.642426 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-da39f41f-69c9-429c-9ee3-7c9ec45f8dc0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:22.650545 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-da39f41f-69c9-429c-9ee3-7c9ec45f8dc0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.146841 Oct 11 06:57:22.651100 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 959/1938] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:22 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:22.943334 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9837d95e-3bcb-4511-a75e-e0724326d345 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:22.943969 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9837d95e-3bcb-4511-a75e-e0724326d345 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:22.950801 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9837d95e-3bcb-4511-a75e-e0724326d345 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:22.951269 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9837d95e-3bcb-4511-a75e-e0724326d345 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:22.951733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9837d95e-3bcb-4511-a75e-e0724326d345 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:22.952414 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9837d95e-3bcb-4511-a75e-e0724326d345 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:22.952854 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9837d95e-3bcb-4511-a75e-e0724326d345 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:22.953265 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9837d95e-3bcb-4511-a75e-e0724326d345 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:22.985911 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8c38a33b-8bb0-4aaa-b767-5e4638822680 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:22.986524 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8c38a33b-8bb0-4aaa-b767-5e4638822680 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:22.993011 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8c38a33b-8bb0-4aaa-b767-5e4638822680 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:22.993517 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8c38a33b-8bb0-4aaa-b767-5e4638822680 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:22.993950 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8c38a33b-8bb0-4aaa-b767-5e4638822680 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:22.994661 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8c38a33b-8bb0-4aaa-b767-5e4638822680 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:22.995109 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8c38a33b-8bb0-4aaa-b767-5e4638822680 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:22.995602 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8c38a33b-8bb0-4aaa-b767-5e4638822680 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:23.079466 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9837d95e-3bcb-4511-a75e-e0724326d345 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:23.087866 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9837d95e-3bcb-4511-a75e-e0724326d345 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.148287 Oct 11 06:57:23.088425 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 980/1939] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:22 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:23.126339 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8c38a33b-8bb0-4aaa-b767-5e4638822680 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:23.134680 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8c38a33b-8bb0-4aaa-b767-5e4638822680 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.152555 Oct 11 06:57:23.135233 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 960/1940] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:22 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:23.674822 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ff1b996a-3821-4b02-958a-dfbfc25538f5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:23.675181 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ff1b996a-3821-4b02-958a-dfbfc25538f5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:23.681236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff1b996a-3821-4b02-958a-dfbfc25538f5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:23.681709 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff1b996a-3821-4b02-958a-dfbfc25538f5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:23.682146 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff1b996a-3821-4b02-958a-dfbfc25538f5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:23.682843 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff1b996a-3821-4b02-958a-dfbfc25538f5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:23.683900 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff1b996a-3821-4b02-958a-dfbfc25538f5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:23.684346 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff1b996a-3821-4b02-958a-dfbfc25538f5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:23.810815 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ff1b996a-3821-4b02-958a-dfbfc25538f5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:23.818894 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ff1b996a-3821-4b02-958a-dfbfc25538f5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.148481 Oct 11 06:57:23.819470 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 981/1941] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:23 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:24.111301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-433f6b8e-1915-49c2-883f-865801362c00 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:24.111941 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-433f6b8e-1915-49c2-883f-865801362c00 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:24.118305 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-433f6b8e-1915-49c2-883f-865801362c00 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:24.118784 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-433f6b8e-1915-49c2-883f-865801362c00 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:24.119215 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-433f6b8e-1915-49c2-883f-865801362c00 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:24.119940 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-433f6b8e-1915-49c2-883f-865801362c00 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:24.120871 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-433f6b8e-1915-49c2-883f-865801362c00 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:24.121305 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-433f6b8e-1915-49c2-883f-865801362c00 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:24.157727 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-61b83655-7548-4635-83a2-29336a1e5277 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:24.158336 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-61b83655-7548-4635-83a2-29336a1e5277 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:24.165183 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-61b83655-7548-4635-83a2-29336a1e5277 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:24.165658 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-61b83655-7548-4635-83a2-29336a1e5277 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:24.166105 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-61b83655-7548-4635-83a2-29336a1e5277 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:24.166782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-61b83655-7548-4635-83a2-29336a1e5277 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:24.167225 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-61b83655-7548-4635-83a2-29336a1e5277 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:24.167691 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-61b83655-7548-4635-83a2-29336a1e5277 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:24.249080 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-433f6b8e-1915-49c2-883f-865801362c00 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:24.257443 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-433f6b8e-1915-49c2-883f-865801362c00 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.149963 Oct 11 06:57:24.257994 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 961/1942] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:24 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:24.299498 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-61b83655-7548-4635-83a2-29336a1e5277 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:24.307629 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-61b83655-7548-4635-83a2-29336a1e5277 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.153606 Oct 11 06:57:24.308184 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 982/1943] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:24 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:24.841857 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a0987898-9ccb-45f0-82b6-d05152e01005 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:24.842395 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a0987898-9ccb-45f0-82b6-d05152e01005 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:24.848370 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a0987898-9ccb-45f0-82b6-d05152e01005 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:24.848846 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a0987898-9ccb-45f0-82b6-d05152e01005 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:24.849295 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a0987898-9ccb-45f0-82b6-d05152e01005 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:24.849975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a0987898-9ccb-45f0-82b6-d05152e01005 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:24.850428 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a0987898-9ccb-45f0-82b6-d05152e01005 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:24.850852 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a0987898-9ccb-45f0-82b6-d05152e01005 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:24.980365 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a0987898-9ccb-45f0-82b6-d05152e01005 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:24.988590 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a0987898-9ccb-45f0-82b6-d05152e01005 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150633 Oct 11 06:57:24.989139 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 962/1944] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:24 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:25.281034 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ce3f4900-e2b1-4a3b-84f6-35d3e9380978 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:25.281673 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ce3f4900-e2b1-4a3b-84f6-35d3e9380978 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:25.288315 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ce3f4900-e2b1-4a3b-84f6-35d3e9380978 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:25.288792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ce3f4900-e2b1-4a3b-84f6-35d3e9380978 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:25.289440 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ce3f4900-e2b1-4a3b-84f6-35d3e9380978 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:25.289901 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ce3f4900-e2b1-4a3b-84f6-35d3e9380978 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:25.290346 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ce3f4900-e2b1-4a3b-84f6-35d3e9380978 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:25.290764 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ce3f4900-e2b1-4a3b-84f6-35d3e9380978 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:25.295477 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:25.330407 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-dc367838-2e08-463f-bfe6-2069f82d6629 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:25.331025 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-dc367838-2e08-463f-bfe6-2069f82d6629 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:25.337987 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dc367838-2e08-463f-bfe6-2069f82d6629 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:25.338473 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dc367838-2e08-463f-bfe6-2069f82d6629 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:25.338904 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dc367838-2e08-463f-bfe6-2069f82d6629 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:25.339649 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dc367838-2e08-463f-bfe6-2069f82d6629 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:25.340094 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dc367838-2e08-463f-bfe6-2069f82d6629 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:25.340511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dc367838-2e08-463f-bfe6-2069f82d6629 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:25.481906 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-dc367838-2e08-463f-bfe6-2069f82d6629 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:25.493216 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-dc367838-2e08-463f-bfe6-2069f82d6629 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.166641 Oct 11 06:57:25.493808 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 963/1945] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:25 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:25.573862 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ce3f4900-e2b1-4a3b-84f6-35d3e9380978 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:25.581907 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ce3f4900-e2b1-4a3b-84f6-35d3e9380978 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.304762 Oct 11 06:57:25.582449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 983/1946] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:25 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:26.012174 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2135a9b1-a16e-4c5d-b0f1-dd24e5d2a6c4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:26.012778 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2135a9b1-a16e-4c5d-b0f1-dd24e5d2a6c4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:26.018992 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2135a9b1-a16e-4c5d-b0f1-dd24e5d2a6c4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:26.019562 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2135a9b1-a16e-4c5d-b0f1-dd24e5d2a6c4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:26.020000 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2135a9b1-a16e-4c5d-b0f1-dd24e5d2a6c4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:26.020695 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2135a9b1-a16e-4c5d-b0f1-dd24e5d2a6c4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:26.021136 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2135a9b1-a16e-4c5d-b0f1-dd24e5d2a6c4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:26.021553 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2135a9b1-a16e-4c5d-b0f1-dd24e5d2a6c4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:26.145130 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2135a9b1-a16e-4c5d-b0f1-dd24e5d2a6c4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:26.154321 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2135a9b1-a16e-4c5d-b0f1-dd24e5d2a6c4 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.146138 Oct 11 06:57:26.154841 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 964/1947] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:26 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:26.516792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0b4c48f6-8cec-46dc-9c61-7140f7cbbcaf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:26.517393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0b4c48f6-8cec-46dc-9c61-7140f7cbbcaf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:26.523998 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b4c48f6-8cec-46dc-9c61-7140f7cbbcaf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:26.524474 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b4c48f6-8cec-46dc-9c61-7140f7cbbcaf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:26.524898 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b4c48f6-8cec-46dc-9c61-7140f7cbbcaf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:26.525580 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b4c48f6-8cec-46dc-9c61-7140f7cbbcaf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:26.526091 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b4c48f6-8cec-46dc-9c61-7140f7cbbcaf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:26.526494 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b4c48f6-8cec-46dc-9c61-7140f7cbbcaf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:26.605383 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2ba340a9-5427-403f-a63a-6e16430c6226 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:26.605993 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2ba340a9-5427-403f-a63a-6e16430c6226 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:26.612591 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2ba340a9-5427-403f-a63a-6e16430c6226 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:26.613064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2ba340a9-5427-403f-a63a-6e16430c6226 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:26.613490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2ba340a9-5427-403f-a63a-6e16430c6226 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:26.614201 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2ba340a9-5427-403f-a63a-6e16430c6226 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:26.614639 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2ba340a9-5427-403f-a63a-6e16430c6226 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:26.615048 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2ba340a9-5427-403f-a63a-6e16430c6226 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:26.911225 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0b4c48f6-8cec-46dc-9c61-7140f7cbbcaf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:26.919796 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0b4c48f6-8cec-46dc-9c61-7140f7cbbcaf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.407081 Oct 11 06:57:26.920340 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 984/1948] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:26 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:26.975962 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2ba340a9-5427-403f-a63a-6e16430c6226 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:26.984560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2ba340a9-5427-403f-a63a-6e16430c6226 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.383177 Oct 11 06:57:26.985116 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 965/1949] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:26 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:27.178095 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d97f8e52-0792-4b87-ad41-931e6629a24e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:27.178709 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d97f8e52-0792-4b87-ad41-931e6629a24e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:27.184610 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d97f8e52-0792-4b87-ad41-931e6629a24e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:27.185089 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d97f8e52-0792-4b87-ad41-931e6629a24e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:27.185524 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d97f8e52-0792-4b87-ad41-931e6629a24e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:27.186212 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d97f8e52-0792-4b87-ad41-931e6629a24e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:27.186684 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d97f8e52-0792-4b87-ad41-931e6629a24e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:27.187107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d97f8e52-0792-4b87-ad41-931e6629a24e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:27.310324 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d97f8e52-0792-4b87-ad41-931e6629a24e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:27.318465 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d97f8e52-0792-4b87-ad41-931e6629a24e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.144423 Oct 11 06:57:27.319018 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 985/1950] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:27 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:27.943077 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6143d95a-f0d0-459d-9cd6-c574a32713a6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:27.943920 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6143d95a-f0d0-459d-9cd6-c574a32713a6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:27.950859 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6143d95a-f0d0-459d-9cd6-c574a32713a6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:27.951335 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6143d95a-f0d0-459d-9cd6-c574a32713a6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:27.951806 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6143d95a-f0d0-459d-9cd6-c574a32713a6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:27.952497 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6143d95a-f0d0-459d-9cd6-c574a32713a6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:27.952951 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6143d95a-f0d0-459d-9cd6-c574a32713a6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:27.953369 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6143d95a-f0d0-459d-9cd6-c574a32713a6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:28.007734 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-32426a56-868b-4c27-9154-ba9af3b82e61 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:28.008465 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-32426a56-868b-4c27-9154-ba9af3b82e61 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:28.015726 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-32426a56-868b-4c27-9154-ba9af3b82e61 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:28.016269 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-32426a56-868b-4c27-9154-ba9af3b82e61 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:28.016761 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-32426a56-868b-4c27-9154-ba9af3b82e61 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:28.017455 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-32426a56-868b-4c27-9154-ba9af3b82e61 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:28.017897 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-32426a56-868b-4c27-9154-ba9af3b82e61 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:28.018309 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-32426a56-868b-4c27-9154-ba9af3b82e61 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:28.080413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6143d95a-f0d0-459d-9cd6-c574a32713a6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:28.088632 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6143d95a-f0d0-459d-9cd6-c574a32713a6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.149418 Oct 11 06:57:28.089202 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 966/1951] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:27 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:28.147431 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-32426a56-868b-4c27-9154-ba9af3b82e61 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:28.156242 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-32426a56-868b-4c27-9154-ba9af3b82e61 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.152404 Oct 11 06:57:28.156821 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 986/1952] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:28 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:28.342655 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f9520ba6-9bce-4452-9b76-b43f149d1bae tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:28.343184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f9520ba6-9bce-4452-9b76-b43f149d1bae tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:28.349178 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f9520ba6-9bce-4452-9b76-b43f149d1bae tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:28.349658 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f9520ba6-9bce-4452-9b76-b43f149d1bae tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:28.350087 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f9520ba6-9bce-4452-9b76-b43f149d1bae tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:28.350776 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f9520ba6-9bce-4452-9b76-b43f149d1bae tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:28.351226 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f9520ba6-9bce-4452-9b76-b43f149d1bae tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:28.351670 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f9520ba6-9bce-4452-9b76-b43f149d1bae tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:28.482242 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f9520ba6-9bce-4452-9b76-b43f149d1bae tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:28.490253 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f9520ba6-9bce-4452-9b76-b43f149d1bae tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.152165 Oct 11 06:57:28.490802 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 967/1953] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:28 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:29.111599 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5b9096ff-9ddc-45dd-a865-e8cf81c15004 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:29.112213 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5b9096ff-9ddc-45dd-a865-e8cf81c15004 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:29.118574 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5b9096ff-9ddc-45dd-a865-e8cf81c15004 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:29.119050 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5b9096ff-9ddc-45dd-a865-e8cf81c15004 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:29.119578 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5b9096ff-9ddc-45dd-a865-e8cf81c15004 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:29.120271 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5b9096ff-9ddc-45dd-a865-e8cf81c15004 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:29.120720 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5b9096ff-9ddc-45dd-a865-e8cf81c15004 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:29.121139 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5b9096ff-9ddc-45dd-a865-e8cf81c15004 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:29.179041 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9cbc0361-ae8f-461b-9268-3696cebd7c21 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:29.180268 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9cbc0361-ae8f-461b-9268-3696cebd7c21 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:29.186967 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9cbc0361-ae8f-461b-9268-3696cebd7c21 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:29.187472 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9cbc0361-ae8f-461b-9268-3696cebd7c21 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:29.187903 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9cbc0361-ae8f-461b-9268-3696cebd7c21 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:29.188590 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9cbc0361-ae8f-461b-9268-3696cebd7c21 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:29.189575 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9cbc0361-ae8f-461b-9268-3696cebd7c21 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:29.189998 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9cbc0361-ae8f-461b-9268-3696cebd7c21 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:29.254913 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5b9096ff-9ddc-45dd-a865-e8cf81c15004 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:29.263619 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5b9096ff-9ddc-45dd-a865-e8cf81c15004 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.155914 Oct 11 06:57:29.264179 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 987/1954] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:29 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:29.317317 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9cbc0361-ae8f-461b-9268-3696cebd7c21 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:29.326001 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9cbc0361-ae8f-461b-9268-3696cebd7c21 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.150962 Oct 11 06:57:29.326546 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 968/1955] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:29 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:29.513760 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7f9a77a7-6d8b-4fb5-9cb5-aada526fe419 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:29.514361 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7f9a77a7-6d8b-4fb5-9cb5-aada526fe419 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:29.520826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7f9a77a7-6d8b-4fb5-9cb5-aada526fe419 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:29.521310 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7f9a77a7-6d8b-4fb5-9cb5-aada526fe419 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:29.521777 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7f9a77a7-6d8b-4fb5-9cb5-aada526fe419 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:29.523324 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7f9a77a7-6d8b-4fb5-9cb5-aada526fe419 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:29.523820 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7f9a77a7-6d8b-4fb5-9cb5-aada526fe419 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:29.524284 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7f9a77a7-6d8b-4fb5-9cb5-aada526fe419 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:29.652015 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7f9a77a7-6d8b-4fb5-9cb5-aada526fe419 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:29.660669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7f9a77a7-6d8b-4fb5-9cb5-aada526fe419 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150821 Oct 11 06:57:29.661161 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 988/1956] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:29 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:30.287108 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2114bd5a-46de-45cd-98f1-acd6783ebbbd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:30.287753 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2114bd5a-46de-45cd-98f1-acd6783ebbbd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:30.294360 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2114bd5a-46de-45cd-98f1-acd6783ebbbd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:30.294839 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2114bd5a-46de-45cd-98f1-acd6783ebbbd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:30.295274 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2114bd5a-46de-45cd-98f1-acd6783ebbbd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:30.295996 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2114bd5a-46de-45cd-98f1-acd6783ebbbd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:30.296451 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2114bd5a-46de-45cd-98f1-acd6783ebbbd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:30.296875 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2114bd5a-46de-45cd-98f1-acd6783ebbbd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:30.348873 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-71ae78c8-f4f8-4b78-b114-cb005d8e1b1d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:30.349475 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-71ae78c8-f4f8-4b78-b114-cb005d8e1b1d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:30.355842 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-71ae78c8-f4f8-4b78-b114-cb005d8e1b1d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:30.356308 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-71ae78c8-f4f8-4b78-b114-cb005d8e1b1d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:30.356742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-71ae78c8-f4f8-4b78-b114-cb005d8e1b1d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:30.357417 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-71ae78c8-f4f8-4b78-b114-cb005d8e1b1d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:30.357854 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-71ae78c8-f4f8-4b78-b114-cb005d8e1b1d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:30.358267 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-71ae78c8-f4f8-4b78-b114-cb005d8e1b1d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:30.430612 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2114bd5a-46de-45cd-98f1-acd6783ebbbd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:30.439467 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2114bd5a-46de-45cd-98f1-acd6783ebbbd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.156163 Oct 11 06:57:30.440038 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 969/1957] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:30 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:30.488891 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-71ae78c8-f4f8-4b78-b114-cb005d8e1b1d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:30.497607 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-71ae78c8-f4f8-4b78-b114-cb005d8e1b1d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.152498 Oct 11 06:57:30.498158 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 989/1958] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:30 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:30.683562 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3032f225-d6ed-488d-ba01-55a4b1bd6507 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:30.684677 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3032f225-d6ed-488d-ba01-55a4b1bd6507 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:30.690667 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3032f225-d6ed-488d-ba01-55a4b1bd6507 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:30.691151 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3032f225-d6ed-488d-ba01-55a4b1bd6507 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:30.691624 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3032f225-d6ed-488d-ba01-55a4b1bd6507 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:30.692318 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3032f225-d6ed-488d-ba01-55a4b1bd6507 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:30.692769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3032f225-d6ed-488d-ba01-55a4b1bd6507 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:30.693194 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3032f225-d6ed-488d-ba01-55a4b1bd6507 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:30.818377 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3032f225-d6ed-488d-ba01-55a4b1bd6507 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:30.826539 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3032f225-d6ed-488d-ba01-55a4b1bd6507 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.146907 Oct 11 06:57:30.827100 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 970/1959] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:30 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:31.462353 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f61b7c99-638e-493b-b655-c7912e888084 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:31.462992 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f61b7c99-638e-493b-b655-c7912e888084 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:31.470309 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f61b7c99-638e-493b-b655-c7912e888084 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:31.470785 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f61b7c99-638e-493b-b655-c7912e888084 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:31.471213 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f61b7c99-638e-493b-b655-c7912e888084 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:31.471922 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f61b7c99-638e-493b-b655-c7912e888084 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:31.472373 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f61b7c99-638e-493b-b655-c7912e888084 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:31.472806 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f61b7c99-638e-493b-b655-c7912e888084 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:31.523933 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e7247d78-d732-4b50-a463-d5e5c9c1e24b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:31.524569 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e7247d78-d732-4b50-a463-d5e5c9c1e24b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:31.531509 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7247d78-d732-4b50-a463-d5e5c9c1e24b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:31.531984 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7247d78-d732-4b50-a463-d5e5c9c1e24b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:31.532409 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7247d78-d732-4b50-a463-d5e5c9c1e24b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:31.533149 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7247d78-d732-4b50-a463-d5e5c9c1e24b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:31.533537 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7247d78-d732-4b50-a463-d5e5c9c1e24b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:31.533953 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7247d78-d732-4b50-a463-d5e5c9c1e24b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:31.599922 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f61b7c99-638e-493b-b655-c7912e888084 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:31.608440 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f61b7c99-638e-493b-b655-c7912e888084 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.149919 Oct 11 06:57:31.609033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 990/1960] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:31 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:31.664986 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e7247d78-d732-4b50-a463-d5e5c9c1e24b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:31.673345 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e7247d78-d732-4b50-a463-d5e5c9c1e24b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.155535 Oct 11 06:57:31.673899 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 971/1961] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:31 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:31.849980 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-762b8678-9558-4ebe-8a35-0341fadc8635 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:31.850592 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-762b8678-9558-4ebe-8a35-0341fadc8635 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:31.857089 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-762b8678-9558-4ebe-8a35-0341fadc8635 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:31.857563 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-762b8678-9558-4ebe-8a35-0341fadc8635 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:31.858014 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-762b8678-9558-4ebe-8a35-0341fadc8635 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:31.858688 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-762b8678-9558-4ebe-8a35-0341fadc8635 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:31.859140 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-762b8678-9558-4ebe-8a35-0341fadc8635 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:31.859598 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-762b8678-9558-4ebe-8a35-0341fadc8635 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:31.988323 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-762b8678-9558-4ebe-8a35-0341fadc8635 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:31.996693 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-762b8678-9558-4ebe-8a35-0341fadc8635 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150545 Oct 11 06:57:31.997255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 991/1962] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:31 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:32.632246 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5103eda1-8bdb-4cf3-bccd-2f5e11487671 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:32.632909 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5103eda1-8bdb-4cf3-bccd-2f5e11487671 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:32.640136 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5103eda1-8bdb-4cf3-bccd-2f5e11487671 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:32.640606 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5103eda1-8bdb-4cf3-bccd-2f5e11487671 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:32.641027 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5103eda1-8bdb-4cf3-bccd-2f5e11487671 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:32.641708 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5103eda1-8bdb-4cf3-bccd-2f5e11487671 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:32.642151 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5103eda1-8bdb-4cf3-bccd-2f5e11487671 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:32.642565 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5103eda1-8bdb-4cf3-bccd-2f5e11487671 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:32.697358 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-665a8711-6172-459f-a403-359a2b4da449 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:32.698061 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-665a8711-6172-459f-a403-359a2b4da449 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:32.704780 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-665a8711-6172-459f-a403-359a2b4da449 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:32.705269 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-665a8711-6172-459f-a403-359a2b4da449 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:32.705697 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-665a8711-6172-459f-a403-359a2b4da449 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:32.706509 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-665a8711-6172-459f-a403-359a2b4da449 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:32.707041 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-665a8711-6172-459f-a403-359a2b4da449 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:32.707481 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-665a8711-6172-459f-a403-359a2b4da449 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:32.772819 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5103eda1-8bdb-4cf3-bccd-2f5e11487671 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:32.781045 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5103eda1-8bdb-4cf3-bccd-2f5e11487671 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.152635 Oct 11 06:57:32.781613 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 972/1963] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:32 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:32.835228 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-665a8711-6172-459f-a403-359a2b4da449 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:32.843848 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-665a8711-6172-459f-a403-359a2b4da449 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.150324 Oct 11 06:57:32.844398 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 992/1964] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:32 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:33.020946 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-966b5b44-f3fb-4849-83b4-be465cca73a0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:33.021561 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-966b5b44-f3fb-4849-83b4-be465cca73a0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:33.027998 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-966b5b44-f3fb-4849-83b4-be465cca73a0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:33.028474 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-966b5b44-f3fb-4849-83b4-be465cca73a0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:33.028897 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-966b5b44-f3fb-4849-83b4-be465cca73a0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:33.029579 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-966b5b44-f3fb-4849-83b4-be465cca73a0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:33.030022 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-966b5b44-f3fb-4849-83b4-be465cca73a0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:33.030437 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-966b5b44-f3fb-4849-83b4-be465cca73a0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:33.155886 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-966b5b44-f3fb-4849-83b4-be465cca73a0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:33.164076 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-966b5b44-f3fb-4849-83b4-be465cca73a0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.146981 Oct 11 06:57:33.164632 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 973/1965] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:33 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:33.804826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3f76a742-4d4f-4361-9941-c3f9f7ad9822 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:33.805367 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3f76a742-4d4f-4361-9941-c3f9f7ad9822 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:33.812288 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3f76a742-4d4f-4361-9941-c3f9f7ad9822 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:33.812758 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3f76a742-4d4f-4361-9941-c3f9f7ad9822 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:33.813181 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3f76a742-4d4f-4361-9941-c3f9f7ad9822 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:33.813859 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3f76a742-4d4f-4361-9941-c3f9f7ad9822 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:33.814297 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3f76a742-4d4f-4361-9941-c3f9f7ad9822 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:33.814742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3f76a742-4d4f-4361-9941-c3f9f7ad9822 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:33.868248 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-11565a60-35a1-4794-9a29-badd318f55e3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:33.868862 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-11565a60-35a1-4794-9a29-badd318f55e3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:33.875974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-11565a60-35a1-4794-9a29-badd318f55e3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:33.876460 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-11565a60-35a1-4794-9a29-badd318f55e3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:33.876893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-11565a60-35a1-4794-9a29-badd318f55e3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:33.877592 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-11565a60-35a1-4794-9a29-badd318f55e3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:33.878046 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-11565a60-35a1-4794-9a29-badd318f55e3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:33.878469 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-11565a60-35a1-4794-9a29-badd318f55e3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:33.953245 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3f76a742-4d4f-4361-9941-c3f9f7ad9822 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:33.961583 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3f76a742-4d4f-4361-9941-c3f9f7ad9822 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.160699 Oct 11 06:57:33.962042 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 993/1966] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:33 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:34.011154 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-11565a60-35a1-4794-9a29-badd318f55e3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:34.020255 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-11565a60-35a1-4794-9a29-badd318f55e3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.155933 Oct 11 06:57:34.020812 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 974/1967] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:33 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:34.187040 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7d1e1bf7-78d5-4ba9-b8dc-0e0d53672ec8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:34.187677 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7d1e1bf7-78d5-4ba9-b8dc-0e0d53672ec8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:34.193607 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d1e1bf7-78d5-4ba9-b8dc-0e0d53672ec8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:34.194123 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d1e1bf7-78d5-4ba9-b8dc-0e0d53672ec8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:34.194561 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d1e1bf7-78d5-4ba9-b8dc-0e0d53672ec8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:34.195251 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d1e1bf7-78d5-4ba9-b8dc-0e0d53672ec8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:34.195739 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d1e1bf7-78d5-4ba9-b8dc-0e0d53672ec8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:34.196162 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d1e1bf7-78d5-4ba9-b8dc-0e0d53672ec8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:34.320673 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7d1e1bf7-78d5-4ba9-b8dc-0e0d53672ec8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:34.328841 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7d1e1bf7-78d5-4ba9-b8dc-0e0d53672ec8 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.146444 Oct 11 06:57:34.329399 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 994/1968] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:34 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:34.984219 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-03386f8e-a908-401c-b04a-4542f993a420 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:34.984917 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-03386f8e-a908-401c-b04a-4542f993a420 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:34.991205 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-03386f8e-a908-401c-b04a-4542f993a420 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:34.991703 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-03386f8e-a908-401c-b04a-4542f993a420 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:34.992134 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-03386f8e-a908-401c-b04a-4542f993a420 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:34.992823 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-03386f8e-a908-401c-b04a-4542f993a420 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:34.993269 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-03386f8e-a908-401c-b04a-4542f993a420 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:34.993696 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-03386f8e-a908-401c-b04a-4542f993a420 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:35.043067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-77123530-15c7-44cd-9db0-75154e2df013 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:35.043729 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-77123530-15c7-44cd-9db0-75154e2df013 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:35.046025 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:35.051211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77123530-15c7-44cd-9db0-75154e2df013 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:35.051714 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77123530-15c7-44cd-9db0-75154e2df013 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:35.052144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77123530-15c7-44cd-9db0-75154e2df013 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:35.052829 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77123530-15c7-44cd-9db0-75154e2df013 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:35.053271 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77123530-15c7-44cd-9db0-75154e2df013 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:35.053684 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77123530-15c7-44cd-9db0-75154e2df013 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:35.123681 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-03386f8e-a908-401c-b04a-4542f993a420 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:35.131987 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-03386f8e-a908-401c-b04a-4542f993a420 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.151492 Oct 11 06:57:35.132554 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 975/1969] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:34 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:35.180926 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-77123530-15c7-44cd-9db0-75154e2df013 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:35.189031 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-77123530-15c7-44cd-9db0-75154e2df013 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.149736 Oct 11 06:57:35.189582 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 995/1970] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:35 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:35.351390 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8f4469e3-1380-4c92-8794-f8e9a5fb73a6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:35.352026 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8f4469e3-1380-4c92-8794-f8e9a5fb73a6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:35.357987 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f4469e3-1380-4c92-8794-f8e9a5fb73a6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:35.358460 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f4469e3-1380-4c92-8794-f8e9a5fb73a6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:35.358891 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f4469e3-1380-4c92-8794-f8e9a5fb73a6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:35.359682 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f4469e3-1380-4c92-8794-f8e9a5fb73a6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:35.360135 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f4469e3-1380-4c92-8794-f8e9a5fb73a6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:35.360558 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f4469e3-1380-4c92-8794-f8e9a5fb73a6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:35.364412 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:35.491080 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8f4469e3-1380-4c92-8794-f8e9a5fb73a6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:35.499690 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8f4469e3-1380-4c92-8794-f8e9a5fb73a6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.152057 Oct 11 06:57:35.500248 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 976/1971] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:35 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:36.155198 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bda3d9b2-715d-453f-816c-c2355b7774e8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:36.155840 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bda3d9b2-715d-453f-816c-c2355b7774e8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:36.162209 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bda3d9b2-715d-453f-816c-c2355b7774e8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:36.162678 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bda3d9b2-715d-453f-816c-c2355b7774e8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:36.163106 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bda3d9b2-715d-453f-816c-c2355b7774e8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:36.163826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bda3d9b2-715d-453f-816c-c2355b7774e8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:36.164276 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bda3d9b2-715d-453f-816c-c2355b7774e8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:36.164696 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bda3d9b2-715d-453f-816c-c2355b7774e8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:36.212603 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d49df418-c3bf-4b92-807e-504514136c1b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:36.213339 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d49df418-c3bf-4b92-807e-504514136c1b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:36.220393 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d49df418-c3bf-4b92-807e-504514136c1b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:36.220877 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d49df418-c3bf-4b92-807e-504514136c1b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:36.221352 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d49df418-c3bf-4b92-807e-504514136c1b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:36.222028 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d49df418-c3bf-4b92-807e-504514136c1b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:36.222486 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d49df418-c3bf-4b92-807e-504514136c1b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:36.222909 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d49df418-c3bf-4b92-807e-504514136c1b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:36.301171 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bda3d9b2-715d-453f-816c-c2355b7774e8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:36.310431 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bda3d9b2-715d-453f-816c-c2355b7774e8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.159501 Oct 11 06:57:36.310999 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 996/1972] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:36 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:36.358726 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d49df418-c3bf-4b92-807e-504514136c1b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:36.366926 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d49df418-c3bf-4b92-807e-504514136c1b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.158219 Oct 11 06:57:36.367504 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 977/1973] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:36 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:36.523762 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-828e5827-fbd5-491f-af69-1fff1968d2a0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:36.524366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-828e5827-fbd5-491f-af69-1fff1968d2a0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:36.531178 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-828e5827-fbd5-491f-af69-1fff1968d2a0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:36.531831 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-828e5827-fbd5-491f-af69-1fff1968d2a0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:36.532258 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-828e5827-fbd5-491f-af69-1fff1968d2a0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:36.532939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-828e5827-fbd5-491f-af69-1fff1968d2a0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:36.533380 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-828e5827-fbd5-491f-af69-1fff1968d2a0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:36.533789 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-828e5827-fbd5-491f-af69-1fff1968d2a0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:36.660673 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-828e5827-fbd5-491f-af69-1fff1968d2a0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:36.669232 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-828e5827-fbd5-491f-af69-1fff1968d2a0 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149616 Oct 11 06:57:36.669826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 997/1974] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:36 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:37.333016 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1f4b2181-05e8-483f-ae5c-2e583e09402b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:37.333572 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1f4b2181-05e8-483f-ae5c-2e583e09402b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:37.340546 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1f4b2181-05e8-483f-ae5c-2e583e09402b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:37.341026 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1f4b2181-05e8-483f-ae5c-2e583e09402b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:37.341459 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1f4b2181-05e8-483f-ae5c-2e583e09402b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:37.342154 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1f4b2181-05e8-483f-ae5c-2e583e09402b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:37.342735 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1f4b2181-05e8-483f-ae5c-2e583e09402b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:37.343018 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1f4b2181-05e8-483f-ae5c-2e583e09402b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:37.390971 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-84796559-aedd-4f81-a9d1-bf1739fa42b9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:37.391686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-84796559-aedd-4f81-a9d1-bf1739fa42b9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:37.398457 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-84796559-aedd-4f81-a9d1-bf1739fa42b9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:37.398936 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-84796559-aedd-4f81-a9d1-bf1739fa42b9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:37.399368 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-84796559-aedd-4f81-a9d1-bf1739fa42b9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:37.400215 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-84796559-aedd-4f81-a9d1-bf1739fa42b9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:37.400662 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-84796559-aedd-4f81-a9d1-bf1739fa42b9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:37.401081 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-84796559-aedd-4f81-a9d1-bf1739fa42b9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:37.479454 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1f4b2181-05e8-483f-ae5c-2e583e09402b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:37.488294 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1f4b2181-05e8-483f-ae5c-2e583e09402b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.159116 Oct 11 06:57:37.488861 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 978/1975] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:37 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:37.534186 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-84796559-aedd-4f81-a9d1-bf1739fa42b9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:37.542302 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-84796559-aedd-4f81-a9d1-bf1739fa42b9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.156109 Oct 11 06:57:37.543533 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 998/1976] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:37 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:37.693564 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-aa8c2e62-2a4c-4cc8-8bb6-916db577d321 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:37.694176 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-aa8c2e62-2a4c-4cc8-8bb6-916db577d321 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:37.700105 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aa8c2e62-2a4c-4cc8-8bb6-916db577d321 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:37.700581 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aa8c2e62-2a4c-4cc8-8bb6-916db577d321 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:37.701009 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aa8c2e62-2a4c-4cc8-8bb6-916db577d321 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:37.701702 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aa8c2e62-2a4c-4cc8-8bb6-916db577d321 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:37.702147 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aa8c2e62-2a4c-4cc8-8bb6-916db577d321 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:37.702565 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aa8c2e62-2a4c-4cc8-8bb6-916db577d321 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:37.831115 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-aa8c2e62-2a4c-4cc8-8bb6-916db577d321 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:37.839190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-aa8c2e62-2a4c-4cc8-8bb6-916db577d321 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.150242 Oct 11 06:57:37.840320 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 979/1977] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:37 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:38.512968 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9ae10db7-1de5-473d-b3ed-e96d4f5cace1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:38.513513 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9ae10db7-1de5-473d-b3ed-e96d4f5cace1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:38.520196 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9ae10db7-1de5-473d-b3ed-e96d4f5cace1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:38.520675 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9ae10db7-1de5-473d-b3ed-e96d4f5cace1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:38.521110 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9ae10db7-1de5-473d-b3ed-e96d4f5cace1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:38.521792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9ae10db7-1de5-473d-b3ed-e96d4f5cace1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:38.522238 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9ae10db7-1de5-473d-b3ed-e96d4f5cace1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:38.522651 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9ae10db7-1de5-473d-b3ed-e96d4f5cace1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:38.566007 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5b621ddb-469c-4915-b4eb-bc38fda22778 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:38.566614 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5b621ddb-469c-4915-b4eb-bc38fda22778 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:38.573022 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b621ddb-469c-4915-b4eb-bc38fda22778 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:38.573499 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b621ddb-469c-4915-b4eb-bc38fda22778 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:38.574030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b621ddb-469c-4915-b4eb-bc38fda22778 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:38.575262 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b621ddb-469c-4915-b4eb-bc38fda22778 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:38.575738 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b621ddb-469c-4915-b4eb-bc38fda22778 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:38.576155 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b621ddb-469c-4915-b4eb-bc38fda22778 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:38.648736 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9ae10db7-1de5-473d-b3ed-e96d4f5cace1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:38.652198 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:38.658294 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9ae10db7-1de5-473d-b3ed-e96d4f5cace1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.149783 Oct 11 06:57:38.658863 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 999/1978] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:38 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:38.704477 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5b621ddb-469c-4915-b4eb-bc38fda22778 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:38.712923 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5b621ddb-469c-4915-b4eb-bc38fda22778 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.150735 Oct 11 06:57:38.713592 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 980/1979] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:38 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:38.862191 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8e45d70a-623b-4d18-9fd3-4b98e5591556 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:38.862802 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8e45d70a-623b-4d18-9fd3-4b98e5591556 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:38.869285 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8e45d70a-623b-4d18-9fd3-4b98e5591556 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:38.869777 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8e45d70a-623b-4d18-9fd3-4b98e5591556 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:38.870214 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8e45d70a-623b-4d18-9fd3-4b98e5591556 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:38.871592 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8e45d70a-623b-4d18-9fd3-4b98e5591556 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:38.872047 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8e45d70a-623b-4d18-9fd3-4b98e5591556 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:38.872470 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8e45d70a-623b-4d18-9fd3-4b98e5591556 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:38.994690 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8e45d70a-623b-4d18-9fd3-4b98e5591556 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:39.003457 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8e45d70a-623b-4d18-9fd3-4b98e5591556 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.145172 Oct 11 06:57:39.004032 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1000/1980] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:38 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:39.683029 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d8d9c197-06e7-4e15-8c40-8f9e25b0d0b6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:39.683697 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d8d9c197-06e7-4e15-8c40-8f9e25b0d0b6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:39.690234 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8d9c197-06e7-4e15-8c40-8f9e25b0d0b6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:39.690716 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8d9c197-06e7-4e15-8c40-8f9e25b0d0b6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:39.691155 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8d9c197-06e7-4e15-8c40-8f9e25b0d0b6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:39.691884 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8d9c197-06e7-4e15-8c40-8f9e25b0d0b6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:39.692341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8d9c197-06e7-4e15-8c40-8f9e25b0d0b6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:39.692769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8d9c197-06e7-4e15-8c40-8f9e25b0d0b6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:39.736233 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2a18e50f-77d5-4d34-b869-413fc03290cd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:39.736792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2a18e50f-77d5-4d34-b869-413fc03290cd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:39.743115 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2a18e50f-77d5-4d34-b869-413fc03290cd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:39.745064 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2a18e50f-77d5-4d34-b869-413fc03290cd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:39.745064 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2a18e50f-77d5-4d34-b869-413fc03290cd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:39.745064 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2a18e50f-77d5-4d34-b869-413fc03290cd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:39.745369 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2a18e50f-77d5-4d34-b869-413fc03290cd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:39.745527 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2a18e50f-77d5-4d34-b869-413fc03290cd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:39.830109 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d8d9c197-06e7-4e15-8c40-8f9e25b0d0b6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:39.838349 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d8d9c197-06e7-4e15-8c40-8f9e25b0d0b6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.159209 Oct 11 06:57:39.838902 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 981/1981] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:39 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:39.878274 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2a18e50f-77d5-4d34-b869-413fc03290cd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:39.886325 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2a18e50f-77d5-4d34-b869-413fc03290cd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.153981 Oct 11 06:57:39.887442 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1001/1982] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:39 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:40.026723 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-49301ce9-1f41-400b-82d7-bba166ddaf52 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:40.027294 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-49301ce9-1f41-400b-82d7-bba166ddaf52 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:40.033155 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-49301ce9-1f41-400b-82d7-bba166ddaf52 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:40.033626 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-49301ce9-1f41-400b-82d7-bba166ddaf52 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:40.034052 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-49301ce9-1f41-400b-82d7-bba166ddaf52 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:40.034732 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-49301ce9-1f41-400b-82d7-bba166ddaf52 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:40.035185 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-49301ce9-1f41-400b-82d7-bba166ddaf52 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:40.035640 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-49301ce9-1f41-400b-82d7-bba166ddaf52 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:40.162245 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-49301ce9-1f41-400b-82d7-bba166ddaf52 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:40.170886 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-49301ce9-1f41-400b-82d7-bba166ddaf52 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147980 Oct 11 06:57:40.171470 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 982/1983] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:40 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:40.861696 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-42cdd5cb-fd0d-4293-9f6e-211fe9765eca tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:40.862306 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-42cdd5cb-fd0d-4293-9f6e-211fe9765eca tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:40.869068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42cdd5cb-fd0d-4293-9f6e-211fe9765eca tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:40.869459 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42cdd5cb-fd0d-4293-9f6e-211fe9765eca tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:40.869900 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42cdd5cb-fd0d-4293-9f6e-211fe9765eca tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:40.870602 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42cdd5cb-fd0d-4293-9f6e-211fe9765eca tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:40.871044 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42cdd5cb-fd0d-4293-9f6e-211fe9765eca tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:40.871514 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42cdd5cb-fd0d-4293-9f6e-211fe9765eca tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:40.910246 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-db75c324-b3b8-4c6e-a270-00dc1b414032 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:40.910858 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-db75c324-b3b8-4c6e-a270-00dc1b414032 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:40.917580 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db75c324-b3b8-4c6e-a270-00dc1b414032 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:40.918070 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db75c324-b3b8-4c6e-a270-00dc1b414032 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:40.918503 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db75c324-b3b8-4c6e-a270-00dc1b414032 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:40.919214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db75c324-b3b8-4c6e-a270-00dc1b414032 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:40.919710 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db75c324-b3b8-4c6e-a270-00dc1b414032 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:40.920114 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db75c324-b3b8-4c6e-a270-00dc1b414032 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:41.005152 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-42cdd5cb-fd0d-4293-9f6e-211fe9765eca tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:41.013945 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-42cdd5cb-fd0d-4293-9f6e-211fe9765eca tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.156161 Oct 11 06:57:41.014797 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1002/1984] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:40 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:41.052802 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-db75c324-b3b8-4c6e-a270-00dc1b414032 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:41.061216 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-db75c324-b3b8-4c6e-a270-00dc1b414032 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.154840 Oct 11 06:57:41.061785 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 983/1985] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:40 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:41.194026 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5b297e4c-505e-47e6-b1b8-4fe17513bfb6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:41.194451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5b297e4c-505e-47e6-b1b8-4fe17513bfb6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:41.200915 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5b297e4c-505e-47e6-b1b8-4fe17513bfb6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:41.201388 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5b297e4c-505e-47e6-b1b8-4fe17513bfb6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:41.201824 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5b297e4c-505e-47e6-b1b8-4fe17513bfb6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:41.202508 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5b297e4c-505e-47e6-b1b8-4fe17513bfb6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:41.202953 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5b297e4c-505e-47e6-b1b8-4fe17513bfb6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:41.203375 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5b297e4c-505e-47e6-b1b8-4fe17513bfb6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:41.334488 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5b297e4c-505e-47e6-b1b8-4fe17513bfb6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:41.342811 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5b297e4c-505e-47e6-b1b8-4fe17513bfb6 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.152821 Oct 11 06:57:41.343373 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1003/1986] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:41 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:42.038086 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4a770de3-4fbd-4d9d-8c7e-c5da2428566f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:42.038723 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4a770de3-4fbd-4d9d-8c7e-c5da2428566f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:42.045858 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4a770de3-4fbd-4d9d-8c7e-c5da2428566f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:42.046340 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4a770de3-4fbd-4d9d-8c7e-c5da2428566f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:42.046777 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4a770de3-4fbd-4d9d-8c7e-c5da2428566f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:42.047498 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4a770de3-4fbd-4d9d-8c7e-c5da2428566f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:42.047956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4a770de3-4fbd-4d9d-8c7e-c5da2428566f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:42.048380 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4a770de3-4fbd-4d9d-8c7e-c5da2428566f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:42.084794 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-dc8e9142-ced9-4818-8152-ea68df67ce16 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:42.085538 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-dc8e9142-ced9-4818-8152-ea68df67ce16 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:42.092727 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc8e9142-ced9-4818-8152-ea68df67ce16 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:42.093289 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc8e9142-ced9-4818-8152-ea68df67ce16 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:42.093812 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc8e9142-ced9-4818-8152-ea68df67ce16 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:42.094579 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc8e9142-ced9-4818-8152-ea68df67ce16 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:42.095124 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc8e9142-ced9-4818-8152-ea68df67ce16 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:42.095643 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc8e9142-ced9-4818-8152-ea68df67ce16 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:42.180073 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4a770de3-4fbd-4d9d-8c7e-c5da2428566f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:42.188341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4a770de3-4fbd-4d9d-8c7e-c5da2428566f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.154145 Oct 11 06:57:42.188902 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 984/1987] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:42 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:42.224546 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-dc8e9142-ced9-4818-8152-ea68df67ce16 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:42.233622 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-dc8e9142-ced9-4818-8152-ea68df67ce16 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.152626 Oct 11 06:57:42.234178 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1004/1988] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:42 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:42.364988 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1386ffe0-2f3f-43fb-976a-d31f554150db tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:42.365675 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1386ffe0-2f3f-43fb-976a-d31f554150db tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:42.371844 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1386ffe0-2f3f-43fb-976a-d31f554150db tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:42.372211 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1386ffe0-2f3f-43fb-976a-d31f554150db tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:42.372643 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1386ffe0-2f3f-43fb-976a-d31f554150db tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:42.373340 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1386ffe0-2f3f-43fb-976a-d31f554150db tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:42.373792 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1386ffe0-2f3f-43fb-976a-d31f554150db tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:42.374212 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1386ffe0-2f3f-43fb-976a-d31f554150db tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:42.500059 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1386ffe0-2f3f-43fb-976a-d31f554150db tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:42.508203 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1386ffe0-2f3f-43fb-976a-d31f554150db tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.147028 Oct 11 06:57:42.508763 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 985/1989] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:42 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:43.211121 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1b394d67-bdb3-49f9-a33a-caad93742031 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:43.211724 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1b394d67-bdb3-49f9-a33a-caad93742031 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:43.218133 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b394d67-bdb3-49f9-a33a-caad93742031 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:43.218613 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b394d67-bdb3-49f9-a33a-caad93742031 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:43.219080 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b394d67-bdb3-49f9-a33a-caad93742031 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:43.219802 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b394d67-bdb3-49f9-a33a-caad93742031 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:43.220250 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b394d67-bdb3-49f9-a33a-caad93742031 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:43.220673 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b394d67-bdb3-49f9-a33a-caad93742031 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:43.257811 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3dafc16d-828d-44f0-8edf-c114c29e8d6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:43.258452 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3dafc16d-828d-44f0-8edf-c114c29e8d6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:43.265345 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3dafc16d-828d-44f0-8edf-c114c29e8d6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:43.265820 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3dafc16d-828d-44f0-8edf-c114c29e8d6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:43.266248 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3dafc16d-828d-44f0-8edf-c114c29e8d6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:43.266938 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3dafc16d-828d-44f0-8edf-c114c29e8d6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:43.267381 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3dafc16d-828d-44f0-8edf-c114c29e8d6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:43.267821 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3dafc16d-828d-44f0-8edf-c114c29e8d6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:43.354561 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1b394d67-bdb3-49f9-a33a-caad93742031 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:43.363565 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1b394d67-bdb3-49f9-a33a-caad93742031 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.156259 Oct 11 06:57:43.364137 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1005/1990] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:43 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:43.400570 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3dafc16d-828d-44f0-8edf-c114c29e8d6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:43.408924 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3dafc16d-828d-44f0-8edf-c114c29e8d6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.155255 Oct 11 06:57:43.409702 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 986/1991] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:43 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:43.532284 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bdc88d33-762d-4428-b9c5-5b2d59ec27f2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:43.532884 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bdc88d33-762d-4428-b9c5-5b2d59ec27f2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:43.539028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bdc88d33-762d-4428-b9c5-5b2d59ec27f2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:43.539534 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bdc88d33-762d-4428-b9c5-5b2d59ec27f2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:43.539962 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bdc88d33-762d-4428-b9c5-5b2d59ec27f2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:43.540634 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bdc88d33-762d-4428-b9c5-5b2d59ec27f2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:43.541071 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bdc88d33-762d-4428-b9c5-5b2d59ec27f2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:43.541484 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bdc88d33-762d-4428-b9c5-5b2d59ec27f2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:43.665215 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bdc88d33-762d-4428-b9c5-5b2d59ec27f2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:43.674477 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bdc88d33-762d-4428-b9c5-5b2d59ec27f2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.145978 Oct 11 06:57:43.675229 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1006/1992] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:43 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:44.386868 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9dd6ea6c-22d9-4ed9-8f73-2b44269081e4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:44.387503 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9dd6ea6c-22d9-4ed9-8f73-2b44269081e4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:44.394267 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9dd6ea6c-22d9-4ed9-8f73-2b44269081e4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:44.394744 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9dd6ea6c-22d9-4ed9-8f73-2b44269081e4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:44.395174 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9dd6ea6c-22d9-4ed9-8f73-2b44269081e4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:44.395890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9dd6ea6c-22d9-4ed9-8f73-2b44269081e4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:44.396342 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9dd6ea6c-22d9-4ed9-8f73-2b44269081e4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:44.396765 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9dd6ea6c-22d9-4ed9-8f73-2b44269081e4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:44.432749 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7e0fc878-b994-4056-9ea3-bace7a4fd3d7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:44.433358 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7e0fc878-b994-4056-9ea3-bace7a4fd3d7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:44.439955 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e0fc878-b994-4056-9ea3-bace7a4fd3d7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:44.440431 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e0fc878-b994-4056-9ea3-bace7a4fd3d7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:44.440861 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e0fc878-b994-4056-9ea3-bace7a4fd3d7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:44.441557 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e0fc878-b994-4056-9ea3-bace7a4fd3d7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:44.442001 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e0fc878-b994-4056-9ea3-bace7a4fd3d7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:44.442421 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e0fc878-b994-4056-9ea3-bace7a4fd3d7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:44.527849 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9dd6ea6c-22d9-4ed9-8f73-2b44269081e4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:44.536887 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9dd6ea6c-22d9-4ed9-8f73-2b44269081e4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.153783 Oct 11 06:57:44.537653 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 987/1993] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:44 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:44.572360 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7e0fc878-b994-4056-9ea3-bace7a4fd3d7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:44.580659 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7e0fc878-b994-4056-9ea3-bace7a4fd3d7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.151659 Oct 11 06:57:44.581213 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1007/1994] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:44 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:44.697839 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7ae119ef-c5c4-4f9e-9643-8d30b94e76fd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:44.698386 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7ae119ef-c5c4-4f9e-9643-8d30b94e76fd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:44.704411 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7ae119ef-c5c4-4f9e-9643-8d30b94e76fd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:44.704945 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7ae119ef-c5c4-4f9e-9643-8d30b94e76fd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:44.705376 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7ae119ef-c5c4-4f9e-9643-8d30b94e76fd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:44.706071 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7ae119ef-c5c4-4f9e-9643-8d30b94e76fd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:44.706522 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7ae119ef-c5c4-4f9e-9643-8d30b94e76fd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:44.706947 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7ae119ef-c5c4-4f9e-9643-8d30b94e76fd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:44.835381 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7ae119ef-c5c4-4f9e-9643-8d30b94e76fd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:44.843495 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7ae119ef-c5c4-4f9e-9643-8d30b94e76fd tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.149508 Oct 11 06:57:44.844054 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 988/1995] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:44 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:45.560046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4268a03c-4901-4124-aa22-4961fb801a7c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:45.560659 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4268a03c-4901-4124-aa22-4961fb801a7c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:45.567006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4268a03c-4901-4124-aa22-4961fb801a7c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:45.567512 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4268a03c-4901-4124-aa22-4961fb801a7c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:45.567946 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4268a03c-4901-4124-aa22-4961fb801a7c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:45.568641 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4268a03c-4901-4124-aa22-4961fb801a7c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:45.569093 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4268a03c-4901-4124-aa22-4961fb801a7c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:45.569516 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4268a03c-4901-4124-aa22-4961fb801a7c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:45.604387 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-680e2d80-3a48-45d3-b417-cf7a60a907be tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:45.605492 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-680e2d80-3a48-45d3-b417-cf7a60a907be tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:45.611798 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-680e2d80-3a48-45d3-b417-cf7a60a907be tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:45.612282 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-680e2d80-3a48-45d3-b417-cf7a60a907be tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:45.612712 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-680e2d80-3a48-45d3-b417-cf7a60a907be tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:45.613417 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-680e2d80-3a48-45d3-b417-cf7a60a907be tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:45.613872 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-680e2d80-3a48-45d3-b417-cf7a60a907be tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:45.614294 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-680e2d80-3a48-45d3-b417-cf7a60a907be tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:45.700818 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4268a03c-4901-4124-aa22-4961fb801a7c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:45.709168 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4268a03c-4901-4124-aa22-4961fb801a7c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.153549 Oct 11 06:57:45.709743 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1008/1996] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:45 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:45.744799 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-680e2d80-3a48-45d3-b417-cf7a60a907be tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:45.753092 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-680e2d80-3a48-45d3-b417-cf7a60a907be tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.152521 Oct 11 06:57:45.753656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 989/1997] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:45 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:45.866362 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-16eb19ca-2e57-47d4-8edd-d68e9ba0cdba tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:45.867011 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-16eb19ca-2e57-47d4-8edd-d68e9ba0cdba tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 70f4927d-5233-4d2b-a109-a1739feef2eb] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:45.873564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-16eb19ca-2e57-47d4-8edd-d68e9ba0cdba tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:45.874044 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-16eb19ca-2e57-47d4-8edd-d68e9ba0cdba tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:45.874480 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-16eb19ca-2e57-47d4-8edd-d68e9ba0cdba tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:45.875172 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-16eb19ca-2e57-47d4-8edd-d68e9ba0cdba tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:45.875654 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-16eb19ca-2e57-47d4-8edd-d68e9ba0cdba tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:45.876085 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-16eb19ca-2e57-47d4-8edd-d68e9ba0cdba tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:46.002923 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-16eb19ca-2e57-47d4-8edd-d68e9ba0cdba tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:46.011022 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-16eb19ca-2e57-47d4-8edd-d68e9ba0cdba tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb" status: 200 len: 1734 microversion: 2.1 time: 0.148500 Oct 11 06:57:46.012179 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1009/1998] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:45 2022] GET /compute/v2.1/servers/70f4927d-5233-4d2b-a109-a1739feef2eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:46.034208 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9690af95-7ca1-413a-a98b-803319d78a0e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '.version_select at 0x7f8e2a567790>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:46.054909 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9690af95-7ca1-413a-a98b-803319d78a0e tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-799405031" status: 202 len: 0 microversion: 2.1 time: 0.024429 Oct 11 06:57:46.055477 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 990/1999] 10.222.0.39 () {58 vars in 1218 bytes} [Tue Oct 11 06:57:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-799405031 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 06:57:46.732892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ef562d58-3d69-445b-a038-9f170911920b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:46.733432 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ef562d58-3d69-445b-a038-9f170911920b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:46.740428 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef562d58-3d69-445b-a038-9f170911920b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:46.741005 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef562d58-3d69-445b-a038-9f170911920b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:46.741446 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef562d58-3d69-445b-a038-9f170911920b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:46.742143 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef562d58-3d69-445b-a038-9f170911920b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:46.742592 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef562d58-3d69-445b-a038-9f170911920b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:46.743014 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef562d58-3d69-445b-a038-9f170911920b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:46.778140 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3062198f-7102-4c4b-96ce-d7feb6d50895 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:46.778727 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3062198f-7102-4c4b-96ce-d7feb6d50895 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:46.784826 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3062198f-7102-4c4b-96ce-d7feb6d50895 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:46.785383 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3062198f-7102-4c4b-96ce-d7feb6d50895 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:46.785914 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3062198f-7102-4c4b-96ce-d7feb6d50895 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:46.786675 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3062198f-7102-4c4b-96ce-d7feb6d50895 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:46.787198 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3062198f-7102-4c4b-96ce-d7feb6d50895 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:46.787699 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3062198f-7102-4c4b-96ce-d7feb6d50895 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:46.919048 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3062198f-7102-4c4b-96ce-d7feb6d50895 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:46.927307 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3062198f-7102-4c4b-96ce-d7feb6d50895 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.154342 Oct 11 06:57:46.927930 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 991/2000] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:46 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:46.934800 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ef562d58-3d69-445b-a038-9f170911920b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:46.943182 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ef562d58-3d69-445b-a038-9f170911920b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.214809 Oct 11 06:57:46.943989 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1010/2001] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:46 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:47.088324 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-6d0dc285-e7f4-4d14-bb63-6b8ecaee878d req-04966737-83fb-4431-8274-97873a539674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70f4927d-5233-4d2b-a109-a1739feef2eb", "tag": "d3558897-9eb2-44a5-8c6f-5fcac13e4072"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:57:47.100427 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-6d0dc285-e7f4-4d14-bb63-6b8ecaee878d req-04966737-83fb-4431-8274-97873a539674 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:47.100913 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-6d0dc285-e7f4-4d14-bb63-6b8ecaee878d req-04966737-83fb-4431-8274-97873a539674 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:47.101345 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-6d0dc285-e7f4-4d14-bb63-6b8ecaee878d req-04966737-83fb-4431-8274-97873a539674 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:47.116427 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-6d0dc285-e7f4-4d14-bb63-6b8ecaee878d req-04966737-83fb-4431-8274-97873a539674 service nova] Creating event network-changed:d3558897-9eb2-44a5-8c6f-5fcac13e4072 for instance 70f4927d-5233-4d2b-a109-a1739feef2eb on hv-cinder-85495 Oct 11 06:57:47.122624 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-6d0dc285-e7f4-4d14-bb63-6b8ecaee878d req-04966737-83fb-4431-8274-97873a539674 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094192 Oct 11 06:57:47.123440 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 992/2002] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 06:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:57:47.950858 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ac0c51e2-ac26-4cae-a86e-565daa466476 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:47.951578 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ac0c51e2-ac26-4cae-a86e-565daa466476 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:47.958291 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ac0c51e2-ac26-4cae-a86e-565daa466476 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:47.958801 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ac0c51e2-ac26-4cae-a86e-565daa466476 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:47.959256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ac0c51e2-ac26-4cae-a86e-565daa466476 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:47.960024 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ac0c51e2-ac26-4cae-a86e-565daa466476 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:47.960474 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ac0c51e2-ac26-4cae-a86e-565daa466476 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:47.960892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ac0c51e2-ac26-4cae-a86e-565daa466476 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:47.968482 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5cbfb3a9-1c7c-419a-970c-9b435e5b2f29 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:47.969382 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5cbfb3a9-1c7c-419a-970c-9b435e5b2f29 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:47.971323 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:47.976846 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5cbfb3a9-1c7c-419a-970c-9b435e5b2f29 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:47.977328 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5cbfb3a9-1c7c-419a-970c-9b435e5b2f29 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:47.977785 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5cbfb3a9-1c7c-419a-970c-9b435e5b2f29 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:47.978465 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5cbfb3a9-1c7c-419a-970c-9b435e5b2f29 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:47.978939 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5cbfb3a9-1c7c-419a-970c-9b435e5b2f29 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:47.979366 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5cbfb3a9-1c7c-419a-970c-9b435e5b2f29 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:48.093618 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ac0c51e2-ac26-4cae-a86e-565daa466476 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:48.101784 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ac0c51e2-ac26-4cae-a86e-565daa466476 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.155508 Oct 11 06:57:48.102345 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1011/2003] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:47 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:48.115497 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5cbfb3a9-1c7c-419a-970c-9b435e5b2f29 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:48.124230 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5cbfb3a9-1c7c-419a-970c-9b435e5b2f29 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.161514 Oct 11 06:57:48.124780 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 993/2004] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:47 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:49.125546 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a042f360-60f4-47a6-8b38-82bca07e290f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:49.126184 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a042f360-60f4-47a6-8b38-82bca07e290f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:49.132556 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a042f360-60f4-47a6-8b38-82bca07e290f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:49.133025 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a042f360-60f4-47a6-8b38-82bca07e290f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:49.133451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a042f360-60f4-47a6-8b38-82bca07e290f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:49.134133 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a042f360-60f4-47a6-8b38-82bca07e290f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:49.134596 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a042f360-60f4-47a6-8b38-82bca07e290f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:49.135017 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a042f360-60f4-47a6-8b38-82bca07e290f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:49.147785 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-62697c39-0be2-404d-b97a-2fc5fabf316b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:49.148398 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-62697c39-0be2-404d-b97a-2fc5fabf316b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:49.154696 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62697c39-0be2-404d-b97a-2fc5fabf316b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:49.155165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62697c39-0be2-404d-b97a-2fc5fabf316b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:49.155635 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62697c39-0be2-404d-b97a-2fc5fabf316b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:49.156326 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62697c39-0be2-404d-b97a-2fc5fabf316b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:49.156771 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62697c39-0be2-404d-b97a-2fc5fabf316b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:49.157184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62697c39-0be2-404d-b97a-2fc5fabf316b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:49.175282 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:49.271879 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a042f360-60f4-47a6-8b38-82bca07e290f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:49.280057 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a042f360-60f4-47a6-8b38-82bca07e290f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.158395 Oct 11 06:57:49.280618 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1012/2005] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:49 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:49.291355 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-62697c39-0be2-404d-b97a-2fc5fabf316b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:49.300087 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-62697c39-0be2-404d-b97a-2fc5fabf316b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.156102 Oct 11 06:57:49.300678 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 994/2006] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:49 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:50.304214 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f7d2f7b5-3fbd-44aa-8241-5e4e64a4c54c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:50.304820 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f7d2f7b5-3fbd-44aa-8241-5e4e64a4c54c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:50.311636 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f7d2f7b5-3fbd-44aa-8241-5e4e64a4c54c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:50.312110 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f7d2f7b5-3fbd-44aa-8241-5e4e64a4c54c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:50.312558 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f7d2f7b5-3fbd-44aa-8241-5e4e64a4c54c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:50.313247 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f7d2f7b5-3fbd-44aa-8241-5e4e64a4c54c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:50.313690 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f7d2f7b5-3fbd-44aa-8241-5e4e64a4c54c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:50.314113 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f7d2f7b5-3fbd-44aa-8241-5e4e64a4c54c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:50.323672 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-13022e4d-1343-4a51-b53e-1821b89eab19 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:50.324791 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-13022e4d-1343-4a51-b53e-1821b89eab19 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:50.331255 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13022e4d-1343-4a51-b53e-1821b89eab19 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:50.331771 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13022e4d-1343-4a51-b53e-1821b89eab19 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:50.332224 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13022e4d-1343-4a51-b53e-1821b89eab19 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:50.332921 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13022e4d-1343-4a51-b53e-1821b89eab19 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:50.333375 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13022e4d-1343-4a51-b53e-1821b89eab19 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:50.333797 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13022e4d-1343-4a51-b53e-1821b89eab19 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:50.447874 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f7d2f7b5-3fbd-44aa-8241-5e4e64a4c54c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:50.456795 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f7d2f7b5-3fbd-44aa-8241-5e4e64a4c54c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.156317 Oct 11 06:57:50.457459 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1013/2007] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:50 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:50.462183 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6a5d9e21-6de9-43a7-b9ae-1e8b069759e5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:50.462678 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6a5d9e21-6de9-43a7-b9ae-1e8b069759e5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:50.468384 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a5d9e21-6de9-43a7-b9ae-1e8b069759e5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:50.468873 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a5d9e21-6de9-43a7-b9ae-1e8b069759e5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:50.469309 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a5d9e21-6de9-43a7-b9ae-1e8b069759e5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:50.470032 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a5d9e21-6de9-43a7-b9ae-1e8b069759e5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:50.470482 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a5d9e21-6de9-43a7-b9ae-1e8b069759e5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:50.470907 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a5d9e21-6de9-43a7-b9ae-1e8b069759e5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:50.474452 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-13022e4d-1343-4a51-b53e-1821b89eab19 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:50.482897 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-13022e4d-1343-4a51-b53e-1821b89eab19 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.163165 Oct 11 06:57:50.483499 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 995/2008] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:50 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:50.495948 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6a5d9e21-6de9-43a7-b9ae-1e8b069759e5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Going to try to terminate instance {{(pid=125266) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 06:57:50.545259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:50.573481 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6a5d9e21-6de9-43a7-b9ae-1e8b069759e5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "DELETE /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 204 len: 0 microversion: 2.20 time: 0.114703 Oct 11 06:57:50.574854 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1014/2009] 10.222.0.39 () {60 vars in 1280 bytes} [Tue Oct 11 06:57:50 2022] DELETE /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 06:57:50.583225 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-db92480c-ad45-49b9-a8b1-706c236bf1db tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:50.584072 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-db92480c-ad45-49b9-a8b1-706c236bf1db tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:50.590202 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db92480c-ad45-49b9-a8b1-706c236bf1db tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:50.590687 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db92480c-ad45-49b9-a8b1-706c236bf1db tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:50.591150 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db92480c-ad45-49b9-a8b1-706c236bf1db tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:50.591874 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db92480c-ad45-49b9-a8b1-706c236bf1db tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:50.592328 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db92480c-ad45-49b9-a8b1-706c236bf1db tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:50.592750 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-db92480c-ad45-49b9-a8b1-706c236bf1db tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:50.719045 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-db92480c-ad45-49b9-a8b1-706c236bf1db tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:50.727700 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-db92480c-ad45-49b9-a8b1-706c236bf1db tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:50.729132 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-db92480c-ad45-49b9-a8b1-706c236bf1db tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:50.730788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-db92480c-ad45-49b9-a8b1-706c236bf1db tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.151744 Oct 11 06:57:50.731341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 996/2010] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:57:50 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:57:51.479710 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2c3a19b9-6324-4e0d-86cd-28fec53b7bc7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:51.480410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2c3a19b9-6324-4e0d-86cd-28fec53b7bc7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:51.486526 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c3a19b9-6324-4e0d-86cd-28fec53b7bc7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:51.486999 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c3a19b9-6324-4e0d-86cd-28fec53b7bc7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:51.487452 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c3a19b9-6324-4e0d-86cd-28fec53b7bc7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:51.488140 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c3a19b9-6324-4e0d-86cd-28fec53b7bc7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:51.488581 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c3a19b9-6324-4e0d-86cd-28fec53b7bc7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:51.489000 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c3a19b9-6324-4e0d-86cd-28fec53b7bc7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:51.505946 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e485cf5a-2994-42b0-a831-4274ff2708fb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:51.506545 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e485cf5a-2994-42b0-a831-4274ff2708fb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:51.513409 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e485cf5a-2994-42b0-a831-4274ff2708fb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:51.513866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e485cf5a-2994-42b0-a831-4274ff2708fb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:51.514298 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e485cf5a-2994-42b0-a831-4274ff2708fb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:51.515309 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e485cf5a-2994-42b0-a831-4274ff2708fb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:51.515786 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e485cf5a-2994-42b0-a831-4274ff2708fb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:51.516230 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e485cf5a-2994-42b0-a831-4274ff2708fb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:51.619655 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2c3a19b9-6324-4e0d-86cd-28fec53b7bc7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:51.627815 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2c3a19b9-6324-4e0d-86cd-28fec53b7bc7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.152297 Oct 11 06:57:51.628387 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1015/2011] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:51 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:51.646800 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e485cf5a-2994-42b0-a831-4274ff2708fb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:51.655550 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e485cf5a-2994-42b0-a831-4274ff2708fb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.153438 Oct 11 06:57:51.656094 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 997/2012] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:51 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:51.756582 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-aedf69ac-ced4-4d8c-bd2a-bbcb010d7ab7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:51.757186 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-aedf69ac-ced4-4d8c-bd2a-bbcb010d7ab7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:51.763512 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aedf69ac-ced4-4d8c-bd2a-bbcb010d7ab7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:51.763992 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aedf69ac-ced4-4d8c-bd2a-bbcb010d7ab7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:51.764423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aedf69ac-ced4-4d8c-bd2a-bbcb010d7ab7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:51.765364 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aedf69ac-ced4-4d8c-bd2a-bbcb010d7ab7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:51.765827 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aedf69ac-ced4-4d8c-bd2a-bbcb010d7ab7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:51.766252 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aedf69ac-ced4-4d8c-bd2a-bbcb010d7ab7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:51.895530 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-aedf69ac-ced4-4d8c-bd2a-bbcb010d7ab7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:51.904288 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-aedf69ac-ced4-4d8c-bd2a-bbcb010d7ab7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:51.905732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-aedf69ac-ced4-4d8c-bd2a-bbcb010d7ab7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:51.906924 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-aedf69ac-ced4-4d8c-bd2a-bbcb010d7ab7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.154198 Oct 11 06:57:51.907487 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1016/2013] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:57:51 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:57:52.651305 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5d6d137e-edb8-4c90-8c7c-cbea853cbe08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:52.652419 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5d6d137e-edb8-4c90-8c7c-cbea853cbe08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:52.658708 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5d6d137e-edb8-4c90-8c7c-cbea853cbe08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:52.659184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5d6d137e-edb8-4c90-8c7c-cbea853cbe08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:52.659647 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5d6d137e-edb8-4c90-8c7c-cbea853cbe08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:52.660338 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5d6d137e-edb8-4c90-8c7c-cbea853cbe08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:52.660787 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5d6d137e-edb8-4c90-8c7c-cbea853cbe08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:52.661206 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5d6d137e-edb8-4c90-8c7c-cbea853cbe08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:52.677998 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8ba70406-db44-4b35-a5d9-62a242f63223 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:52.678613 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8ba70406-db44-4b35-a5d9-62a242f63223 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:52.685281 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ba70406-db44-4b35-a5d9-62a242f63223 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:52.685761 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ba70406-db44-4b35-a5d9-62a242f63223 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:52.686190 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ba70406-db44-4b35-a5d9-62a242f63223 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:52.686883 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ba70406-db44-4b35-a5d9-62a242f63223 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:52.687335 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ba70406-db44-4b35-a5d9-62a242f63223 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:52.687780 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ba70406-db44-4b35-a5d9-62a242f63223 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:52.794351 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5d6d137e-edb8-4c90-8c7c-cbea853cbe08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:52.802741 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5d6d137e-edb8-4c90-8c7c-cbea853cbe08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.155265 Oct 11 06:57:52.803475 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 998/2014] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:52 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:52.817745 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8ba70406-db44-4b35-a5d9-62a242f63223 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:52.825902 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8ba70406-db44-4b35-a5d9-62a242f63223 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.151731 Oct 11 06:57:52.826461 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1017/2015] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:52 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:52.932332 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-25f549b3-a2d7-4dc2-8302-97f8902c14cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:52.932860 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-25f549b3-a2d7-4dc2-8302-97f8902c14cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:52.938797 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-25f549b3-a2d7-4dc2-8302-97f8902c14cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:52.939275 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-25f549b3-a2d7-4dc2-8302-97f8902c14cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:52.939745 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-25f549b3-a2d7-4dc2-8302-97f8902c14cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:52.940433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-25f549b3-a2d7-4dc2-8302-97f8902c14cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:52.940881 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-25f549b3-a2d7-4dc2-8302-97f8902c14cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:52.941302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-25f549b3-a2d7-4dc2-8302-97f8902c14cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:53.065839 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-25f549b3-a2d7-4dc2-8302-97f8902c14cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:53.074855 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-25f549b3-a2d7-4dc2-8302-97f8902c14cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:53.076319 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-25f549b3-a2d7-4dc2-8302-97f8902c14cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:53.077474 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-25f549b3-a2d7-4dc2-8302-97f8902c14cc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.149228 Oct 11 06:57:53.078019 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 999/2016] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:57:52 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:57:53.826482 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-241f85e2-d4b2-453f-8429-9bd45baa3397 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:53.827110 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-241f85e2-d4b2-453f-8429-9bd45baa3397 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:53.833422 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-241f85e2-d4b2-453f-8429-9bd45baa3397 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:53.833889 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-241f85e2-d4b2-453f-8429-9bd45baa3397 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:53.834309 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-241f85e2-d4b2-453f-8429-9bd45baa3397 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:53.834981 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-241f85e2-d4b2-453f-8429-9bd45baa3397 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:53.835437 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-241f85e2-d4b2-453f-8429-9bd45baa3397 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:53.835846 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-241f85e2-d4b2-453f-8429-9bd45baa3397 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:53.849853 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-62471603-36b7-4a37-b2c7-9e8b085114ec tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:53.850467 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-62471603-36b7-4a37-b2c7-9e8b085114ec tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:53.856940 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62471603-36b7-4a37-b2c7-9e8b085114ec tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:53.857419 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62471603-36b7-4a37-b2c7-9e8b085114ec tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:53.857849 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62471603-36b7-4a37-b2c7-9e8b085114ec tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:53.858554 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62471603-36b7-4a37-b2c7-9e8b085114ec tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:53.859002 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62471603-36b7-4a37-b2c7-9e8b085114ec tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:53.859437 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62471603-36b7-4a37-b2c7-9e8b085114ec tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:53.967531 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-241f85e2-d4b2-453f-8429-9bd45baa3397 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:53.975631 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-241f85e2-d4b2-453f-8429-9bd45baa3397 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.153375 Oct 11 06:57:53.976185 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1018/2017] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:53 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:53.992385 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-62471603-36b7-4a37-b2c7-9e8b085114ec tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:54.000508 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-62471603-36b7-4a37-b2c7-9e8b085114ec tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.154448 Oct 11 06:57:54.001051 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1000/2018] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:53 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:54.102731 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0404d77e-b389-4f53-ae02-37724ee9b5d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:54.103339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0404d77e-b389-4f53-ae02-37724ee9b5d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:54.109295 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0404d77e-b389-4f53-ae02-37724ee9b5d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:54.109761 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0404d77e-b389-4f53-ae02-37724ee9b5d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:54.110190 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0404d77e-b389-4f53-ae02-37724ee9b5d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:54.110859 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0404d77e-b389-4f53-ae02-37724ee9b5d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:54.111301 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0404d77e-b389-4f53-ae02-37724ee9b5d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:54.111735 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0404d77e-b389-4f53-ae02-37724ee9b5d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:54.235664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0404d77e-b389-4f53-ae02-37724ee9b5d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:54.244245 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0404d77e-b389-4f53-ae02-37724ee9b5d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:54.246188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0404d77e-b389-4f53-ae02-37724ee9b5d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:54.247338 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0404d77e-b389-4f53-ae02-37724ee9b5d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.148407 Oct 11 06:57:54.247910 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1019/2019] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:57:54 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:57:54.998909 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ca2b41f4-94eb-48f5-9b22-adbe9c3a468b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:54.999565 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ca2b41f4-94eb-48f5-9b22-adbe9c3a468b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:55.005933 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca2b41f4-94eb-48f5-9b22-adbe9c3a468b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:55.006404 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca2b41f4-94eb-48f5-9b22-adbe9c3a468b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:55.006832 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca2b41f4-94eb-48f5-9b22-adbe9c3a468b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:55.007536 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca2b41f4-94eb-48f5-9b22-adbe9c3a468b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:55.007981 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca2b41f4-94eb-48f5-9b22-adbe9c3a468b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:55.008394 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca2b41f4-94eb-48f5-9b22-adbe9c3a468b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:55.024138 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9cb01d92-040e-4abf-acdc-236a4b7b6279 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:55.024743 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9cb01d92-040e-4abf-acdc-236a4b7b6279 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:55.031539 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9cb01d92-040e-4abf-acdc-236a4b7b6279 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:55.032009 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9cb01d92-040e-4abf-acdc-236a4b7b6279 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:55.032445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9cb01d92-040e-4abf-acdc-236a4b7b6279 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:55.033132 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9cb01d92-040e-4abf-acdc-236a4b7b6279 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:55.033577 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9cb01d92-040e-4abf-acdc-236a4b7b6279 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:55.033996 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9cb01d92-040e-4abf-acdc-236a4b7b6279 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:55.141076 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ca2b41f4-94eb-48f5-9b22-adbe9c3a468b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:55.149414 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ca2b41f4-94eb-48f5-9b22-adbe9c3a468b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.154268 Oct 11 06:57:55.149983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1001/2020] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:54 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:55.175181 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9cb01d92-040e-4abf-acdc-236a4b7b6279 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:55.183285 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9cb01d92-040e-4abf-acdc-236a4b7b6279 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.163045 Oct 11 06:57:55.183868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1020/2021] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:55 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:55.273093 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e5d39731-9bd0-4344-9e8a-cee169f42d02 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:55.274058 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e5d39731-9bd0-4344-9e8a-cee169f42d02 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:55.280633 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e5d39731-9bd0-4344-9e8a-cee169f42d02 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:55.281113 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e5d39731-9bd0-4344-9e8a-cee169f42d02 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:55.281547 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e5d39731-9bd0-4344-9e8a-cee169f42d02 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:55.282243 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e5d39731-9bd0-4344-9e8a-cee169f42d02 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:55.282697 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e5d39731-9bd0-4344-9e8a-cee169f42d02 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:55.283121 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e5d39731-9bd0-4344-9e8a-cee169f42d02 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:55.412860 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e5d39731-9bd0-4344-9e8a-cee169f42d02 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:55.421455 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e5d39731-9bd0-4344-9e8a-cee169f42d02 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:55.422883 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e5d39731-9bd0-4344-9e8a-cee169f42d02 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:55.424064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e5d39731-9bd0-4344-9e8a-cee169f42d02 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.154906 Oct 11 06:57:55.424619 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1002/2022] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:57:55 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:57:56.172765 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-293ed086-fc82-4467-b636-c6bfbccc1e44 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:56.173373 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-293ed086-fc82-4467-b636-c6bfbccc1e44 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:56.179663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-293ed086-fc82-4467-b636-c6bfbccc1e44 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:56.180169 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-293ed086-fc82-4467-b636-c6bfbccc1e44 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:56.180597 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-293ed086-fc82-4467-b636-c6bfbccc1e44 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:56.181280 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-293ed086-fc82-4467-b636-c6bfbccc1e44 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:56.181725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-293ed086-fc82-4467-b636-c6bfbccc1e44 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:56.182142 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-293ed086-fc82-4467-b636-c6bfbccc1e44 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:56.206017 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-52076516-3815-4e17-b686-01133bbc9755 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:56.206654 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-52076516-3815-4e17-b686-01133bbc9755 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:56.213048 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-52076516-3815-4e17-b686-01133bbc9755 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:56.213523 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-52076516-3815-4e17-b686-01133bbc9755 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:56.213952 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-52076516-3815-4e17-b686-01133bbc9755 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:56.214749 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-52076516-3815-4e17-b686-01133bbc9755 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:56.215197 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-52076516-3815-4e17-b686-01133bbc9755 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:56.215642 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-52076516-3815-4e17-b686-01133bbc9755 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:56.315054 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-293ed086-fc82-4467-b636-c6bfbccc1e44 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:56.323230 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-293ed086-fc82-4467-b636-c6bfbccc1e44 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.154268 Oct 11 06:57:56.323923 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1021/2023] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:56 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:56.345245 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-52076516-3815-4e17-b686-01133bbc9755 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:56.353380 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-52076516-3815-4e17-b686-01133bbc9755 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.151219 Oct 11 06:57:56.353929 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1003/2024] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:56 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:56.449208 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-df711864-c42e-4dd1-aa07-332c4e03947b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:56.449812 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-df711864-c42e-4dd1-aa07-332c4e03947b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:56.455676 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-df711864-c42e-4dd1-aa07-332c4e03947b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:56.456145 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-df711864-c42e-4dd1-aa07-332c4e03947b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:56.456566 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-df711864-c42e-4dd1-aa07-332c4e03947b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:56.457238 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-df711864-c42e-4dd1-aa07-332c4e03947b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:56.457677 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-df711864-c42e-4dd1-aa07-332c4e03947b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:56.458088 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-df711864-c42e-4dd1-aa07-332c4e03947b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:56.582654 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-df711864-c42e-4dd1-aa07-332c4e03947b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:56.591783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-df711864-c42e-4dd1-aa07-332c4e03947b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:56.593299 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-df711864-c42e-4dd1-aa07-332c4e03947b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:56.594451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-df711864-c42e-4dd1-aa07-332c4e03947b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.149216 Oct 11 06:57:56.595575 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1022/2025] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:57:56 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:57:57.346344 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b14b8613-cc85-4bfc-bfbb-e95385806c44 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:57.346921 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b14b8613-cc85-4bfc-bfbb-e95385806c44 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:57.353421 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b14b8613-cc85-4bfc-bfbb-e95385806c44 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:57.353891 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b14b8613-cc85-4bfc-bfbb-e95385806c44 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:57.354323 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b14b8613-cc85-4bfc-bfbb-e95385806c44 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:57.355060 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b14b8613-cc85-4bfc-bfbb-e95385806c44 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:57.355590 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b14b8613-cc85-4bfc-bfbb-e95385806c44 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:57.356012 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b14b8613-cc85-4bfc-bfbb-e95385806c44 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:57.376952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b78aa0d8-3bd3-4a9f-ac51-5521470250fa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:57.377559 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b78aa0d8-3bd3-4a9f-ac51-5521470250fa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:57.383941 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b78aa0d8-3bd3-4a9f-ac51-5521470250fa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:57.384416 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b78aa0d8-3bd3-4a9f-ac51-5521470250fa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:57.384840 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b78aa0d8-3bd3-4a9f-ac51-5521470250fa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:57.385526 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b78aa0d8-3bd3-4a9f-ac51-5521470250fa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:57.389741 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b78aa0d8-3bd3-4a9f-ac51-5521470250fa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:57.390216 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b78aa0d8-3bd3-4a9f-ac51-5521470250fa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:57.485878 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b14b8613-cc85-4bfc-bfbb-e95385806c44 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:57.494089 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b14b8613-cc85-4bfc-bfbb-e95385806c44 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.151650 Oct 11 06:57:57.495015 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1004/2026] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:57 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:57.526723 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b78aa0d8-3bd3-4a9f-ac51-5521470250fa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:57.534836 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b78aa0d8-3bd3-4a9f-ac51-5521470250fa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.161716 Oct 11 06:57:57.535390 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1023/2027] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:57 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:57.619946 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5d055f73-7332-4e99-ac4e-b129e0a73293 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:57.621126 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5d055f73-7332-4e99-ac4e-b129e0a73293 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:57.627006 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5d055f73-7332-4e99-ac4e-b129e0a73293 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:57.627522 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5d055f73-7332-4e99-ac4e-b129e0a73293 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:57.627971 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5d055f73-7332-4e99-ac4e-b129e0a73293 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:57.628647 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5d055f73-7332-4e99-ac4e-b129e0a73293 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:57.629097 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5d055f73-7332-4e99-ac4e-b129e0a73293 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:57.629515 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5d055f73-7332-4e99-ac4e-b129e0a73293 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:57.762427 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5d055f73-7332-4e99-ac4e-b129e0a73293 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:57.771325 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5d055f73-7332-4e99-ac4e-b129e0a73293 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:57.772827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5d055f73-7332-4e99-ac4e-b129e0a73293 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:57.773980 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5d055f73-7332-4e99-ac4e-b129e0a73293 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.157948 Oct 11 06:57:57.774524 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1005/2028] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:57:57 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:57:58.518243 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3f0e1067-3740-46b7-a5b0-76b1afdb7cf4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:58.518853 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3f0e1067-3740-46b7-a5b0-76b1afdb7cf4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:58.525258 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3f0e1067-3740-46b7-a5b0-76b1afdb7cf4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:58.525736 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3f0e1067-3740-46b7-a5b0-76b1afdb7cf4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:58.526190 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3f0e1067-3740-46b7-a5b0-76b1afdb7cf4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:58.527498 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3f0e1067-3740-46b7-a5b0-76b1afdb7cf4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:58.527951 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3f0e1067-3740-46b7-a5b0-76b1afdb7cf4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:58.528377 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3f0e1067-3740-46b7-a5b0-76b1afdb7cf4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:58.558420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a6f05e30-e340-40a6-a3c7-306c52a3bc46 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:58.559023 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a6f05e30-e340-40a6-a3c7-306c52a3bc46 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:58.565490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6f05e30-e340-40a6-a3c7-306c52a3bc46 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:58.565947 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6f05e30-e340-40a6-a3c7-306c52a3bc46 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:58.566369 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6f05e30-e340-40a6-a3c7-306c52a3bc46 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:58.567055 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6f05e30-e340-40a6-a3c7-306c52a3bc46 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:58.567521 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6f05e30-e340-40a6-a3c7-306c52a3bc46 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:58.567936 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6f05e30-e340-40a6-a3c7-306c52a3bc46 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:58.659452 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3f0e1067-3740-46b7-a5b0-76b1afdb7cf4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:58.668175 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3f0e1067-3740-46b7-a5b0-76b1afdb7cf4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.154070 Oct 11 06:57:58.668738 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1024/2029] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:58 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:58.698288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a6f05e30-e340-40a6-a3c7-306c52a3bc46 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:58.706396 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a6f05e30-e340-40a6-a3c7-306c52a3bc46 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.152311 Oct 11 06:57:58.706949 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1006/2030] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:58 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:58.799123 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9c304638-08ea-4033-9640-660cd7c21b95 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:58.799797 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9c304638-08ea-4033-9640-660cd7c21b95 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:58.805629 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c304638-08ea-4033-9640-660cd7c21b95 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:58.806097 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c304638-08ea-4033-9640-660cd7c21b95 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:58.806519 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c304638-08ea-4033-9640-660cd7c21b95 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:58.807198 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c304638-08ea-4033-9640-660cd7c21b95 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:58.807666 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c304638-08ea-4033-9640-660cd7c21b95 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:58.808082 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c304638-08ea-4033-9640-660cd7c21b95 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:58.934105 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9c304638-08ea-4033-9640-660cd7c21b95 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:58.942590 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9c304638-08ea-4033-9640-660cd7c21b95 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:58.944120 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9c304638-08ea-4033-9640-660cd7c21b95 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:58.945273 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9c304638-08ea-4033-9640-660cd7c21b95 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.149981 Oct 11 06:57:58.945815 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1025/2031] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:57:58 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:57:59.691232 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-18fca590-9c67-47e2-a6a4-955f34ab179b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:59.691865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-18fca590-9c67-47e2-a6a4-955f34ab179b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:59.698313 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-18fca590-9c67-47e2-a6a4-955f34ab179b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:59.698782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-18fca590-9c67-47e2-a6a4-955f34ab179b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:59.699207 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-18fca590-9c67-47e2-a6a4-955f34ab179b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:59.699930 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-18fca590-9c67-47e2-a6a4-955f34ab179b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:59.700379 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-18fca590-9c67-47e2-a6a4-955f34ab179b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:59.700793 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-18fca590-9c67-47e2-a6a4-955f34ab179b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:59.730283 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e8f05d9e-88e9-436d-a75a-24fad6c52bef tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:59.730885 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e8f05d9e-88e9-436d-a75a-24fad6c52bef tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:59.737267 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8f05d9e-88e9-436d-a75a-24fad6c52bef tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:59.737745 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8f05d9e-88e9-436d-a75a-24fad6c52bef tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:59.738169 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8f05d9e-88e9-436d-a75a-24fad6c52bef tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:59.738860 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8f05d9e-88e9-436d-a75a-24fad6c52bef tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:59.739329 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8f05d9e-88e9-436d-a75a-24fad6c52bef tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:59.739770 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8f05d9e-88e9-436d-a75a-24fad6c52bef tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:59.839514 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-18fca590-9c67-47e2-a6a4-955f34ab179b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:59.847801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-18fca590-9c67-47e2-a6a4-955f34ab179b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.160386 Oct 11 06:57:59.848376 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1007/2032] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:59 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:57:59.872671 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e8f05d9e-88e9-436d-a75a-24fad6c52bef tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:57:59.880700 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e8f05d9e-88e9-436d-a75a-24fad6c52bef tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.154780 Oct 11 06:57:59.881289 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1026/2033] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:57:59 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:57:59.970814 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-931cbd98-a3f2-44e7-a286-8e3707e8e0d9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:57:59.971384 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-931cbd98-a3f2-44e7-a286-8e3707e8e0d9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:57:59.977376 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-931cbd98-a3f2-44e7-a286-8e3707e8e0d9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:59.977856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-931cbd98-a3f2-44e7-a286-8e3707e8e0d9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:59.978289 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-931cbd98-a3f2-44e7-a286-8e3707e8e0d9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:57:59.978985 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-931cbd98-a3f2-44e7-a286-8e3707e8e0d9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:57:59.979456 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-931cbd98-a3f2-44e7-a286-8e3707e8e0d9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:57:59.979888 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-931cbd98-a3f2-44e7-a286-8e3707e8e0d9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:00.104526 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-931cbd98-a3f2-44e7-a286-8e3707e8e0d9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:00.113174 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-931cbd98-a3f2-44e7-a286-8e3707e8e0d9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:00.114623 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-931cbd98-a3f2-44e7-a286-8e3707e8e0d9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:00.115810 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-931cbd98-a3f2-44e7-a286-8e3707e8e0d9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.148987 Oct 11 06:58:00.116367 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1008/2034] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:57:59 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:58:00.871894 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fa750f0c-afc6-46cd-9ff0-8166f946cef1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:00.872494 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fa750f0c-afc6-46cd-9ff0-8166f946cef1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:00.879155 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa750f0c-afc6-46cd-9ff0-8166f946cef1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:00.879658 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa750f0c-afc6-46cd-9ff0-8166f946cef1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:00.880202 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa750f0c-afc6-46cd-9ff0-8166f946cef1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:00.880898 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa750f0c-afc6-46cd-9ff0-8166f946cef1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:00.881344 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa750f0c-afc6-46cd-9ff0-8166f946cef1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:00.881874 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa750f0c-afc6-46cd-9ff0-8166f946cef1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:00.905355 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-30b04356-029d-40db-8e3c-dc8cee5a5c68 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:00.905972 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-30b04356-029d-40db-8e3c-dc8cee5a5c68 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:00.912451 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30b04356-029d-40db-8e3c-dc8cee5a5c68 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:00.912925 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30b04356-029d-40db-8e3c-dc8cee5a5c68 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:00.913352 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30b04356-029d-40db-8e3c-dc8cee5a5c68 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:00.914044 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30b04356-029d-40db-8e3c-dc8cee5a5c68 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:00.914594 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30b04356-029d-40db-8e3c-dc8cee5a5c68 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:00.915199 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30b04356-029d-40db-8e3c-dc8cee5a5c68 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:01.009111 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fa750f0c-afc6-46cd-9ff0-8166f946cef1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:01.017525 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fa750f0c-afc6-46cd-9ff0-8166f946cef1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.149423 Oct 11 06:58:01.018115 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1027/2035] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:00 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:01.044363 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-30b04356-029d-40db-8e3c-dc8cee5a5c68 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:01.052400 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-30b04356-029d-40db-8e3c-dc8cee5a5c68 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.151381 Oct 11 06:58:01.052947 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1009/2036] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:00 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:01.142123 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-62843988-fffe-4cfe-ae9f-0f35c707e7c7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:01.142726 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-62843988-fffe-4cfe-ae9f-0f35c707e7c7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:01.148567 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62843988-fffe-4cfe-ae9f-0f35c707e7c7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:01.149022 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62843988-fffe-4cfe-ae9f-0f35c707e7c7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:01.149447 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62843988-fffe-4cfe-ae9f-0f35c707e7c7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:01.150130 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62843988-fffe-4cfe-ae9f-0f35c707e7c7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:01.150576 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62843988-fffe-4cfe-ae9f-0f35c707e7c7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:01.150991 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62843988-fffe-4cfe-ae9f-0f35c707e7c7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:01.279969 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-62843988-fffe-4cfe-ae9f-0f35c707e7c7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:01.288424 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-62843988-fffe-4cfe-ae9f-0f35c707e7c7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:01.289856 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-62843988-fffe-4cfe-ae9f-0f35c707e7c7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:01.291006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-62843988-fffe-4cfe-ae9f-0f35c707e7c7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.153098 Oct 11 06:58:01.291587 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1028/2037] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:01 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:58:02.041516 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-968a1e50-6f54-419c-b6ff-18cdeec94cb1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:02.042164 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-968a1e50-6f54-419c-b6ff-18cdeec94cb1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:02.048551 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-968a1e50-6f54-419c-b6ff-18cdeec94cb1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:02.049019 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-968a1e50-6f54-419c-b6ff-18cdeec94cb1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:02.049443 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-968a1e50-6f54-419c-b6ff-18cdeec94cb1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:02.050124 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-968a1e50-6f54-419c-b6ff-18cdeec94cb1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:02.050565 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-968a1e50-6f54-419c-b6ff-18cdeec94cb1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:02.050979 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-968a1e50-6f54-419c-b6ff-18cdeec94cb1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:02.075112 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d7d6084a-5de9-41f5-9164-d15e883458de tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:02.075742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d7d6084a-5de9-41f5-9164-d15e883458de tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:02.082078 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7d6084a-5de9-41f5-9164-d15e883458de tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:02.082551 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7d6084a-5de9-41f5-9164-d15e883458de tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:02.082979 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7d6084a-5de9-41f5-9164-d15e883458de tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:02.083697 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7d6084a-5de9-41f5-9164-d15e883458de tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:02.084152 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7d6084a-5de9-41f5-9164-d15e883458de tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:02.084568 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7d6084a-5de9-41f5-9164-d15e883458de tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:02.182839 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-968a1e50-6f54-419c-b6ff-18cdeec94cb1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:02.191301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-968a1e50-6f54-419c-b6ff-18cdeec94cb1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.153551 Oct 11 06:58:02.191899 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1010/2038] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:02 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:02.211889 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d7d6084a-5de9-41f5-9164-d15e883458de tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:02.220143 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d7d6084a-5de9-41f5-9164-d15e883458de tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.149346 Oct 11 06:58:02.220701 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1029/2039] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:02 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:58:02.317433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-26b90fb7-834b-4aef-b5c4-18177c6dd9a4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:02.318035 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-26b90fb7-834b-4aef-b5c4-18177c6dd9a4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:02.323965 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26b90fb7-834b-4aef-b5c4-18177c6dd9a4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:02.324435 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26b90fb7-834b-4aef-b5c4-18177c6dd9a4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:02.324858 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26b90fb7-834b-4aef-b5c4-18177c6dd9a4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:02.325546 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26b90fb7-834b-4aef-b5c4-18177c6dd9a4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:02.326012 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26b90fb7-834b-4aef-b5c4-18177c6dd9a4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:02.326426 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26b90fb7-834b-4aef-b5c4-18177c6dd9a4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:02.330353 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:58:02.454527 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-26b90fb7-834b-4aef-b5c4-18177c6dd9a4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:02.463058 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-26b90fb7-834b-4aef-b5c4-18177c6dd9a4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:02.465222 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-26b90fb7-834b-4aef-b5c4-18177c6dd9a4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:02.466366 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-26b90fb7-834b-4aef-b5c4-18177c6dd9a4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.153714 Oct 11 06:58:02.466910 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1011/2040] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:02 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:58:03.215517 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-06f66a07-0f9e-4e70-8b23-9a27563f53a3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:03.216074 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-06f66a07-0f9e-4e70-8b23-9a27563f53a3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:03.222602 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-06f66a07-0f9e-4e70-8b23-9a27563f53a3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:03.223081 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-06f66a07-0f9e-4e70-8b23-9a27563f53a3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:03.223541 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-06f66a07-0f9e-4e70-8b23-9a27563f53a3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:03.224238 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-06f66a07-0f9e-4e70-8b23-9a27563f53a3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:03.224689 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-06f66a07-0f9e-4e70-8b23-9a27563f53a3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:03.225111 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-06f66a07-0f9e-4e70-8b23-9a27563f53a3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:03.243782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9247b586-8430-4547-9541-da3681f82fdf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:03.244423 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9247b586-8430-4547-9541-da3681f82fdf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:03.250792 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9247b586-8430-4547-9541-da3681f82fdf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:03.251272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9247b586-8430-4547-9541-da3681f82fdf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:03.251731 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9247b586-8430-4547-9541-da3681f82fdf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:03.252419 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9247b586-8430-4547-9541-da3681f82fdf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:03.252866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9247b586-8430-4547-9541-da3681f82fdf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:03.253284 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9247b586-8430-4547-9541-da3681f82fdf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:03.357014 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-06f66a07-0f9e-4e70-8b23-9a27563f53a3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:03.365270 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-06f66a07-0f9e-4e70-8b23-9a27563f53a3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.153978 Oct 11 06:58:03.365838 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1030/2041] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:03 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:03.383648 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9247b586-8430-4547-9541-da3681f82fdf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:03.392532 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9247b586-8430-4547-9541-da3681f82fdf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.152559 Oct 11 06:58:03.393084 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1012/2042] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:03 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:58:03.491906 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2aadc193-b568-4607-88c3-538d2abcf637 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:03.492492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2aadc193-b568-4607-88c3-538d2abcf637 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:03.498330 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2aadc193-b568-4607-88c3-538d2abcf637 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:03.498794 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2aadc193-b568-4607-88c3-538d2abcf637 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:03.499218 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2aadc193-b568-4607-88c3-538d2abcf637 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:03.499921 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2aadc193-b568-4607-88c3-538d2abcf637 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:03.500367 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2aadc193-b568-4607-88c3-538d2abcf637 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:03.500782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2aadc193-b568-4607-88c3-538d2abcf637 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:03.518860 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:58:03.630205 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2aadc193-b568-4607-88c3-538d2abcf637 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:03.639232 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2aadc193-b568-4607-88c3-538d2abcf637 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:03.640974 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2aadc193-b568-4607-88c3-538d2abcf637 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:03.642112 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2aadc193-b568-4607-88c3-538d2abcf637 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.154162 Oct 11 06:58:03.642653 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1031/2043] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:03 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:58:04.388536 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-23cecdd7-20b4-4866-af86-10d576bf2f0f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:04.389141 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-23cecdd7-20b4-4866-af86-10d576bf2f0f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:04.395826 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23cecdd7-20b4-4866-af86-10d576bf2f0f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:04.396297 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23cecdd7-20b4-4866-af86-10d576bf2f0f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:04.396722 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23cecdd7-20b4-4866-af86-10d576bf2f0f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:04.397402 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23cecdd7-20b4-4866-af86-10d576bf2f0f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:04.397846 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23cecdd7-20b4-4866-af86-10d576bf2f0f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:04.398375 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23cecdd7-20b4-4866-af86-10d576bf2f0f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:04.416335 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fa979202-fee3-4601-b4e0-516403c147bf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:04.417440 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fa979202-fee3-4601-b4e0-516403c147bf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:04.423763 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa979202-fee3-4601-b4e0-516403c147bf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:04.424238 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa979202-fee3-4601-b4e0-516403c147bf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:04.424668 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa979202-fee3-4601-b4e0-516403c147bf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:04.425352 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa979202-fee3-4601-b4e0-516403c147bf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:04.425799 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa979202-fee3-4601-b4e0-516403c147bf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:04.426214 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa979202-fee3-4601-b4e0-516403c147bf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:04.527552 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-23cecdd7-20b4-4866-af86-10d576bf2f0f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:04.535771 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-23cecdd7-20b4-4866-af86-10d576bf2f0f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.151062 Oct 11 06:58:04.536344 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1013/2044] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:04 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:04.557081 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fa979202-fee3-4601-b4e0-516403c147bf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:04.565948 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fa979202-fee3-4601-b4e0-516403c147bf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.153852 Oct 11 06:58:04.566509 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1032/2045] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:04 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:58:04.667272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-66ce35c3-3166-44fd-b2ab-d1aaeace4be3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:04.667845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-66ce35c3-3166-44fd-b2ab-d1aaeace4be3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:04.673767 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-66ce35c3-3166-44fd-b2ab-d1aaeace4be3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:04.674245 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-66ce35c3-3166-44fd-b2ab-d1aaeace4be3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:04.674680 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-66ce35c3-3166-44fd-b2ab-d1aaeace4be3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:04.675371 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-66ce35c3-3166-44fd-b2ab-d1aaeace4be3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:04.675846 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-66ce35c3-3166-44fd-b2ab-d1aaeace4be3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:04.676267 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-66ce35c3-3166-44fd-b2ab-d1aaeace4be3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:04.803957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-66ce35c3-3166-44fd-b2ab-d1aaeace4be3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:04.813013 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-66ce35c3-3166-44fd-b2ab-d1aaeace4be3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:04.814453 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-66ce35c3-3166-44fd-b2ab-d1aaeace4be3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:04.815675 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-66ce35c3-3166-44fd-b2ab-d1aaeace4be3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152334 Oct 11 06:58:04.816226 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1014/2046] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:04 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:58:05.558790 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-400f1d16-1ca9-4448-be1d-4a7542820782 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:05.559488 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-400f1d16-1ca9-4448-be1d-4a7542820782 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:05.561746 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:58:05.566904 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-400f1d16-1ca9-4448-be1d-4a7542820782 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:05.567381 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-400f1d16-1ca9-4448-be1d-4a7542820782 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:05.567835 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-400f1d16-1ca9-4448-be1d-4a7542820782 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:05.568516 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-400f1d16-1ca9-4448-be1d-4a7542820782 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:05.568961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-400f1d16-1ca9-4448-be1d-4a7542820782 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:05.569379 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-400f1d16-1ca9-4448-be1d-4a7542820782 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:05.590481 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3c8f2c3f-32ab-4176-869e-33b8d0cb0fca tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:05.591186 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3c8f2c3f-32ab-4176-869e-33b8d0cb0fca tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:05.597569 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c8f2c3f-32ab-4176-869e-33b8d0cb0fca tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:05.598048 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c8f2c3f-32ab-4176-869e-33b8d0cb0fca tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:05.598483 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c8f2c3f-32ab-4176-869e-33b8d0cb0fca tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:05.599174 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c8f2c3f-32ab-4176-869e-33b8d0cb0fca tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:05.599800 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c8f2c3f-32ab-4176-869e-33b8d0cb0fca tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:05.600228 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c8f2c3f-32ab-4176-869e-33b8d0cb0fca tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:05.705018 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-400f1d16-1ca9-4448-be1d-4a7542820782 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:05.710973 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-400f1d16-1ca9-4448-be1d-4a7542820782 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.155919 Oct 11 06:58:05.711624 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1033/2047] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:05 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:05.740289 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3c8f2c3f-32ab-4176-869e-33b8d0cb0fca tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:05.748562 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3c8f2c3f-32ab-4176-869e-33b8d0cb0fca tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.162392 Oct 11 06:58:05.749113 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1015/2048] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:05 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:58:05.842175 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8b0d1320-d26a-445b-a878-0cf31e04a23b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:05.842767 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8b0d1320-d26a-445b-a878-0cf31e04a23b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:05.848661 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8b0d1320-d26a-445b-a878-0cf31e04a23b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:05.849133 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8b0d1320-d26a-445b-a878-0cf31e04a23b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:05.849563 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8b0d1320-d26a-445b-a878-0cf31e04a23b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:05.850240 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8b0d1320-d26a-445b-a878-0cf31e04a23b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:05.850685 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8b0d1320-d26a-445b-a878-0cf31e04a23b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:05.851098 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8b0d1320-d26a-445b-a878-0cf31e04a23b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:05.974566 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8b0d1320-d26a-445b-a878-0cf31e04a23b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:05.982974 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8b0d1320-d26a-445b-a878-0cf31e04a23b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:05.984435 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8b0d1320-d26a-445b-a878-0cf31e04a23b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:05.985589 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8b0d1320-d26a-445b-a878-0cf31e04a23b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.148010 Oct 11 06:58:05.986130 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1034/2049] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:05 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:58:06.733780 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-56958ab3-5105-4e92-ba2c-9857d2364815 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:06.734384 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-56958ab3-5105-4e92-ba2c-9857d2364815 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:06.740830 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-56958ab3-5105-4e92-ba2c-9857d2364815 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:06.741118 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-56958ab3-5105-4e92-ba2c-9857d2364815 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:06.741575 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-56958ab3-5105-4e92-ba2c-9857d2364815 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:06.742261 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-56958ab3-5105-4e92-ba2c-9857d2364815 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:06.742705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-56958ab3-5105-4e92-ba2c-9857d2364815 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:06.743117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-56958ab3-5105-4e92-ba2c-9857d2364815 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:06.772054 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ad0edbcd-83f1-4708-b48a-cf585daae831 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:06.772657 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ad0edbcd-83f1-4708-b48a-cf585daae831 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:06.780039 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ad0edbcd-83f1-4708-b48a-cf585daae831 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:06.780608 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ad0edbcd-83f1-4708-b48a-cf585daae831 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:06.781122 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ad0edbcd-83f1-4708-b48a-cf585daae831 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:06.781892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ad0edbcd-83f1-4708-b48a-cf585daae831 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:06.782413 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ad0edbcd-83f1-4708-b48a-cf585daae831 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:06.782910 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ad0edbcd-83f1-4708-b48a-cf585daae831 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:06.878801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-56958ab3-5105-4e92-ba2c-9857d2364815 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:06.887686 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-56958ab3-5105-4e92-ba2c-9857d2364815 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.157642 Oct 11 06:58:06.888253 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1016/2050] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:06 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:06.915840 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ad0edbcd-83f1-4708-b48a-cf585daae831 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:06.924061 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ad0edbcd-83f1-4708-b48a-cf585daae831 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.155845 Oct 11 06:58:06.924610 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1035/2051] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:06 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:58:07.010156 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-58f63364-c088-46ed-a5da-ec578f2710f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:07.011266 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-58f63364-c088-46ed-a5da-ec578f2710f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:07.017402 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-58f63364-c088-46ed-a5da-ec578f2710f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:07.017870 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-58f63364-c088-46ed-a5da-ec578f2710f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:07.018296 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-58f63364-c088-46ed-a5da-ec578f2710f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:07.018979 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-58f63364-c088-46ed-a5da-ec578f2710f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:07.019439 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-58f63364-c088-46ed-a5da-ec578f2710f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:07.019859 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-58f63364-c088-46ed-a5da-ec578f2710f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:07.147806 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-58f63364-c088-46ed-a5da-ec578f2710f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:07.156237 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-58f63364-c088-46ed-a5da-ec578f2710f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:07.157868 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-58f63364-c088-46ed-a5da-ec578f2710f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:07.159011 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-58f63364-c088-46ed-a5da-ec578f2710f2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152796 Oct 11 06:58:07.159582 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1017/2052] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:07 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:58:07.909943 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-15fdd190-712c-4fad-8050-3412cc0d67e1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:07.910554 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-15fdd190-712c-4fad-8050-3412cc0d67e1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:07.917138 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-15fdd190-712c-4fad-8050-3412cc0d67e1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:07.917611 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-15fdd190-712c-4fad-8050-3412cc0d67e1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:07.918044 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-15fdd190-712c-4fad-8050-3412cc0d67e1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:07.918752 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-15fdd190-712c-4fad-8050-3412cc0d67e1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:07.919170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-15fdd190-712c-4fad-8050-3412cc0d67e1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:07.920040 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-15fdd190-712c-4fad-8050-3412cc0d67e1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:07.947703 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-26f06f9b-7c8a-4f7c-9748-d44c484a965e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:07.948843 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-26f06f9b-7c8a-4f7c-9748-d44c484a965e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:07.955264 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26f06f9b-7c8a-4f7c-9748-d44c484a965e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:07.955779 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26f06f9b-7c8a-4f7c-9748-d44c484a965e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:07.956215 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26f06f9b-7c8a-4f7c-9748-d44c484a965e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:07.956916 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26f06f9b-7c8a-4f7c-9748-d44c484a965e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:07.957376 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26f06f9b-7c8a-4f7c-9748-d44c484a965e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:07.957803 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26f06f9b-7c8a-4f7c-9748-d44c484a965e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:08.048966 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-15fdd190-712c-4fad-8050-3412cc0d67e1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:08.057108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-15fdd190-712c-4fad-8050-3412cc0d67e1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.150976 Oct 11 06:58:08.057733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1036/2053] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:07 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:08.088077 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-26f06f9b-7c8a-4f7c-9748-d44c484a965e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:08.096831 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-26f06f9b-7c8a-4f7c-9748-d44c484a965e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.153062 Oct 11 06:58:08.097396 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1018/2054] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:07 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:58:08.184876 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1d21f4a1-b616-4b23-84da-500a0a70aa2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:08.185483 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1d21f4a1-b616-4b23-84da-500a0a70aa2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:08.191348 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1d21f4a1-b616-4b23-84da-500a0a70aa2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:08.191867 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1d21f4a1-b616-4b23-84da-500a0a70aa2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:08.192297 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1d21f4a1-b616-4b23-84da-500a0a70aa2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:08.192980 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1d21f4a1-b616-4b23-84da-500a0a70aa2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:08.193430 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1d21f4a1-b616-4b23-84da-500a0a70aa2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:08.193851 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1d21f4a1-b616-4b23-84da-500a0a70aa2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:08.324507 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1d21f4a1-b616-4b23-84da-500a0a70aa2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:08.333170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1d21f4a1-b616-4b23-84da-500a0a70aa2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:08.334642 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1d21f4a1-b616-4b23-84da-500a0a70aa2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:08.335841 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1d21f4a1-b616-4b23-84da-500a0a70aa2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.154782 Oct 11 06:58:08.336397 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1037/2055] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:08 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:58:09.080372 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-41678125-3a55-4d33-81d5-f37e2d88b6d3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:09.080981 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-41678125-3a55-4d33-81d5-f37e2d88b6d3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:09.087370 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41678125-3a55-4d33-81d5-f37e2d88b6d3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:09.087839 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41678125-3a55-4d33-81d5-f37e2d88b6d3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:09.088272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41678125-3a55-4d33-81d5-f37e2d88b6d3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:09.089481 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41678125-3a55-4d33-81d5-f37e2d88b6d3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:09.089979 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41678125-3a55-4d33-81d5-f37e2d88b6d3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:09.090406 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41678125-3a55-4d33-81d5-f37e2d88b6d3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:09.119800 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0292a30f-a8dd-4fd6-a138-b315274e903b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:09.120413 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0292a30f-a8dd-4fd6-a138-b315274e903b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:09.126764 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0292a30f-a8dd-4fd6-a138-b315274e903b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:09.127237 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0292a30f-a8dd-4fd6-a138-b315274e903b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:09.127695 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0292a30f-a8dd-4fd6-a138-b315274e903b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:09.128464 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0292a30f-a8dd-4fd6-a138-b315274e903b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:09.128941 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0292a30f-a8dd-4fd6-a138-b315274e903b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:09.129364 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0292a30f-a8dd-4fd6-a138-b315274e903b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:09.224530 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-41678125-3a55-4d33-81d5-f37e2d88b6d3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:09.233638 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-41678125-3a55-4d33-81d5-f37e2d88b6d3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.157043 Oct 11 06:58:09.234202 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1019/2056] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:09 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:09.261582 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0292a30f-a8dd-4fd6-a138-b315274e903b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:09.269842 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0292a30f-a8dd-4fd6-a138-b315274e903b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.153893 Oct 11 06:58:09.270388 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1038/2057] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:09 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:58:09.361233 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3b7e107f-7036-4ecc-80b1-b3a1ae4e323b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:09.361864 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3b7e107f-7036-4ecc-80b1-b3a1ae4e323b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:09.367735 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3b7e107f-7036-4ecc-80b1-b3a1ae4e323b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:09.368206 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3b7e107f-7036-4ecc-80b1-b3a1ae4e323b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:09.368635 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3b7e107f-7036-4ecc-80b1-b3a1ae4e323b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:09.369313 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3b7e107f-7036-4ecc-80b1-b3a1ae4e323b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:09.369802 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3b7e107f-7036-4ecc-80b1-b3a1ae4e323b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:09.370235 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3b7e107f-7036-4ecc-80b1-b3a1ae4e323b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:09.497332 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3b7e107f-7036-4ecc-80b1-b3a1ae4e323b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:09.505774 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3b7e107f-7036-4ecc-80b1-b3a1ae4e323b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:09.507183 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3b7e107f-7036-4ecc-80b1-b3a1ae4e323b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:09.508354 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3b7e107f-7036-4ecc-80b1-b3a1ae4e323b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.150918 Oct 11 06:58:09.508906 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1020/2058] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:09 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:58:10.256967 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-44e9f5da-02e3-4550-b9d8-94921ed63558 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:10.257509 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-44e9f5da-02e3-4550-b9d8-94921ed63558 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:10.263963 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-44e9f5da-02e3-4550-b9d8-94921ed63558 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:10.264695 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-44e9f5da-02e3-4550-b9d8-94921ed63558 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:10.265127 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-44e9f5da-02e3-4550-b9d8-94921ed63558 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:10.265812 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-44e9f5da-02e3-4550-b9d8-94921ed63558 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:10.266262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-44e9f5da-02e3-4550-b9d8-94921ed63558 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:10.266704 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-44e9f5da-02e3-4550-b9d8-94921ed63558 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:10.293479 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1b2211a7-21eb-44b9-a177-f1025de86f55 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:10.294084 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1b2211a7-21eb-44b9-a177-f1025de86f55 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:10.300543 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1b2211a7-21eb-44b9-a177-f1025de86f55 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:10.301023 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1b2211a7-21eb-44b9-a177-f1025de86f55 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:10.301454 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1b2211a7-21eb-44b9-a177-f1025de86f55 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:10.302157 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1b2211a7-21eb-44b9-a177-f1025de86f55 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:10.302604 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1b2211a7-21eb-44b9-a177-f1025de86f55 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:10.303027 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1b2211a7-21eb-44b9-a177-f1025de86f55 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:10.396015 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-44e9f5da-02e3-4550-b9d8-94921ed63558 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:10.404294 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-44e9f5da-02e3-4550-b9d8-94921ed63558 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.151201 Oct 11 06:58:10.405949 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1039/2059] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:10 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:10.437530 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1b2211a7-21eb-44b9-a177-f1025de86f55 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:10.445972 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1b2211a7-21eb-44b9-a177-f1025de86f55 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.156764 Oct 11 06:58:10.446524 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1021/2060] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:10 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:10.534807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cf87ce19-8f94-4d17-ad8f-bc323ba3a107 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:10.535339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cf87ce19-8f94-4d17-ad8f-bc323ba3a107 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:10.541334 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf87ce19-8f94-4d17-ad8f-bc323ba3a107 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:10.542451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf87ce19-8f94-4d17-ad8f-bc323ba3a107 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:10.542879 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf87ce19-8f94-4d17-ad8f-bc323ba3a107 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:10.543604 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf87ce19-8f94-4d17-ad8f-bc323ba3a107 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:10.544049 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf87ce19-8f94-4d17-ad8f-bc323ba3a107 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:10.544467 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf87ce19-8f94-4d17-ad8f-bc323ba3a107 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:10.672663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cf87ce19-8f94-4d17-ad8f-bc323ba3a107 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:10.681050 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cf87ce19-8f94-4d17-ad8f-bc323ba3a107 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:10.682466 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cf87ce19-8f94-4d17-ad8f-bc323ba3a107 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:10.683635 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cf87ce19-8f94-4d17-ad8f-bc323ba3a107 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152675 Oct 11 06:58:10.684450 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1040/2061] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:10 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:58:11.428563 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ef754f01-0a25-4439-b8bd-d2d9e5fb009c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:11.429188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ef754f01-0a25-4439-b8bd-d2d9e5fb009c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:11.436053 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ef754f01-0a25-4439-b8bd-d2d9e5fb009c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:11.436386 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ef754f01-0a25-4439-b8bd-d2d9e5fb009c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:11.436821 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ef754f01-0a25-4439-b8bd-d2d9e5fb009c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:11.437518 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ef754f01-0a25-4439-b8bd-d2d9e5fb009c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:11.437976 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ef754f01-0a25-4439-b8bd-d2d9e5fb009c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:11.438399 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ef754f01-0a25-4439-b8bd-d2d9e5fb009c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:11.469299 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f00442c4-8a69-4563-b867-79aa39412ec1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:11.469910 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f00442c4-8a69-4563-b867-79aa39412ec1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:11.476387 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f00442c4-8a69-4563-b867-79aa39412ec1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:11.476891 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f00442c4-8a69-4563-b867-79aa39412ec1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:11.477319 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f00442c4-8a69-4563-b867-79aa39412ec1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:11.478008 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f00442c4-8a69-4563-b867-79aa39412ec1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:11.478454 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f00442c4-8a69-4563-b867-79aa39412ec1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:11.478872 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f00442c4-8a69-4563-b867-79aa39412ec1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:11.568459 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ef754f01-0a25-4439-b8bd-d2d9e5fb009c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:11.577530 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ef754f01-0a25-4439-b8bd-d2d9e5fb009c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.152726 Oct 11 06:58:11.578096 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1022/2062] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:11 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:11.606022 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f00442c4-8a69-4563-b867-79aa39412ec1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:11.614266 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f00442c4-8a69-4563-b867-79aa39412ec1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.148750 Oct 11 06:58:11.614817 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1041/2063] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:11 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:58:11.709084 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ab6237c3-6f0b-4260-960f-c1103b411e5d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:11.709695 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ab6237c3-6f0b-4260-960f-c1103b411e5d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:11.715683 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ab6237c3-6f0b-4260-960f-c1103b411e5d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:11.716163 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ab6237c3-6f0b-4260-960f-c1103b411e5d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:11.716599 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ab6237c3-6f0b-4260-960f-c1103b411e5d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:11.717291 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ab6237c3-6f0b-4260-960f-c1103b411e5d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:11.717743 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ab6237c3-6f0b-4260-960f-c1103b411e5d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:11.718167 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ab6237c3-6f0b-4260-960f-c1103b411e5d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:11.842762 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ab6237c3-6f0b-4260-960f-c1103b411e5d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:11.851313 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ab6237c3-6f0b-4260-960f-c1103b411e5d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:11.852788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ab6237c3-6f0b-4260-960f-c1103b411e5d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:11.853955 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ab6237c3-6f0b-4260-960f-c1103b411e5d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.148788 Oct 11 06:58:11.855018 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1023/2064] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:11 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:58:12.599581 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e8033401-039b-4143-8832-cc043383fec9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:12.600182 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e8033401-039b-4143-8832-cc043383fec9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:12.606436 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8033401-039b-4143-8832-cc043383fec9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:12.606910 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8033401-039b-4143-8832-cc043383fec9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:12.607332 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8033401-039b-4143-8832-cc043383fec9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:12.608099 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8033401-039b-4143-8832-cc043383fec9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:12.608538 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8033401-039b-4143-8832-cc043383fec9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:12.608948 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8033401-039b-4143-8832-cc043383fec9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:12.637275 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-42597179-7233-4d92-bf65-ccfacd473816 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:12.637889 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-42597179-7233-4d92-bf65-ccfacd473816 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:12.644624 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42597179-7233-4d92-bf65-ccfacd473816 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:12.645107 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42597179-7233-4d92-bf65-ccfacd473816 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:12.645546 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42597179-7233-4d92-bf65-ccfacd473816 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:12.646248 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42597179-7233-4d92-bf65-ccfacd473816 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:12.646702 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42597179-7233-4d92-bf65-ccfacd473816 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:12.647132 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42597179-7233-4d92-bf65-ccfacd473816 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:12.738337 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e8033401-039b-4143-8832-cc043383fec9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:12.747175 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e8033401-039b-4143-8832-cc043383fec9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.151326 Oct 11 06:58:12.747971 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1042/2065] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:12 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:12.779254 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-42597179-7233-4d92-bf65-ccfacd473816 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:12.787311 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-42597179-7233-4d92-bf65-ccfacd473816 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.154308 Oct 11 06:58:12.787893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1024/2066] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:12 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:58:12.879389 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e8a9e056-33b9-46b9-9348-a3b81a64c8ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:12.880026 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e8a9e056-33b9-46b9-9348-a3b81a64c8ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:12.886488 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8a9e056-33b9-46b9-9348-a3b81a64c8ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:12.886963 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8a9e056-33b9-46b9-9348-a3b81a64c8ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:12.887395 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8a9e056-33b9-46b9-9348-a3b81a64c8ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:12.888094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8a9e056-33b9-46b9-9348-a3b81a64c8ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:12.888534 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8a9e056-33b9-46b9-9348-a3b81a64c8ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:12.888948 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8a9e056-33b9-46b9-9348-a3b81a64c8ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:13.012134 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e8a9e056-33b9-46b9-9348-a3b81a64c8ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:13.020834 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e8a9e056-33b9-46b9-9348-a3b81a64c8ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:13.022253 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e8a9e056-33b9-46b9-9348-a3b81a64c8ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:13.023393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e8a9e056-33b9-46b9-9348-a3b81a64c8ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.147869 Oct 11 06:58:13.023960 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1043/2067] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:12 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:58:13.770614 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-43a14799-0d76-4577-9446-d4a60870dcb1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:13.771257 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-43a14799-0d76-4577-9446-d4a60870dcb1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:13.778123 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-43a14799-0d76-4577-9446-d4a60870dcb1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:13.778595 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-43a14799-0d76-4577-9446-d4a60870dcb1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:13.779025 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-43a14799-0d76-4577-9446-d4a60870dcb1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:13.779747 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-43a14799-0d76-4577-9446-d4a60870dcb1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:13.780193 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-43a14799-0d76-4577-9446-d4a60870dcb1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:13.780610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-43a14799-0d76-4577-9446-d4a60870dcb1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:13.810075 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4045c41a-2768-4ae0-8916-dbb00429f1ff tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:13.810711 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4045c41a-2768-4ae0-8916-dbb00429f1ff tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:13.817267 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4045c41a-2768-4ae0-8916-dbb00429f1ff tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:13.817742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4045c41a-2768-4ae0-8916-dbb00429f1ff tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:13.818174 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4045c41a-2768-4ae0-8916-dbb00429f1ff tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:13.818859 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4045c41a-2768-4ae0-8916-dbb00429f1ff tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:13.819303 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4045c41a-2768-4ae0-8916-dbb00429f1ff tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:13.819760 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4045c41a-2768-4ae0-8916-dbb00429f1ff tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:13.908431 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-43a14799-0d76-4577-9446-d4a60870dcb1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:13.916704 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-43a14799-0d76-4577-9446-d4a60870dcb1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.149950 Oct 11 06:58:13.917270 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1025/2068] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:13 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:13.950114 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4045c41a-2768-4ae0-8916-dbb00429f1ff tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:13.958190 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4045c41a-2768-4ae0-8916-dbb00429f1ff tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.151951 Oct 11 06:58:13.958744 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1044/2069] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:13 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:58:14.048513 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-376b78b7-a87a-4ed9-9c69-2896eb6aa892 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:14.049044 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-376b78b7-a87a-4ed9-9c69-2896eb6aa892 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:14.054853 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-376b78b7-a87a-4ed9-9c69-2896eb6aa892 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:14.055325 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-376b78b7-a87a-4ed9-9c69-2896eb6aa892 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:14.055785 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-376b78b7-a87a-4ed9-9c69-2896eb6aa892 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:14.056465 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-376b78b7-a87a-4ed9-9c69-2896eb6aa892 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:14.056906 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-376b78b7-a87a-4ed9-9c69-2896eb6aa892 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:14.057321 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-376b78b7-a87a-4ed9-9c69-2896eb6aa892 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:14.188593 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-376b78b7-a87a-4ed9-9c69-2896eb6aa892 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:14.197104 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-376b78b7-a87a-4ed9-9c69-2896eb6aa892 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:14.199036 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-376b78b7-a87a-4ed9-9c69-2896eb6aa892 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:14.200218 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-376b78b7-a87a-4ed9-9c69-2896eb6aa892 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.155684 Oct 11 06:58:14.200767 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1026/2070] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:14 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:58:14.939906 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f9c01961-0c38-4785-8d2d-bce71b9f957a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:14.940515 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f9c01961-0c38-4785-8d2d-bce71b9f957a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:14.947102 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f9c01961-0c38-4785-8d2d-bce71b9f957a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:14.947634 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f9c01961-0c38-4785-8d2d-bce71b9f957a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:14.948055 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f9c01961-0c38-4785-8d2d-bce71b9f957a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:14.949273 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f9c01961-0c38-4785-8d2d-bce71b9f957a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:14.949718 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f9c01961-0c38-4785-8d2d-bce71b9f957a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:14.950134 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f9c01961-0c38-4785-8d2d-bce71b9f957a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:14.981898 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c72f0009-04b5-4059-9684-d84d8c3727b8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:14.982512 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c72f0009-04b5-4059-9684-d84d8c3727b8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:14.989236 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c72f0009-04b5-4059-9684-d84d8c3727b8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:14.989716 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c72f0009-04b5-4059-9684-d84d8c3727b8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:14.990145 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c72f0009-04b5-4059-9684-d84d8c3727b8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:14.990872 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c72f0009-04b5-4059-9684-d84d8c3727b8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:14.991322 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c72f0009-04b5-4059-9684-d84d8c3727b8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:14.991784 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c72f0009-04b5-4059-9684-d84d8c3727b8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:15.077478 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f9c01961-0c38-4785-8d2d-bce71b9f957a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:15.085864 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f9c01961-0c38-4785-8d2d-bce71b9f957a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.149794 Oct 11 06:58:15.086434 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1045/2071] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:14 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:15.119528 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c72f0009-04b5-4059-9684-d84d8c3727b8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:15.123491 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:58:15.128915 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c72f0009-04b5-4059-9684-d84d8c3727b8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150813 Oct 11 06:58:15.129468 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1027/2072] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:14 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:58:15.225876 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8bf7bda1-bd58-446d-8193-4af1ab233cb6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:15.226483 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8bf7bda1-bd58-446d-8193-4af1ab233cb6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:15.232350 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8bf7bda1-bd58-446d-8193-4af1ab233cb6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:15.232849 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8bf7bda1-bd58-446d-8193-4af1ab233cb6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:15.233284 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8bf7bda1-bd58-446d-8193-4af1ab233cb6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:15.233972 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8bf7bda1-bd58-446d-8193-4af1ab233cb6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:15.234419 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8bf7bda1-bd58-446d-8193-4af1ab233cb6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:15.234843 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8bf7bda1-bd58-446d-8193-4af1ab233cb6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:15.360445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8bf7bda1-bd58-446d-8193-4af1ab233cb6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:15.368881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8bf7bda1-bd58-446d-8193-4af1ab233cb6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:15.370828 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8bf7bda1-bd58-446d-8193-4af1ab233cb6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:15.372019 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8bf7bda1-bd58-446d-8193-4af1ab233cb6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.149991 Oct 11 06:58:15.372572 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1046/2073] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:15 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:58:16.109872 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9c299e0d-ac4e-4dae-a4ec-cae53ee430ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:16.110520 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9c299e0d-ac4e-4dae-a4ec-cae53ee430ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:16.116876 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9c299e0d-ac4e-4dae-a4ec-cae53ee430ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:16.117355 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9c299e0d-ac4e-4dae-a4ec-cae53ee430ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:16.117790 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9c299e0d-ac4e-4dae-a4ec-cae53ee430ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:16.118470 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9c299e0d-ac4e-4dae-a4ec-cae53ee430ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:16.118922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9c299e0d-ac4e-4dae-a4ec-cae53ee430ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:16.119343 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9c299e0d-ac4e-4dae-a4ec-cae53ee430ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:16.153323 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3c7985ff-df9c-438d-b84a-3eb3401872d2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:16.153928 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3c7985ff-df9c-438d-b84a-3eb3401872d2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:16.160318 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3c7985ff-df9c-438d-b84a-3eb3401872d2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:16.160788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3c7985ff-df9c-438d-b84a-3eb3401872d2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:16.161211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3c7985ff-df9c-438d-b84a-3eb3401872d2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:16.161899 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3c7985ff-df9c-438d-b84a-3eb3401872d2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:16.162337 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3c7985ff-df9c-438d-b84a-3eb3401872d2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:16.162747 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3c7985ff-df9c-438d-b84a-3eb3401872d2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:16.250892 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9c299e0d-ac4e-4dae-a4ec-cae53ee430ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:16.259954 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9c299e0d-ac4e-4dae-a4ec-cae53ee430ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.153973 Oct 11 06:58:16.261130 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1028/2074] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:16 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:16.296496 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3c7985ff-df9c-438d-b84a-3eb3401872d2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:16.304729 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3c7985ff-df9c-438d-b84a-3eb3401872d2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.155843 Oct 11 06:58:16.305288 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1047/2075] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:16 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:58:16.398397 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9a41c2bd-7590-4ffe-8315-ce705d85ec6b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:16.398942 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9a41c2bd-7590-4ffe-8315-ce705d85ec6b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:16.405514 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9a41c2bd-7590-4ffe-8315-ce705d85ec6b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:16.405992 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9a41c2bd-7590-4ffe-8315-ce705d85ec6b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:16.406424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9a41c2bd-7590-4ffe-8315-ce705d85ec6b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:16.407113 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9a41c2bd-7590-4ffe-8315-ce705d85ec6b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:16.407590 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9a41c2bd-7590-4ffe-8315-ce705d85ec6b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:16.408013 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9a41c2bd-7590-4ffe-8315-ce705d85ec6b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:16.535458 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9a41c2bd-7590-4ffe-8315-ce705d85ec6b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:16.543906 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9a41c2bd-7590-4ffe-8315-ce705d85ec6b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:16.545324 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9a41c2bd-7590-4ffe-8315-ce705d85ec6b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:16.546460 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9a41c2bd-7590-4ffe-8315-ce705d85ec6b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.151979 Oct 11 06:58:16.547002 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1029/2076] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:16 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:58:17.284574 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e8a8fde8-8bad-413d-bfbf-e272083f77d2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:17.285175 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e8a8fde8-8bad-413d-bfbf-e272083f77d2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:17.291529 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8a8fde8-8bad-413d-bfbf-e272083f77d2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:17.292000 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8a8fde8-8bad-413d-bfbf-e272083f77d2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:17.292421 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8a8fde8-8bad-413d-bfbf-e272083f77d2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:17.293103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8a8fde8-8bad-413d-bfbf-e272083f77d2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:17.293540 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8a8fde8-8bad-413d-bfbf-e272083f77d2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:17.293946 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8a8fde8-8bad-413d-bfbf-e272083f77d2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:17.298181 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:58:17.328576 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b799c0e8-4e6f-4349-950c-e0a2a7e5c6b1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:17.329822 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b799c0e8-4e6f-4349-950c-e0a2a7e5c6b1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:17.336654 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b799c0e8-4e6f-4349-950c-e0a2a7e5c6b1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:17.337131 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b799c0e8-4e6f-4349-950c-e0a2a7e5c6b1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:17.337830 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b799c0e8-4e6f-4349-950c-e0a2a7e5c6b1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:17.338840 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b799c0e8-4e6f-4349-950c-e0a2a7e5c6b1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:17.339558 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b799c0e8-4e6f-4349-950c-e0a2a7e5c6b1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:17.340196 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b799c0e8-4e6f-4349-950c-e0a2a7e5c6b1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:17.440200 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e8a8fde8-8bad-413d-bfbf-e272083f77d2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:17.449163 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e8a8fde8-8bad-413d-bfbf-e272083f77d2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.168418 Oct 11 06:58:17.450139 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1048/2077] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:17 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:17.475713 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b799c0e8-4e6f-4349-950c-e0a2a7e5c6b1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:17.483950 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b799c0e8-4e6f-4349-950c-e0a2a7e5c6b1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.159140 Oct 11 06:58:17.484585 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1030/2078] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:17 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:58:17.572030 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8e1e31b0-625d-48f1-8705-15e9cdbe153f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:17.572562 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8e1e31b0-625d-48f1-8705-15e9cdbe153f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:17.579117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8e1e31b0-625d-48f1-8705-15e9cdbe153f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:17.579622 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8e1e31b0-625d-48f1-8705-15e9cdbe153f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:17.580043 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8e1e31b0-625d-48f1-8705-15e9cdbe153f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:17.580720 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8e1e31b0-625d-48f1-8705-15e9cdbe153f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:17.581186 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8e1e31b0-625d-48f1-8705-15e9cdbe153f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:17.581599 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8e1e31b0-625d-48f1-8705-15e9cdbe153f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:17.709472 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8e1e31b0-625d-48f1-8705-15e9cdbe153f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:17.718655 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8e1e31b0-625d-48f1-8705-15e9cdbe153f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:17.720106 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8e1e31b0-625d-48f1-8705-15e9cdbe153f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:17.721240 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8e1e31b0-625d-48f1-8705-15e9cdbe153f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.153113 Oct 11 06:58:17.721783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1049/2079] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:17 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:58:18.472660 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ab1ce5ab-7c8a-45f5-8a6d-f4c7d8e60fde tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:18.473262 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ab1ce5ab-7c8a-45f5-8a6d-f4c7d8e60fde tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:18.475632 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=76 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:58:18.481397 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ab1ce5ab-7c8a-45f5-8a6d-f4c7d8e60fde tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:18.481871 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ab1ce5ab-7c8a-45f5-8a6d-f4c7d8e60fde tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:18.482294 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ab1ce5ab-7c8a-45f5-8a6d-f4c7d8e60fde tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:18.482974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ab1ce5ab-7c8a-45f5-8a6d-f4c7d8e60fde tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:18.483435 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ab1ce5ab-7c8a-45f5-8a6d-f4c7d8e60fde tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:18.483850 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ab1ce5ab-7c8a-45f5-8a6d-f4c7d8e60fde tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:18.508180 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d781d16c-8a8a-4d8e-b9d2-81280e8f9754 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:18.508792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d781d16c-8a8a-4d8e-b9d2-81280e8f9754 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:18.515429 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d781d16c-8a8a-4d8e-b9d2-81280e8f9754 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:18.515918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d781d16c-8a8a-4d8e-b9d2-81280e8f9754 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:18.516350 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d781d16c-8a8a-4d8e-b9d2-81280e8f9754 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:18.517040 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d781d16c-8a8a-4d8e-b9d2-81280e8f9754 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:18.517488 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d781d16c-8a8a-4d8e-b9d2-81280e8f9754 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:18.517905 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d781d16c-8a8a-4d8e-b9d2-81280e8f9754 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:18.633749 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ab1ce5ab-7c8a-45f5-8a6d-f4c7d8e60fde tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:18.643111 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ab1ce5ab-7c8a-45f5-8a6d-f4c7d8e60fde tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.174222 Oct 11 06:58:18.643718 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1031/2080] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:18 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:18.649345 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d781d16c-8a8a-4d8e-b9d2-81280e8f9754 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:18.657951 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d781d16c-8a8a-4d8e-b9d2-81280e8f9754 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.153528 Oct 11 06:58:18.663547 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1050/2081] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:18 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:58:18.746727 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e916e1c2-454f-467c-99df-e70e2dd7539e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:18.747665 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e916e1c2-454f-467c-99df-e70e2dd7539e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:18.753786 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e916e1c2-454f-467c-99df-e70e2dd7539e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:18.754267 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e916e1c2-454f-467c-99df-e70e2dd7539e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:18.754708 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e916e1c2-454f-467c-99df-e70e2dd7539e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:18.755408 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e916e1c2-454f-467c-99df-e70e2dd7539e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:18.755889 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e916e1c2-454f-467c-99df-e70e2dd7539e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:18.756312 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e916e1c2-454f-467c-99df-e70e2dd7539e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:18.887093 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e916e1c2-454f-467c-99df-e70e2dd7539e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:18.895867 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e916e1c2-454f-467c-99df-e70e2dd7539e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:18.897289 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e916e1c2-454f-467c-99df-e70e2dd7539e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:18.898431 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e916e1c2-454f-467c-99df-e70e2dd7539e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.156209 Oct 11 06:58:18.898972 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1032/2082] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:18 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:58:19.666581 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-698f0d03-d5db-40be-aecc-d7b877aea514 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:19.667193 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-698f0d03-d5db-40be-aecc-d7b877aea514 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:19.673621 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-698f0d03-d5db-40be-aecc-d7b877aea514 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:19.674126 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-698f0d03-d5db-40be-aecc-d7b877aea514 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:19.674561 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-698f0d03-d5db-40be-aecc-d7b877aea514 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:19.675251 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-698f0d03-d5db-40be-aecc-d7b877aea514 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:19.675731 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-698f0d03-d5db-40be-aecc-d7b877aea514 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:19.676177 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-698f0d03-d5db-40be-aecc-d7b877aea514 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:19.681418 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4a8c5f23-dce7-4af1-94e7-78a9163ea61d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:19.682036 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4a8c5f23-dce7-4af1-94e7-78a9163ea61d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:19.688955 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4a8c5f23-dce7-4af1-94e7-78a9163ea61d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:19.689431 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4a8c5f23-dce7-4af1-94e7-78a9163ea61d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:19.689860 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4a8c5f23-dce7-4af1-94e7-78a9163ea61d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:19.690548 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4a8c5f23-dce7-4af1-94e7-78a9163ea61d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:19.690999 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4a8c5f23-dce7-4af1-94e7-78a9163ea61d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:19.691428 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4a8c5f23-dce7-4af1-94e7-78a9163ea61d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:19.802761 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-698f0d03-d5db-40be-aecc-d7b877aea514 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:19.811785 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-698f0d03-d5db-40be-aecc-d7b877aea514 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.148995 Oct 11 06:58:19.812353 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1051/2083] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:19 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:19.820657 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4a8c5f23-dce7-4af1-94e7-78a9163ea61d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:19.829409 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4a8c5f23-dce7-4af1-94e7-78a9163ea61d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.151920 Oct 11 06:58:19.829968 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1033/2084] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:19 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:58:19.924174 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4a56ff4e-7b43-4a3e-b77a-4615946a6242 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:19.924730 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4a56ff4e-7b43-4a3e-b77a-4615946a6242 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:19.930541 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4a56ff4e-7b43-4a3e-b77a-4615946a6242 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:19.931022 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4a56ff4e-7b43-4a3e-b77a-4615946a6242 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:19.931481 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4a56ff4e-7b43-4a3e-b77a-4615946a6242 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:19.932179 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4a56ff4e-7b43-4a3e-b77a-4615946a6242 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:19.933194 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4a56ff4e-7b43-4a3e-b77a-4615946a6242 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:19.933614 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4a56ff4e-7b43-4a3e-b77a-4615946a6242 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:20.061447 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4a56ff4e-7b43-4a3e-b77a-4615946a6242 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:20.069846 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4a56ff4e-7b43-4a3e-b77a-4615946a6242 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:20.071260 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4a56ff4e-7b43-4a3e-b77a-4615946a6242 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:20.072437 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4a56ff4e-7b43-4a3e-b77a-4615946a6242 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152152 Oct 11 06:58:20.073001 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1052/2085] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:19 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:58:20.836249 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-20054436-8fec-4d49-95dd-9aef1174748d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:20.836875 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-20054436-8fec-4d49-95dd-9aef1174748d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:20.843828 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20054436-8fec-4d49-95dd-9aef1174748d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:20.844295 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20054436-8fec-4d49-95dd-9aef1174748d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:20.844721 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20054436-8fec-4d49-95dd-9aef1174748d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:20.845426 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20054436-8fec-4d49-95dd-9aef1174748d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:20.845870 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20054436-8fec-4d49-95dd-9aef1174748d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:20.846283 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20054436-8fec-4d49-95dd-9aef1174748d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:20.852428 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-eb4e7181-320a-49c7-b99c-cdec6e1c093a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:20.853036 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-eb4e7181-320a-49c7-b99c-cdec6e1c093a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:20.859393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eb4e7181-320a-49c7-b99c-cdec6e1c093a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:20.859899 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eb4e7181-320a-49c7-b99c-cdec6e1c093a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:20.860328 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eb4e7181-320a-49c7-b99c-cdec6e1c093a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:20.861021 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eb4e7181-320a-49c7-b99c-cdec6e1c093a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:20.861466 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eb4e7181-320a-49c7-b99c-cdec6e1c093a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:20.861879 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eb4e7181-320a-49c7-b99c-cdec6e1c093a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:20.982095 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-20054436-8fec-4d49-95dd-9aef1174748d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:20.990196 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-eb4e7181-320a-49c7-b99c-cdec6e1c093a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:20.990438 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-20054436-8fec-4d49-95dd-9aef1174748d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.158025 Oct 11 06:58:20.990998 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1034/2086] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:20 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:20.999208 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-eb4e7181-320a-49c7-b99c-cdec6e1c093a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150507 Oct 11 06:58:20.999780 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1053/2087] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:20 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:58:21.097301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9f78f42c-9233-4dbb-9ec3-5850f0b43dee tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:21.097827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9f78f42c-9233-4dbb-9ec3-5850f0b43dee tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:21.103654 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9f78f42c-9233-4dbb-9ec3-5850f0b43dee tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:21.104345 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9f78f42c-9233-4dbb-9ec3-5850f0b43dee tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:21.104768 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9f78f42c-9233-4dbb-9ec3-5850f0b43dee tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:21.105447 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9f78f42c-9233-4dbb-9ec3-5850f0b43dee tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:21.105892 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9f78f42c-9233-4dbb-9ec3-5850f0b43dee tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:21.106304 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9f78f42c-9233-4dbb-9ec3-5850f0b43dee tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:21.230691 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9f78f42c-9233-4dbb-9ec3-5850f0b43dee tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:21.239240 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9f78f42c-9233-4dbb-9ec3-5850f0b43dee tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:21.240725 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9f78f42c-9233-4dbb-9ec3-5850f0b43dee tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:21.241875 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9f78f42c-9233-4dbb-9ec3-5850f0b43dee tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.148439 Oct 11 06:58:21.242424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1035/2088] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:21 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:58:22.013851 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-72aee00f-9fc8-4fab-b9ec-c0608fa719ae tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:22.014713 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-72aee00f-9fc8-4fab-b9ec-c0608fa719ae tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:22.021232 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-72aee00f-9fc8-4fab-b9ec-c0608fa719ae tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:22.021934 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-72aee00f-9fc8-4fab-b9ec-c0608fa719ae tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:22.022353 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-72aee00f-9fc8-4fab-b9ec-c0608fa719ae tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:22.023040 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-72aee00f-9fc8-4fab-b9ec-c0608fa719ae tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:22.023508 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-72aee00f-9fc8-4fab-b9ec-c0608fa719ae tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:22.023735 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f223f8f2-7ee0-44c5-8e52-41aba5f1d3b1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:22.024158 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-72aee00f-9fc8-4fab-b9ec-c0608fa719ae tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:22.024424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f223f8f2-7ee0-44c5-8e52-41aba5f1d3b1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:22.031712 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f223f8f2-7ee0-44c5-8e52-41aba5f1d3b1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:22.032187 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f223f8f2-7ee0-44c5-8e52-41aba5f1d3b1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:22.032616 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f223f8f2-7ee0-44c5-8e52-41aba5f1d3b1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:22.033299 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f223f8f2-7ee0-44c5-8e52-41aba5f1d3b1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:22.033773 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f223f8f2-7ee0-44c5-8e52-41aba5f1d3b1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:22.034189 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f223f8f2-7ee0-44c5-8e52-41aba5f1d3b1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:22.155588 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-72aee00f-9fc8-4fab-b9ec-c0608fa719ae tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:22.163805 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-72aee00f-9fc8-4fab-b9ec-c0608fa719ae tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.153634 Oct 11 06:58:22.164368 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1054/2089] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:22 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:22.165358 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f223f8f2-7ee0-44c5-8e52-41aba5f1d3b1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:22.173522 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f223f8f2-7ee0-44c5-8e52-41aba5f1d3b1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.154090 Oct 11 06:58:22.174072 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1036/2090] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:22 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:22.267700 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5d7654a5-6999-4914-8c91-72d42eb44d02 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:22.268234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5d7654a5-6999-4914-8c91-72d42eb44d02 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:22.274027 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5d7654a5-6999-4914-8c91-72d42eb44d02 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:22.274493 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5d7654a5-6999-4914-8c91-72d42eb44d02 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:22.274921 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5d7654a5-6999-4914-8c91-72d42eb44d02 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:22.275629 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5d7654a5-6999-4914-8c91-72d42eb44d02 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:22.276687 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5d7654a5-6999-4914-8c91-72d42eb44d02 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:22.277119 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5d7654a5-6999-4914-8c91-72d42eb44d02 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:22.406685 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5d7654a5-6999-4914-8c91-72d42eb44d02 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:22.415900 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5d7654a5-6999-4914-8c91-72d42eb44d02 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:22.417328 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5d7654a5-6999-4914-8c91-72d42eb44d02 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:22.418488 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5d7654a5-6999-4914-8c91-72d42eb44d02 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.154919 Oct 11 06:58:22.419042 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1055/2091] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:22 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:58:23.187088 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bec03255-161e-4267-83d8-91a8ca13d585 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:23.187734 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bec03255-161e-4267-83d8-91a8ca13d585 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:23.194257 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bec03255-161e-4267-83d8-91a8ca13d585 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:23.194751 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bec03255-161e-4267-83d8-91a8ca13d585 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:23.195189 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bec03255-161e-4267-83d8-91a8ca13d585 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:23.195918 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bec03255-161e-4267-83d8-91a8ca13d585 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:23.196242 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-65ebf3b9-acc3-4306-a382-c13c662a0f0e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:23.196649 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bec03255-161e-4267-83d8-91a8ca13d585 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:23.196780 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bec03255-161e-4267-83d8-91a8ca13d585 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:23.196881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-65ebf3b9-acc3-4306-a382-c13c662a0f0e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:23.203177 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-65ebf3b9-acc3-4306-a382-c13c662a0f0e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:23.203690 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-65ebf3b9-acc3-4306-a382-c13c662a0f0e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:23.204120 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-65ebf3b9-acc3-4306-a382-c13c662a0f0e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:23.204805 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-65ebf3b9-acc3-4306-a382-c13c662a0f0e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:23.205251 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-65ebf3b9-acc3-4306-a382-c13c662a0f0e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:23.205672 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-65ebf3b9-acc3-4306-a382-c13c662a0f0e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:23.324989 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-bec03255-161e-4267-83d8-91a8ca13d585 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:23.333231 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bec03255-161e-4267-83d8-91a8ca13d585 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.149897 Oct 11 06:58:23.333802 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1037/2092] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:23 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:23.335391 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-65ebf3b9-acc3-4306-a382-c13c662a0f0e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:23.344098 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-65ebf3b9-acc3-4306-a382-c13c662a0f0e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.151605 Oct 11 06:58:23.344647 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1056/2093] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:23 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:58:23.443506 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cf229bcb-f8c0-4e30-b48a-d0ee6011d6d3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:23.444116 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cf229bcb-f8c0-4e30-b48a-d0ee6011d6d3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:23.450071 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf229bcb-f8c0-4e30-b48a-d0ee6011d6d3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:23.450552 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf229bcb-f8c0-4e30-b48a-d0ee6011d6d3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:23.450981 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf229bcb-f8c0-4e30-b48a-d0ee6011d6d3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:23.451693 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf229bcb-f8c0-4e30-b48a-d0ee6011d6d3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:23.452147 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf229bcb-f8c0-4e30-b48a-d0ee6011d6d3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:23.452566 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf229bcb-f8c0-4e30-b48a-d0ee6011d6d3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:23.580197 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cf229bcb-f8c0-4e30-b48a-d0ee6011d6d3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:23.589253 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cf229bcb-f8c0-4e30-b48a-d0ee6011d6d3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:23.590689 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cf229bcb-f8c0-4e30-b48a-d0ee6011d6d3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:23.591918 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cf229bcb-f8c0-4e30-b48a-d0ee6011d6d3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152268 Oct 11 06:58:23.592474 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1038/2094] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:23 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:58:24.356905 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-56bb9355-8cf7-420c-aa33-979623aa5ce4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:24.357512 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-56bb9355-8cf7-420c-aa33-979623aa5ce4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:24.364055 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-56bb9355-8cf7-420c-aa33-979623aa5ce4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:24.364525 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-56bb9355-8cf7-420c-aa33-979623aa5ce4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:24.364951 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-56bb9355-8cf7-420c-aa33-979623aa5ce4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:24.365629 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-56bb9355-8cf7-420c-aa33-979623aa5ce4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:24.366075 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-56bb9355-8cf7-420c-aa33-979623aa5ce4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:24.366491 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-56bb9355-8cf7-420c-aa33-979623aa5ce4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:24.367409 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1a71473b-abce-4d4d-869f-dd0c11f4830e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:24.368034 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1a71473b-abce-4d4d-869f-dd0c11f4830e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:24.376531 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1a71473b-abce-4d4d-869f-dd0c11f4830e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:24.377357 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1a71473b-abce-4d4d-869f-dd0c11f4830e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:24.377840 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1a71473b-abce-4d4d-869f-dd0c11f4830e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:24.378543 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1a71473b-abce-4d4d-869f-dd0c11f4830e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:24.378998 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1a71473b-abce-4d4d-869f-dd0c11f4830e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:24.379432 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1a71473b-abce-4d4d-869f-dd0c11f4830e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:24.514671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1a71473b-abce-4d4d-869f-dd0c11f4830e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:24.523256 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1a71473b-abce-4d4d-869f-dd0c11f4830e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.159486 Oct 11 06:58:24.523876 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1039/2095] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:24 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:58:24.618054 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e741ee1c-d102-49c8-bc36-85ba67dbb335 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:24.618582 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e741ee1c-d102-49c8-bc36-85ba67dbb335 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:24.625248 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e741ee1c-d102-49c8-bc36-85ba67dbb335 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:24.625719 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e741ee1c-d102-49c8-bc36-85ba67dbb335 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:24.626142 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e741ee1c-d102-49c8-bc36-85ba67dbb335 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:24.626867 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e741ee1c-d102-49c8-bc36-85ba67dbb335 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:24.627318 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e741ee1c-d102-49c8-bc36-85ba67dbb335 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:24.627766 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e741ee1c-d102-49c8-bc36-85ba67dbb335 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:24.746025 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-56bb9355-8cf7-420c-aa33-979623aa5ce4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:24.755331 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-56bb9355-8cf7-420c-aa33-979623aa5ce4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.402279 Oct 11 06:58:24.755930 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1057/2096] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:24 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:24.760612 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e741ee1c-d102-49c8-bc36-85ba67dbb335 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:24.769589 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e741ee1c-d102-49c8-bc36-85ba67dbb335 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:24.771031 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e741ee1c-d102-49c8-bc36-85ba67dbb335 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:24.772221 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e741ee1c-d102-49c8-bc36-85ba67dbb335 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.158298 Oct 11 06:58:24.772766 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1040/2097] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:24 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:58:25.546325 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-127d7b6d-6711-42d9-93d2-0e0142734dee tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:25.546933 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-127d7b6d-6711-42d9-93d2-0e0142734dee tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:25.553367 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-127d7b6d-6711-42d9-93d2-0e0142734dee tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:25.553834 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-127d7b6d-6711-42d9-93d2-0e0142734dee tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:25.554261 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-127d7b6d-6711-42d9-93d2-0e0142734dee tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:25.554939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-127d7b6d-6711-42d9-93d2-0e0142734dee tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:25.555383 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-127d7b6d-6711-42d9-93d2-0e0142734dee tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:25.555828 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-127d7b6d-6711-42d9-93d2-0e0142734dee tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:25.681678 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-127d7b6d-6711-42d9-93d2-0e0142734dee tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:25.690387 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-127d7b6d-6711-42d9-93d2-0e0142734dee tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.147839 Oct 11 06:58:25.690944 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1058/2098] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:25 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:25.779364 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b092d3fc-242c-4b09-af6b-f908b3743214 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:25.780001 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b092d3fc-242c-4b09-af6b-f908b3743214 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:25.786776 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b092d3fc-242c-4b09-af6b-f908b3743214 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:25.787286 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b092d3fc-242c-4b09-af6b-f908b3743214 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:25.787746 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b092d3fc-242c-4b09-af6b-f908b3743214 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:25.788438 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b092d3fc-242c-4b09-af6b-f908b3743214 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:25.788889 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b092d3fc-242c-4b09-af6b-f908b3743214 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:25.789336 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b092d3fc-242c-4b09-af6b-f908b3743214 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:25.798159 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8d1fe892-6794-4421-aa47-589095f867ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:25.798761 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8d1fe892-6794-4421-aa47-589095f867ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:25.804718 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8d1fe892-6794-4421-aa47-589095f867ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:25.805194 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8d1fe892-6794-4421-aa47-589095f867ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:25.805656 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8d1fe892-6794-4421-aa47-589095f867ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:25.806339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8d1fe892-6794-4421-aa47-589095f867ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:25.806825 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8d1fe892-6794-4421-aa47-589095f867ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:25.807184 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8d1fe892-6794-4421-aa47-589095f867ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:25.927484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b092d3fc-242c-4b09-af6b-f908b3743214 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:25.936284 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b092d3fc-242c-4b09-af6b-f908b3743214 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.160569 Oct 11 06:58:25.936782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1041/2099] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:25 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:25.946813 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8d1fe892-6794-4421-aa47-589095f867ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:25.955616 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8d1fe892-6794-4421-aa47-589095f867ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:25.957038 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8d1fe892-6794-4421-aa47-589095f867ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:25.958178 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8d1fe892-6794-4421-aa47-589095f867ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.163967 Oct 11 06:58:25.958754 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1059/2100] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:25 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:58:26.713575 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1e68fc51-15b9-46ac-afff-3cc61d7ac131 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:26.714888 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1e68fc51-15b9-46ac-afff-3cc61d7ac131 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:26.720911 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1e68fc51-15b9-46ac-afff-3cc61d7ac131 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:26.721387 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1e68fc51-15b9-46ac-afff-3cc61d7ac131 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:26.721816 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1e68fc51-15b9-46ac-afff-3cc61d7ac131 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:26.722503 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1e68fc51-15b9-46ac-afff-3cc61d7ac131 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:26.722960 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1e68fc51-15b9-46ac-afff-3cc61d7ac131 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:26.723381 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1e68fc51-15b9-46ac-afff-3cc61d7ac131 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:26.848070 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1e68fc51-15b9-46ac-afff-3cc61d7ac131 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:26.856253 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1e68fc51-15b9-46ac-afff-3cc61d7ac131 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.146536 Oct 11 06:58:26.856817 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1042/2101] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:26 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:26.959431 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9ccde445-f042-4c0f-b036-fa5465f4833a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:26.960032 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9ccde445-f042-4c0f-b036-fa5465f4833a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:26.966939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9ccde445-f042-4c0f-b036-fa5465f4833a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:26.967357 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9ccde445-f042-4c0f-b036-fa5465f4833a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:26.967801 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9ccde445-f042-4c0f-b036-fa5465f4833a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:26.968472 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9ccde445-f042-4c0f-b036-fa5465f4833a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:26.968907 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9ccde445-f042-4c0f-b036-fa5465f4833a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:26.969315 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9ccde445-f042-4c0f-b036-fa5465f4833a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:26.983258 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8328d9a0-e1ec-4253-abc5-a8e4beecc155 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:26.983882 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8328d9a0-e1ec-4253-abc5-a8e4beecc155 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:26.989610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8328d9a0-e1ec-4253-abc5-a8e4beecc155 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:26.990086 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8328d9a0-e1ec-4253-abc5-a8e4beecc155 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:26.990507 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8328d9a0-e1ec-4253-abc5-a8e4beecc155 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:26.991182 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8328d9a0-e1ec-4253-abc5-a8e4beecc155 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:26.991652 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8328d9a0-e1ec-4253-abc5-a8e4beecc155 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:26.992068 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8328d9a0-e1ec-4253-abc5-a8e4beecc155 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:27.097223 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9ccde445-f042-4c0f-b036-fa5465f4833a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:27.105448 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9ccde445-f042-4c0f-b036-fa5465f4833a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.149800 Oct 11 06:58:27.106010 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1060/2102] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:26 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:27.120985 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8328d9a0-e1ec-4253-abc5-a8e4beecc155 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:27.129507 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8328d9a0-e1ec-4253-abc5-a8e4beecc155 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:27.130947 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8328d9a0-e1ec-4253-abc5-a8e4beecc155 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:27.132155 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8328d9a0-e1ec-4253-abc5-a8e4beecc155 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152826 Oct 11 06:58:27.132694 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1043/2103] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:26 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:58:27.879442 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f581a666-972f-43e0-9ad4-d6fd6d2da92f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:27.880074 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f581a666-972f-43e0-9ad4-d6fd6d2da92f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:27.885997 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f581a666-972f-43e0-9ad4-d6fd6d2da92f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:27.886469 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f581a666-972f-43e0-9ad4-d6fd6d2da92f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:27.886903 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f581a666-972f-43e0-9ad4-d6fd6d2da92f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:27.887621 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f581a666-972f-43e0-9ad4-d6fd6d2da92f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:27.888064 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f581a666-972f-43e0-9ad4-d6fd6d2da92f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:27.888481 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f581a666-972f-43e0-9ad4-d6fd6d2da92f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:28.017759 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f581a666-972f-43e0-9ad4-d6fd6d2da92f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:28.025793 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f581a666-972f-43e0-9ad4-d6fd6d2da92f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150168 Oct 11 06:58:28.026865 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1061/2104] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:27 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:28.129058 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2a82bbc0-b7f0-4a57-99e6-c92ffeff7bf1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:28.129720 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2a82bbc0-b7f0-4a57-99e6-c92ffeff7bf1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:28.136575 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2a82bbc0-b7f0-4a57-99e6-c92ffeff7bf1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:28.137048 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2a82bbc0-b7f0-4a57-99e6-c92ffeff7bf1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:28.137480 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2a82bbc0-b7f0-4a57-99e6-c92ffeff7bf1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:28.138162 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2a82bbc0-b7f0-4a57-99e6-c92ffeff7bf1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:28.138609 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2a82bbc0-b7f0-4a57-99e6-c92ffeff7bf1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:28.139028 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2a82bbc0-b7f0-4a57-99e6-c92ffeff7bf1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:28.157767 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:58:28.157951 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3071c5f5-f51b-4985-a5e6-c81be95fd4ef tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:28.158532 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3071c5f5-f51b-4985-a5e6-c81be95fd4ef tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:28.164449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3071c5f5-f51b-4985-a5e6-c81be95fd4ef tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:28.164922 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3071c5f5-f51b-4985-a5e6-c81be95fd4ef tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:28.165343 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3071c5f5-f51b-4985-a5e6-c81be95fd4ef tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:28.166026 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3071c5f5-f51b-4985-a5e6-c81be95fd4ef tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:28.166465 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3071c5f5-f51b-4985-a5e6-c81be95fd4ef tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:28.166881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3071c5f5-f51b-4985-a5e6-c81be95fd4ef tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:28.269261 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2a82bbc0-b7f0-4a57-99e6-c92ffeff7bf1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:28.278127 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2a82bbc0-b7f0-4a57-99e6-c92ffeff7bf1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.152879 Oct 11 06:58:28.278694 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1044/2105] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:28 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:28.296814 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3071c5f5-f51b-4985-a5e6-c81be95fd4ef tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:28.305238 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3071c5f5-f51b-4985-a5e6-c81be95fd4ef tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:28.306650 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3071c5f5-f51b-4985-a5e6-c81be95fd4ef tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:28.307843 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3071c5f5-f51b-4985-a5e6-c81be95fd4ef tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.153635 Oct 11 06:58:28.308378 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1062/2106] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:28 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:58:29.049016 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-70c95942-2502-4d55-a0d9-6f957cd8a444 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:29.049738 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-70c95942-2502-4d55-a0d9-6f957cd8a444 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:29.055604 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-70c95942-2502-4d55-a0d9-6f957cd8a444 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:29.056076 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-70c95942-2502-4d55-a0d9-6f957cd8a444 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:29.056501 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-70c95942-2502-4d55-a0d9-6f957cd8a444 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:29.057182 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-70c95942-2502-4d55-a0d9-6f957cd8a444 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:29.058237 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-70c95942-2502-4d55-a0d9-6f957cd8a444 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:29.058658 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-70c95942-2502-4d55-a0d9-6f957cd8a444 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:29.182357 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-70c95942-2502-4d55-a0d9-6f957cd8a444 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:29.191089 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-70c95942-2502-4d55-a0d9-6f957cd8a444 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.145813 Oct 11 06:58:29.191670 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1045/2107] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:29 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:29.301349 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6caa5c69-5ed9-406c-845f-3b6eca3e7776 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:29.301866 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6caa5c69-5ed9-406c-845f-3b6eca3e7776 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:29.308229 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6caa5c69-5ed9-406c-845f-3b6eca3e7776 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:29.308698 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6caa5c69-5ed9-406c-845f-3b6eca3e7776 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:29.309125 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6caa5c69-5ed9-406c-845f-3b6eca3e7776 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:29.309835 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6caa5c69-5ed9-406c-845f-3b6eca3e7776 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:29.310281 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6caa5c69-5ed9-406c-845f-3b6eca3e7776 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:29.310698 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6caa5c69-5ed9-406c-845f-3b6eca3e7776 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:29.333996 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7f367789-a7d2-4e81-bad4-22f81a3b88eb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:29.334601 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7f367789-a7d2-4e81-bad4-22f81a3b88eb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:29.340981 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7f367789-a7d2-4e81-bad4-22f81a3b88eb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:29.341465 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7f367789-a7d2-4e81-bad4-22f81a3b88eb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:29.341931 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7f367789-a7d2-4e81-bad4-22f81a3b88eb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:29.342617 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7f367789-a7d2-4e81-bad4-22f81a3b88eb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:29.343068 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7f367789-a7d2-4e81-bad4-22f81a3b88eb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:29.343543 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7f367789-a7d2-4e81-bad4-22f81a3b88eb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:29.447579 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6caa5c69-5ed9-406c-845f-3b6eca3e7776 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:29.455807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6caa5c69-5ed9-406c-845f-3b6eca3e7776 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.158295 Oct 11 06:58:29.456368 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1063/2108] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:29 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:29.482940 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7f367789-a7d2-4e81-bad4-22f81a3b88eb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:29.492152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7f367789-a7d2-4e81-bad4-22f81a3b88eb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:29.493618 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7f367789-a7d2-4e81-bad4-22f81a3b88eb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:29.494803 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7f367789-a7d2-4e81-bad4-22f81a3b88eb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.164603 Oct 11 06:58:29.495442 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1046/2109] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:29 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:58:30.213738 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-34027b54-6301-438e-ba62-8fff2beeeb51 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:30.214338 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-34027b54-6301-438e-ba62-8fff2beeeb51 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:30.220186 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-34027b54-6301-438e-ba62-8fff2beeeb51 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:30.220653 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-34027b54-6301-438e-ba62-8fff2beeeb51 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:30.221149 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-34027b54-6301-438e-ba62-8fff2beeeb51 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:30.221818 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-34027b54-6301-438e-ba62-8fff2beeeb51 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:30.222256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-34027b54-6301-438e-ba62-8fff2beeeb51 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:30.222666 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-34027b54-6301-438e-ba62-8fff2beeeb51 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:30.346630 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-34027b54-6301-438e-ba62-8fff2beeeb51 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:30.350034 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:58:30.355976 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-34027b54-6301-438e-ba62-8fff2beeeb51 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.146012 Oct 11 06:58:30.356535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1064/2110] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:30 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:30.480257 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1e4300fe-05cc-4bd4-9585-7ef3979d2a74 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:30.480871 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1e4300fe-05cc-4bd4-9585-7ef3979d2a74 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:30.487119 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1e4300fe-05cc-4bd4-9585-7ef3979d2a74 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:30.487628 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1e4300fe-05cc-4bd4-9585-7ef3979d2a74 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:30.488065 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1e4300fe-05cc-4bd4-9585-7ef3979d2a74 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:30.488764 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1e4300fe-05cc-4bd4-9585-7ef3979d2a74 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:30.489219 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1e4300fe-05cc-4bd4-9585-7ef3979d2a74 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:30.489640 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1e4300fe-05cc-4bd4-9585-7ef3979d2a74 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:30.520081 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5b77399b-e542-4df0-a6ec-47d5ca7e4c10 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:30.520705 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5b77399b-e542-4df0-a6ec-47d5ca7e4c10 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:30.526553 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5b77399b-e542-4df0-a6ec-47d5ca7e4c10 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:30.527025 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5b77399b-e542-4df0-a6ec-47d5ca7e4c10 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:30.527470 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5b77399b-e542-4df0-a6ec-47d5ca7e4c10 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:30.528154 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5b77399b-e542-4df0-a6ec-47d5ca7e4c10 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:30.528600 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5b77399b-e542-4df0-a6ec-47d5ca7e4c10 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:30.529013 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5b77399b-e542-4df0-a6ec-47d5ca7e4c10 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:30.617170 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1e4300fe-05cc-4bd4-9585-7ef3979d2a74 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:30.625981 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1e4300fe-05cc-4bd4-9585-7ef3979d2a74 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.149974 Oct 11 06:58:30.626545 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1047/2111] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:30 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:30.656386 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5b77399b-e542-4df0-a6ec-47d5ca7e4c10 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:30.664907 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5b77399b-e542-4df0-a6ec-47d5ca7e4c10 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:30.666465 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5b77399b-e542-4df0-a6ec-47d5ca7e4c10 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:30.668152 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5b77399b-e542-4df0-a6ec-47d5ca7e4c10 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152244 Oct 11 06:58:30.668707 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1065/2112] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:30 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:58:31.380241 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-66a6cee9-3386-4096-9fcf-77c1f6e0acf8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:31.380850 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-66a6cee9-3386-4096-9fcf-77c1f6e0acf8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:31.386803 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-66a6cee9-3386-4096-9fcf-77c1f6e0acf8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:31.387280 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-66a6cee9-3386-4096-9fcf-77c1f6e0acf8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:31.387752 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-66a6cee9-3386-4096-9fcf-77c1f6e0acf8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:31.388441 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-66a6cee9-3386-4096-9fcf-77c1f6e0acf8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:31.388887 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-66a6cee9-3386-4096-9fcf-77c1f6e0acf8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:31.389310 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-66a6cee9-3386-4096-9fcf-77c1f6e0acf8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:31.518528 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-66a6cee9-3386-4096-9fcf-77c1f6e0acf8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:31.527241 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-66a6cee9-3386-4096-9fcf-77c1f6e0acf8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150846 Oct 11 06:58:31.527825 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1048/2113] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:31 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:31.649332 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2c0d7ba3-93d2-432d-9016-dde679721a21 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:31.649972 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2c0d7ba3-93d2-432d-9016-dde679721a21 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:31.656820 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c0d7ba3-93d2-432d-9016-dde679721a21 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:31.657301 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c0d7ba3-93d2-432d-9016-dde679721a21 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:31.657736 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c0d7ba3-93d2-432d-9016-dde679721a21 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:31.658425 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c0d7ba3-93d2-432d-9016-dde679721a21 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:31.658872 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c0d7ba3-93d2-432d-9016-dde679721a21 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:31.659292 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2c0d7ba3-93d2-432d-9016-dde679721a21 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:31.693845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-08fb24a8-58cf-4dcb-8e6c-6b52b3500264 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:31.694555 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-08fb24a8-58cf-4dcb-8e6c-6b52b3500264 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:31.701101 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-08fb24a8-58cf-4dcb-8e6c-6b52b3500264 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:31.701588 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-08fb24a8-58cf-4dcb-8e6c-6b52b3500264 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:31.702018 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-08fb24a8-58cf-4dcb-8e6c-6b52b3500264 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:31.702867 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-08fb24a8-58cf-4dcb-8e6c-6b52b3500264 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:31.703327 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-08fb24a8-58cf-4dcb-8e6c-6b52b3500264 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:31.703776 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-08fb24a8-58cf-4dcb-8e6c-6b52b3500264 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:31.789633 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2c0d7ba3-93d2-432d-9016-dde679721a21 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:31.798741 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2c0d7ba3-93d2-432d-9016-dde679721a21 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.153261 Oct 11 06:58:31.799309 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1066/2114] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:31 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:31.831950 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-08fb24a8-58cf-4dcb-8e6c-6b52b3500264 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:31.841234 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-08fb24a8-58cf-4dcb-8e6c-6b52b3500264 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:31.842711 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-08fb24a8-58cf-4dcb-8e6c-6b52b3500264 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:31.843912 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-08fb24a8-58cf-4dcb-8e6c-6b52b3500264 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.153881 Oct 11 06:58:31.844469 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1049/2115] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:31 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:58:32.551123 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-814af2f7-9f3e-4c1c-a1e2-fb7b77904406 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:32.551791 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-814af2f7-9f3e-4c1c-a1e2-fb7b77904406 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:32.558467 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-814af2f7-9f3e-4c1c-a1e2-fb7b77904406 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:32.558949 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-814af2f7-9f3e-4c1c-a1e2-fb7b77904406 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:32.559686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-814af2f7-9f3e-4c1c-a1e2-fb7b77904406 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:32.560227 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-814af2f7-9f3e-4c1c-a1e2-fb7b77904406 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:32.560680 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-814af2f7-9f3e-4c1c-a1e2-fb7b77904406 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:32.561103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-814af2f7-9f3e-4c1c-a1e2-fb7b77904406 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:32.687443 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-814af2f7-9f3e-4c1c-a1e2-fb7b77904406 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:32.695632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-814af2f7-9f3e-4c1c-a1e2-fb7b77904406 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.148299 Oct 11 06:58:32.696191 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1067/2116] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:32 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:32.821901 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4fd3d7f1-9ada-4633-95c8-4e4df7f3f852 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:32.822512 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4fd3d7f1-9ada-4633-95c8-4e4df7f3f852 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:32.829077 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4fd3d7f1-9ada-4633-95c8-4e4df7f3f852 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:32.829557 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4fd3d7f1-9ada-4633-95c8-4e4df7f3f852 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:32.829986 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4fd3d7f1-9ada-4633-95c8-4e4df7f3f852 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:32.830676 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4fd3d7f1-9ada-4633-95c8-4e4df7f3f852 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:32.831127 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4fd3d7f1-9ada-4633-95c8-4e4df7f3f852 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:32.831583 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4fd3d7f1-9ada-4633-95c8-4e4df7f3f852 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:32.869565 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6defaaaa-a40e-4401-8345-30de60cf6d2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:32.870760 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6defaaaa-a40e-4401-8345-30de60cf6d2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:32.876640 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6defaaaa-a40e-4401-8345-30de60cf6d2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:32.877121 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6defaaaa-a40e-4401-8345-30de60cf6d2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:32.877553 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6defaaaa-a40e-4401-8345-30de60cf6d2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:32.878250 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6defaaaa-a40e-4401-8345-30de60cf6d2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:32.878696 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6defaaaa-a40e-4401-8345-30de60cf6d2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:32.879120 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6defaaaa-a40e-4401-8345-30de60cf6d2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:32.961196 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4fd3d7f1-9ada-4633-95c8-4e4df7f3f852 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:32.969491 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4fd3d7f1-9ada-4633-95c8-4e4df7f3f852 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.151314 Oct 11 06:58:32.970059 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1050/2117] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:32 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:33.008438 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6defaaaa-a40e-4401-8345-30de60cf6d2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:33.017292 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6defaaaa-a40e-4401-8345-30de60cf6d2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:33.018724 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6defaaaa-a40e-4401-8345-30de60cf6d2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:33.019903 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6defaaaa-a40e-4401-8345-30de60cf6d2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.154188 Oct 11 06:58:33.020453 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1068/2118] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:32 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:58:33.719360 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ed146028-3f10-45da-84aa-21173689513e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:33.719994 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ed146028-3f10-45da-84aa-21173689513e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:33.725927 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ed146028-3f10-45da-84aa-21173689513e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:33.726396 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ed146028-3f10-45da-84aa-21173689513e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:33.726821 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ed146028-3f10-45da-84aa-21173689513e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:33.727531 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ed146028-3f10-45da-84aa-21173689513e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:33.727980 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ed146028-3f10-45da-84aa-21173689513e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:33.728395 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ed146028-3f10-45da-84aa-21173689513e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:33.853141 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ed146028-3f10-45da-84aa-21173689513e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:33.861324 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ed146028-3f10-45da-84aa-21173689513e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.145817 Oct 11 06:58:33.861884 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1051/2119] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:33 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:58:33.993538 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-00ad69d1-8c1b-41da-a045-7395a765de65 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:33.994078 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-00ad69d1-8c1b-41da-a045-7395a765de65 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:34.000950 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-00ad69d1-8c1b-41da-a045-7395a765de65 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:34.001427 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-00ad69d1-8c1b-41da-a045-7395a765de65 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:34.001862 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-00ad69d1-8c1b-41da-a045-7395a765de65 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:34.002546 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-00ad69d1-8c1b-41da-a045-7395a765de65 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:34.002992 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-00ad69d1-8c1b-41da-a045-7395a765de65 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:34.003438 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-00ad69d1-8c1b-41da-a045-7395a765de65 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:34.045298 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-38428ee3-056a-44a4-afba-49e330d2fa29 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:34.045680 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-38428ee3-056a-44a4-afba-49e330d2fa29 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:34.052095 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38428ee3-056a-44a4-afba-49e330d2fa29 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:34.052577 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38428ee3-056a-44a4-afba-49e330d2fa29 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:34.053012 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38428ee3-056a-44a4-afba-49e330d2fa29 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:34.053713 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38428ee3-056a-44a4-afba-49e330d2fa29 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:34.054165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38428ee3-056a-44a4-afba-49e330d2fa29 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:34.054599 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38428ee3-056a-44a4-afba-49e330d2fa29 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:34.133309 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-00ad69d1-8c1b-41da-a045-7395a765de65 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:34.142088 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-00ad69d1-8c1b-41da-a045-7395a765de65 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.152428 Oct 11 06:58:34.142764 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1069/2120] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:33 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:34.183978 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-38428ee3-056a-44a4-afba-49e330d2fa29 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:34.192395 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-38428ee3-056a-44a4-afba-49e330d2fa29 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:34.193819 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-38428ee3-056a-44a4-afba-49e330d2fa29 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:34.194970 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-38428ee3-056a-44a4-afba-49e330d2fa29 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.153893 Oct 11 06:58:34.195537 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1052/2121] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:34 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:58:34.884810 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7b4d1009-d33c-4c5e-8304-ed936052d34e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:34.885418 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7b4d1009-d33c-4c5e-8304-ed936052d34e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:34.892484 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7b4d1009-d33c-4c5e-8304-ed936052d34e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:34.892956 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7b4d1009-d33c-4c5e-8304-ed936052d34e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:34.893384 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7b4d1009-d33c-4c5e-8304-ed936052d34e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:34.894063 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7b4d1009-d33c-4c5e-8304-ed936052d34e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:34.894505 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7b4d1009-d33c-4c5e-8304-ed936052d34e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:34.894923 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7b4d1009-d33c-4c5e-8304-ed936052d34e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:35.020659 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7b4d1009-d33c-4c5e-8304-ed936052d34e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:35.029329 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7b4d1009-d33c-4c5e-8304-ed936052d34e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.148386 Oct 11 06:58:35.029889 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1070/2122] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:34 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:35.165159 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2c0ea0da-e992-48f2-95e6-462f0e6f6293 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:35.165771 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2c0ea0da-e992-48f2-95e6-462f0e6f6293 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:35.172341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2c0ea0da-e992-48f2-95e6-462f0e6f6293 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:35.172817 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2c0ea0da-e992-48f2-95e6-462f0e6f6293 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:35.173251 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2c0ea0da-e992-48f2-95e6-462f0e6f6293 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:35.173933 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2c0ea0da-e992-48f2-95e6-462f0e6f6293 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:35.174381 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2c0ea0da-e992-48f2-95e6-462f0e6f6293 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:35.174802 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2c0ea0da-e992-48f2-95e6-462f0e6f6293 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:35.221286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-574dbb57-3e11-43b6-9ec8-a0d5bea3262e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:35.221841 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-574dbb57-3e11-43b6-9ec8-a0d5bea3262e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:35.227723 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-574dbb57-3e11-43b6-9ec8-a0d5bea3262e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:35.228194 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-574dbb57-3e11-43b6-9ec8-a0d5bea3262e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:35.228617 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-574dbb57-3e11-43b6-9ec8-a0d5bea3262e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:35.229318 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-574dbb57-3e11-43b6-9ec8-a0d5bea3262e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:35.229755 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-574dbb57-3e11-43b6-9ec8-a0d5bea3262e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:35.230168 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-574dbb57-3e11-43b6-9ec8-a0d5bea3262e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:35.308122 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2c0ea0da-e992-48f2-95e6-462f0e6f6293 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:35.316659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2c0ea0da-e992-48f2-95e6-462f0e6f6293 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.155236 Oct 11 06:58:35.317233 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1053/2123] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:35 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:35.363300 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-574dbb57-3e11-43b6-9ec8-a0d5bea3262e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:35.372506 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-574dbb57-3e11-43b6-9ec8-a0d5bea3262e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:35.373960 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-574dbb57-3e11-43b6-9ec8-a0d5bea3262e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:35.375105 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-574dbb57-3e11-43b6-9ec8-a0d5bea3262e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.157872 Oct 11 06:58:35.375677 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1071/2124] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:35 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:58:36.052470 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7695c88c-3046-47bd-8cc3-bc2987b5454e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:36.053031 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7695c88c-3046-47bd-8cc3-bc2987b5454e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:36.059138 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7695c88c-3046-47bd-8cc3-bc2987b5454e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:36.059650 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7695c88c-3046-47bd-8cc3-bc2987b5454e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:36.060076 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7695c88c-3046-47bd-8cc3-bc2987b5454e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:36.060783 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7695c88c-3046-47bd-8cc3-bc2987b5454e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:36.061229 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7695c88c-3046-47bd-8cc3-bc2987b5454e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:36.061644 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7695c88c-3046-47bd-8cc3-bc2987b5454e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:36.185957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7695c88c-3046-47bd-8cc3-bc2987b5454e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:36.194087 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7695c88c-3046-47bd-8cc3-bc2987b5454e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.145548 Oct 11 06:58:36.194642 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1054/2125] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:36 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:36.340845 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-05032959-f968-4361-a713-937cb6ee2c48 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:36.341365 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-05032959-f968-4361-a713-937cb6ee2c48 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:36.343714 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=78 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:58:36.348994 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05032959-f968-4361-a713-937cb6ee2c48 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:36.349468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05032959-f968-4361-a713-937cb6ee2c48 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:36.349898 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05032959-f968-4361-a713-937cb6ee2c48 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:36.350578 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05032959-f968-4361-a713-937cb6ee2c48 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:36.351023 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05032959-f968-4361-a713-937cb6ee2c48 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:36.351532 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05032959-f968-4361-a713-937cb6ee2c48 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:36.407327 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-30831813-d311-4c6b-81ec-0b431b62aa46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:36.407327 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-30831813-d311-4c6b-81ec-0b431b62aa46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:36.409990 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30831813-d311-4c6b-81ec-0b431b62aa46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:36.410321 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30831813-d311-4c6b-81ec-0b431b62aa46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:36.410754 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30831813-d311-4c6b-81ec-0b431b62aa46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:36.411479 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30831813-d311-4c6b-81ec-0b431b62aa46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:36.411931 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30831813-d311-4c6b-81ec-0b431b62aa46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:36.412352 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30831813-d311-4c6b-81ec-0b431b62aa46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:36.490017 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-05032959-f968-4361-a713-937cb6ee2c48 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:36.498244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-05032959-f968-4361-a713-937cb6ee2c48 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.161836 Oct 11 06:58:36.498850 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1072/2126] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:36 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:36.544055 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-30831813-d311-4c6b-81ec-0b431b62aa46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:36.552686 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-30831813-d311-4c6b-81ec-0b431b62aa46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:36.554121 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-30831813-d311-4c6b-81ec-0b431b62aa46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:36.555259 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-30831813-d311-4c6b-81ec-0b431b62aa46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.157257 Oct 11 06:58:36.555845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1055/2127] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:36 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:58:37.216918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5fe0af5a-3b96-4b4d-935f-c50a4ce7b721 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:37.217519 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5fe0af5a-3b96-4b4d-935f-c50a4ce7b721 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:37.223445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5fe0af5a-3b96-4b4d-935f-c50a4ce7b721 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:37.223918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5fe0af5a-3b96-4b4d-935f-c50a4ce7b721 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:37.224344 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5fe0af5a-3b96-4b4d-935f-c50a4ce7b721 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:37.225008 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5fe0af5a-3b96-4b4d-935f-c50a4ce7b721 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:37.225445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5fe0af5a-3b96-4b4d-935f-c50a4ce7b721 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:37.225854 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5fe0af5a-3b96-4b4d-935f-c50a4ce7b721 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:37.353431 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5fe0af5a-3b96-4b4d-935f-c50a4ce7b721 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:37.362028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5fe0af5a-3b96-4b4d-935f-c50a4ce7b721 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.148922 Oct 11 06:58:37.362596 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1073/2128] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:37 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:37.522246 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-87629e5d-2ae3-46d3-b098-6117d774573c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:37.522861 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-87629e5d-2ae3-46d3-b098-6117d774573c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:37.529932 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87629e5d-2ae3-46d3-b098-6117d774573c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:37.530413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87629e5d-2ae3-46d3-b098-6117d774573c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:37.530842 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87629e5d-2ae3-46d3-b098-6117d774573c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:37.531559 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87629e5d-2ae3-46d3-b098-6117d774573c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:37.532016 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87629e5d-2ae3-46d3-b098-6117d774573c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:37.532434 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87629e5d-2ae3-46d3-b098-6117d774573c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:37.580761 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c06b63ee-8b49-4186-8132-a7f47ab9c2c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:37.581461 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c06b63ee-8b49-4186-8132-a7f47ab9c2c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:37.587407 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c06b63ee-8b49-4186-8132-a7f47ab9c2c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:37.587985 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c06b63ee-8b49-4186-8132-a7f47ab9c2c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:37.588508 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c06b63ee-8b49-4186-8132-a7f47ab9c2c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:37.589769 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c06b63ee-8b49-4186-8132-a7f47ab9c2c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:37.590287 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c06b63ee-8b49-4186-8132-a7f47ab9c2c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:37.590781 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c06b63ee-8b49-4186-8132-a7f47ab9c2c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:37.659721 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-87629e5d-2ae3-46d3-b098-6117d774573c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:37.668465 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-87629e5d-2ae3-46d3-b098-6117d774573c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.149945 Oct 11 06:58:37.669298 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1056/2129] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:37 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:37.717559 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c06b63ee-8b49-4186-8132-a7f47ab9c2c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:37.726085 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c06b63ee-8b49-4186-8132-a7f47ab9c2c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:37.727999 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c06b63ee-8b49-4186-8132-a7f47ab9c2c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:37.728637 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c06b63ee-8b49-4186-8132-a7f47ab9c2c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.151931 Oct 11 06:58:37.729190 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1074/2130] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:37 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:58:38.387423 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0e1ff682-e2f6-4437-9b8f-a53a658b9b22 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:38.388052 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0e1ff682-e2f6-4437-9b8f-a53a658b9b22 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:38.394271 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0e1ff682-e2f6-4437-9b8f-a53a658b9b22 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:38.394743 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0e1ff682-e2f6-4437-9b8f-a53a658b9b22 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:38.395173 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0e1ff682-e2f6-4437-9b8f-a53a658b9b22 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:38.395883 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0e1ff682-e2f6-4437-9b8f-a53a658b9b22 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:38.396337 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0e1ff682-e2f6-4437-9b8f-a53a658b9b22 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:38.396756 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0e1ff682-e2f6-4437-9b8f-a53a658b9b22 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:38.524839 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0e1ff682-e2f6-4437-9b8f-a53a658b9b22 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:38.533658 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0e1ff682-e2f6-4437-9b8f-a53a658b9b22 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150658 Oct 11 06:58:38.534221 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1057/2131] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:38 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:38.691593 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-87c042ea-0e5c-4a9d-bfe9-5c782f16dae9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:38.692126 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-87c042ea-0e5c-4a9d-bfe9-5c782f16dae9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:38.699081 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-87c042ea-0e5c-4a9d-bfe9-5c782f16dae9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:38.699591 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-87c042ea-0e5c-4a9d-bfe9-5c782f16dae9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:38.700021 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-87c042ea-0e5c-4a9d-bfe9-5c782f16dae9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:38.700706 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-87c042ea-0e5c-4a9d-bfe9-5c782f16dae9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:38.701147 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-87c042ea-0e5c-4a9d-bfe9-5c782f16dae9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:38.701568 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-87c042ea-0e5c-4a9d-bfe9-5c782f16dae9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:38.754143 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-698c0c1c-4677-4793-b2e9-3c0b213a0244 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:38.754746 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-698c0c1c-4677-4793-b2e9-3c0b213a0244 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:38.761285 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-698c0c1c-4677-4793-b2e9-3c0b213a0244 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:38.761761 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-698c0c1c-4677-4793-b2e9-3c0b213a0244 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:38.762191 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-698c0c1c-4677-4793-b2e9-3c0b213a0244 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:38.762880 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-698c0c1c-4677-4793-b2e9-3c0b213a0244 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:38.763324 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-698c0c1c-4677-4793-b2e9-3c0b213a0244 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:38.763765 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-698c0c1c-4677-4793-b2e9-3c0b213a0244 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:38.833370 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-87c042ea-0e5c-4a9d-bfe9-5c782f16dae9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:38.842234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-87c042ea-0e5c-4a9d-bfe9-5c782f16dae9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.154488 Oct 11 06:58:38.842803 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1075/2132] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:38 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:38.893205 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-698c0c1c-4677-4793-b2e9-3c0b213a0244 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:38.902434 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-698c0c1c-4677-4793-b2e9-3c0b213a0244 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:38.903901 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-698c0c1c-4677-4793-b2e9-3c0b213a0244 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:38.905060 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-698c0c1c-4677-4793-b2e9-3c0b213a0244 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.154815 Oct 11 06:58:38.905605 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1058/2133] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:38 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:58:39.556360 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c05dd28d-03a7-485d-b36e-5cb319b0395a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:39.556932 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c05dd28d-03a7-485d-b36e-5cb319b0395a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:39.563813 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c05dd28d-03a7-485d-b36e-5cb319b0395a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:39.564222 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c05dd28d-03a7-485d-b36e-5cb319b0395a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:39.564649 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c05dd28d-03a7-485d-b36e-5cb319b0395a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:39.565339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c05dd28d-03a7-485d-b36e-5cb319b0395a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:39.565781 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c05dd28d-03a7-485d-b36e-5cb319b0395a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:39.566201 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c05dd28d-03a7-485d-b36e-5cb319b0395a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:39.692259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c05dd28d-03a7-485d-b36e-5cb319b0395a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:39.700407 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c05dd28d-03a7-485d-b36e-5cb319b0395a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.147969 Oct 11 06:58:39.700957 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1076/2134] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:39 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:39.867027 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2f6a797c-d7ca-423f-85c9-02202b44a4c4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:39.867787 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2f6a797c-d7ca-423f-85c9-02202b44a4c4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:39.874235 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2f6a797c-d7ca-423f-85c9-02202b44a4c4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:39.874716 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2f6a797c-d7ca-423f-85c9-02202b44a4c4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:39.875149 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2f6a797c-d7ca-423f-85c9-02202b44a4c4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:39.875886 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2f6a797c-d7ca-423f-85c9-02202b44a4c4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:39.876338 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2f6a797c-d7ca-423f-85c9-02202b44a4c4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:39.876761 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2f6a797c-d7ca-423f-85c9-02202b44a4c4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:39.930051 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c1c78f94-a9da-4467-95e5-c9e7e5d46d52 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:39.930769 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c1c78f94-a9da-4467-95e5-c9e7e5d46d52 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:39.936761 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c1c78f94-a9da-4467-95e5-c9e7e5d46d52 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:39.937233 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c1c78f94-a9da-4467-95e5-c9e7e5d46d52 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:39.937691 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c1c78f94-a9da-4467-95e5-c9e7e5d46d52 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:39.938406 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c1c78f94-a9da-4467-95e5-c9e7e5d46d52 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:39.938851 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c1c78f94-a9da-4467-95e5-c9e7e5d46d52 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:39.939268 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c1c78f94-a9da-4467-95e5-c9e7e5d46d52 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:40.012224 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2f6a797c-d7ca-423f-85c9-02202b44a4c4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:40.020899 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2f6a797c-d7ca-423f-85c9-02202b44a4c4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.157730 Oct 11 06:58:40.021537 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1059/2135] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:39 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:40.069777 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c1c78f94-a9da-4467-95e5-c9e7e5d46d52 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:40.078814 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c1c78f94-a9da-4467-95e5-c9e7e5d46d52 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:40.080272 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c1c78f94-a9da-4467-95e5-c9e7e5d46d52 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:40.081419 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c1c78f94-a9da-4467-95e5-c9e7e5d46d52 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.155234 Oct 11 06:58:40.081967 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1077/2136] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:39 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:58:40.724085 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c8a22692-bf9c-43e3-bba9-606426d8b804 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:40.724881 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c8a22692-bf9c-43e3-bba9-606426d8b804 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:40.731012 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8a22692-bf9c-43e3-bba9-606426d8b804 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:40.731524 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8a22692-bf9c-43e3-bba9-606426d8b804 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:40.731966 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8a22692-bf9c-43e3-bba9-606426d8b804 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:40.732661 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8a22692-bf9c-43e3-bba9-606426d8b804 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:40.733113 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8a22692-bf9c-43e3-bba9-606426d8b804 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:40.733536 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8a22692-bf9c-43e3-bba9-606426d8b804 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:40.863786 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c8a22692-bf9c-43e3-bba9-606426d8b804 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:40.873013 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c8a22692-bf9c-43e3-bba9-606426d8b804 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.152986 Oct 11 06:58:40.873605 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1060/2137] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:40 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:41.044870 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4f8fdffd-0b2b-4771-b7f4-ad42f8024f23 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:41.045476 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4f8fdffd-0b2b-4771-b7f4-ad42f8024f23 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:41.051756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f8fdffd-0b2b-4771-b7f4-ad42f8024f23 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:41.052225 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f8fdffd-0b2b-4771-b7f4-ad42f8024f23 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:41.052651 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f8fdffd-0b2b-4771-b7f4-ad42f8024f23 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:41.053332 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f8fdffd-0b2b-4771-b7f4-ad42f8024f23 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:41.053774 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f8fdffd-0b2b-4771-b7f4-ad42f8024f23 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:41.054190 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f8fdffd-0b2b-4771-b7f4-ad42f8024f23 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:41.107002 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1d4ac2d4-68a6-4dad-b483-e00dd8a67c13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:41.107725 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1d4ac2d4-68a6-4dad-b483-e00dd8a67c13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:41.113700 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d4ac2d4-68a6-4dad-b483-e00dd8a67c13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:41.114241 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d4ac2d4-68a6-4dad-b483-e00dd8a67c13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:41.114866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d4ac2d4-68a6-4dad-b483-e00dd8a67c13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:41.115578 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d4ac2d4-68a6-4dad-b483-e00dd8a67c13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:41.116025 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d4ac2d4-68a6-4dad-b483-e00dd8a67c13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:41.116444 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d4ac2d4-68a6-4dad-b483-e00dd8a67c13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:41.120615 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:58:41.186098 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4f8fdffd-0b2b-4771-b7f4-ad42f8024f23 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:41.194215 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4f8fdffd-0b2b-4771-b7f4-ad42f8024f23 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.153589 Oct 11 06:58:41.195131 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1078/2138] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:41 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:41.244298 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1d4ac2d4-68a6-4dad-b483-e00dd8a67c13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:41.252798 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1d4ac2d4-68a6-4dad-b483-e00dd8a67c13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:41.254214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1d4ac2d4-68a6-4dad-b483-e00dd8a67c13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:41.255348 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1d4ac2d4-68a6-4dad-b483-e00dd8a67c13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152866 Oct 11 06:58:41.255960 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1061/2139] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:41 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:58:41.896073 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5a0bf99b-8ada-4f1b-b27e-eaf65e469945 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:41.896685 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5a0bf99b-8ada-4f1b-b27e-eaf65e469945 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:41.903258 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5a0bf99b-8ada-4f1b-b27e-eaf65e469945 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:41.903752 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5a0bf99b-8ada-4f1b-b27e-eaf65e469945 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:41.904187 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5a0bf99b-8ada-4f1b-b27e-eaf65e469945 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:41.904872 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5a0bf99b-8ada-4f1b-b27e-eaf65e469945 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:41.905320 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5a0bf99b-8ada-4f1b-b27e-eaf65e469945 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:41.905741 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5a0bf99b-8ada-4f1b-b27e-eaf65e469945 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:42.034274 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5a0bf99b-8ada-4f1b-b27e-eaf65e469945 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:42.042393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5a0bf99b-8ada-4f1b-b27e-eaf65e469945 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150112 Oct 11 06:58:42.042961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1079/2140] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:41 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:42.217317 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a6fea875-87eb-4c0c-b3c8-c46d1c7afbfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:42.217921 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a6fea875-87eb-4c0c-b3c8-c46d1c7afbfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:42.224323 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6fea875-87eb-4c0c-b3c8-c46d1c7afbfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:42.224798 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6fea875-87eb-4c0c-b3c8-c46d1c7afbfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:42.225228 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6fea875-87eb-4c0c-b3c8-c46d1c7afbfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:42.225915 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6fea875-87eb-4c0c-b3c8-c46d1c7afbfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:42.226359 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6fea875-87eb-4c0c-b3c8-c46d1c7afbfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:42.226781 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6fea875-87eb-4c0c-b3c8-c46d1c7afbfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:42.280938 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-955ea9b4-7bfd-4017-8970-9cfef4cf4379 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:42.281488 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-955ea9b4-7bfd-4017-8970-9cfef4cf4379 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:42.287715 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-955ea9b4-7bfd-4017-8970-9cfef4cf4379 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:42.288187 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-955ea9b4-7bfd-4017-8970-9cfef4cf4379 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:42.288613 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-955ea9b4-7bfd-4017-8970-9cfef4cf4379 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:42.289297 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-955ea9b4-7bfd-4017-8970-9cfef4cf4379 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:42.289740 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-955ea9b4-7bfd-4017-8970-9cfef4cf4379 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:42.290165 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-955ea9b4-7bfd-4017-8970-9cfef4cf4379 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:42.357475 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a6fea875-87eb-4c0c-b3c8-c46d1c7afbfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:42.365700 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a6fea875-87eb-4c0c-b3c8-c46d1c7afbfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.152413 Oct 11 06:58:42.366645 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1062/2141] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:42 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:42.425394 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-955ea9b4-7bfd-4017-8970-9cfef4cf4379 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:42.433443 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-955ea9b4-7bfd-4017-8970-9cfef4cf4379 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:42.434864 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-955ea9b4-7bfd-4017-8970-9cfef4cf4379 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:42.436040 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-955ea9b4-7bfd-4017-8970-9cfef4cf4379 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.159184 Oct 11 06:58:42.436586 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1080/2142] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:42 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:58:43.066290 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f1a3efbc-53fd-483a-aa3b-d244d0549933 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:43.066821 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f1a3efbc-53fd-483a-aa3b-d244d0549933 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:43.072867 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f1a3efbc-53fd-483a-aa3b-d244d0549933 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:43.073339 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f1a3efbc-53fd-483a-aa3b-d244d0549933 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:43.073766 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f1a3efbc-53fd-483a-aa3b-d244d0549933 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:43.074451 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f1a3efbc-53fd-483a-aa3b-d244d0549933 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:43.075503 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f1a3efbc-53fd-483a-aa3b-d244d0549933 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:43.075924 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f1a3efbc-53fd-483a-aa3b-d244d0549933 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:43.202486 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f1a3efbc-53fd-483a-aa3b-d244d0549933 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:43.210562 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f1a3efbc-53fd-483a-aa3b-d244d0549933 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.148286 Oct 11 06:58:43.211136 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1063/2143] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:43 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:43.394065 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a6686d2d-2509-459b-a5fc-a426f47969b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:43.394671 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a6686d2d-2509-459b-a5fc-a426f47969b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:43.401041 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6686d2d-2509-459b-a5fc-a426f47969b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:43.401517 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6686d2d-2509-459b-a5fc-a426f47969b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:43.401950 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6686d2d-2509-459b-a5fc-a426f47969b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:43.402632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6686d2d-2509-459b-a5fc-a426f47969b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:43.403078 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6686d2d-2509-459b-a5fc-a426f47969b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:43.403522 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6686d2d-2509-459b-a5fc-a426f47969b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:43.421830 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:58:43.461525 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-febcc2fa-a641-46d5-a98e-55a99a8e689b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:43.462233 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-febcc2fa-a641-46d5-a98e-55a99a8e689b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:43.469230 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-febcc2fa-a641-46d5-a98e-55a99a8e689b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:43.469709 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-febcc2fa-a641-46d5-a98e-55a99a8e689b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:43.470146 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-febcc2fa-a641-46d5-a98e-55a99a8e689b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:43.470841 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-febcc2fa-a641-46d5-a98e-55a99a8e689b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:43.471292 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-febcc2fa-a641-46d5-a98e-55a99a8e689b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:43.471740 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-febcc2fa-a641-46d5-a98e-55a99a8e689b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:43.533191 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a6686d2d-2509-459b-a5fc-a426f47969b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:43.541641 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a6686d2d-2509-459b-a5fc-a426f47969b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.151329 Oct 11 06:58:43.542200 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1081/2144] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:43 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:43.597271 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-febcc2fa-a641-46d5-a98e-55a99a8e689b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:43.605822 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-febcc2fa-a641-46d5-a98e-55a99a8e689b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:43.607878 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-febcc2fa-a641-46d5-a98e-55a99a8e689b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:43.609114 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-febcc2fa-a641-46d5-a98e-55a99a8e689b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.151582 Oct 11 06:58:43.609663 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1064/2145] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:43 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:58:44.233483 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b2d95e08-d61d-4558-9ffd-3b15c6c4ef48 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:44.234097 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b2d95e08-d61d-4558-9ffd-3b15c6c4ef48 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:44.240041 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b2d95e08-d61d-4558-9ffd-3b15c6c4ef48 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:44.240517 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b2d95e08-d61d-4558-9ffd-3b15c6c4ef48 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:44.240946 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b2d95e08-d61d-4558-9ffd-3b15c6c4ef48 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:44.241630 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b2d95e08-d61d-4558-9ffd-3b15c6c4ef48 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:44.242076 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b2d95e08-d61d-4558-9ffd-3b15c6c4ef48 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:44.242501 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b2d95e08-d61d-4558-9ffd-3b15c6c4ef48 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:44.367121 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b2d95e08-d61d-4558-9ffd-3b15c6c4ef48 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:44.375832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b2d95e08-d61d-4558-9ffd-3b15c6c4ef48 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.146080 Oct 11 06:58:44.376390 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1082/2146] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:44 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:44.565279 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-17c1edea-692e-4b55-86f2-f1ccb0c6dc73 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:44.565892 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-17c1edea-692e-4b55-86f2-f1ccb0c6dc73 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:44.572370 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17c1edea-692e-4b55-86f2-f1ccb0c6dc73 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:44.572848 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17c1edea-692e-4b55-86f2-f1ccb0c6dc73 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:44.573284 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17c1edea-692e-4b55-86f2-f1ccb0c6dc73 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:44.573974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17c1edea-692e-4b55-86f2-f1ccb0c6dc73 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:44.574459 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17c1edea-692e-4b55-86f2-f1ccb0c6dc73 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:44.575514 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17c1edea-692e-4b55-86f2-f1ccb0c6dc73 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:44.635798 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9c4e79a1-1497-4c9a-9c1c-0d79f940860d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:44.636408 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9c4e79a1-1497-4c9a-9c1c-0d79f940860d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:44.643723 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c4e79a1-1497-4c9a-9c1c-0d79f940860d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:44.643723 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c4e79a1-1497-4c9a-9c1c-0d79f940860d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:44.644073 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c4e79a1-1497-4c9a-9c1c-0d79f940860d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:44.644875 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c4e79a1-1497-4c9a-9c1c-0d79f940860d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:44.645333 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c4e79a1-1497-4c9a-9c1c-0d79f940860d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:44.645762 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c4e79a1-1497-4c9a-9c1c-0d79f940860d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:44.707846 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-17c1edea-692e-4b55-86f2-f1ccb0c6dc73 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:44.716339 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-17c1edea-692e-4b55-86f2-f1ccb0c6dc73 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.154870 Oct 11 06:58:44.716908 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1065/2147] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:44 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:44.776537 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9c4e79a1-1497-4c9a-9c1c-0d79f940860d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:44.785052 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9c4e79a1-1497-4c9a-9c1c-0d79f940860d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:44.786490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9c4e79a1-1497-4c9a-9c1c-0d79f940860d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:44.787675 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9c4e79a1-1497-4c9a-9c1c-0d79f940860d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.155698 Oct 11 06:58:44.788223 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1083/2148] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:44 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:58:45.399821 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ed5dd86f-9c52-4da6-bb88-f9f909bd25c9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:45.400432 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ed5dd86f-9c52-4da6-bb88-f9f909bd25c9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:45.407288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ed5dd86f-9c52-4da6-bb88-f9f909bd25c9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:45.407797 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ed5dd86f-9c52-4da6-bb88-f9f909bd25c9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:45.408521 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ed5dd86f-9c52-4da6-bb88-f9f909bd25c9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:45.408901 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ed5dd86f-9c52-4da6-bb88-f9f909bd25c9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:45.409353 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ed5dd86f-9c52-4da6-bb88-f9f909bd25c9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:45.409773 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ed5dd86f-9c52-4da6-bb88-f9f909bd25c9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:45.534672 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ed5dd86f-9c52-4da6-bb88-f9f909bd25c9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:45.542784 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ed5dd86f-9c52-4da6-bb88-f9f909bd25c9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.146803 Oct 11 06:58:45.543321 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1066/2149] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:45 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:45.739826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-18ce0d0e-8e86-4b3f-aee5-e92cac63553f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:45.740434 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-18ce0d0e-8e86-4b3f-aee5-e92cac63553f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:45.747262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18ce0d0e-8e86-4b3f-aee5-e92cac63553f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:45.748419 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18ce0d0e-8e86-4b3f-aee5-e92cac63553f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:45.748853 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18ce0d0e-8e86-4b3f-aee5-e92cac63553f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:45.749540 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18ce0d0e-8e86-4b3f-aee5-e92cac63553f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:45.749990 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18ce0d0e-8e86-4b3f-aee5-e92cac63553f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:45.750416 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18ce0d0e-8e86-4b3f-aee5-e92cac63553f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:45.814044 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e3e3d94d-4ac5-486c-ad62-31a21c9f9b3b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:45.814595 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e3e3d94d-4ac5-486c-ad62-31a21c9f9b3b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:45.820886 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e3e3d94d-4ac5-486c-ad62-31a21c9f9b3b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:45.821361 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e3e3d94d-4ac5-486c-ad62-31a21c9f9b3b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:45.821793 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e3e3d94d-4ac5-486c-ad62-31a21c9f9b3b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:45.822500 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e3e3d94d-4ac5-486c-ad62-31a21c9f9b3b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:45.822962 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e3e3d94d-4ac5-486c-ad62-31a21c9f9b3b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:45.823385 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e3e3d94d-4ac5-486c-ad62-31a21c9f9b3b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:45.884816 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-18ce0d0e-8e86-4b3f-aee5-e92cac63553f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:45.893851 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-18ce0d0e-8e86-4b3f-aee5-e92cac63553f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.157880 Oct 11 06:58:45.894421 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1084/2150] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:45 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:45.957035 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e3e3d94d-4ac5-486c-ad62-31a21c9f9b3b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:45.965700 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e3e3d94d-4ac5-486c-ad62-31a21c9f9b3b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:45.967180 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e3e3d94d-4ac5-486c-ad62-31a21c9f9b3b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:45.968375 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e3e3d94d-4ac5-486c-ad62-31a21c9f9b3b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.158887 Oct 11 06:58:45.968919 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1067/2151] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:45 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:58:46.564740 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f826de4e-be60-4987-b681-2bdba67c9e31 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:46.565325 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f826de4e-be60-4987-b681-2bdba67c9e31 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:46.571272 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f826de4e-be60-4987-b681-2bdba67c9e31 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:46.571776 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f826de4e-be60-4987-b681-2bdba67c9e31 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:46.572201 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f826de4e-be60-4987-b681-2bdba67c9e31 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:46.572876 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f826de4e-be60-4987-b681-2bdba67c9e31 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:46.573321 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f826de4e-be60-4987-b681-2bdba67c9e31 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:46.573740 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f826de4e-be60-4987-b681-2bdba67c9e31 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:46.700926 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f826de4e-be60-4987-b681-2bdba67c9e31 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:46.709024 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f826de4e-be60-4987-b681-2bdba67c9e31 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.148180 Oct 11 06:58:46.709576 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1085/2152] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:46 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:46.917165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-163eb0ec-b47b-44b7-a89a-31c28d3e69db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:46.917772 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-163eb0ec-b47b-44b7-a89a-31c28d3e69db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:46.924206 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-163eb0ec-b47b-44b7-a89a-31c28d3e69db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:46.924693 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-163eb0ec-b47b-44b7-a89a-31c28d3e69db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:46.925113 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-163eb0ec-b47b-44b7-a89a-31c28d3e69db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:46.925799 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-163eb0ec-b47b-44b7-a89a-31c28d3e69db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:46.926245 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-163eb0ec-b47b-44b7-a89a-31c28d3e69db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:46.926663 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-163eb0ec-b47b-44b7-a89a-31c28d3e69db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:46.993265 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8f071197-622e-43a2-9aae-6c489b5ec717 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:46.993878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8f071197-622e-43a2-9aae-6c489b5ec717 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:47.000321 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f071197-622e-43a2-9aae-6c489b5ec717 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:47.000797 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f071197-622e-43a2-9aae-6c489b5ec717 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:47.001228 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f071197-622e-43a2-9aae-6c489b5ec717 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:47.002007 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f071197-622e-43a2-9aae-6c489b5ec717 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:47.002347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f071197-622e-43a2-9aae-6c489b5ec717 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:47.002764 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f071197-622e-43a2-9aae-6c489b5ec717 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:47.058723 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-163eb0ec-b47b-44b7-a89a-31c28d3e69db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:47.067629 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-163eb0ec-b47b-44b7-a89a-31c28d3e69db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.154294 Oct 11 06:58:47.068195 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1068/2153] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:46 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:47.132142 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8f071197-622e-43a2-9aae-6c489b5ec717 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:47.140817 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8f071197-622e-43a2-9aae-6c489b5ec717 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:47.142253 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8f071197-622e-43a2-9aae-6c489b5ec717 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:47.143499 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8f071197-622e-43a2-9aae-6c489b5ec717 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.154022 Oct 11 06:58:47.144060 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1086/2154] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:46 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:58:47.732830 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3e7145f0-70e1-4489-a0c8-4ce3ad5a66f6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:47.733441 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3e7145f0-70e1-4489-a0c8-4ce3ad5a66f6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:47.739468 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e7145f0-70e1-4489-a0c8-4ce3ad5a66f6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:47.739950 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e7145f0-70e1-4489-a0c8-4ce3ad5a66f6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:47.740386 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e7145f0-70e1-4489-a0c8-4ce3ad5a66f6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:47.741081 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e7145f0-70e1-4489-a0c8-4ce3ad5a66f6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:47.741535 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e7145f0-70e1-4489-a0c8-4ce3ad5a66f6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:47.741960 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e7145f0-70e1-4489-a0c8-4ce3ad5a66f6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:47.866631 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3e7145f0-70e1-4489-a0c8-4ce3ad5a66f6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:47.874807 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3e7145f0-70e1-4489-a0c8-4ce3ad5a66f6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.146158 Oct 11 06:58:47.875368 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1069/2155] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:47 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:48.090483 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-28bbb53c-6019-46bb-b2cb-83494bc74845 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:48.091091 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-28bbb53c-6019-46bb-b2cb-83494bc74845 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:48.097499 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28bbb53c-6019-46bb-b2cb-83494bc74845 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:48.097973 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28bbb53c-6019-46bb-b2cb-83494bc74845 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:48.098401 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28bbb53c-6019-46bb-b2cb-83494bc74845 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:48.099080 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28bbb53c-6019-46bb-b2cb-83494bc74845 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:48.099556 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28bbb53c-6019-46bb-b2cb-83494bc74845 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:48.099975 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28bbb53c-6019-46bb-b2cb-83494bc74845 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:48.169244 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-de418c90-59de-412e-849c-1aa359dcd992 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:48.169852 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-de418c90-59de-412e-849c-1aa359dcd992 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:48.175772 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-de418c90-59de-412e-849c-1aa359dcd992 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:48.176251 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-de418c90-59de-412e-849c-1aa359dcd992 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:48.176681 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-de418c90-59de-412e-849c-1aa359dcd992 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:48.177374 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-de418c90-59de-412e-849c-1aa359dcd992 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:48.177823 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-de418c90-59de-412e-849c-1aa359dcd992 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:48.178242 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-de418c90-59de-412e-849c-1aa359dcd992 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:48.230685 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-28bbb53c-6019-46bb-b2cb-83494bc74845 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:48.239368 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-28bbb53c-6019-46bb-b2cb-83494bc74845 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.152651 Oct 11 06:58:48.239957 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1087/2156] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:48 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:48.309493 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-de418c90-59de-412e-849c-1aa359dcd992 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:48.318687 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-de418c90-59de-412e-849c-1aa359dcd992 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:48.320148 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-de418c90-59de-412e-849c-1aa359dcd992 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:48.321285 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-de418c90-59de-412e-849c-1aa359dcd992 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.155946 Oct 11 06:58:48.321834 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1070/2157] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:48 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:58:48.898083 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-456290ba-cf94-4706-8e22-647f1f20ea23 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:48.898687 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-456290ba-cf94-4706-8e22-647f1f20ea23 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:48.905096 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-456290ba-cf94-4706-8e22-647f1f20ea23 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:48.905571 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-456290ba-cf94-4706-8e22-647f1f20ea23 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:48.905997 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-456290ba-cf94-4706-8e22-647f1f20ea23 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:48.906685 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-456290ba-cf94-4706-8e22-647f1f20ea23 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:48.907130 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-456290ba-cf94-4706-8e22-647f1f20ea23 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:48.907580 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-456290ba-cf94-4706-8e22-647f1f20ea23 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:49.031967 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-456290ba-cf94-4706-8e22-647f1f20ea23 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:49.040008 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-456290ba-cf94-4706-8e22-647f1f20ea23 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.145872 Oct 11 06:58:49.040566 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1088/2158] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:48 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:49.263856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0a8038ba-60c6-4d51-abc3-11af4cda53ea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:49.264644 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0a8038ba-60c6-4d51-abc3-11af4cda53ea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:49.266985 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=80 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:58:49.272153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0a8038ba-60c6-4d51-abc3-11af4cda53ea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:49.272627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0a8038ba-60c6-4d51-abc3-11af4cda53ea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:49.273062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0a8038ba-60c6-4d51-abc3-11af4cda53ea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:49.273746 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0a8038ba-60c6-4d51-abc3-11af4cda53ea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:49.274200 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0a8038ba-60c6-4d51-abc3-11af4cda53ea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:49.274618 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0a8038ba-60c6-4d51-abc3-11af4cda53ea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:49.346741 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a863ef1a-2bd1-4db6-8b66-d0dbe520c987 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:49.347346 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a863ef1a-2bd1-4db6-8b66-d0dbe520c987 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:49.353768 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a863ef1a-2bd1-4db6-8b66-d0dbe520c987 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:49.354247 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a863ef1a-2bd1-4db6-8b66-d0dbe520c987 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:49.354677 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a863ef1a-2bd1-4db6-8b66-d0dbe520c987 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:49.355362 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a863ef1a-2bd1-4db6-8b66-d0dbe520c987 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:49.355834 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a863ef1a-2bd1-4db6-8b66-d0dbe520c987 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:49.356256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a863ef1a-2bd1-4db6-8b66-d0dbe520c987 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:49.400357 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0a8038ba-60c6-4d51-abc3-11af4cda53ea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:49.409565 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0a8038ba-60c6-4d51-abc3-11af4cda53ea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.150063 Oct 11 06:58:49.410139 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1071/2159] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:49 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:49.489433 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a863ef1a-2bd1-4db6-8b66-d0dbe520c987 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:49.498546 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a863ef1a-2bd1-4db6-8b66-d0dbe520c987 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:49.500042 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a863ef1a-2bd1-4db6-8b66-d0dbe520c987 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:49.501188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a863ef1a-2bd1-4db6-8b66-d0dbe520c987 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.158444 Oct 11 06:58:49.501736 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1089/2160] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:49 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:58:50.063986 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3c418443-4d4b-4040-bef1-bcd830ec8817 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:50.064594 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3c418443-4d4b-4040-bef1-bcd830ec8817 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:50.070506 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c418443-4d4b-4040-bef1-bcd830ec8817 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:50.070976 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c418443-4d4b-4040-bef1-bcd830ec8817 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:50.071404 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c418443-4d4b-4040-bef1-bcd830ec8817 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:50.072107 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c418443-4d4b-4040-bef1-bcd830ec8817 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:50.072555 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c418443-4d4b-4040-bef1-bcd830ec8817 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:50.072975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c418443-4d4b-4040-bef1-bcd830ec8817 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:50.201735 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3c418443-4d4b-4040-bef1-bcd830ec8817 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:50.209736 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3c418443-4d4b-4040-bef1-bcd830ec8817 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150258 Oct 11 06:58:50.210280 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1072/2161] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:50 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:50.432904 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0714ace6-a8e0-4f2a-8b14-8aec307d12b5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:50.433509 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0714ace6-a8e0-4f2a-8b14-8aec307d12b5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:50.441904 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0714ace6-a8e0-4f2a-8b14-8aec307d12b5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:50.442377 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0714ace6-a8e0-4f2a-8b14-8aec307d12b5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:50.442810 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0714ace6-a8e0-4f2a-8b14-8aec307d12b5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:50.443534 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0714ace6-a8e0-4f2a-8b14-8aec307d12b5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:50.443983 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0714ace6-a8e0-4f2a-8b14-8aec307d12b5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:50.444401 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0714ace6-a8e0-4f2a-8b14-8aec307d12b5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:50.528047 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-05fd3440-57b1-4ea3-8f11-ff04921af840 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:50.529171 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-05fd3440-57b1-4ea3-8f11-ff04921af840 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:50.536032 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-05fd3440-57b1-4ea3-8f11-ff04921af840 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:50.536470 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-05fd3440-57b1-4ea3-8f11-ff04921af840 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:50.536908 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-05fd3440-57b1-4ea3-8f11-ff04921af840 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:50.537609 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-05fd3440-57b1-4ea3-8f11-ff04921af840 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:50.538066 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-05fd3440-57b1-4ea3-8f11-ff04921af840 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:50.538490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-05fd3440-57b1-4ea3-8f11-ff04921af840 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:50.577046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0714ace6-a8e0-4f2a-8b14-8aec307d12b5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:50.585539 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0714ace6-a8e0-4f2a-8b14-8aec307d12b5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.156452 Oct 11 06:58:50.586287 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1090/2162] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:50 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:50.669999 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-05fd3440-57b1-4ea3-8f11-ff04921af840 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:50.678442 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-05fd3440-57b1-4ea3-8f11-ff04921af840 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:50.679897 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-05fd3440-57b1-4ea3-8f11-ff04921af840 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:50.681054 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-05fd3440-57b1-4ea3-8f11-ff04921af840 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.156917 Oct 11 06:58:50.681599 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1073/2163] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:50 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:58:51.232648 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-42fb1762-2370-412a-b9b3-ae460b99f4d2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:51.233327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-42fb1762-2370-412a-b9b3-ae460b99f4d2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:51.239199 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42fb1762-2370-412a-b9b3-ae460b99f4d2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:51.239709 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42fb1762-2370-412a-b9b3-ae460b99f4d2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:51.240141 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42fb1762-2370-412a-b9b3-ae460b99f4d2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:51.240816 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42fb1762-2370-412a-b9b3-ae460b99f4d2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:51.241255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42fb1762-2370-412a-b9b3-ae460b99f4d2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:51.241665 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-42fb1762-2370-412a-b9b3-ae460b99f4d2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:51.369408 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-42fb1762-2370-412a-b9b3-ae460b99f4d2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:51.378030 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-42fb1762-2370-412a-b9b3-ae460b99f4d2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.149534 Oct 11 06:58:51.378579 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1091/2164] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:51 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:51.610062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b3f98141-5eea-4747-8fc2-8882a8d3dec8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:51.610674 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b3f98141-5eea-4747-8fc2-8882a8d3dec8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:51.617064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b3f98141-5eea-4747-8fc2-8882a8d3dec8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:51.617542 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b3f98141-5eea-4747-8fc2-8882a8d3dec8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:51.617970 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b3f98141-5eea-4747-8fc2-8882a8d3dec8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:51.618659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b3f98141-5eea-4747-8fc2-8882a8d3dec8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:51.619106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b3f98141-5eea-4747-8fc2-8882a8d3dec8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:51.619555 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b3f98141-5eea-4747-8fc2-8882a8d3dec8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:51.705977 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-af788c22-1fad-425e-9c01-6f718ab7a588 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:51.706581 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-af788c22-1fad-425e-9c01-6f718ab7a588 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:51.712343 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af788c22-1fad-425e-9c01-6f718ab7a588 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:51.712814 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af788c22-1fad-425e-9c01-6f718ab7a588 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:51.713241 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af788c22-1fad-425e-9c01-6f718ab7a588 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:51.713921 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af788c22-1fad-425e-9c01-6f718ab7a588 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:51.714394 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af788c22-1fad-425e-9c01-6f718ab7a588 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:51.714813 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af788c22-1fad-425e-9c01-6f718ab7a588 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:51.748730 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b3f98141-5eea-4747-8fc2-8882a8d3dec8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:51.757020 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b3f98141-5eea-4747-8fc2-8882a8d3dec8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.151237 Oct 11 06:58:51.757590 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1074/2165] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:51 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:51.845432 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-af788c22-1fad-425e-9c01-6f718ab7a588 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:51.853923 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-af788c22-1fad-425e-9c01-6f718ab7a588 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:51.855343 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-af788c22-1fad-425e-9c01-6f718ab7a588 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:51.856514 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-af788c22-1fad-425e-9c01-6f718ab7a588 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.154387 Oct 11 06:58:51.857664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1092/2166] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:51 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:58:52.401064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a9ff7eef-921b-40d6-b1b2-f4308511bdf6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:52.401682 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a9ff7eef-921b-40d6-b1b2-f4308511bdf6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:52.408733 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a9ff7eef-921b-40d6-b1b2-f4308511bdf6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:52.408842 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a9ff7eef-921b-40d6-b1b2-f4308511bdf6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:52.409198 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a9ff7eef-921b-40d6-b1b2-f4308511bdf6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:52.409891 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a9ff7eef-921b-40d6-b1b2-f4308511bdf6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:52.410344 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a9ff7eef-921b-40d6-b1b2-f4308511bdf6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:52.410766 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a9ff7eef-921b-40d6-b1b2-f4308511bdf6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:52.536928 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a9ff7eef-921b-40d6-b1b2-f4308511bdf6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:52.545109 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a9ff7eef-921b-40d6-b1b2-f4308511bdf6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.147878 Oct 11 06:58:52.545658 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1075/2167] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:52 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:52.780619 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6729c82c-5525-43c2-87ec-ee1fe44d81f2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:52.781224 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6729c82c-5525-43c2-87ec-ee1fe44d81f2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:52.787681 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6729c82c-5525-43c2-87ec-ee1fe44d81f2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:52.788103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6729c82c-5525-43c2-87ec-ee1fe44d81f2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:52.788533 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6729c82c-5525-43c2-87ec-ee1fe44d81f2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:52.789215 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6729c82c-5525-43c2-87ec-ee1fe44d81f2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:52.789664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6729c82c-5525-43c2-87ec-ee1fe44d81f2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:52.790079 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6729c82c-5525-43c2-87ec-ee1fe44d81f2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:52.882301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-fca88172-8852-456f-8da0-ffc620b44e2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:52.882904 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-fca88172-8852-456f-8da0-ffc620b44e2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:52.889559 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fca88172-8852-456f-8da0-ffc620b44e2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:52.890031 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fca88172-8852-456f-8da0-ffc620b44e2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:52.890458 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fca88172-8852-456f-8da0-ffc620b44e2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:52.891140 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fca88172-8852-456f-8da0-ffc620b44e2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:52.891615 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fca88172-8852-456f-8da0-ffc620b44e2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:52.892029 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fca88172-8852-456f-8da0-ffc620b44e2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:52.918315 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6729c82c-5525-43c2-87ec-ee1fe44d81f2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:52.927181 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6729c82c-5525-43c2-87ec-ee1fe44d81f2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.150304 Oct 11 06:58:52.927939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1093/2168] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:52 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:53.017792 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-fca88172-8852-456f-8da0-ffc620b44e2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:53.026321 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-fca88172-8852-456f-8da0-ffc620b44e2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:53.027799 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-fca88172-8852-456f-8da0-ffc620b44e2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:53.028954 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-fca88172-8852-456f-8da0-ffc620b44e2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.150536 Oct 11 06:58:53.029509 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1076/2169] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:52 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:58:53.568496 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e8f43daa-84de-4489-817d-7cb6a64d1954 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:53.569045 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e8f43daa-84de-4489-817d-7cb6a64d1954 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:53.574955 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8f43daa-84de-4489-817d-7cb6a64d1954 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:53.575954 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8f43daa-84de-4489-817d-7cb6a64d1954 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:53.576387 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8f43daa-84de-4489-817d-7cb6a64d1954 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:53.577072 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8f43daa-84de-4489-817d-7cb6a64d1954 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:53.577521 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8f43daa-84de-4489-817d-7cb6a64d1954 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:53.577944 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e8f43daa-84de-4489-817d-7cb6a64d1954 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:53.702311 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e8f43daa-84de-4489-817d-7cb6a64d1954 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:53.710550 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e8f43daa-84de-4489-817d-7cb6a64d1954 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.145934 Oct 11 06:58:53.711115 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1094/2170] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:53 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:53.951473 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-958041b6-4bfa-47b6-9fa7-f6ad854d4915 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:53.952077 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-958041b6-4bfa-47b6-9fa7-f6ad854d4915 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:53.959104 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-958041b6-4bfa-47b6-9fa7-f6ad854d4915 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:53.959719 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-958041b6-4bfa-47b6-9fa7-f6ad854d4915 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:53.960149 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-958041b6-4bfa-47b6-9fa7-f6ad854d4915 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:53.960832 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-958041b6-4bfa-47b6-9fa7-f6ad854d4915 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:53.961278 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-958041b6-4bfa-47b6-9fa7-f6ad854d4915 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:53.961694 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-958041b6-4bfa-47b6-9fa7-f6ad854d4915 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:54.054108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6fa1103e-53ee-40c6-ae23-e120394de3a7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:54.054709 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6fa1103e-53ee-40c6-ae23-e120394de3a7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:54.061052 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fa1103e-53ee-40c6-ae23-e120394de3a7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:54.062037 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fa1103e-53ee-40c6-ae23-e120394de3a7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:54.062461 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fa1103e-53ee-40c6-ae23-e120394de3a7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:54.063137 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fa1103e-53ee-40c6-ae23-e120394de3a7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:54.063603 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fa1103e-53ee-40c6-ae23-e120394de3a7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:54.064024 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fa1103e-53ee-40c6-ae23-e120394de3a7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:54.090327 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-958041b6-4bfa-47b6-9fa7-f6ad854d4915 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:54.093725 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:58:54.099725 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-958041b6-4bfa-47b6-9fa7-f6ad854d4915 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.152128 Oct 11 06:58:54.100291 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1077/2171] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:53 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:54.194406 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6fa1103e-53ee-40c6-ae23-e120394de3a7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:54.203645 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6fa1103e-53ee-40c6-ae23-e120394de3a7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:54.205019 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6fa1103e-53ee-40c6-ae23-e120394de3a7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:54.206151 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6fa1103e-53ee-40c6-ae23-e120394de3a7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.156017 Oct 11 06:58:54.206696 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1095/2172] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:54 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:58:54.734038 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2efd13b9-d687-46fd-8ba8-57543b058c26 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:54.734669 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2efd13b9-d687-46fd-8ba8-57543b058c26 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:54.740870 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2efd13b9-d687-46fd-8ba8-57543b058c26 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:54.741341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2efd13b9-d687-46fd-8ba8-57543b058c26 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:54.741770 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2efd13b9-d687-46fd-8ba8-57543b058c26 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:54.742850 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2efd13b9-d687-46fd-8ba8-57543b058c26 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:54.743297 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2efd13b9-d687-46fd-8ba8-57543b058c26 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:54.743741 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2efd13b9-d687-46fd-8ba8-57543b058c26 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:54.909306 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2efd13b9-d687-46fd-8ba8-57543b058c26 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:54.917490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2efd13b9-d687-46fd-8ba8-57543b058c26 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.187291 Oct 11 06:58:54.918052 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1078/2173] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:54 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:55.123210 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-73b015b4-5d56-45c7-921f-0f24bd3193ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:55.123851 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-73b015b4-5d56-45c7-921f-0f24bd3193ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:55.130779 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-73b015b4-5d56-45c7-921f-0f24bd3193ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:55.131255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-73b015b4-5d56-45c7-921f-0f24bd3193ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:55.131721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-73b015b4-5d56-45c7-921f-0f24bd3193ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:55.132403 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-73b015b4-5d56-45c7-921f-0f24bd3193ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:55.132855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-73b015b4-5d56-45c7-921f-0f24bd3193ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:55.133277 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-73b015b4-5d56-45c7-921f-0f24bd3193ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:55.232211 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5daf91fc-4cf1-455b-8f58-96c9c56c2d11 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:55.232811 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5daf91fc-4cf1-455b-8f58-96c9c56c2d11 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:55.239681 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5daf91fc-4cf1-455b-8f58-96c9c56c2d11 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:55.240156 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5daf91fc-4cf1-455b-8f58-96c9c56c2d11 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:55.240581 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5daf91fc-4cf1-455b-8f58-96c9c56c2d11 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:55.241266 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5daf91fc-4cf1-455b-8f58-96c9c56c2d11 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:55.241710 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5daf91fc-4cf1-455b-8f58-96c9c56c2d11 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:55.242139 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5daf91fc-4cf1-455b-8f58-96c9c56c2d11 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:55.258999 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-73b015b4-5d56-45c7-921f-0f24bd3193ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:55.267661 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-73b015b4-5d56-45c7-921f-0f24bd3193ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.148210 Oct 11 06:58:55.268261 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1096/2174] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:55 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:55.371121 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5daf91fc-4cf1-455b-8f58-96c9c56c2d11 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:55.380158 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5daf91fc-4cf1-455b-8f58-96c9c56c2d11 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:55.381521 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5daf91fc-4cf1-455b-8f58-96c9c56c2d11 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:55.382665 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5daf91fc-4cf1-455b-8f58-96c9c56c2d11 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.154537 Oct 11 06:58:55.383207 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1079/2175] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:55 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:58:55.941119 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c64a8d10-04c2-4507-9abf-00dabcea7724 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:55.941719 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c64a8d10-04c2-4507-9abf-00dabcea7724 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:55.947713 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c64a8d10-04c2-4507-9abf-00dabcea7724 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:55.948188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c64a8d10-04c2-4507-9abf-00dabcea7724 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:55.948610 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c64a8d10-04c2-4507-9abf-00dabcea7724 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:55.949311 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c64a8d10-04c2-4507-9abf-00dabcea7724 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:55.949754 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c64a8d10-04c2-4507-9abf-00dabcea7724 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:55.950280 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c64a8d10-04c2-4507-9abf-00dabcea7724 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:56.077465 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c64a8d10-04c2-4507-9abf-00dabcea7724 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:56.085691 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c64a8d10-04c2-4507-9abf-00dabcea7724 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.149155 Oct 11 06:58:56.086255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1097/2176] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:55 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:56.290129 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-484d233d-0cc3-4851-8d81-37a8918aaf5b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:56.290740 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-484d233d-0cc3-4851-8d81-37a8918aaf5b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:56.297825 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-484d233d-0cc3-4851-8d81-37a8918aaf5b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:56.298305 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-484d233d-0cc3-4851-8d81-37a8918aaf5b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:56.298739 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-484d233d-0cc3-4851-8d81-37a8918aaf5b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:56.299442 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-484d233d-0cc3-4851-8d81-37a8918aaf5b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:56.299904 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-484d233d-0cc3-4851-8d81-37a8918aaf5b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:56.300330 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-484d233d-0cc3-4851-8d81-37a8918aaf5b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:56.409344 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cb567716-8d9f-4a3c-8d11-3f382a17d367 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:56.410095 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cb567716-8d9f-4a3c-8d11-3f382a17d367 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:56.418796 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb567716-8d9f-4a3c-8d11-3f382a17d367 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:56.419238 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb567716-8d9f-4a3c-8d11-3f382a17d367 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:56.419703 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb567716-8d9f-4a3c-8d11-3f382a17d367 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:56.420437 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb567716-8d9f-4a3c-8d11-3f382a17d367 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:56.420893 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb567716-8d9f-4a3c-8d11-3f382a17d367 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:56.421879 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb567716-8d9f-4a3c-8d11-3f382a17d367 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:56.425454 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-484d233d-0cc3-4851-8d81-37a8918aaf5b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:56.426000 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:58:56.433783 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-484d233d-0cc3-4851-8d81-37a8918aaf5b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.147521 Oct 11 06:58:56.434350 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1080/2177] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:56 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:56.551509 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cb567716-8d9f-4a3c-8d11-3f382a17d367 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:56.560152 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cb567716-8d9f-4a3c-8d11-3f382a17d367 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:56.561636 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cb567716-8d9f-4a3c-8d11-3f382a17d367 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:56.562822 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cb567716-8d9f-4a3c-8d11-3f382a17d367 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.157923 Oct 11 06:58:56.563375 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1098/2178] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:56 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:58:57.108761 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-fecf27c7-a17c-4138-a7f6-df706e87bc5f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:57.109372 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-fecf27c7-a17c-4138-a7f6-df706e87bc5f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:57.115304 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fecf27c7-a17c-4138-a7f6-df706e87bc5f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:57.115812 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fecf27c7-a17c-4138-a7f6-df706e87bc5f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:57.116241 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fecf27c7-a17c-4138-a7f6-df706e87bc5f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:57.116926 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fecf27c7-a17c-4138-a7f6-df706e87bc5f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:57.117372 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fecf27c7-a17c-4138-a7f6-df706e87bc5f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:57.117791 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fecf27c7-a17c-4138-a7f6-df706e87bc5f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:57.244239 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-fecf27c7-a17c-4138-a7f6-df706e87bc5f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:57.252902 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-fecf27c7-a17c-4138-a7f6-df706e87bc5f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.147921 Oct 11 06:58:57.253454 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1081/2179] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:57 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:57.456780 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d779c721-e4e9-420b-9891-e97b88c57ca5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:57.457319 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d779c721-e4e9-420b-9891-e97b88c57ca5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:57.463886 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d779c721-e4e9-420b-9891-e97b88c57ca5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:57.464352 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d779c721-e4e9-420b-9891-e97b88c57ca5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:57.464777 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d779c721-e4e9-420b-9891-e97b88c57ca5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:57.465448 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d779c721-e4e9-420b-9891-e97b88c57ca5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:57.465919 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d779c721-e4e9-420b-9891-e97b88c57ca5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:57.466331 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d779c721-e4e9-420b-9891-e97b88c57ca5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:57.588324 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4d7107fb-5bb5-48cb-8fbb-7e925e18eea2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:57.589615 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4d7107fb-5bb5-48cb-8fbb-7e925e18eea2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:57.596601 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4d7107fb-5bb5-48cb-8fbb-7e925e18eea2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:57.596774 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d779c721-e4e9-420b-9891-e97b88c57ca5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:57.597080 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4d7107fb-5bb5-48cb-8fbb-7e925e18eea2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:57.597505 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4d7107fb-5bb5-48cb-8fbb-7e925e18eea2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:57.598328 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4d7107fb-5bb5-48cb-8fbb-7e925e18eea2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:57.598776 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4d7107fb-5bb5-48cb-8fbb-7e925e18eea2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:57.599272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4d7107fb-5bb5-48cb-8fbb-7e925e18eea2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:57.604776 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d779c721-e4e9-420b-9891-e97b88c57ca5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.151851 Oct 11 06:58:57.605327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1099/2180] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:57 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:57.728280 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4d7107fb-5bb5-48cb-8fbb-7e925e18eea2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:57.737460 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4d7107fb-5bb5-48cb-8fbb-7e925e18eea2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:57.738913 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4d7107fb-5bb5-48cb-8fbb-7e925e18eea2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:57.740213 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4d7107fb-5bb5-48cb-8fbb-7e925e18eea2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.155812 Oct 11 06:58:57.740763 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1082/2181] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:57 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:58:58.275981 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1869a805-7c6a-4a3f-b672-96b8b2fc150c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:58.276618 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1869a805-7c6a-4a3f-b672-96b8b2fc150c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:58.283018 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1869a805-7c6a-4a3f-b672-96b8b2fc150c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:58.283521 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1869a805-7c6a-4a3f-b672-96b8b2fc150c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:58.283954 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1869a805-7c6a-4a3f-b672-96b8b2fc150c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:58.284662 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1869a805-7c6a-4a3f-b672-96b8b2fc150c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:58.285107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1869a805-7c6a-4a3f-b672-96b8b2fc150c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:58.285524 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1869a805-7c6a-4a3f-b672-96b8b2fc150c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:58.414177 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1869a805-7c6a-4a3f-b672-96b8b2fc150c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:58.422411 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1869a805-7c6a-4a3f-b672-96b8b2fc150c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150183 Oct 11 06:58:58.422966 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1100/2182] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:58 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:58.629031 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3f5a2958-67e6-4421-809b-99408782c525 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:58.629643 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3f5a2958-67e6-4421-809b-99408782c525 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:58.636116 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3f5a2958-67e6-4421-809b-99408782c525 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:58.636598 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3f5a2958-67e6-4421-809b-99408782c525 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:58.637030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3f5a2958-67e6-4421-809b-99408782c525 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:58.637724 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3f5a2958-67e6-4421-809b-99408782c525 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:58.638173 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3f5a2958-67e6-4421-809b-99408782c525 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:58.638628 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3f5a2958-67e6-4421-809b-99408782c525 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:58.766018 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3f5a2958-67e6-4421-809b-99408782c525 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:58.766436 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d880bcfb-7ddf-41b3-ba8d-3791fe98235c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:58.767048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d880bcfb-7ddf-41b3-ba8d-3791fe98235c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:58.773753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d880bcfb-7ddf-41b3-ba8d-3791fe98235c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:58.774227 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d880bcfb-7ddf-41b3-ba8d-3791fe98235c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:58.774354 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3f5a2958-67e6-4421-809b-99408782c525 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.149615 Oct 11 06:58:58.774663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d880bcfb-7ddf-41b3-ba8d-3791fe98235c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:58.774890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1083/2183] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:58 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:58.775360 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d880bcfb-7ddf-41b3-ba8d-3791fe98235c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:58.775838 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d880bcfb-7ddf-41b3-ba8d-3791fe98235c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:58.776262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d880bcfb-7ddf-41b3-ba8d-3791fe98235c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:58.903000 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d880bcfb-7ddf-41b3-ba8d-3791fe98235c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:58.911565 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d880bcfb-7ddf-41b3-ba8d-3791fe98235c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:58.913003 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d880bcfb-7ddf-41b3-ba8d-3791fe98235c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:58.914146 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d880bcfb-7ddf-41b3-ba8d-3791fe98235c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.151880 Oct 11 06:58:58.914735 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1101/2184] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:58 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:58:59.445984 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d33efe82-ad0f-418f-a2b9-f895809c0e37 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:59.446601 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d33efe82-ad0f-418f-a2b9-f895809c0e37 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:59.452746 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d33efe82-ad0f-418f-a2b9-f895809c0e37 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:59.453226 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d33efe82-ad0f-418f-a2b9-f895809c0e37 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:59.453682 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d33efe82-ad0f-418f-a2b9-f895809c0e37 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:59.454376 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d33efe82-ad0f-418f-a2b9-f895809c0e37 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:59.454846 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d33efe82-ad0f-418f-a2b9-f895809c0e37 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:59.455252 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d33efe82-ad0f-418f-a2b9-f895809c0e37 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:59.584013 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d33efe82-ad0f-418f-a2b9-f895809c0e37 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:59.592234 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d33efe82-ad0f-418f-a2b9-f895809c0e37 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150013 Oct 11 06:58:59.592739 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1084/2185] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:59 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:59.797792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9da7ea92-3621-443b-a081-6c557d294b55 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:59.798392 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9da7ea92-3621-443b-a081-6c557d294b55 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:59.804926 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9da7ea92-3621-443b-a081-6c557d294b55 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:59.805403 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9da7ea92-3621-443b-a081-6c557d294b55 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:59.805838 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9da7ea92-3621-443b-a081-6c557d294b55 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:59.806519 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9da7ea92-3621-443b-a081-6c557d294b55 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:59.806967 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9da7ea92-3621-443b-a081-6c557d294b55 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:59.807386 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9da7ea92-3621-443b-a081-6c557d294b55 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:59.938427 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9da7ea92-3621-443b-a081-6c557d294b55 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:58:59.939522 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4f8ec279-f0f5-40bd-b17a-b2ddc0ce7e95 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:58:59.940138 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4f8ec279-f0f5-40bd-b17a-b2ddc0ce7e95 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:58:59.946590 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4f8ec279-f0f5-40bd-b17a-b2ddc0ce7e95 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:59.946780 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9da7ea92-3621-443b-a081-6c557d294b55 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.152604 Oct 11 06:58:59.947191 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1102/2186] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:58:59 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:58:59.947346 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4f8ec279-f0f5-40bd-b17a-b2ddc0ce7e95 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:59.947742 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4f8ec279-f0f5-40bd-b17a-b2ddc0ce7e95 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:58:59.948619 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4f8ec279-f0f5-40bd-b17a-b2ddc0ce7e95 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:58:59.949065 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4f8ec279-f0f5-40bd-b17a-b2ddc0ce7e95 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:58:59.949508 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4f8ec279-f0f5-40bd-b17a-b2ddc0ce7e95 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:00.075579 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4f8ec279-f0f5-40bd-b17a-b2ddc0ce7e95 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:00.084799 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4f8ec279-f0f5-40bd-b17a-b2ddc0ce7e95 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:00.086231 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4f8ec279-f0f5-40bd-b17a-b2ddc0ce7e95 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:00.087383 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4f8ec279-f0f5-40bd-b17a-b2ddc0ce7e95 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152277 Oct 11 06:59:00.087954 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1085/2187] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:58:59 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:59:00.615725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4b545d20-b839-4d81-9eb8-45eab777425c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:00.616336 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4b545d20-b839-4d81-9eb8-45eab777425c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:00.622269 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4b545d20-b839-4d81-9eb8-45eab777425c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:00.622749 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4b545d20-b839-4d81-9eb8-45eab777425c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:00.623180 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4b545d20-b839-4d81-9eb8-45eab777425c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:00.623904 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4b545d20-b839-4d81-9eb8-45eab777425c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:00.624364 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4b545d20-b839-4d81-9eb8-45eab777425c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:00.625300 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4b545d20-b839-4d81-9eb8-45eab777425c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:00.751067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4b545d20-b839-4d81-9eb8-45eab777425c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:00.759574 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4b545d20-b839-4d81-9eb8-45eab777425c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.147722 Oct 11 06:59:00.760116 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1103/2188] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:00 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:00.970617 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0fc752be-1791-4e9e-af5d-92dfd54eb7db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:00.971166 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0fc752be-1791-4e9e-af5d-92dfd54eb7db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:00.977548 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0fc752be-1791-4e9e-af5d-92dfd54eb7db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:00.978019 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0fc752be-1791-4e9e-af5d-92dfd54eb7db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:00.978443 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0fc752be-1791-4e9e-af5d-92dfd54eb7db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:00.979119 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0fc752be-1791-4e9e-af5d-92dfd54eb7db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:00.979596 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0fc752be-1791-4e9e-af5d-92dfd54eb7db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:00.980018 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0fc752be-1791-4e9e-af5d-92dfd54eb7db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:01.107164 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0fc752be-1791-4e9e-af5d-92dfd54eb7db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:01.113437 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-419ee63d-1694-4d93-b0d2-3e36949cdb33 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:01.114173 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-419ee63d-1694-4d93-b0d2-3e36949cdb33 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:01.116613 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0fc752be-1791-4e9e-af5d-92dfd54eb7db tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.149909 Oct 11 06:59:01.127683 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1086/2189] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:00 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:01.127788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-419ee63d-1694-4d93-b0d2-3e36949cdb33 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:01.127788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-419ee63d-1694-4d93-b0d2-3e36949cdb33 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:01.127788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-419ee63d-1694-4d93-b0d2-3e36949cdb33 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:01.127788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-419ee63d-1694-4d93-b0d2-3e36949cdb33 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:01.128131 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-419ee63d-1694-4d93-b0d2-3e36949cdb33 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:01.128131 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-419ee63d-1694-4d93-b0d2-3e36949cdb33 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:01.255950 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-419ee63d-1694-4d93-b0d2-3e36949cdb33 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:01.264667 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-419ee63d-1694-4d93-b0d2-3e36949cdb33 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:01.266083 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-419ee63d-1694-4d93-b0d2-3e36949cdb33 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:01.267221 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-419ee63d-1694-4d93-b0d2-3e36949cdb33 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.158285 Oct 11 06:59:01.267806 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1104/2190] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:01 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:59:01.783963 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1dbde773-041c-48a3-88ea-aa8be35baa86 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:01.784568 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1dbde773-041c-48a3-88ea-aa8be35baa86 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:01.790437 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1dbde773-041c-48a3-88ea-aa8be35baa86 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:01.790909 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1dbde773-041c-48a3-88ea-aa8be35baa86 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:01.791332 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1dbde773-041c-48a3-88ea-aa8be35baa86 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:01.792035 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1dbde773-041c-48a3-88ea-aa8be35baa86 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:01.792480 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1dbde773-041c-48a3-88ea-aa8be35baa86 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:01.792881 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1dbde773-041c-48a3-88ea-aa8be35baa86 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:02.136106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1dbde773-041c-48a3-88ea-aa8be35baa86 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:02.142614 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fb766c07-155e-4d05-92ae-7a16b8a091b1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:02.143325 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fb766c07-155e-4d05-92ae-7a16b8a091b1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:02.145228 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1dbde773-041c-48a3-88ea-aa8be35baa86 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.365656 Oct 11 06:59:02.145790 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1087/2191] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:01 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:02.149766 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fb766c07-155e-4d05-92ae-7a16b8a091b1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:02.150240 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fb766c07-155e-4d05-92ae-7a16b8a091b1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:02.150669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fb766c07-155e-4d05-92ae-7a16b8a091b1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:02.151355 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fb766c07-155e-4d05-92ae-7a16b8a091b1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:02.151844 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fb766c07-155e-4d05-92ae-7a16b8a091b1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:02.152261 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fb766c07-155e-4d05-92ae-7a16b8a091b1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:02.279014 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fb766c07-155e-4d05-92ae-7a16b8a091b1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:02.287094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fb766c07-155e-4d05-92ae-7a16b8a091b1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.149144 Oct 11 06:59:02.287636 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1105/2192] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:02 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:59:02.292243 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3185626c-4880-449b-8193-c828afffe4da tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:02.292849 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3185626c-4880-449b-8193-c828afffe4da tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:02.298748 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3185626c-4880-449b-8193-c828afffe4da tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:02.299221 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3185626c-4880-449b-8193-c828afffe4da tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:02.299680 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3185626c-4880-449b-8193-c828afffe4da tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:02.300364 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3185626c-4880-449b-8193-c828afffe4da tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:02.300813 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3185626c-4880-449b-8193-c828afffe4da tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:02.301227 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3185626c-4880-449b-8193-c828afffe4da tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:02.426923 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3185626c-4880-449b-8193-c828afffe4da tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:02.435507 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3185626c-4880-449b-8193-c828afffe4da tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:02.436937 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3185626c-4880-449b-8193-c828afffe4da tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:02.438083 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3185626c-4880-449b-8193-c828afffe4da tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.149683 Oct 11 06:59:02.439144 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1088/2193] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:02 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:59:03.168541 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-25177df9-e3a8-4daf-b85e-61a671a3f35a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:03.169192 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-25177df9-e3a8-4daf-b85e-61a671a3f35a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:03.176261 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25177df9-e3a8-4daf-b85e-61a671a3f35a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:03.176740 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25177df9-e3a8-4daf-b85e-61a671a3f35a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:03.177175 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25177df9-e3a8-4daf-b85e-61a671a3f35a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:03.177863 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25177df9-e3a8-4daf-b85e-61a671a3f35a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:03.178311 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25177df9-e3a8-4daf-b85e-61a671a3f35a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:03.178731 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25177df9-e3a8-4daf-b85e-61a671a3f35a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:03.307193 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-25177df9-e3a8-4daf-b85e-61a671a3f35a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:03.309886 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-72fb3348-7fbe-406d-8b78-0e860064a9ec tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:03.310512 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-72fb3348-7fbe-406d-8b78-0e860064a9ec tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:03.315491 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-25177df9-e3a8-4daf-b85e-61a671a3f35a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150731 Oct 11 06:59:03.316053 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1106/2194] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:03 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:03.316814 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-72fb3348-7fbe-406d-8b78-0e860064a9ec tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:03.317294 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-72fb3348-7fbe-406d-8b78-0e860064a9ec tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:03.317724 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-72fb3348-7fbe-406d-8b78-0e860064a9ec tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:03.318419 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-72fb3348-7fbe-406d-8b78-0e860064a9ec tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:03.318868 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-72fb3348-7fbe-406d-8b78-0e860064a9ec tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:03.319286 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-72fb3348-7fbe-406d-8b78-0e860064a9ec tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:03.448222 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-72fb3348-7fbe-406d-8b78-0e860064a9ec tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:03.457060 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-72fb3348-7fbe-406d-8b78-0e860064a9ec tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.150903 Oct 11 06:59:03.457616 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1089/2195] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:03 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:59:03.464467 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b7a94962-b97f-4caa-a994-efe1e1cf00aa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:03.465074 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b7a94962-b97f-4caa-a994-efe1e1cf00aa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:03.471534 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b7a94962-b97f-4caa-a994-efe1e1cf00aa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:03.472005 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b7a94962-b97f-4caa-a994-efe1e1cf00aa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:03.472436 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b7a94962-b97f-4caa-a994-efe1e1cf00aa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:03.473111 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b7a94962-b97f-4caa-a994-efe1e1cf00aa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:03.473555 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b7a94962-b97f-4caa-a994-efe1e1cf00aa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:03.473968 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b7a94962-b97f-4caa-a994-efe1e1cf00aa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:03.600823 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b7a94962-b97f-4caa-a994-efe1e1cf00aa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:03.609485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b7a94962-b97f-4caa-a994-efe1e1cf00aa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:03.610941 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b7a94962-b97f-4caa-a994-efe1e1cf00aa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:03.612127 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b7a94962-b97f-4caa-a994-efe1e1cf00aa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.151502 Oct 11 06:59:03.612702 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1107/2196] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:03 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:04.339876 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-fc3db2db-af9b-4a4c-95a4-c6d1f459ca1e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:04.340420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-fc3db2db-af9b-4a4c-95a4-c6d1f459ca1e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:04.347527 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc3db2db-af9b-4a4c-95a4-c6d1f459ca1e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:04.348006 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc3db2db-af9b-4a4c-95a4-c6d1f459ca1e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:04.348434 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc3db2db-af9b-4a4c-95a4-c6d1f459ca1e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:04.349117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc3db2db-af9b-4a4c-95a4-c6d1f459ca1e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:04.349561 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc3db2db-af9b-4a4c-95a4-c6d1f459ca1e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:04.349980 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc3db2db-af9b-4a4c-95a4-c6d1f459ca1e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:04.480133 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-fc3db2db-af9b-4a4c-95a4-c6d1f459ca1e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:04.480964 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ac4a2412-2931-4465-8484-ebb10bf93635 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:04.481568 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ac4a2412-2931-4465-8484-ebb10bf93635 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:04.489020 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-fc3db2db-af9b-4a4c-95a4-c6d1f459ca1e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.153020 Oct 11 06:59:04.489588 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1090/2197] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:04 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:04.491011 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ac4a2412-2931-4465-8484-ebb10bf93635 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:04.491530 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ac4a2412-2931-4465-8484-ebb10bf93635 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:04.491965 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ac4a2412-2931-4465-8484-ebb10bf93635 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:04.492668 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ac4a2412-2931-4465-8484-ebb10bf93635 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:04.493114 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ac4a2412-2931-4465-8484-ebb10bf93635 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:04.493533 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ac4a2412-2931-4465-8484-ebb10bf93635 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:04.618033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ac4a2412-2931-4465-8484-ebb10bf93635 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:04.626150 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ac4a2412-2931-4465-8484-ebb10bf93635 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.149248 Oct 11 06:59:04.626703 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1108/2198] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:04 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:59:04.637789 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-15b0a461-1a71-4b6c-bef7-d3b9ac20ee6b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:04.638390 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-15b0a461-1a71-4b6c-bef7-d3b9ac20ee6b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:04.644596 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15b0a461-1a71-4b6c-bef7-d3b9ac20ee6b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:04.645065 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15b0a461-1a71-4b6c-bef7-d3b9ac20ee6b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:04.645488 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15b0a461-1a71-4b6c-bef7-d3b9ac20ee6b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:04.646161 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15b0a461-1a71-4b6c-bef7-d3b9ac20ee6b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:04.646603 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15b0a461-1a71-4b6c-bef7-d3b9ac20ee6b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:04.647019 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15b0a461-1a71-4b6c-bef7-d3b9ac20ee6b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:04.774307 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-15b0a461-1a71-4b6c-bef7-d3b9ac20ee6b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:04.783405 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-15b0a461-1a71-4b6c-bef7-d3b9ac20ee6b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:04.784835 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-15b0a461-1a71-4b6c-bef7-d3b9ac20ee6b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:04.785969 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-15b0a461-1a71-4b6c-bef7-d3b9ac20ee6b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152029 Oct 11 06:59:04.786518 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1091/2199] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:04 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:05.512226 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-391071b7-2e4c-4c97-bc6c-80b460db4d70 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:05.512857 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-391071b7-2e4c-4c97-bc6c-80b460db4d70 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:05.519543 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-391071b7-2e4c-4c97-bc6c-80b460db4d70 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:05.520009 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-391071b7-2e4c-4c97-bc6c-80b460db4d70 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:05.520429 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-391071b7-2e4c-4c97-bc6c-80b460db4d70 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:05.521098 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-391071b7-2e4c-4c97-bc6c-80b460db4d70 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:05.521535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-391071b7-2e4c-4c97-bc6c-80b460db4d70 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:05.521946 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-391071b7-2e4c-4c97-bc6c-80b460db4d70 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:05.649478 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-391071b7-2e4c-4c97-bc6c-80b460db4d70 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:05.649650 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1c495934-e4f7-43e1-8e10-ca9336d146cc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:05.650279 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1c495934-e4f7-43e1-8e10-ca9336d146cc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:05.656646 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c495934-e4f7-43e1-8e10-ca9336d146cc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:05.657119 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c495934-e4f7-43e1-8e10-ca9336d146cc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:05.657543 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c495934-e4f7-43e1-8e10-ca9336d146cc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:05.657977 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-391071b7-2e4c-4c97-bc6c-80b460db4d70 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.149539 Oct 11 06:59:05.658229 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c495934-e4f7-43e1-8e10-ca9336d146cc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:05.658547 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1109/2200] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:05 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:05.658699 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c495934-e4f7-43e1-8e10-ca9336d146cc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:05.659074 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c495934-e4f7-43e1-8e10-ca9336d146cc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:05.787723 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1c495934-e4f7-43e1-8e10-ca9336d146cc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:05.795775 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1c495934-e4f7-43e1-8e10-ca9336d146cc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.149977 Oct 11 06:59:05.796357 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1092/2201] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:05 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:59:05.810679 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-be49c936-f9e5-4e58-b276-d1c13f49e215 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:05.811279 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-be49c936-f9e5-4e58-b276-d1c13f49e215 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:05.817927 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-be49c936-f9e5-4e58-b276-d1c13f49e215 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:05.818394 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-be49c936-f9e5-4e58-b276-d1c13f49e215 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:05.818819 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-be49c936-f9e5-4e58-b276-d1c13f49e215 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:05.819522 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-be49c936-f9e5-4e58-b276-d1c13f49e215 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:05.819973 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-be49c936-f9e5-4e58-b276-d1c13f49e215 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:05.820387 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-be49c936-f9e5-4e58-b276-d1c13f49e215 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:05.946424 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-be49c936-f9e5-4e58-b276-d1c13f49e215 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:05.955151 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-be49c936-f9e5-4e58-b276-d1c13f49e215 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:05.956612 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-be49c936-f9e5-4e58-b276-d1c13f49e215 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:05.957760 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-be49c936-f9e5-4e58-b276-d1c13f49e215 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.150914 Oct 11 06:59:05.958306 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1110/2202] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:05 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:59:06.680528 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7182437d-0514-4df2-9af8-2e2328b0f7cd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:06.681089 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7182437d-0514-4df2-9af8-2e2328b0f7cd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:06.687507 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7182437d-0514-4df2-9af8-2e2328b0f7cd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:06.687983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7182437d-0514-4df2-9af8-2e2328b0f7cd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:06.688923 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7182437d-0514-4df2-9af8-2e2328b0f7cd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:06.689605 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7182437d-0514-4df2-9af8-2e2328b0f7cd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:06.690053 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7182437d-0514-4df2-9af8-2e2328b0f7cd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:06.690475 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7182437d-0514-4df2-9af8-2e2328b0f7cd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:06.818083 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7182437d-0514-4df2-9af8-2e2328b0f7cd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:06.819891 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-16d19d68-ffc1-4ff3-8faa-c3f73d6ae363 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:06.820502 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-16d19d68-ffc1-4ff3-8faa-c3f73d6ae363 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:06.822855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=78 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:59:06.826386 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7182437d-0514-4df2-9af8-2e2328b0f7cd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.149697 Oct 11 06:59:06.827185 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1093/2203] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:06 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:06.828061 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-16d19d68-ffc1-4ff3-8faa-c3f73d6ae363 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:06.828539 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-16d19d68-ffc1-4ff3-8faa-c3f73d6ae363 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:06.829626 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-16d19d68-ffc1-4ff3-8faa-c3f73d6ae363 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:06.830317 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-16d19d68-ffc1-4ff3-8faa-c3f73d6ae363 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:06.830761 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-16d19d68-ffc1-4ff3-8faa-c3f73d6ae363 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:06.831177 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-16d19d68-ffc1-4ff3-8faa-c3f73d6ae363 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:06.958421 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-16d19d68-ffc1-4ff3-8faa-c3f73d6ae363 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:06.966692 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-16d19d68-ffc1-4ff3-8faa-c3f73d6ae363 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.150660 Oct 11 06:59:06.967278 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1111/2204] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:06 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:59:06.983912 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-975a41af-fdbd-454b-b3f4-663389d00273 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:06.984518 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-975a41af-fdbd-454b-b3f4-663389d00273 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:06.991104 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-975a41af-fdbd-454b-b3f4-663389d00273 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:06.991627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-975a41af-fdbd-454b-b3f4-663389d00273 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:06.992059 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-975a41af-fdbd-454b-b3f4-663389d00273 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:06.992743 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-975a41af-fdbd-454b-b3f4-663389d00273 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:06.993192 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-975a41af-fdbd-454b-b3f4-663389d00273 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:06.993617 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-975a41af-fdbd-454b-b3f4-663389d00273 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:07.011483 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:59:07.119712 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-975a41af-fdbd-454b-b3f4-663389d00273 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:07.128829 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-975a41af-fdbd-454b-b3f4-663389d00273 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:07.130256 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-975a41af-fdbd-454b-b3f4-663389d00273 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:07.131399 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-975a41af-fdbd-454b-b3f4-663389d00273 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.151439 Oct 11 06:59:07.131966 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1094/2205] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:06 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:59:07.850770 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c11d11d1-1775-422f-aeea-70a448f9d727 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:07.851380 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c11d11d1-1775-422f-aeea-70a448f9d727 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:07.857840 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c11d11d1-1775-422f-aeea-70a448f9d727 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:07.858314 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c11d11d1-1775-422f-aeea-70a448f9d727 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:07.858742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c11d11d1-1775-422f-aeea-70a448f9d727 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:07.859441 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c11d11d1-1775-422f-aeea-70a448f9d727 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:07.859887 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c11d11d1-1775-422f-aeea-70a448f9d727 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:07.860311 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c11d11d1-1775-422f-aeea-70a448f9d727 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:07.988172 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c11d11d1-1775-422f-aeea-70a448f9d727 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:07.990612 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-da68f628-4990-496f-89cf-4699247a8b21 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:07.991399 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-da68f628-4990-496f-89cf-4699247a8b21 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:07.997656 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c11d11d1-1775-422f-aeea-70a448f9d727 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150685 Oct 11 06:59:07.998235 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1112/2206] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:07 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:07.999175 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-da68f628-4990-496f-89cf-4699247a8b21 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:07.999677 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-da68f628-4990-496f-89cf-4699247a8b21 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:08.000108 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-da68f628-4990-496f-89cf-4699247a8b21 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:08.000800 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-da68f628-4990-496f-89cf-4699247a8b21 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:08.001291 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-da68f628-4990-496f-89cf-4699247a8b21 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:08.001770 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-da68f628-4990-496f-89cf-4699247a8b21 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:08.130272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-da68f628-4990-496f-89cf-4699247a8b21 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:08.138470 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-da68f628-4990-496f-89cf-4699247a8b21 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.152143 Oct 11 06:59:08.139017 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1095/2207] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:07 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:08.156697 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a03236da-e1b9-42c7-b33e-31da3fe43adb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:08.157296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a03236da-e1b9-42c7-b33e-31da3fe43adb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:08.163071 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a03236da-e1b9-42c7-b33e-31da3fe43adb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:08.163573 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a03236da-e1b9-42c7-b33e-31da3fe43adb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:08.163999 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a03236da-e1b9-42c7-b33e-31da3fe43adb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:08.164679 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a03236da-e1b9-42c7-b33e-31da3fe43adb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:08.165119 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a03236da-e1b9-42c7-b33e-31da3fe43adb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:08.165534 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a03236da-e1b9-42c7-b33e-31da3fe43adb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:08.292681 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a03236da-e1b9-42c7-b33e-31da3fe43adb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:08.301148 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a03236da-e1b9-42c7-b33e-31da3fe43adb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:08.302568 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a03236da-e1b9-42c7-b33e-31da3fe43adb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:08.303747 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a03236da-e1b9-42c7-b33e-31da3fe43adb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.150835 Oct 11 06:59:08.304297 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1113/2208] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:08 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:09.021120 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-988b22d6-6887-441d-8f90-57f761e1dbfb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:09.021758 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-988b22d6-6887-441d-8f90-57f761e1dbfb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:09.035742 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-988b22d6-6887-441d-8f90-57f761e1dbfb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:09.036219 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-988b22d6-6887-441d-8f90-57f761e1dbfb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:09.036648 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-988b22d6-6887-441d-8f90-57f761e1dbfb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:09.037340 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-988b22d6-6887-441d-8f90-57f761e1dbfb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:09.037784 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-988b22d6-6887-441d-8f90-57f761e1dbfb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:09.038200 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-988b22d6-6887-441d-8f90-57f761e1dbfb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:09.163612 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ac1373cd-ecbc-454b-88b4-811899ca2b14 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:09.164208 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ac1373cd-ecbc-454b-88b4-811899ca2b14 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:09.166556 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-988b22d6-6887-441d-8f90-57f761e1dbfb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:09.170822 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ac1373cd-ecbc-454b-88b4-811899ca2b14 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:09.171296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ac1373cd-ecbc-454b-88b4-811899ca2b14 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:09.171753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ac1373cd-ecbc-454b-88b4-811899ca2b14 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:09.172439 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ac1373cd-ecbc-454b-88b4-811899ca2b14 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:09.173067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ac1373cd-ecbc-454b-88b4-811899ca2b14 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:09.173645 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ac1373cd-ecbc-454b-88b4-811899ca2b14 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:09.175251 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-988b22d6-6887-441d-8f90-57f761e1dbfb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.158630 Oct 11 06:59:09.186420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1096/2209] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:09 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:59:09.306078 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ac1373cd-ecbc-454b-88b4-811899ca2b14 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:09.309449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:59:09.316024 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ac1373cd-ecbc-454b-88b4-811899ca2b14 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.156238 Oct 11 06:59:09.316691 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1114/2210] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:09 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:59:09.328843 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-54d3e35b-ac51-4d53-8fcc-827f29c1e2d6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:09.329451 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-54d3e35b-ac51-4d53-8fcc-827f29c1e2d6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:09.335528 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-54d3e35b-ac51-4d53-8fcc-827f29c1e2d6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:09.336008 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-54d3e35b-ac51-4d53-8fcc-827f29c1e2d6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:09.336466 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-54d3e35b-ac51-4d53-8fcc-827f29c1e2d6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:09.337148 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-54d3e35b-ac51-4d53-8fcc-827f29c1e2d6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:09.337598 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-54d3e35b-ac51-4d53-8fcc-827f29c1e2d6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:09.338039 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-54d3e35b-ac51-4d53-8fcc-827f29c1e2d6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:09.463301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-54d3e35b-ac51-4d53-8fcc-827f29c1e2d6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:09.472139 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-54d3e35b-ac51-4d53-8fcc-827f29c1e2d6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:09.473611 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-54d3e35b-ac51-4d53-8fcc-827f29c1e2d6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:09.474774 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-54d3e35b-ac51-4d53-8fcc-827f29c1e2d6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.149832 Oct 11 06:59:09.475320 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1097/2211] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:09 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:10.199054 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2e8359b3-186b-45a7-a7a8-b09c5a08c837 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:10.199666 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2e8359b3-186b-45a7-a7a8-b09c5a08c837 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:10.206654 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2e8359b3-186b-45a7-a7a8-b09c5a08c837 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:10.207116 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2e8359b3-186b-45a7-a7a8-b09c5a08c837 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:10.207572 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2e8359b3-186b-45a7-a7a8-b09c5a08c837 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:10.208248 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2e8359b3-186b-45a7-a7a8-b09c5a08c837 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:10.208684 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2e8359b3-186b-45a7-a7a8-b09c5a08c837 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:10.209097 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2e8359b3-186b-45a7-a7a8-b09c5a08c837 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:10.339294 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-63cfc74b-74f6-4995-8246-82253f41cf05 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:10.339809 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2e8359b3-186b-45a7-a7a8-b09c5a08c837 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:10.339941 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-63cfc74b-74f6-4995-8246-82253f41cf05 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:10.346524 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-63cfc74b-74f6-4995-8246-82253f41cf05 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:10.346997 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-63cfc74b-74f6-4995-8246-82253f41cf05 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:10.347531 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-63cfc74b-74f6-4995-8246-82253f41cf05 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:10.347664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2e8359b3-186b-45a7-a7a8-b09c5a08c837 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.152393 Oct 11 06:59:10.348114 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1115/2212] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:10 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:10.348273 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-63cfc74b-74f6-4995-8246-82253f41cf05 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:10.348668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-63cfc74b-74f6-4995-8246-82253f41cf05 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:10.349089 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-63cfc74b-74f6-4995-8246-82253f41cf05 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:10.477765 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-63cfc74b-74f6-4995-8246-82253f41cf05 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:10.485945 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-63cfc74b-74f6-4995-8246-82253f41cf05 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.150458 Oct 11 06:59:10.486510 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1098/2213] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:10 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:59:10.502300 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b547030b-6420-429d-a367-3644a35cf53f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:10.502897 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b547030b-6420-429d-a367-3644a35cf53f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:10.508772 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b547030b-6420-429d-a367-3644a35cf53f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:10.509239 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b547030b-6420-429d-a367-3644a35cf53f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:10.509663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b547030b-6420-429d-a367-3644a35cf53f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:10.510332 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b547030b-6420-429d-a367-3644a35cf53f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:10.510771 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b547030b-6420-429d-a367-3644a35cf53f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:10.511185 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b547030b-6420-429d-a367-3644a35cf53f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:10.643851 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b547030b-6420-429d-a367-3644a35cf53f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:10.652321 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b547030b-6420-429d-a367-3644a35cf53f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:10.653732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b547030b-6420-429d-a367-3644a35cf53f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:10.654985 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b547030b-6420-429d-a367-3644a35cf53f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.156954 Oct 11 06:59:10.655648 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1116/2214] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:10 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:59:11.369875 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-33b2ac5f-0928-4efc-98d4-2dae35dca7fa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:11.370480 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-33b2ac5f-0928-4efc-98d4-2dae35dca7fa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:11.377426 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-33b2ac5f-0928-4efc-98d4-2dae35dca7fa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:11.377941 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-33b2ac5f-0928-4efc-98d4-2dae35dca7fa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:11.378326 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-33b2ac5f-0928-4efc-98d4-2dae35dca7fa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:11.378998 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-33b2ac5f-0928-4efc-98d4-2dae35dca7fa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:11.379456 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-33b2ac5f-0928-4efc-98d4-2dae35dca7fa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:11.379872 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-33b2ac5f-0928-4efc-98d4-2dae35dca7fa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:11.506707 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-33b2ac5f-0928-4efc-98d4-2dae35dca7fa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:11.509969 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cd5d380b-6c40-4d99-94ad-02f597a0955c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:11.510609 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cd5d380b-6c40-4d99-94ad-02f597a0955c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:11.515143 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-33b2ac5f-0928-4efc-98d4-2dae35dca7fa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.149008 Oct 11 06:59:11.515753 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1099/2215] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:11 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:11.517432 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cd5d380b-6c40-4d99-94ad-02f597a0955c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:11.517907 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cd5d380b-6c40-4d99-94ad-02f597a0955c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:11.518338 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cd5d380b-6c40-4d99-94ad-02f597a0955c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:11.519021 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cd5d380b-6c40-4d99-94ad-02f597a0955c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:11.519487 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cd5d380b-6c40-4d99-94ad-02f597a0955c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:11.519911 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cd5d380b-6c40-4d99-94ad-02f597a0955c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:11.643904 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cd5d380b-6c40-4d99-94ad-02f597a0955c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:11.651981 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cd5d380b-6c40-4d99-94ad-02f597a0955c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.145780 Oct 11 06:59:11.652530 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1117/2216] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:11 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:59:11.680037 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2607b00e-6941-40c3-bcb4-99d87957e364 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:11.680650 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2607b00e-6941-40c3-bcb4-99d87957e364 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:11.686604 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2607b00e-6941-40c3-bcb4-99d87957e364 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:11.687006 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2607b00e-6941-40c3-bcb4-99d87957e364 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:11.687460 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2607b00e-6941-40c3-bcb4-99d87957e364 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:11.688754 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2607b00e-6941-40c3-bcb4-99d87957e364 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:11.689204 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2607b00e-6941-40c3-bcb4-99d87957e364 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:11.689623 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2607b00e-6941-40c3-bcb4-99d87957e364 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:11.816169 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2607b00e-6941-40c3-bcb4-99d87957e364 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:11.824498 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2607b00e-6941-40c3-bcb4-99d87957e364 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:11.825908 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2607b00e-6941-40c3-bcb4-99d87957e364 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:11.827040 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2607b00e-6941-40c3-bcb4-99d87957e364 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.150835 Oct 11 06:59:11.827624 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1100/2217] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:11 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:12.538549 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-65b1d740-0b69-4cfc-9d8f-2d440a0d6aae tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:12.539160 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-65b1d740-0b69-4cfc-9d8f-2d440a0d6aae tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:12.545586 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-65b1d740-0b69-4cfc-9d8f-2d440a0d6aae tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:12.546068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-65b1d740-0b69-4cfc-9d8f-2d440a0d6aae tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:12.546502 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-65b1d740-0b69-4cfc-9d8f-2d440a0d6aae tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:12.547190 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-65b1d740-0b69-4cfc-9d8f-2d440a0d6aae tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:12.547666 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-65b1d740-0b69-4cfc-9d8f-2d440a0d6aae tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:12.548093 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-65b1d740-0b69-4cfc-9d8f-2d440a0d6aae tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:12.674852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-65b1d740-0b69-4cfc-9d8f-2d440a0d6aae tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:12.675326 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e9bd8cee-7159-469f-b567-f468f17e7f81 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:12.675997 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e9bd8cee-7159-469f-b567-f468f17e7f81 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:12.682524 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e9bd8cee-7159-469f-b567-f468f17e7f81 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:12.683037 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e9bd8cee-7159-469f-b567-f468f17e7f81 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:12.683191 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-65b1d740-0b69-4cfc-9d8f-2d440a0d6aae tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.148422 Oct 11 06:59:12.683484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e9bd8cee-7159-469f-b567-f468f17e7f81 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:12.683737 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1118/2218] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:12 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:12.684170 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e9bd8cee-7159-469f-b567-f468f17e7f81 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:12.684609 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e9bd8cee-7159-469f-b567-f468f17e7f81 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:12.685023 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e9bd8cee-7159-469f-b567-f468f17e7f81 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:12.816245 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e9bd8cee-7159-469f-b567-f468f17e7f81 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:12.824440 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e9bd8cee-7159-469f-b567-f468f17e7f81 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.152959 Oct 11 06:59:12.824992 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1101/2219] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:12 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:59:12.853000 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-27ed6743-446e-4b70-b6f7-506f5a1d8e95 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:12.853609 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-27ed6743-446e-4b70-b6f7-506f5a1d8e95 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:12.859425 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-27ed6743-446e-4b70-b6f7-506f5a1d8e95 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:12.859920 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-27ed6743-446e-4b70-b6f7-506f5a1d8e95 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:12.860371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-27ed6743-446e-4b70-b6f7-506f5a1d8e95 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:12.861058 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-27ed6743-446e-4b70-b6f7-506f5a1d8e95 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:12.861507 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-27ed6743-446e-4b70-b6f7-506f5a1d8e95 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:12.861926 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-27ed6743-446e-4b70-b6f7-506f5a1d8e95 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:12.986431 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-27ed6743-446e-4b70-b6f7-506f5a1d8e95 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:12.995213 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-27ed6743-446e-4b70-b6f7-506f5a1d8e95 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:12.996704 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-27ed6743-446e-4b70-b6f7-506f5a1d8e95 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:12.997856 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-27ed6743-446e-4b70-b6f7-506f5a1d8e95 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.148783 Oct 11 06:59:12.998408 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1119/2220] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:12 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:13.706036 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1d663484-ec50-4a20-9672-695cd128481a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:13.706640 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1d663484-ec50-4a20-9672-695cd128481a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:13.713003 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d663484-ec50-4a20-9672-695cd128481a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:13.713473 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d663484-ec50-4a20-9672-695cd128481a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:13.713901 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d663484-ec50-4a20-9672-695cd128481a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:13.714613 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d663484-ec50-4a20-9672-695cd128481a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:13.715056 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d663484-ec50-4a20-9672-695cd128481a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:13.715501 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d663484-ec50-4a20-9672-695cd128481a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:13.846879 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1d663484-ec50-4a20-9672-695cd128481a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:13.847811 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b0a68325-7638-4535-a7d0-be43686021c0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:13.848429 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b0a68325-7638-4535-a7d0-be43686021c0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:13.854840 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b0a68325-7638-4535-a7d0-be43686021c0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:13.855323 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b0a68325-7638-4535-a7d0-be43686021c0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:13.855562 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1d663484-ec50-4a20-9672-695cd128481a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.153297 Oct 11 06:59:13.855795 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b0a68325-7638-4535-a7d0-be43686021c0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:13.856286 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1102/2221] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:13 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:13.856488 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b0a68325-7638-4535-a7d0-be43686021c0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:13.856938 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b0a68325-7638-4535-a7d0-be43686021c0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:13.857362 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b0a68325-7638-4535-a7d0-be43686021c0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:13.983629 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b0a68325-7638-4535-a7d0-be43686021c0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:13.992263 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b0a68325-7638-4535-a7d0-be43686021c0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.148209 Oct 11 06:59:13.992820 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1120/2222] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:13 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:14.024171 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3c4fe05a-e533-4edb-87e8-6bac5196eeb1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:14.024769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3c4fe05a-e533-4edb-87e8-6bac5196eeb1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:14.030485 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c4fe05a-e533-4edb-87e8-6bac5196eeb1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:14.030955 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c4fe05a-e533-4edb-87e8-6bac5196eeb1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:14.031381 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c4fe05a-e533-4edb-87e8-6bac5196eeb1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:14.032105 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c4fe05a-e533-4edb-87e8-6bac5196eeb1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:14.032544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c4fe05a-e533-4edb-87e8-6bac5196eeb1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:14.033564 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c4fe05a-e533-4edb-87e8-6bac5196eeb1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:14.161724 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3c4fe05a-e533-4edb-87e8-6bac5196eeb1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:14.170214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3c4fe05a-e533-4edb-87e8-6bac5196eeb1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:14.171666 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3c4fe05a-e533-4edb-87e8-6bac5196eeb1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:14.172801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3c4fe05a-e533-4edb-87e8-6bac5196eeb1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152606 Oct 11 06:59:14.173360 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1103/2223] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:14 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:14.879093 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bb4793ce-b376-423f-a7bc-d6d8dda5018a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:14.880333 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bb4793ce-b376-423f-a7bc-d6d8dda5018a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:14.886765 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bb4793ce-b376-423f-a7bc-d6d8dda5018a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:14.887238 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bb4793ce-b376-423f-a7bc-d6d8dda5018a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:14.887704 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bb4793ce-b376-423f-a7bc-d6d8dda5018a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:14.888390 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bb4793ce-b376-423f-a7bc-d6d8dda5018a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:14.888833 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bb4793ce-b376-423f-a7bc-d6d8dda5018a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:14.889520 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bb4793ce-b376-423f-a7bc-d6d8dda5018a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:15.016519 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-663a94d8-7daa-4462-9657-4b90593c5f0b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:15.017147 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-663a94d8-7daa-4462-9657-4b90593c5f0b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:15.018258 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bb4793ce-b376-423f-a7bc-d6d8dda5018a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:15.023656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-663a94d8-7daa-4462-9657-4b90593c5f0b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:15.024133 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-663a94d8-7daa-4462-9657-4b90593c5f0b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:15.024564 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-663a94d8-7daa-4462-9657-4b90593c5f0b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:15.025259 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-663a94d8-7daa-4462-9657-4b90593c5f0b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:15.025703 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-663a94d8-7daa-4462-9657-4b90593c5f0b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:15.026119 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-663a94d8-7daa-4462-9657-4b90593c5f0b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:15.026546 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bb4793ce-b376-423f-a7bc-d6d8dda5018a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.151220 Oct 11 06:59:15.027106 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1121/2224] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:14 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:15.152184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-663a94d8-7daa-4462-9657-4b90593c5f0b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:15.160719 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-663a94d8-7daa-4462-9657-4b90593c5f0b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.148525 Oct 11 06:59:15.161271 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1104/2225] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:15 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:15.197953 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0b09a7f9-5084-4c49-875f-d69d72bece72 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:15.198562 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0b09a7f9-5084-4c49-875f-d69d72bece72 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:15.204893 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b09a7f9-5084-4c49-875f-d69d72bece72 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:15.205388 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b09a7f9-5084-4c49-875f-d69d72bece72 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:15.205821 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b09a7f9-5084-4c49-875f-d69d72bece72 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:15.206507 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b09a7f9-5084-4c49-875f-d69d72bece72 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:15.206957 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b09a7f9-5084-4c49-875f-d69d72bece72 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:15.207378 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b09a7f9-5084-4c49-875f-d69d72bece72 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:15.331397 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0b09a7f9-5084-4c49-875f-d69d72bece72 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:15.339810 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0b09a7f9-5084-4c49-875f-d69d72bece72 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:15.341227 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0b09a7f9-5084-4c49-875f-d69d72bece72 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:15.342363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0b09a7f9-5084-4c49-875f-d69d72bece72 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.148244 Oct 11 06:59:15.343215 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1122/2226] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:15 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:16.050479 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b635c851-23a1-45d8-a389-a3ef71cecfa4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:16.051116 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b635c851-23a1-45d8-a389-a3ef71cecfa4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:16.057520 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b635c851-23a1-45d8-a389-a3ef71cecfa4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:16.057999 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b635c851-23a1-45d8-a389-a3ef71cecfa4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:16.058434 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b635c851-23a1-45d8-a389-a3ef71cecfa4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:16.059124 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b635c851-23a1-45d8-a389-a3ef71cecfa4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:16.059607 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b635c851-23a1-45d8-a389-a3ef71cecfa4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:16.060030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b635c851-23a1-45d8-a389-a3ef71cecfa4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:16.184061 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3962c3a2-d6a8-47d5-952d-5d820e5cdc7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:16.184667 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3962c3a2-d6a8-47d5-952d-5d820e5cdc7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:16.188404 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b635c851-23a1-45d8-a389-a3ef71cecfa4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:16.191899 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3962c3a2-d6a8-47d5-952d-5d820e5cdc7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:16.192369 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3962c3a2-d6a8-47d5-952d-5d820e5cdc7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:16.192796 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3962c3a2-d6a8-47d5-952d-5d820e5cdc7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:16.193476 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3962c3a2-d6a8-47d5-952d-5d820e5cdc7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:16.193914 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3962c3a2-d6a8-47d5-952d-5d820e5cdc7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:16.194332 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3962c3a2-d6a8-47d5-952d-5d820e5cdc7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:16.197562 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b635c851-23a1-45d8-a389-a3ef71cecfa4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.151370 Oct 11 06:59:16.198119 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1105/2227] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:16 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:16.322443 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3962c3a2-d6a8-47d5-952d-5d820e5cdc7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:16.330673 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3962c3a2-d6a8-47d5-952d-5d820e5cdc7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.150442 Oct 11 06:59:16.331229 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1123/2228] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:16 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:59:16.368583 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-31beb8ac-f0de-48d6-9e8b-5e686f2e5d0b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:16.369190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-31beb8ac-f0de-48d6-9e8b-5e686f2e5d0b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:16.375036 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-31beb8ac-f0de-48d6-9e8b-5e686f2e5d0b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:16.375554 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-31beb8ac-f0de-48d6-9e8b-5e686f2e5d0b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:16.375997 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-31beb8ac-f0de-48d6-9e8b-5e686f2e5d0b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:16.376682 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-31beb8ac-f0de-48d6-9e8b-5e686f2e5d0b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:16.377136 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-31beb8ac-f0de-48d6-9e8b-5e686f2e5d0b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:16.377559 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-31beb8ac-f0de-48d6-9e8b-5e686f2e5d0b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:16.502187 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-31beb8ac-f0de-48d6-9e8b-5e686f2e5d0b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:16.510806 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-31beb8ac-f0de-48d6-9e8b-5e686f2e5d0b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:16.512359 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-31beb8ac-f0de-48d6-9e8b-5e686f2e5d0b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:16.513519 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-31beb8ac-f0de-48d6-9e8b-5e686f2e5d0b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.148758 Oct 11 06:59:16.514069 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1106/2229] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:16 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:17.219693 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6f4dfe6b-4a24-4d26-8561-fb3aa8e282e5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:17.220300 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6f4dfe6b-4a24-4d26-8561-fb3aa8e282e5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:17.226643 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f4dfe6b-4a24-4d26-8561-fb3aa8e282e5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:17.227047 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f4dfe6b-4a24-4d26-8561-fb3aa8e282e5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:17.227495 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f4dfe6b-4a24-4d26-8561-fb3aa8e282e5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:17.228168 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f4dfe6b-4a24-4d26-8561-fb3aa8e282e5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:17.228604 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f4dfe6b-4a24-4d26-8561-fb3aa8e282e5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:17.229017 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f4dfe6b-4a24-4d26-8561-fb3aa8e282e5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:17.352988 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6f4dfe6b-4a24-4d26-8561-fb3aa8e282e5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:17.354279 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-610a4959-5e55-4df3-b94e-9d6834b5a338 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:17.355011 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-610a4959-5e55-4df3-b94e-9d6834b5a338 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:17.361395 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6f4dfe6b-4a24-4d26-8561-fb3aa8e282e5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.145488 Oct 11 06:59:17.361542 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-610a4959-5e55-4df3-b94e-9d6834b5a338 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:17.361950 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1124/2230] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:17 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:17.362065 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-610a4959-5e55-4df3-b94e-9d6834b5a338 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:17.362410 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-610a4959-5e55-4df3-b94e-9d6834b5a338 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:17.363109 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-610a4959-5e55-4df3-b94e-9d6834b5a338 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:17.363610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-610a4959-5e55-4df3-b94e-9d6834b5a338 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:17.364012 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-610a4959-5e55-4df3-b94e-9d6834b5a338 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:17.495133 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-610a4959-5e55-4df3-b94e-9d6834b5a338 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:17.503882 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-610a4959-5e55-4df3-b94e-9d6834b5a338 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.153552 Oct 11 06:59:17.504444 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1107/2231] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:17 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:59:17.538018 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2f009f61-d335-484b-8a40-382ffcf57a88 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:17.538622 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2f009f61-d335-484b-8a40-382ffcf57a88 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:17.544442 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f009f61-d335-484b-8a40-382ffcf57a88 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:17.544915 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f009f61-d335-484b-8a40-382ffcf57a88 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:17.545344 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f009f61-d335-484b-8a40-382ffcf57a88 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:17.546030 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f009f61-d335-484b-8a40-382ffcf57a88 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:17.546477 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f009f61-d335-484b-8a40-382ffcf57a88 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:17.546891 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f009f61-d335-484b-8a40-382ffcf57a88 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:17.671707 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2f009f61-d335-484b-8a40-382ffcf57a88 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:17.680924 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2f009f61-d335-484b-8a40-382ffcf57a88 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:17.682354 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2f009f61-d335-484b-8a40-382ffcf57a88 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:17.683569 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2f009f61-d335-484b-8a40-382ffcf57a88 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.149399 Oct 11 06:59:17.684123 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1125/2232] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:17 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:18.385098 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f024c0d4-b0ff-4c6b-b7d4-0fbdf78d522b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:18.385779 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f024c0d4-b0ff-4c6b-b7d4-0fbdf78d522b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:18.392644 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f024c0d4-b0ff-4c6b-b7d4-0fbdf78d522b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:18.393117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f024c0d4-b0ff-4c6b-b7d4-0fbdf78d522b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:18.393545 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f024c0d4-b0ff-4c6b-b7d4-0fbdf78d522b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:18.394221 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f024c0d4-b0ff-4c6b-b7d4-0fbdf78d522b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:18.394661 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f024c0d4-b0ff-4c6b-b7d4-0fbdf78d522b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:18.395076 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f024c0d4-b0ff-4c6b-b7d4-0fbdf78d522b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:18.524086 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f024c0d4-b0ff-4c6b-b7d4-0fbdf78d522b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:18.528108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-644ba96a-c7a7-4e6f-9f80-f9a3c7844ba0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:18.528721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-644ba96a-c7a7-4e6f-9f80-f9a3c7844ba0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:18.532339 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f024c0d4-b0ff-4c6b-b7d4-0fbdf78d522b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.151085 Oct 11 06:59:18.533840 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1108/2233] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:18 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:18.535690 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-644ba96a-c7a7-4e6f-9f80-f9a3c7844ba0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:18.536171 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-644ba96a-c7a7-4e6f-9f80-f9a3c7844ba0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:18.536601 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-644ba96a-c7a7-4e6f-9f80-f9a3c7844ba0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:18.537293 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-644ba96a-c7a7-4e6f-9f80-f9a3c7844ba0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:18.537741 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-644ba96a-c7a7-4e6f-9f80-f9a3c7844ba0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:18.538161 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-644ba96a-c7a7-4e6f-9f80-f9a3c7844ba0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:18.666434 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-644ba96a-c7a7-4e6f-9f80-f9a3c7844ba0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:18.674492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-644ba96a-c7a7-4e6f-9f80-f9a3c7844ba0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.150249 Oct 11 06:59:18.675054 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1126/2234] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:18 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:59:18.709895 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a6598258-4fae-4819-9cba-d37b11e30b98 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:18.710501 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a6598258-4fae-4819-9cba-d37b11e30b98 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:18.716424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6598258-4fae-4819-9cba-d37b11e30b98 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:18.716903 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6598258-4fae-4819-9cba-d37b11e30b98 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:18.717329 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6598258-4fae-4819-9cba-d37b11e30b98 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:18.718015 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6598258-4fae-4819-9cba-d37b11e30b98 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:18.718467 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6598258-4fae-4819-9cba-d37b11e30b98 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:18.718884 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6598258-4fae-4819-9cba-d37b11e30b98 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:18.848003 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a6598258-4fae-4819-9cba-d37b11e30b98 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:18.857085 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a6598258-4fae-4819-9cba-d37b11e30b98 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:18.858529 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a6598258-4fae-4819-9cba-d37b11e30b98 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:18.859835 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a6598258-4fae-4819-9cba-d37b11e30b98 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.153711 Oct 11 06:59:18.860912 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1109/2235] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:18 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:19.555948 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-893940ff-b34c-4c88-abd3-9802feb269f7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:19.556560 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-893940ff-b34c-4c88-abd3-9802feb269f7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:19.562943 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-893940ff-b34c-4c88-abd3-9802feb269f7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:19.563439 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-893940ff-b34c-4c88-abd3-9802feb269f7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:19.563932 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-893940ff-b34c-4c88-abd3-9802feb269f7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:19.564621 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-893940ff-b34c-4c88-abd3-9802feb269f7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:19.565095 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-893940ff-b34c-4c88-abd3-9802feb269f7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:19.565522 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-893940ff-b34c-4c88-abd3-9802feb269f7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:19.691681 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-893940ff-b34c-4c88-abd3-9802feb269f7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:19.697884 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-57d4c587-1d4b-412f-95eb-2b70c378c76d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:19.698604 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-57d4c587-1d4b-412f-95eb-2b70c378c76d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:19.700161 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-893940ff-b34c-4c88-abd3-9802feb269f7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.147995 Oct 11 06:59:19.700734 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1127/2236] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:19 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:19.701154 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=78 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:59:19.706424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57d4c587-1d4b-412f-95eb-2b70c378c76d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:19.706898 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57d4c587-1d4b-412f-95eb-2b70c378c76d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:19.707325 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57d4c587-1d4b-412f-95eb-2b70c378c76d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:19.708069 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57d4c587-1d4b-412f-95eb-2b70c378c76d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:19.708509 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57d4c587-1d4b-412f-95eb-2b70c378c76d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:19.708932 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-57d4c587-1d4b-412f-95eb-2b70c378c76d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:19.841407 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-57d4c587-1d4b-412f-95eb-2b70c378c76d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:19.850200 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-57d4c587-1d4b-412f-95eb-2b70c378c76d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.156075 Oct 11 06:59:19.850761 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1110/2237] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:19 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:59:19.886473 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4914c165-3432-40a4-aa34-9805030e47ed tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:19.887111 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4914c165-3432-40a4-aa34-9805030e47ed tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:19.893805 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4914c165-3432-40a4-aa34-9805030e47ed tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:19.894227 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4914c165-3432-40a4-aa34-9805030e47ed tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:19.894664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4914c165-3432-40a4-aa34-9805030e47ed tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:19.895351 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4914c165-3432-40a4-aa34-9805030e47ed tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:19.895824 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4914c165-3432-40a4-aa34-9805030e47ed tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:19.896254 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4914c165-3432-40a4-aa34-9805030e47ed tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:20.023527 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4914c165-3432-40a4-aa34-9805030e47ed tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:20.032072 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4914c165-3432-40a4-aa34-9805030e47ed tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:20.034147 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4914c165-3432-40a4-aa34-9805030e47ed tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:20.035302 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4914c165-3432-40a4-aa34-9805030e47ed tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152652 Oct 11 06:59:20.035891 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1128/2238] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:19 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:20.724263 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4a3821bd-1e85-4bae-9644-1bf12e032cc1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:20.724821 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4a3821bd-1e85-4bae-9644-1bf12e032cc1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:20.731106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4a3821bd-1e85-4bae-9644-1bf12e032cc1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:20.731612 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4a3821bd-1e85-4bae-9644-1bf12e032cc1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:20.732036 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4a3821bd-1e85-4bae-9644-1bf12e032cc1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:20.732712 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4a3821bd-1e85-4bae-9644-1bf12e032cc1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:20.733151 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4a3821bd-1e85-4bae-9644-1bf12e032cc1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:20.733565 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4a3821bd-1e85-4bae-9644-1bf12e032cc1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:20.737945 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:59:20.861339 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4a3821bd-1e85-4bae-9644-1bf12e032cc1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:20.869657 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4a3821bd-1e85-4bae-9644-1bf12e032cc1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.149307 Oct 11 06:59:20.883437 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1111/2239] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:20 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:20.883632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6a044267-de52-418d-ab99-d7f9224d06dc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:20.883632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6a044267-de52-418d-ab99-d7f9224d06dc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:20.883632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a044267-de52-418d-ab99-d7f9224d06dc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:20.883632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a044267-de52-418d-ab99-d7f9224d06dc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:20.884364 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a044267-de52-418d-ab99-d7f9224d06dc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:20.884364 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a044267-de52-418d-ab99-d7f9224d06dc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:20.884364 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a044267-de52-418d-ab99-d7f9224d06dc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:20.884364 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a044267-de52-418d-ab99-d7f9224d06dc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:21.009092 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6a044267-de52-418d-ab99-d7f9224d06dc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:21.017533 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6a044267-de52-418d-ab99-d7f9224d06dc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.148108 Oct 11 06:59:21.018080 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1129/2240] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:20 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:59:21.060322 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4905a107-bea8-415f-b1a8-dda107830678 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:21.060921 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4905a107-bea8-415f-b1a8-dda107830678 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:21.066771 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4905a107-bea8-415f-b1a8-dda107830678 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:21.067237 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4905a107-bea8-415f-b1a8-dda107830678 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:21.067701 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4905a107-bea8-415f-b1a8-dda107830678 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:21.068377 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4905a107-bea8-415f-b1a8-dda107830678 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:21.068820 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4905a107-bea8-415f-b1a8-dda107830678 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:21.069231 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4905a107-bea8-415f-b1a8-dda107830678 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:21.193382 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4905a107-bea8-415f-b1a8-dda107830678 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:21.202239 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4905a107-bea8-415f-b1a8-dda107830678 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:21.203702 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4905a107-bea8-415f-b1a8-dda107830678 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:21.205447 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4905a107-bea8-415f-b1a8-dda107830678 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.148854 Oct 11 06:59:21.206002 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1112/2241] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:21 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:21.894643 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-df393c20-acba-44d7-8c7f-12d9bb6a23a3 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:21.895253 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-df393c20-acba-44d7-8c7f-12d9bb6a23a3 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:21.901159 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-df393c20-acba-44d7-8c7f-12d9bb6a23a3 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:21.901626 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-df393c20-acba-44d7-8c7f-12d9bb6a23a3 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:21.902052 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-df393c20-acba-44d7-8c7f-12d9bb6a23a3 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:21.902770 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-df393c20-acba-44d7-8c7f-12d9bb6a23a3 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:21.903157 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-df393c20-acba-44d7-8c7f-12d9bb6a23a3 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:21.903608 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-df393c20-acba-44d7-8c7f-12d9bb6a23a3 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:22.032516 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-df393c20-acba-44d7-8c7f-12d9bb6a23a3 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:22.040956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-abb240f3-d0e6-4226-a5c1-1b0b09b2d956 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:22.041451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-df393c20-acba-44d7-8c7f-12d9bb6a23a3 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.151091 Oct 11 06:59:22.041576 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-abb240f3-d0e6-4226-a5c1-1b0b09b2d956 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:22.041969 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1130/2242] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:21 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:22.048165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-abb240f3-d0e6-4226-a5c1-1b0b09b2d956 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:22.048636 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-abb240f3-d0e6-4226-a5c1-1b0b09b2d956 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:22.049062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-abb240f3-d0e6-4226-a5c1-1b0b09b2d956 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:22.049743 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-abb240f3-d0e6-4226-a5c1-1b0b09b2d956 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:22.050184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-abb240f3-d0e6-4226-a5c1-1b0b09b2d956 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:22.050598 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-abb240f3-d0e6-4226-a5c1-1b0b09b2d956 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:22.179009 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-abb240f3-d0e6-4226-a5c1-1b0b09b2d956 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:22.187238 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-abb240f3-d0e6-4226-a5c1-1b0b09b2d956 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.150028 Oct 11 06:59:22.187827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1113/2243] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:22 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:59:22.231395 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8dbfafcc-a320-40c0-a76a-1307e80e94ef tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:22.232048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8dbfafcc-a320-40c0-a76a-1307e80e94ef tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:22.237883 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8dbfafcc-a320-40c0-a76a-1307e80e94ef tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:22.238350 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8dbfafcc-a320-40c0-a76a-1307e80e94ef tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:22.238772 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8dbfafcc-a320-40c0-a76a-1307e80e94ef tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:22.239465 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8dbfafcc-a320-40c0-a76a-1307e80e94ef tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:22.239913 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8dbfafcc-a320-40c0-a76a-1307e80e94ef tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:22.240327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8dbfafcc-a320-40c0-a76a-1307e80e94ef tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:22.257571 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:59:22.366280 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8dbfafcc-a320-40c0-a76a-1307e80e94ef tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:22.374702 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8dbfafcc-a320-40c0-a76a-1307e80e94ef tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:22.376164 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8dbfafcc-a320-40c0-a76a-1307e80e94ef tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:22.377819 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8dbfafcc-a320-40c0-a76a-1307e80e94ef tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.149882 Oct 11 06:59:22.378369 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1131/2244] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:22 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:23.063372 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-897d4e01-f0cb-42be-84ab-0718603beb50 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:23.064017 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-897d4e01-f0cb-42be-84ab-0718603beb50 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:23.070452 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-897d4e01-f0cb-42be-84ab-0718603beb50 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:23.070923 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-897d4e01-f0cb-42be-84ab-0718603beb50 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:23.071352 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-897d4e01-f0cb-42be-84ab-0718603beb50 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:23.072060 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-897d4e01-f0cb-42be-84ab-0718603beb50 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:23.072507 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-897d4e01-f0cb-42be-84ab-0718603beb50 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:23.072927 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-897d4e01-f0cb-42be-84ab-0718603beb50 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:23.197997 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-897d4e01-f0cb-42be-84ab-0718603beb50 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:23.206223 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-897d4e01-f0cb-42be-84ab-0718603beb50 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.146665 Oct 11 06:59:23.206792 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1114/2245] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:23 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:23.210317 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-86e26bc9-0ac1-4db4-9f28-08abfc5cdf71 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:23.210928 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-86e26bc9-0ac1-4db4-9f28-08abfc5cdf71 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:23.217264 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-86e26bc9-0ac1-4db4-9f28-08abfc5cdf71 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:23.217738 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-86e26bc9-0ac1-4db4-9f28-08abfc5cdf71 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:23.218166 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-86e26bc9-0ac1-4db4-9f28-08abfc5cdf71 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:23.218847 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-86e26bc9-0ac1-4db4-9f28-08abfc5cdf71 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:23.219291 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-86e26bc9-0ac1-4db4-9f28-08abfc5cdf71 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:23.219742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-86e26bc9-0ac1-4db4-9f28-08abfc5cdf71 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:23.345402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-86e26bc9-0ac1-4db4-9f28-08abfc5cdf71 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:23.354242 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-86e26bc9-0ac1-4db4-9f28-08abfc5cdf71 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.147658 Oct 11 06:59:23.354794 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1132/2246] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:23 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:59:23.403341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1ad513ca-4b18-4d9a-9a22-a5f3943a11d6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:23.403980 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1ad513ca-4b18-4d9a-9a22-a5f3943a11d6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:23.410939 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1ad513ca-4b18-4d9a-9a22-a5f3943a11d6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:23.411440 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1ad513ca-4b18-4d9a-9a22-a5f3943a11d6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:23.411875 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1ad513ca-4b18-4d9a-9a22-a5f3943a11d6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:23.412602 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1ad513ca-4b18-4d9a-9a22-a5f3943a11d6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:23.413059 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1ad513ca-4b18-4d9a-9a22-a5f3943a11d6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:23.413479 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1ad513ca-4b18-4d9a-9a22-a5f3943a11d6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:23.540181 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1ad513ca-4b18-4d9a-9a22-a5f3943a11d6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:23.548649 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1ad513ca-4b18-4d9a-9a22-a5f3943a11d6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:23.550675 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1ad513ca-4b18-4d9a-9a22-a5f3943a11d6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:23.551852 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1ad513ca-4b18-4d9a-9a22-a5f3943a11d6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152413 Oct 11 06:59:23.552406 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1115/2247] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:23 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:24.229150 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3937609d-0623-4720-bde4-793227c14066 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:24.229782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3937609d-0623-4720-bde4-793227c14066 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:24.236112 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3937609d-0623-4720-bde4-793227c14066 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:24.237092 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3937609d-0623-4720-bde4-793227c14066 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:24.237517 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3937609d-0623-4720-bde4-793227c14066 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:24.238194 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3937609d-0623-4720-bde4-793227c14066 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:24.238636 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3937609d-0623-4720-bde4-793227c14066 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:24.239051 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3937609d-0623-4720-bde4-793227c14066 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:24.369084 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3937609d-0623-4720-bde4-793227c14066 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:24.378281 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e2e33f9b-2dad-4987-bb03-0d1e09227ad3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:24.378746 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3937609d-0623-4720-bde4-793227c14066 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.153093 Oct 11 06:59:24.378880 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e2e33f9b-2dad-4987-bb03-0d1e09227ad3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:24.379433 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1133/2248] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:24 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:24.385904 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e2e33f9b-2dad-4987-bb03-0d1e09227ad3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:24.386390 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e2e33f9b-2dad-4987-bb03-0d1e09227ad3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:24.386827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e2e33f9b-2dad-4987-bb03-0d1e09227ad3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:24.387565 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e2e33f9b-2dad-4987-bb03-0d1e09227ad3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:24.388025 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e2e33f9b-2dad-4987-bb03-0d1e09227ad3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:24.388448 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e2e33f9b-2dad-4987-bb03-0d1e09227ad3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:24.514941 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e2e33f9b-2dad-4987-bb03-0d1e09227ad3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:24.523113 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e2e33f9b-2dad-4987-bb03-0d1e09227ad3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.149163 Oct 11 06:59:24.523707 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1116/2249] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:24 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:24.576788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b1dfefb2-59d6-42e5-9edb-bf49396d6a08 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:24.577314 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b1dfefb2-59d6-42e5-9edb-bf49396d6a08 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:24.583105 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b1dfefb2-59d6-42e5-9edb-bf49396d6a08 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:24.583638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b1dfefb2-59d6-42e5-9edb-bf49396d6a08 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:24.584069 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b1dfefb2-59d6-42e5-9edb-bf49396d6a08 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:24.584749 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b1dfefb2-59d6-42e5-9edb-bf49396d6a08 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:24.585192 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b1dfefb2-59d6-42e5-9edb-bf49396d6a08 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:24.585613 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b1dfefb2-59d6-42e5-9edb-bf49396d6a08 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:24.711205 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b1dfefb2-59d6-42e5-9edb-bf49396d6a08 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:24.719688 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b1dfefb2-59d6-42e5-9edb-bf49396d6a08 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:24.721115 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b1dfefb2-59d6-42e5-9edb-bf49396d6a08 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:24.722789 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b1dfefb2-59d6-42e5-9edb-bf49396d6a08 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.149896 Oct 11 06:59:24.723365 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1134/2250] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:24 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:25.402304 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f46dfb47-9dcb-44d7-8203-32b829c07ef5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:25.402915 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f46dfb47-9dcb-44d7-8203-32b829c07ef5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:25.410132 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f46dfb47-9dcb-44d7-8203-32b829c07ef5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:25.410616 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f46dfb47-9dcb-44d7-8203-32b829c07ef5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:25.411047 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f46dfb47-9dcb-44d7-8203-32b829c07ef5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:25.411773 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f46dfb47-9dcb-44d7-8203-32b829c07ef5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:25.412223 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f46dfb47-9dcb-44d7-8203-32b829c07ef5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:25.412647 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f46dfb47-9dcb-44d7-8203-32b829c07ef5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:25.544572 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f46dfb47-9dcb-44d7-8203-32b829c07ef5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:25.546537 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e640024d-f56b-4b96-a113-24ec72c9dd95 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:25.547147 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e640024d-f56b-4b96-a113-24ec72c9dd95 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:25.553939 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f46dfb47-9dcb-44d7-8203-32b829c07ef5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.155556 Oct 11 06:59:25.554119 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e640024d-f56b-4b96-a113-24ec72c9dd95 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:25.554681 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1117/2251] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:25 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:25.554807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e640024d-f56b-4b96-a113-24ec72c9dd95 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:25.554947 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e640024d-f56b-4b96-a113-24ec72c9dd95 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:25.555661 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e640024d-f56b-4b96-a113-24ec72c9dd95 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:25.556190 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e640024d-f56b-4b96-a113-24ec72c9dd95 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:25.556521 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e640024d-f56b-4b96-a113-24ec72c9dd95 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:25.683847 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e640024d-f56b-4b96-a113-24ec72c9dd95 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:25.691969 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e640024d-f56b-4b96-a113-24ec72c9dd95 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.149206 Oct 11 06:59:25.692533 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1135/2252] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:25 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:59:25.748834 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-678bffd0-4f45-445e-b097-b1d4dd4d75ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:25.749447 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-678bffd0-4f45-445e-b097-b1d4dd4d75ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:25.755341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-678bffd0-4f45-445e-b097-b1d4dd4d75ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:25.755851 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-678bffd0-4f45-445e-b097-b1d4dd4d75ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:25.756287 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-678bffd0-4f45-445e-b097-b1d4dd4d75ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:25.756977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-678bffd0-4f45-445e-b097-b1d4dd4d75ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:25.757428 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-678bffd0-4f45-445e-b097-b1d4dd4d75ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:25.757849 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-678bffd0-4f45-445e-b097-b1d4dd4d75ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:25.885772 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-678bffd0-4f45-445e-b097-b1d4dd4d75ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:25.895398 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-678bffd0-4f45-445e-b097-b1d4dd4d75ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:25.896898 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-678bffd0-4f45-445e-b097-b1d4dd4d75ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:25.898055 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-678bffd0-4f45-445e-b097-b1d4dd4d75ea tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.153080 Oct 11 06:59:25.898604 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1118/2253] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:25 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:26.576683 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-058e07d6-e37d-4330-9e68-e582c08dbf1d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:26.577291 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-058e07d6-e37d-4330-9e68-e582c08dbf1d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:26.583818 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-058e07d6-e37d-4330-9e68-e582c08dbf1d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:26.584292 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-058e07d6-e37d-4330-9e68-e582c08dbf1d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:26.584724 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-058e07d6-e37d-4330-9e68-e582c08dbf1d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:26.585407 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-058e07d6-e37d-4330-9e68-e582c08dbf1d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:26.585848 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-058e07d6-e37d-4330-9e68-e582c08dbf1d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:26.586264 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-058e07d6-e37d-4330-9e68-e582c08dbf1d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:26.712467 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-058e07d6-e37d-4330-9e68-e582c08dbf1d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:26.715736 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f2eb8f06-db24-4f89-a33b-ec29fe93c2b6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:26.716353 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f2eb8f06-db24-4f89-a33b-ec29fe93c2b6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:26.720784 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-058e07d6-e37d-4330-9e68-e582c08dbf1d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.147867 Oct 11 06:59:26.721539 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1136/2254] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:26 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:26.722944 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f2eb8f06-db24-4f89-a33b-ec29fe93c2b6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:26.723441 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f2eb8f06-db24-4f89-a33b-ec29fe93c2b6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:26.723874 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f2eb8f06-db24-4f89-a33b-ec29fe93c2b6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:26.724559 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f2eb8f06-db24-4f89-a33b-ec29fe93c2b6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:26.725002 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f2eb8f06-db24-4f89-a33b-ec29fe93c2b6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:26.725416 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f2eb8f06-db24-4f89-a33b-ec29fe93c2b6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:26.851864 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f2eb8f06-db24-4f89-a33b-ec29fe93c2b6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:26.860020 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f2eb8f06-db24-4f89-a33b-ec29fe93c2b6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.148131 Oct 11 06:59:26.860581 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1119/2255] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:26 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:59:26.924002 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-723f2d1f-d36f-4c2a-ad67-9d187b136ae1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:26.924541 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-723f2d1f-d36f-4c2a-ad67-9d187b136ae1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:26.931056 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-723f2d1f-d36f-4c2a-ad67-9d187b136ae1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:26.931565 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-723f2d1f-d36f-4c2a-ad67-9d187b136ae1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:26.932008 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-723f2d1f-d36f-4c2a-ad67-9d187b136ae1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:26.932688 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-723f2d1f-d36f-4c2a-ad67-9d187b136ae1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:26.933135 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-723f2d1f-d36f-4c2a-ad67-9d187b136ae1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:26.933559 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-723f2d1f-d36f-4c2a-ad67-9d187b136ae1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:27.056328 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-723f2d1f-d36f-4c2a-ad67-9d187b136ae1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:27.064966 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-723f2d1f-d36f-4c2a-ad67-9d187b136ae1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:27.066406 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-723f2d1f-d36f-4c2a-ad67-9d187b136ae1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:27.067625 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-723f2d1f-d36f-4c2a-ad67-9d187b136ae1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.147479 Oct 11 06:59:27.068194 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1137/2256] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:26 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:27.742970 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-950764b2-f7a8-45c1-a97a-c25a07ae8cc5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:27.743612 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-950764b2-f7a8-45c1-a97a-c25a07ae8cc5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:27.749922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-950764b2-f7a8-45c1-a97a-c25a07ae8cc5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:27.750389 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-950764b2-f7a8-45c1-a97a-c25a07ae8cc5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:27.750813 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-950764b2-f7a8-45c1-a97a-c25a07ae8cc5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:27.751537 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-950764b2-f7a8-45c1-a97a-c25a07ae8cc5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:27.751981 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-950764b2-f7a8-45c1-a97a-c25a07ae8cc5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:27.752395 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-950764b2-f7a8-45c1-a97a-c25a07ae8cc5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:27.881377 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-950764b2-f7a8-45c1-a97a-c25a07ae8cc5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:27.884936 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-abe92745-38d2-4b17-aff1-e44dffb2b23e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:27.885546 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-abe92745-38d2-4b17-aff1-e44dffb2b23e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:27.889913 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-950764b2-f7a8-45c1-a97a-c25a07ae8cc5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150775 Oct 11 06:59:27.890644 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1120/2257] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:27 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:27.892360 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-abe92745-38d2-4b17-aff1-e44dffb2b23e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:27.892841 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-abe92745-38d2-4b17-aff1-e44dffb2b23e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:27.893270 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-abe92745-38d2-4b17-aff1-e44dffb2b23e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:27.893957 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-abe92745-38d2-4b17-aff1-e44dffb2b23e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:27.894406 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-abe92745-38d2-4b17-aff1-e44dffb2b23e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:27.894843 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-abe92745-38d2-4b17-aff1-e44dffb2b23e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:28.024679 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-abe92745-38d2-4b17-aff1-e44dffb2b23e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:28.032845 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-abe92745-38d2-4b17-aff1-e44dffb2b23e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.151679 Oct 11 06:59:28.033399 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1138/2258] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:27 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:59:28.092004 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8cf82138-5b58-459f-aebd-fa4f41095493 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:28.092537 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8cf82138-5b58-459f-aebd-fa4f41095493 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:28.100038 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8cf82138-5b58-459f-aebd-fa4f41095493 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:28.100533 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8cf82138-5b58-459f-aebd-fa4f41095493 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:28.100960 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8cf82138-5b58-459f-aebd-fa4f41095493 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:28.101641 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8cf82138-5b58-459f-aebd-fa4f41095493 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:28.102085 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8cf82138-5b58-459f-aebd-fa4f41095493 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:28.102503 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8cf82138-5b58-459f-aebd-fa4f41095493 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:28.230638 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8cf82138-5b58-459f-aebd-fa4f41095493 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:28.239836 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8cf82138-5b58-459f-aebd-fa4f41095493 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:28.241270 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8cf82138-5b58-459f-aebd-fa4f41095493 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:28.242448 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8cf82138-5b58-459f-aebd-fa4f41095493 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.154407 Oct 11 06:59:28.243087 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1121/2259] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:28 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:28.913400 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a5493853-429c-4953-92b3-e4af37a9f678 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:28.914009 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a5493853-429c-4953-92b3-e4af37a9f678 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:28.920450 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a5493853-429c-4953-92b3-e4af37a9f678 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:28.920922 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a5493853-429c-4953-92b3-e4af37a9f678 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:28.921349 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a5493853-429c-4953-92b3-e4af37a9f678 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:28.922028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a5493853-429c-4953-92b3-e4af37a9f678 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:28.922471 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a5493853-429c-4953-92b3-e4af37a9f678 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:28.922889 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a5493853-429c-4953-92b3-e4af37a9f678 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:29.046029 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a5493853-429c-4953-92b3-e4af37a9f678 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:29.054552 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a5493853-429c-4953-92b3-e4af37a9f678 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.145540 Oct 11 06:59:29.055150 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1139/2260] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:28 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:29.055978 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-81f3ad20-418a-402d-a8ab-bdd0606ae14f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:29.056624 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-81f3ad20-418a-402d-a8ab-bdd0606ae14f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:29.063000 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81f3ad20-418a-402d-a8ab-bdd0606ae14f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:29.063531 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81f3ad20-418a-402d-a8ab-bdd0606ae14f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:29.063966 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81f3ad20-418a-402d-a8ab-bdd0606ae14f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:29.064660 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81f3ad20-418a-402d-a8ab-bdd0606ae14f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:29.065112 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81f3ad20-418a-402d-a8ab-bdd0606ae14f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:29.066047 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81f3ad20-418a-402d-a8ab-bdd0606ae14f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:29.194741 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-81f3ad20-418a-402d-a8ab-bdd0606ae14f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:29.203034 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-81f3ad20-418a-402d-a8ab-bdd0606ae14f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.150851 Oct 11 06:59:29.203642 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1122/2261] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:29 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:59:29.269766 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e2632357-6495-4ae4-b55b-c4cca6577e9e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:29.270494 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e2632357-6495-4ae4-b55b-c4cca6577e9e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:29.276291 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e2632357-6495-4ae4-b55b-c4cca6577e9e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:29.276767 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e2632357-6495-4ae4-b55b-c4cca6577e9e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:29.277198 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e2632357-6495-4ae4-b55b-c4cca6577e9e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:29.277879 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e2632357-6495-4ae4-b55b-c4cca6577e9e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:29.278327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e2632357-6495-4ae4-b55b-c4cca6577e9e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:29.278747 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e2632357-6495-4ae4-b55b-c4cca6577e9e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:29.408897 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e2632357-6495-4ae4-b55b-c4cca6577e9e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:29.417647 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e2632357-6495-4ae4-b55b-c4cca6577e9e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:29.419098 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e2632357-6495-4ae4-b55b-c4cca6577e9e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:29.420289 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e2632357-6495-4ae4-b55b-c4cca6577e9e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.155076 Oct 11 06:59:29.420837 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1140/2262] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:29 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:30.078003 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0a93b386-2785-4074-8a4a-9a9adb4ba83c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:30.078619 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0a93b386-2785-4074-8a4a-9a9adb4ba83c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:30.085021 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0a93b386-2785-4074-8a4a-9a9adb4ba83c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:30.085498 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0a93b386-2785-4074-8a4a-9a9adb4ba83c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:30.085936 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0a93b386-2785-4074-8a4a-9a9adb4ba83c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:30.086626 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0a93b386-2785-4074-8a4a-9a9adb4ba83c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:30.087078 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0a93b386-2785-4074-8a4a-9a9adb4ba83c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:30.087537 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0a93b386-2785-4074-8a4a-9a9adb4ba83c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:30.213306 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0a93b386-2785-4074-8a4a-9a9adb4ba83c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:30.222316 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0a93b386-2785-4074-8a4a-9a9adb4ba83c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.147554 Oct 11 06:59:30.222956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1123/2263] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:30 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:30.226481 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6622cb57-8177-4bb7-adf1-5d348df69964 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:30.227091 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6622cb57-8177-4bb7-adf1-5d348df69964 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:30.233520 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6622cb57-8177-4bb7-adf1-5d348df69964 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:30.233991 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6622cb57-8177-4bb7-adf1-5d348df69964 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:30.234422 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6622cb57-8177-4bb7-adf1-5d348df69964 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:30.235102 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6622cb57-8177-4bb7-adf1-5d348df69964 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:30.235575 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6622cb57-8177-4bb7-adf1-5d348df69964 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:30.235996 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6622cb57-8177-4bb7-adf1-5d348df69964 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:30.362737 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6622cb57-8177-4bb7-adf1-5d348df69964 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:30.370843 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6622cb57-8177-4bb7-adf1-5d348df69964 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.148071 Oct 11 06:59:30.371334 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1141/2264] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:30 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:59:30.445640 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-02c077ef-cdfd-4563-b345-4f8343c25cb7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:30.446243 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-02c077ef-cdfd-4563-b345-4f8343c25cb7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:30.452153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-02c077ef-cdfd-4563-b345-4f8343c25cb7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:30.452621 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-02c077ef-cdfd-4563-b345-4f8343c25cb7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:30.453051 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-02c077ef-cdfd-4563-b345-4f8343c25cb7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:30.453729 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-02c077ef-cdfd-4563-b345-4f8343c25cb7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:30.454170 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-02c077ef-cdfd-4563-b345-4f8343c25cb7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:30.454584 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-02c077ef-cdfd-4563-b345-4f8343c25cb7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:30.585155 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-02c077ef-cdfd-4563-b345-4f8343c25cb7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:30.593864 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-02c077ef-cdfd-4563-b345-4f8343c25cb7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:30.595232 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-02c077ef-cdfd-4563-b345-4f8343c25cb7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:30.596397 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-02c077ef-cdfd-4563-b345-4f8343c25cb7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.154641 Oct 11 06:59:30.596959 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1124/2265] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:30 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:31.246801 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cc3f3c47-1612-440e-a0c3-6f619464d684 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:31.246801 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cc3f3c47-1612-440e-a0c3-6f619464d684 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:31.252262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc3f3c47-1612-440e-a0c3-6f619464d684 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:31.252737 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc3f3c47-1612-440e-a0c3-6f619464d684 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:31.253770 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc3f3c47-1612-440e-a0c3-6f619464d684 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:31.254437 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc3f3c47-1612-440e-a0c3-6f619464d684 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:31.254874 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc3f3c47-1612-440e-a0c3-6f619464d684 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:31.255288 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc3f3c47-1612-440e-a0c3-6f619464d684 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:31.383673 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cc3f3c47-1612-440e-a0c3-6f619464d684 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:31.392036 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cc3f3c47-1612-440e-a0c3-6f619464d684 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150864 Oct 11 06:59:31.392754 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1142/2266] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:31 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:31.394380 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1510f427-0bad-46a2-84cc-ea9571c9e905 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:31.394993 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1510f427-0bad-46a2-84cc-ea9571c9e905 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:31.402191 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1510f427-0bad-46a2-84cc-ea9571c9e905 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:31.403207 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1510f427-0bad-46a2-84cc-ea9571c9e905 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:31.403962 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1510f427-0bad-46a2-84cc-ea9571c9e905 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:31.404812 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1510f427-0bad-46a2-84cc-ea9571c9e905 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:31.405624 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1510f427-0bad-46a2-84cc-ea9571c9e905 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:31.406212 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1510f427-0bad-46a2-84cc-ea9571c9e905 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:31.538205 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1510f427-0bad-46a2-84cc-ea9571c9e905 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:31.546201 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1510f427-0bad-46a2-84cc-ea9571c9e905 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.155712 Oct 11 06:59:31.546755 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1125/2267] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:31 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:59:31.624915 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6fc53484-1e47-4fd2-a492-747ca58cdc6b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:31.625510 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6fc53484-1e47-4fd2-a492-747ca58cdc6b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:31.631295 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fc53484-1e47-4fd2-a492-747ca58cdc6b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:31.631800 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fc53484-1e47-4fd2-a492-747ca58cdc6b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:31.632222 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fc53484-1e47-4fd2-a492-747ca58cdc6b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:31.632891 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fc53484-1e47-4fd2-a492-747ca58cdc6b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:31.633328 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fc53484-1e47-4fd2-a492-747ca58cdc6b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:31.633742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6fc53484-1e47-4fd2-a492-747ca58cdc6b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:31.757991 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6fc53484-1e47-4fd2-a492-747ca58cdc6b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:31.766951 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6fc53484-1e47-4fd2-a492-747ca58cdc6b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:31.768404 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6fc53484-1e47-4fd2-a492-747ca58cdc6b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:31.770082 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6fc53484-1e47-4fd2-a492-747ca58cdc6b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.148975 Oct 11 06:59:31.770618 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1143/2268] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:31 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:32.414183 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3ad8a9c1-2346-4729-b4b5-6d84e1ea526f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:32.414852 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3ad8a9c1-2346-4729-b4b5-6d84e1ea526f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:32.421257 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3ad8a9c1-2346-4729-b4b5-6d84e1ea526f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:32.421724 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3ad8a9c1-2346-4729-b4b5-6d84e1ea526f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:32.422151 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3ad8a9c1-2346-4729-b4b5-6d84e1ea526f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:32.422825 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3ad8a9c1-2346-4729-b4b5-6d84e1ea526f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:32.423265 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3ad8a9c1-2346-4729-b4b5-6d84e1ea526f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:32.423712 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3ad8a9c1-2346-4729-b4b5-6d84e1ea526f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:32.551104 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3ad8a9c1-2346-4729-b4b5-6d84e1ea526f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:32.559334 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3ad8a9c1-2346-4729-b4b5-6d84e1ea526f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.149015 Oct 11 06:59:32.559915 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1126/2269] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:32 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:32.570397 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ec08dee5-b72f-4384-b8f5-d38939a0208c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:32.571024 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ec08dee5-b72f-4384-b8f5-d38939a0208c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:32.577291 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec08dee5-b72f-4384-b8f5-d38939a0208c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:32.577755 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec08dee5-b72f-4384-b8f5-d38939a0208c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:32.578361 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec08dee5-b72f-4384-b8f5-d38939a0208c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:32.579041 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec08dee5-b72f-4384-b8f5-d38939a0208c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:32.579515 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec08dee5-b72f-4384-b8f5-d38939a0208c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:32.579920 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec08dee5-b72f-4384-b8f5-d38939a0208c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:32.704195 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ec08dee5-b72f-4384-b8f5-d38939a0208c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:32.712230 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ec08dee5-b72f-4384-b8f5-d38939a0208c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.145630 Oct 11 06:59:32.712781 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1144/2270] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:32 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:32.795738 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-03f7f11e-6ffa-4e6e-a76d-60df0b5e54d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:32.796346 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-03f7f11e-6ffa-4e6e-a76d-60df0b5e54d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:32.802843 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-03f7f11e-6ffa-4e6e-a76d-60df0b5e54d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:32.803318 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-03f7f11e-6ffa-4e6e-a76d-60df0b5e54d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:32.803777 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-03f7f11e-6ffa-4e6e-a76d-60df0b5e54d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:32.804460 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-03f7f11e-6ffa-4e6e-a76d-60df0b5e54d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:32.804909 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-03f7f11e-6ffa-4e6e-a76d-60df0b5e54d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:32.805329 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-03f7f11e-6ffa-4e6e-a76d-60df0b5e54d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:32.935458 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-03f7f11e-6ffa-4e6e-a76d-60df0b5e54d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:32.938764 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:59:32.944620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-03f7f11e-6ffa-4e6e-a76d-60df0b5e54d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:32.946040 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-03f7f11e-6ffa-4e6e-a76d-60df0b5e54d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:32.947173 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-03f7f11e-6ffa-4e6e-a76d-60df0b5e54d4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.155260 Oct 11 06:59:32.947748 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1127/2271] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:32 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:33.582012 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-398d8af1-35df-4e04-9602-2da6ffcc78e9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:33.582618 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-398d8af1-35df-4e04-9602-2da6ffcc78e9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:33.589161 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-398d8af1-35df-4e04-9602-2da6ffcc78e9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:33.589679 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-398d8af1-35df-4e04-9602-2da6ffcc78e9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:33.590115 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-398d8af1-35df-4e04-9602-2da6ffcc78e9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:33.590855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-398d8af1-35df-4e04-9602-2da6ffcc78e9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:33.591307 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-398d8af1-35df-4e04-9602-2da6ffcc78e9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:33.591769 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-398d8af1-35df-4e04-9602-2da6ffcc78e9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:33.720876 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-398d8af1-35df-4e04-9602-2da6ffcc78e9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:33.729587 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-398d8af1-35df-4e04-9602-2da6ffcc78e9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.151507 Oct 11 06:59:33.730443 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1145/2272] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:33 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:33.734887 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-dcf8ec36-6201-4b27-bb97-4fdae6a00bea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:33.735520 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-dcf8ec36-6201-4b27-bb97-4fdae6a00bea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:33.742622 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dcf8ec36-6201-4b27-bb97-4fdae6a00bea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:33.743093 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dcf8ec36-6201-4b27-bb97-4fdae6a00bea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:33.743586 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dcf8ec36-6201-4b27-bb97-4fdae6a00bea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:33.744278 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dcf8ec36-6201-4b27-bb97-4fdae6a00bea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:33.744726 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dcf8ec36-6201-4b27-bb97-4fdae6a00bea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:33.745145 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dcf8ec36-6201-4b27-bb97-4fdae6a00bea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:33.870431 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-dcf8ec36-6201-4b27-bb97-4fdae6a00bea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:33.878617 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-dcf8ec36-6201-4b27-bb97-4fdae6a00bea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.147501 Oct 11 06:59:33.879175 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1128/2273] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:33 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:59:33.972743 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-62296519-d291-422f-9c15-aff823c5d08d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:33.973385 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-62296519-d291-422f-9c15-aff823c5d08d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:33.979272 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62296519-d291-422f-9c15-aff823c5d08d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:33.979766 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62296519-d291-422f-9c15-aff823c5d08d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:33.980197 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62296519-d291-422f-9c15-aff823c5d08d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:33.980880 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62296519-d291-422f-9c15-aff823c5d08d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:33.981329 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62296519-d291-422f-9c15-aff823c5d08d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:33.981750 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62296519-d291-422f-9c15-aff823c5d08d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:34.105510 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-62296519-d291-422f-9c15-aff823c5d08d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:34.113901 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-62296519-d291-422f-9c15-aff823c5d08d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:34.115321 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-62296519-d291-422f-9c15-aff823c5d08d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:34.116505 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-62296519-d291-422f-9c15-aff823c5d08d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.148251 Oct 11 06:59:34.117065 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1146/2274] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:33 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:34.754152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-858e389e-d44d-4a2f-a835-37e752839a03 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:34.754682 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-858e389e-d44d-4a2f-a835-37e752839a03 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:34.761072 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-858e389e-d44d-4a2f-a835-37e752839a03 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:34.761550 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-858e389e-d44d-4a2f-a835-37e752839a03 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:34.761981 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-858e389e-d44d-4a2f-a835-37e752839a03 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:34.762669 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-858e389e-d44d-4a2f-a835-37e752839a03 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:34.763118 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-858e389e-d44d-4a2f-a835-37e752839a03 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:34.763569 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-858e389e-d44d-4a2f-a835-37e752839a03 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:34.892874 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-858e389e-d44d-4a2f-a835-37e752839a03 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:34.900949 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-858e389e-d44d-4a2f-a835-37e752839a03 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.151239 Oct 11 06:59:34.907566 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1129/2275] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:34 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:34.907742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3eb0d0d0-1a83-4173-93c5-25fed41a0608 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:34.907742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3eb0d0d0-1a83-4173-93c5-25fed41a0608 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:34.908924 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3eb0d0d0-1a83-4173-93c5-25fed41a0608 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:34.909394 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3eb0d0d0-1a83-4173-93c5-25fed41a0608 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:34.909822 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3eb0d0d0-1a83-4173-93c5-25fed41a0608 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:34.910503 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3eb0d0d0-1a83-4173-93c5-25fed41a0608 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:34.910947 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3eb0d0d0-1a83-4173-93c5-25fed41a0608 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:34.911363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3eb0d0d0-1a83-4173-93c5-25fed41a0608 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:35.041740 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3eb0d0d0-1a83-4173-93c5-25fed41a0608 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:35.050454 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3eb0d0d0-1a83-4173-93c5-25fed41a0608 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.151658 Oct 11 06:59:35.051009 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1147/2276] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:34 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:59:35.142196 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7f7bc16c-2878-44f5-9e66-6b67af74cb13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:35.142795 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7f7bc16c-2878-44f5-9e66-6b67af74cb13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:35.148721 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7f7bc16c-2878-44f5-9e66-6b67af74cb13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:35.149191 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7f7bc16c-2878-44f5-9e66-6b67af74cb13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:35.149616 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7f7bc16c-2878-44f5-9e66-6b67af74cb13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:35.150294 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7f7bc16c-2878-44f5-9e66-6b67af74cb13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:35.150737 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7f7bc16c-2878-44f5-9e66-6b67af74cb13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:35.151149 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7f7bc16c-2878-44f5-9e66-6b67af74cb13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:35.277421 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7f7bc16c-2878-44f5-9e66-6b67af74cb13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:35.286477 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7f7bc16c-2878-44f5-9e66-6b67af74cb13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:35.287924 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7f7bc16c-2878-44f5-9e66-6b67af74cb13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:35.289067 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7f7bc16c-2878-44f5-9e66-6b67af74cb13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.150992 Oct 11 06:59:35.289689 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1130/2277] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:35 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:35.923632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9dfea568-2241-49f0-b343-fed9993e2eb2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:35.924255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9dfea568-2241-49f0-b343-fed9993e2eb2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:35.930435 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9dfea568-2241-49f0-b343-fed9993e2eb2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:35.930908 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9dfea568-2241-49f0-b343-fed9993e2eb2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:35.931337 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9dfea568-2241-49f0-b343-fed9993e2eb2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:35.932050 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9dfea568-2241-49f0-b343-fed9993e2eb2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:35.932493 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9dfea568-2241-49f0-b343-fed9993e2eb2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:35.932910 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9dfea568-2241-49f0-b343-fed9993e2eb2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:35.936852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:59:36.059801 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9dfea568-2241-49f0-b343-fed9993e2eb2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:36.068686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9dfea568-2241-49f0-b343-fed9993e2eb2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.148988 Oct 11 06:59:36.069261 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1148/2278] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:35 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:36.073381 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-687433aa-afd9-4468-84ee-2a2379680e55 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:36.073986 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-687433aa-afd9-4468-84ee-2a2379680e55 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:36.080652 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-687433aa-afd9-4468-84ee-2a2379680e55 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:36.081696 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-687433aa-afd9-4468-84ee-2a2379680e55 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:36.082122 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-687433aa-afd9-4468-84ee-2a2379680e55 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:36.083065 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-687433aa-afd9-4468-84ee-2a2379680e55 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:36.083533 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-687433aa-afd9-4468-84ee-2a2379680e55 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:36.083954 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-687433aa-afd9-4468-84ee-2a2379680e55 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:36.209589 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-687433aa-afd9-4468-84ee-2a2379680e55 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:36.217856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-687433aa-afd9-4468-84ee-2a2379680e55 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.148246 Oct 11 06:59:36.218432 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1131/2279] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:36 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:59:36.314120 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-05bcb1aa-773e-4c88-9a77-e0d39c73e2be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:36.314727 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-05bcb1aa-773e-4c88-9a77-e0d39c73e2be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:36.321260 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05bcb1aa-773e-4c88-9a77-e0d39c73e2be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:36.321730 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05bcb1aa-773e-4c88-9a77-e0d39c73e2be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:36.322153 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05bcb1aa-773e-4c88-9a77-e0d39c73e2be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:36.322825 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05bcb1aa-773e-4c88-9a77-e0d39c73e2be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:36.323264 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05bcb1aa-773e-4c88-9a77-e0d39c73e2be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:36.323704 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05bcb1aa-773e-4c88-9a77-e0d39c73e2be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:36.447930 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-05bcb1aa-773e-4c88-9a77-e0d39c73e2be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:36.456421 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-05bcb1aa-773e-4c88-9a77-e0d39c73e2be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:36.457838 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-05bcb1aa-773e-4c88-9a77-e0d39c73e2be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:36.458974 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-05bcb1aa-773e-4c88-9a77-e0d39c73e2be tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.148751 Oct 11 06:59:36.459535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1149/2280] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:36 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:37.092100 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-19065abe-2f48-4f7a-8c60-493cf52f5458 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:37.092706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-19065abe-2f48-4f7a-8c60-493cf52f5458 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:37.099647 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-19065abe-2f48-4f7a-8c60-493cf52f5458 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:37.100120 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-19065abe-2f48-4f7a-8c60-493cf52f5458 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:37.100556 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-19065abe-2f48-4f7a-8c60-493cf52f5458 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:37.101241 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-19065abe-2f48-4f7a-8c60-493cf52f5458 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:37.101688 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-19065abe-2f48-4f7a-8c60-493cf52f5458 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:37.102106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-19065abe-2f48-4f7a-8c60-493cf52f5458 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:37.232042 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-19065abe-2f48-4f7a-8c60-493cf52f5458 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:37.240107 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-19065abe-2f48-4f7a-8c60-493cf52f5458 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.151718 Oct 11 06:59:37.240824 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1132/2281] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:37 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:37.241391 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-736057e4-ff2b-4c00-abae-7eb43b6f0d98 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:37.242003 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-736057e4-ff2b-4c00-abae-7eb43b6f0d98 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:37.244463 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=78 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:59:37.249581 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-736057e4-ff2b-4c00-abae-7eb43b6f0d98 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:37.250054 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-736057e4-ff2b-4c00-abae-7eb43b6f0d98 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:37.250484 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-736057e4-ff2b-4c00-abae-7eb43b6f0d98 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:37.251169 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-736057e4-ff2b-4c00-abae-7eb43b6f0d98 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:37.251647 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-736057e4-ff2b-4c00-abae-7eb43b6f0d98 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:37.252064 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-736057e4-ff2b-4c00-abae-7eb43b6f0d98 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:37.380593 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-736057e4-ff2b-4c00-abae-7eb43b6f0d98 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:37.388799 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-736057e4-ff2b-4c00-abae-7eb43b6f0d98 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.151101 Oct 11 06:59:37.389679 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1150/2282] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:37 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:59:37.484020 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1349079f-da73-4406-9e7b-7aebee48387d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:37.484630 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1349079f-da73-4406-9e7b-7aebee48387d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:37.490583 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1349079f-da73-4406-9e7b-7aebee48387d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:37.491064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1349079f-da73-4406-9e7b-7aebee48387d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:37.491527 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1349079f-da73-4406-9e7b-7aebee48387d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:37.492246 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1349079f-da73-4406-9e7b-7aebee48387d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:37.492702 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1349079f-da73-4406-9e7b-7aebee48387d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:37.493125 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1349079f-da73-4406-9e7b-7aebee48387d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:37.619114 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1349079f-da73-4406-9e7b-7aebee48387d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:37.628335 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1349079f-da73-4406-9e7b-7aebee48387d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:37.629786 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1349079f-da73-4406-9e7b-7aebee48387d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:37.630941 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1349079f-da73-4406-9e7b-7aebee48387d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.150870 Oct 11 06:59:37.631513 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1133/2283] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:37 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:38.263881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2f345013-b79b-43c3-8365-a44522d6a677 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:38.264690 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2f345013-b79b-43c3-8365-a44522d6a677 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:38.271093 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f345013-b79b-43c3-8365-a44522d6a677 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:38.271600 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f345013-b79b-43c3-8365-a44522d6a677 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:38.272029 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f345013-b79b-43c3-8365-a44522d6a677 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:38.272716 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f345013-b79b-43c3-8365-a44522d6a677 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:38.273161 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f345013-b79b-43c3-8365-a44522d6a677 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:38.273582 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f345013-b79b-43c3-8365-a44522d6a677 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:38.397403 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2f345013-b79b-43c3-8365-a44522d6a677 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:38.405560 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2f345013-b79b-43c3-8365-a44522d6a677 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.145604 Oct 11 06:59:38.406140 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1151/2284] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:38 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:38.413449 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9294777b-868b-4418-8958-6b95583d9f34 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:38.414627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9294777b-868b-4418-8958-6b95583d9f34 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:38.421307 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9294777b-868b-4418-8958-6b95583d9f34 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:38.421784 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9294777b-868b-4418-8958-6b95583d9f34 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:38.422215 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9294777b-868b-4418-8958-6b95583d9f34 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:38.422900 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9294777b-868b-4418-8958-6b95583d9f34 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:38.423349 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9294777b-868b-4418-8958-6b95583d9f34 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:38.423800 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9294777b-868b-4418-8958-6b95583d9f34 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:38.553352 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9294777b-868b-4418-8958-6b95583d9f34 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:38.561519 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9294777b-868b-4418-8958-6b95583d9f34 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.152417 Oct 11 06:59:38.562081 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1134/2285] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:38 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:38.656452 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3d20110d-0816-4c39-92da-648bad6c2aba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:38.657053 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3d20110d-0816-4c39-92da-648bad6c2aba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:38.663605 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3d20110d-0816-4c39-92da-648bad6c2aba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:38.664082 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3d20110d-0816-4c39-92da-648bad6c2aba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:38.664511 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3d20110d-0816-4c39-92da-648bad6c2aba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:38.665189 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3d20110d-0816-4c39-92da-648bad6c2aba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:38.665637 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3d20110d-0816-4c39-92da-648bad6c2aba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:38.666052 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3d20110d-0816-4c39-92da-648bad6c2aba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:38.793773 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3d20110d-0816-4c39-92da-648bad6c2aba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:38.802816 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3d20110d-0816-4c39-92da-648bad6c2aba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:38.804218 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3d20110d-0816-4c39-92da-648bad6c2aba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:38.805395 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3d20110d-0816-4c39-92da-648bad6c2aba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152821 Oct 11 06:59:38.805940 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1152/2286] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:38 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:39.429664 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-911e651a-2c35-4b6d-b029-82a38cbef742 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:39.430271 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-911e651a-2c35-4b6d-b029-82a38cbef742 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:39.436782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-911e651a-2c35-4b6d-b029-82a38cbef742 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:39.437222 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-911e651a-2c35-4b6d-b029-82a38cbef742 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:39.437645 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-911e651a-2c35-4b6d-b029-82a38cbef742 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:39.438322 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-911e651a-2c35-4b6d-b029-82a38cbef742 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:39.438766 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-911e651a-2c35-4b6d-b029-82a38cbef742 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:39.439180 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-911e651a-2c35-4b6d-b029-82a38cbef742 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:39.566647 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-911e651a-2c35-4b6d-b029-82a38cbef742 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:39.574741 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-911e651a-2c35-4b6d-b029-82a38cbef742 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.148846 Oct 11 06:59:39.575288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1135/2287] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:39 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:39.584654 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4c7aa464-95f9-48d8-8e31-d0128446d2b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:39.585251 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4c7aa464-95f9-48d8-8e31-d0128446d2b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:39.592661 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4c7aa464-95f9-48d8-8e31-d0128446d2b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:39.593225 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4c7aa464-95f9-48d8-8e31-d0128446d2b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:39.593666 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4c7aa464-95f9-48d8-8e31-d0128446d2b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:39.594359 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4c7aa464-95f9-48d8-8e31-d0128446d2b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:39.594802 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4c7aa464-95f9-48d8-8e31-d0128446d2b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:39.595216 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4c7aa464-95f9-48d8-8e31-d0128446d2b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:39.719720 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4c7aa464-95f9-48d8-8e31-d0128446d2b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:39.728210 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4c7aa464-95f9-48d8-8e31-d0128446d2b4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.147332 Oct 11 06:59:39.728770 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1153/2288] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:39 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:39.830890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7ba289d4-ab47-4dd2-8006-1ac5de1dfd24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:39.831533 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7ba289d4-ab47-4dd2-8006-1ac5de1dfd24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:39.837452 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7ba289d4-ab47-4dd2-8006-1ac5de1dfd24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:39.837930 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7ba289d4-ab47-4dd2-8006-1ac5de1dfd24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:39.838365 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7ba289d4-ab47-4dd2-8006-1ac5de1dfd24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:39.839053 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7ba289d4-ab47-4dd2-8006-1ac5de1dfd24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:39.839531 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7ba289d4-ab47-4dd2-8006-1ac5de1dfd24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:39.839959 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7ba289d4-ab47-4dd2-8006-1ac5de1dfd24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:39.965625 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7ba289d4-ab47-4dd2-8006-1ac5de1dfd24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:39.974733 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7ba289d4-ab47-4dd2-8006-1ac5de1dfd24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:39.976146 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7ba289d4-ab47-4dd2-8006-1ac5de1dfd24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:39.977296 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7ba289d4-ab47-4dd2-8006-1ac5de1dfd24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.150261 Oct 11 06:59:39.977843 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1136/2289] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:39 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:40.598291 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-172190d9-9c46-4663-ae08-7d4fed2b8e5f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:40.598843 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-172190d9-9c46-4663-ae08-7d4fed2b8e5f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:40.605240 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-172190d9-9c46-4663-ae08-7d4fed2b8e5f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:40.605707 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-172190d9-9c46-4663-ae08-7d4fed2b8e5f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:40.606125 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-172190d9-9c46-4663-ae08-7d4fed2b8e5f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:40.606824 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-172190d9-9c46-4663-ae08-7d4fed2b8e5f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:40.607262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-172190d9-9c46-4663-ae08-7d4fed2b8e5f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:40.607702 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-172190d9-9c46-4663-ae08-7d4fed2b8e5f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:40.740405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-172190d9-9c46-4663-ae08-7d4fed2b8e5f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:40.748744 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-172190d9-9c46-4663-ae08-7d4fed2b8e5f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.154401 Oct 11 06:59:40.763914 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1154/2290] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:40 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:40.764896 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-90a9a1f6-5e13-4e87-bbe6-82967e841515 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:40.764896 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-90a9a1f6-5e13-4e87-bbe6-82967e841515 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:40.764896 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-90a9a1f6-5e13-4e87-bbe6-82967e841515 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:40.764896 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-90a9a1f6-5e13-4e87-bbe6-82967e841515 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:40.765575 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-90a9a1f6-5e13-4e87-bbe6-82967e841515 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:40.765575 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-90a9a1f6-5e13-4e87-bbe6-82967e841515 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:40.765575 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-90a9a1f6-5e13-4e87-bbe6-82967e841515 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:40.765575 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-90a9a1f6-5e13-4e87-bbe6-82967e841515 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:40.901127 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-90a9a1f6-5e13-4e87-bbe6-82967e841515 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:40.909267 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-90a9a1f6-5e13-4e87-bbe6-82967e841515 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.162062 Oct 11 06:59:40.909825 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1137/2291] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:40 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:41.001956 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0379f295-0a13-4681-80bb-8235898e3a86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:41.002568 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0379f295-0a13-4681-80bb-8235898e3a86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:41.008957 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0379f295-0a13-4681-80bb-8235898e3a86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:41.009432 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0379f295-0a13-4681-80bb-8235898e3a86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:41.009861 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0379f295-0a13-4681-80bb-8235898e3a86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:41.010538 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0379f295-0a13-4681-80bb-8235898e3a86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:41.010982 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0379f295-0a13-4681-80bb-8235898e3a86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:41.011399 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0379f295-0a13-4681-80bb-8235898e3a86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:41.137898 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0379f295-0a13-4681-80bb-8235898e3a86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:41.146707 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0379f295-0a13-4681-80bb-8235898e3a86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:41.148165 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0379f295-0a13-4681-80bb-8235898e3a86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:41.149314 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0379f295-0a13-4681-80bb-8235898e3a86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.151277 Oct 11 06:59:41.149863 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1155/2292] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:40 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:41.775801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9c05bc66-8183-485f-aca3-f00504f38571 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:41.776354 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9c05bc66-8183-485f-aca3-f00504f38571 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:41.782644 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9c05bc66-8183-485f-aca3-f00504f38571 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:41.783135 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9c05bc66-8183-485f-aca3-f00504f38571 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:41.783603 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9c05bc66-8183-485f-aca3-f00504f38571 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:41.784281 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9c05bc66-8183-485f-aca3-f00504f38571 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:41.784729 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9c05bc66-8183-485f-aca3-f00504f38571 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:41.785143 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9c05bc66-8183-485f-aca3-f00504f38571 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:41.910302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9c05bc66-8183-485f-aca3-f00504f38571 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:41.918398 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9c05bc66-8183-485f-aca3-f00504f38571 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.146646 Oct 11 06:59:41.918951 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1138/2293] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:41 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:41.932672 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2e9761d2-b7d2-478a-b202-86a3605af0dc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:41.933306 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2e9761d2-b7d2-478a-b202-86a3605af0dc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:41.939636 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2e9761d2-b7d2-478a-b202-86a3605af0dc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:41.940614 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2e9761d2-b7d2-478a-b202-86a3605af0dc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:41.941037 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2e9761d2-b7d2-478a-b202-86a3605af0dc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:41.941720 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2e9761d2-b7d2-478a-b202-86a3605af0dc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:41.942160 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2e9761d2-b7d2-478a-b202-86a3605af0dc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:41.942578 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2e9761d2-b7d2-478a-b202-86a3605af0dc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:42.069355 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2e9761d2-b7d2-478a-b202-86a3605af0dc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:42.077430 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2e9761d2-b7d2-478a-b202-86a3605af0dc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.148533 Oct 11 06:59:42.077985 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1156/2294] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:41 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:42.173958 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6e746a99-912a-4b54-8755-2518b634618d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:42.175044 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6e746a99-912a-4b54-8755-2518b634618d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:42.180868 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e746a99-912a-4b54-8755-2518b634618d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:42.181338 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e746a99-912a-4b54-8755-2518b634618d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:42.181761 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e746a99-912a-4b54-8755-2518b634618d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:42.182444 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e746a99-912a-4b54-8755-2518b634618d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:42.182884 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e746a99-912a-4b54-8755-2518b634618d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:42.183298 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e746a99-912a-4b54-8755-2518b634618d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:42.311284 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6e746a99-912a-4b54-8755-2518b634618d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:42.320375 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6e746a99-912a-4b54-8755-2518b634618d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:42.321732 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6e746a99-912a-4b54-8755-2518b634618d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:42.322874 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6e746a99-912a-4b54-8755-2518b634618d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152837 Oct 11 06:59:42.323441 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1139/2295] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:42 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:42.941915 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a1bc294f-55f4-4f21-b301-8915e7f929be tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:42.942517 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a1bc294f-55f4-4f21-b301-8915e7f929be tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:42.948882 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a1bc294f-55f4-4f21-b301-8915e7f929be tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:42.949351 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a1bc294f-55f4-4f21-b301-8915e7f929be tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:42.949777 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a1bc294f-55f4-4f21-b301-8915e7f929be tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:42.950447 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a1bc294f-55f4-4f21-b301-8915e7f929be tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:42.950887 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a1bc294f-55f4-4f21-b301-8915e7f929be tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:42.951299 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a1bc294f-55f4-4f21-b301-8915e7f929be tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:43.080012 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a1bc294f-55f4-4f21-b301-8915e7f929be tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:43.088130 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a1bc294f-55f4-4f21-b301-8915e7f929be tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150566 Oct 11 06:59:43.088679 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1157/2296] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:42 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:43.101078 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8d42508e-f6dd-4d80-abba-789d79881e17 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:43.101677 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8d42508e-f6dd-4d80-abba-789d79881e17 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:43.108027 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d42508e-f6dd-4d80-abba-789d79881e17 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:43.108494 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d42508e-f6dd-4d80-abba-789d79881e17 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:43.108920 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d42508e-f6dd-4d80-abba-789d79881e17 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:43.109626 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d42508e-f6dd-4d80-abba-789d79881e17 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:43.110070 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d42508e-f6dd-4d80-abba-789d79881e17 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:43.110522 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d42508e-f6dd-4d80-abba-789d79881e17 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:43.237554 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8d42508e-f6dd-4d80-abba-789d79881e17 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:43.246312 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8d42508e-f6dd-4d80-abba-789d79881e17 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.148796 Oct 11 06:59:43.246931 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1140/2297] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:43 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:43.348396 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c4e16900-9a10-4ad7-bfdf-7a0ae47cece3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:43.348994 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c4e16900-9a10-4ad7-bfdf-7a0ae47cece3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:43.354810 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c4e16900-9a10-4ad7-bfdf-7a0ae47cece3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:43.355276 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c4e16900-9a10-4ad7-bfdf-7a0ae47cece3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:43.355727 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c4e16900-9a10-4ad7-bfdf-7a0ae47cece3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:43.356401 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c4e16900-9a10-4ad7-bfdf-7a0ae47cece3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:43.356840 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c4e16900-9a10-4ad7-bfdf-7a0ae47cece3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:43.357703 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c4e16900-9a10-4ad7-bfdf-7a0ae47cece3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:43.488583 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c4e16900-9a10-4ad7-bfdf-7a0ae47cece3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:43.497640 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c4e16900-9a10-4ad7-bfdf-7a0ae47cece3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:43.502443 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c4e16900-9a10-4ad7-bfdf-7a0ae47cece3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:43.503633 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c4e16900-9a10-4ad7-bfdf-7a0ae47cece3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.159554 Oct 11 06:59:43.504292 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1158/2298] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:43 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:44.111082 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-82cdae89-ee2d-4cd1-a3cc-2a5f5c9ea118 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:44.111721 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-82cdae89-ee2d-4cd1-a3cc-2a5f5c9ea118 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:44.118619 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82cdae89-ee2d-4cd1-a3cc-2a5f5c9ea118 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:44.119099 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82cdae89-ee2d-4cd1-a3cc-2a5f5c9ea118 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:44.119568 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82cdae89-ee2d-4cd1-a3cc-2a5f5c9ea118 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:44.120256 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82cdae89-ee2d-4cd1-a3cc-2a5f5c9ea118 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:44.121361 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82cdae89-ee2d-4cd1-a3cc-2a5f5c9ea118 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:44.121791 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82cdae89-ee2d-4cd1-a3cc-2a5f5c9ea118 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:44.251393 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-82cdae89-ee2d-4cd1-a3cc-2a5f5c9ea118 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:44.260306 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-82cdae89-ee2d-4cd1-a3cc-2a5f5c9ea118 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.153038 Oct 11 06:59:44.260866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1141/2299] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:44 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:44.270714 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5ea41ee5-734f-41cd-a8eb-31552ef0c44e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:44.271334 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5ea41ee5-734f-41cd-a8eb-31552ef0c44e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:44.277789 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ea41ee5-734f-41cd-a8eb-31552ef0c44e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:44.278269 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ea41ee5-734f-41cd-a8eb-31552ef0c44e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:44.278699 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ea41ee5-734f-41cd-a8eb-31552ef0c44e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:44.279380 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ea41ee5-734f-41cd-a8eb-31552ef0c44e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:44.279854 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ea41ee5-734f-41cd-a8eb-31552ef0c44e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:44.280275 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ea41ee5-734f-41cd-a8eb-31552ef0c44e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:44.407994 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5ea41ee5-734f-41cd-a8eb-31552ef0c44e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:44.416163 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5ea41ee5-734f-41cd-a8eb-31552ef0c44e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.149808 Oct 11 06:59:44.416720 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1159/2300] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:44 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:44.532910 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-73e98e7d-babd-43a2-9e5e-1151cb17b49b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:44.533516 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-73e98e7d-babd-43a2-9e5e-1151cb17b49b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:44.539332 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-73e98e7d-babd-43a2-9e5e-1151cb17b49b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:44.539840 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-73e98e7d-babd-43a2-9e5e-1151cb17b49b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:44.540276 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-73e98e7d-babd-43a2-9e5e-1151cb17b49b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:44.540962 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-73e98e7d-babd-43a2-9e5e-1151cb17b49b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:44.541411 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-73e98e7d-babd-43a2-9e5e-1151cb17b49b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:44.541834 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-73e98e7d-babd-43a2-9e5e-1151cb17b49b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:44.672594 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-73e98e7d-babd-43a2-9e5e-1151cb17b49b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:44.681577 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-73e98e7d-babd-43a2-9e5e-1151cb17b49b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:44.683011 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-73e98e7d-babd-43a2-9e5e-1151cb17b49b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:44.684193 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-73e98e7d-babd-43a2-9e5e-1151cb17b49b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.155174 Oct 11 06:59:44.684741 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1142/2301] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:44 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:45.284702 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7bb86ff7-3ded-437b-984c-282eb850ae87 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:45.285315 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7bb86ff7-3ded-437b-984c-282eb850ae87 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:45.291706 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7bb86ff7-3ded-437b-984c-282eb850ae87 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:45.292185 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7bb86ff7-3ded-437b-984c-282eb850ae87 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:45.292621 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7bb86ff7-3ded-437b-984c-282eb850ae87 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:45.293308 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7bb86ff7-3ded-437b-984c-282eb850ae87 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:45.293754 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7bb86ff7-3ded-437b-984c-282eb850ae87 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:45.294176 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7bb86ff7-3ded-437b-984c-282eb850ae87 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:45.419263 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7bb86ff7-3ded-437b-984c-282eb850ae87 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:45.427472 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7bb86ff7-3ded-437b-984c-282eb850ae87 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.147316 Oct 11 06:59:45.428025 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1160/2302] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:45 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:45.439518 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0364aa4a-d675-4a05-b021-a281c69e7fe5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:45.440178 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0364aa4a-d675-4a05-b021-a281c69e7fe5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:45.446481 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0364aa4a-d675-4a05-b021-a281c69e7fe5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:45.446950 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0364aa4a-d675-4a05-b021-a281c69e7fe5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:45.447376 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0364aa4a-d675-4a05-b021-a281c69e7fe5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:45.448078 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0364aa4a-d675-4a05-b021-a281c69e7fe5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:45.448522 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0364aa4a-d675-4a05-b021-a281c69e7fe5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:45.448934 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0364aa4a-d675-4a05-b021-a281c69e7fe5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:45.575157 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0364aa4a-d675-4a05-b021-a281c69e7fe5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:45.584086 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0364aa4a-d675-4a05-b021-a281c69e7fe5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.148292 Oct 11 06:59:45.584652 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1143/2303] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:45 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:45.710966 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-69d75ebf-6981-4ebe-9e76-c901839aa892 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:45.711538 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-69d75ebf-6981-4ebe-9e76-c901839aa892 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:45.717496 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-69d75ebf-6981-4ebe-9e76-c901839aa892 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:45.717967 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-69d75ebf-6981-4ebe-9e76-c901839aa892 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:45.718397 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-69d75ebf-6981-4ebe-9e76-c901839aa892 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:45.719085 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-69d75ebf-6981-4ebe-9e76-c901839aa892 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:45.719549 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-69d75ebf-6981-4ebe-9e76-c901839aa892 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:45.719971 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-69d75ebf-6981-4ebe-9e76-c901839aa892 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:45.845875 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-69d75ebf-6981-4ebe-9e76-c901839aa892 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:45.854368 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-69d75ebf-6981-4ebe-9e76-c901839aa892 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:45.855889 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-69d75ebf-6981-4ebe-9e76-c901839aa892 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:45.857029 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-69d75ebf-6981-4ebe-9e76-c901839aa892 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.150001 Oct 11 06:59:45.857600 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1161/2304] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:45 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:46.450442 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ca4e208d-708e-4fdf-868b-9faf386b59a9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:46.451047 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ca4e208d-708e-4fdf-868b-9faf386b59a9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:46.457635 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca4e208d-708e-4fdf-868b-9faf386b59a9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:46.458043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca4e208d-708e-4fdf-868b-9faf386b59a9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:46.458467 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca4e208d-708e-4fdf-868b-9faf386b59a9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:46.459139 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca4e208d-708e-4fdf-868b-9faf386b59a9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:46.459616 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca4e208d-708e-4fdf-868b-9faf386b59a9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:46.460030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca4e208d-708e-4fdf-868b-9faf386b59a9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:46.477574 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:59:46.591381 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ca4e208d-708e-4fdf-868b-9faf386b59a9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:46.600442 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ca4e208d-708e-4fdf-868b-9faf386b59a9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.153713 Oct 11 06:59:46.601019 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1144/2305] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:46 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:46.607550 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f22169a8-5da3-4773-a61c-621d5c4aafc0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:46.608233 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f22169a8-5da3-4773-a61c-621d5c4aafc0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:46.615294 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f22169a8-5da3-4773-a61c-621d5c4aafc0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:46.615773 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f22169a8-5da3-4773-a61c-621d5c4aafc0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:46.616208 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f22169a8-5da3-4773-a61c-621d5c4aafc0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:46.616907 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f22169a8-5da3-4773-a61c-621d5c4aafc0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:46.617356 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f22169a8-5da3-4773-a61c-621d5c4aafc0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:46.617765 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f22169a8-5da3-4773-a61c-621d5c4aafc0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:46.751811 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f22169a8-5da3-4773-a61c-621d5c4aafc0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:46.760000 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f22169a8-5da3-4773-a61c-621d5c4aafc0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.156222 Oct 11 06:59:46.760561 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1162/2306] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:46 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:46.882821 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6c293c1e-fb46-43ba-8be9-b465bccafb65 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:46.883497 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6c293c1e-fb46-43ba-8be9-b465bccafb65 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:46.889858 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c293c1e-fb46-43ba-8be9-b465bccafb65 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:46.890331 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c293c1e-fb46-43ba-8be9-b465bccafb65 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:46.890759 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c293c1e-fb46-43ba-8be9-b465bccafb65 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:46.891457 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c293c1e-fb46-43ba-8be9-b465bccafb65 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:46.891908 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c293c1e-fb46-43ba-8be9-b465bccafb65 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:46.892327 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c293c1e-fb46-43ba-8be9-b465bccafb65 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:47.018681 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6c293c1e-fb46-43ba-8be9-b465bccafb65 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:47.027096 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6c293c1e-fb46-43ba-8be9-b465bccafb65 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:47.028557 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6c293c1e-fb46-43ba-8be9-b465bccafb65 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:47.029709 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6c293c1e-fb46-43ba-8be9-b465bccafb65 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.150984 Oct 11 06:59:47.030292 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1145/2307] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:46 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:47.627119 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-02174d43-83b4-4cc4-b6ac-259aa0d53c60 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:47.628325 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-02174d43-83b4-4cc4-b6ac-259aa0d53c60 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:47.634755 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02174d43-83b4-4cc4-b6ac-259aa0d53c60 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:47.635236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02174d43-83b4-4cc4-b6ac-259aa0d53c60 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:47.635696 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02174d43-83b4-4cc4-b6ac-259aa0d53c60 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:47.636377 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02174d43-83b4-4cc4-b6ac-259aa0d53c60 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:47.636820 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02174d43-83b4-4cc4-b6ac-259aa0d53c60 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:47.637243 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02174d43-83b4-4cc4-b6ac-259aa0d53c60 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:47.763276 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-02174d43-83b4-4cc4-b6ac-259aa0d53c60 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:47.771610 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-02174d43-83b4-4cc4-b6ac-259aa0d53c60 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.148324 Oct 11 06:59:47.772165 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1163/2308] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:47 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:47.784402 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0043150a-784a-4f96-87d0-115299d9de69 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:47.785088 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0043150a-784a-4f96-87d0-115299d9de69 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:47.791263 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0043150a-784a-4f96-87d0-115299d9de69 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:47.791773 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0043150a-784a-4f96-87d0-115299d9de69 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:47.792214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0043150a-784a-4f96-87d0-115299d9de69 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:47.792899 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0043150a-784a-4f96-87d0-115299d9de69 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:47.793345 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0043150a-784a-4f96-87d0-115299d9de69 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:47.793765 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0043150a-784a-4f96-87d0-115299d9de69 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:47.921135 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0043150a-784a-4f96-87d0-115299d9de69 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:47.930571 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0043150a-784a-4f96-87d0-115299d9de69 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.150303 Oct 11 06:59:47.931154 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1146/2309] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:47 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:48.055921 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-898052a8-046c-42b6-98d2-d819b33a7725 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:48.056526 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-898052a8-046c-42b6-98d2-d819b33a7725 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:48.062355 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-898052a8-046c-42b6-98d2-d819b33a7725 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:48.062830 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-898052a8-046c-42b6-98d2-d819b33a7725 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:48.063392 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-898052a8-046c-42b6-98d2-d819b33a7725 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:48.064104 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-898052a8-046c-42b6-98d2-d819b33a7725 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:48.064556 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-898052a8-046c-42b6-98d2-d819b33a7725 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:48.064980 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-898052a8-046c-42b6-98d2-d819b33a7725 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:48.192754 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-898052a8-046c-42b6-98d2-d819b33a7725 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:48.196180 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:59:48.202005 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-898052a8-046c-42b6-98d2-d819b33a7725 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:48.203443 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-898052a8-046c-42b6-98d2-d819b33a7725 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:48.204603 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-898052a8-046c-42b6-98d2-d819b33a7725 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152649 Oct 11 06:59:48.205156 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1164/2310] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:48 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:48.795004 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7ae0622e-e6b8-4f50-b791-0e30b8aa5505 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:48.795657 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7ae0622e-e6b8-4f50-b791-0e30b8aa5505 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:48.802088 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7ae0622e-e6b8-4f50-b791-0e30b8aa5505 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:48.802564 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7ae0622e-e6b8-4f50-b791-0e30b8aa5505 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:48.802996 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7ae0622e-e6b8-4f50-b791-0e30b8aa5505 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:48.803710 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7ae0622e-e6b8-4f50-b791-0e30b8aa5505 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:48.804163 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7ae0622e-e6b8-4f50-b791-0e30b8aa5505 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:48.804582 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7ae0622e-e6b8-4f50-b791-0e30b8aa5505 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:48.930220 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7ae0622e-e6b8-4f50-b791-0e30b8aa5505 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:48.938384 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7ae0622e-e6b8-4f50-b791-0e30b8aa5505 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.147157 Oct 11 06:59:48.938939 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1147/2311] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:48 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:48.953979 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a822f519-e42b-4879-88bb-4f605593b42c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:48.954582 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a822f519-e42b-4879-88bb-4f605593b42c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:48.961187 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a822f519-e42b-4879-88bb-4f605593b42c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:48.961582 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a822f519-e42b-4879-88bb-4f605593b42c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:48.962009 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a822f519-e42b-4879-88bb-4f605593b42c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:48.962691 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a822f519-e42b-4879-88bb-4f605593b42c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:48.963136 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a822f519-e42b-4879-88bb-4f605593b42c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:48.963593 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a822f519-e42b-4879-88bb-4f605593b42c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:49.088935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a822f519-e42b-4879-88bb-4f605593b42c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:49.096994 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a822f519-e42b-4879-88bb-4f605593b42c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.147002 Oct 11 06:59:49.097546 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1165/2312] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:48 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:49.230040 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-67ed40b9-2436-4c62-95ad-51d688d26b90 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:49.230572 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-67ed40b9-2436-4c62-95ad-51d688d26b90 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:49.236574 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-67ed40b9-2436-4c62-95ad-51d688d26b90 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:49.237553 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-67ed40b9-2436-4c62-95ad-51d688d26b90 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:49.237980 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-67ed40b9-2436-4c62-95ad-51d688d26b90 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:49.238649 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-67ed40b9-2436-4c62-95ad-51d688d26b90 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:49.239206 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-67ed40b9-2436-4c62-95ad-51d688d26b90 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:49.239652 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-67ed40b9-2436-4c62-95ad-51d688d26b90 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:49.363813 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-67ed40b9-2436-4c62-95ad-51d688d26b90 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:49.372220 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-67ed40b9-2436-4c62-95ad-51d688d26b90 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:49.373643 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-67ed40b9-2436-4c62-95ad-51d688d26b90 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:49.374782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-67ed40b9-2436-4c62-95ad-51d688d26b90 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.148621 Oct 11 06:59:49.375433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1148/2313] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:49 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 06:59:49.961782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0484dd18-7d9b-4458-84a2-8ba17b39f724 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:49.962390 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0484dd18-7d9b-4458-84a2-8ba17b39f724 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:49.968804 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0484dd18-7d9b-4458-84a2-8ba17b39f724 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:49.969273 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0484dd18-7d9b-4458-84a2-8ba17b39f724 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:49.969697 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0484dd18-7d9b-4458-84a2-8ba17b39f724 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:49.970368 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0484dd18-7d9b-4458-84a2-8ba17b39f724 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:49.970811 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0484dd18-7d9b-4458-84a2-8ba17b39f724 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:49.971891 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0484dd18-7d9b-4458-84a2-8ba17b39f724 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:50.098182 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0484dd18-7d9b-4458-84a2-8ba17b39f724 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:50.106228 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0484dd18-7d9b-4458-84a2-8ba17b39f724 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.148316 Oct 11 06:59:50.106813 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1166/2314] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:49 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:50.120243 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5f36839e-d3ce-4dbb-8ae8-e5d8ae2a0446 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:50.120887 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5f36839e-d3ce-4dbb-8ae8-e5d8ae2a0446 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:50.123233 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=78 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:59:50.128489 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f36839e-d3ce-4dbb-8ae8-e5d8ae2a0446 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:50.128973 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f36839e-d3ce-4dbb-8ae8-e5d8ae2a0446 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:50.129410 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f36839e-d3ce-4dbb-8ae8-e5d8ae2a0446 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:50.130103 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f36839e-d3ce-4dbb-8ae8-e5d8ae2a0446 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:50.130556 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f36839e-d3ce-4dbb-8ae8-e5d8ae2a0446 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:50.130982 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f36839e-d3ce-4dbb-8ae8-e5d8ae2a0446 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:50.258903 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5f36839e-d3ce-4dbb-8ae8-e5d8ae2a0446 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:50.267321 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5f36839e-d3ce-4dbb-8ae8-e5d8ae2a0446 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.150893 Oct 11 06:59:50.267919 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1149/2315] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:50 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:50.399528 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-284fa536-31d1-4dd3-852e-590da3987a09 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:50.400125 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-284fa536-31d1-4dd3-852e-590da3987a09 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:50.405913 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-284fa536-31d1-4dd3-852e-590da3987a09 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:50.406385 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-284fa536-31d1-4dd3-852e-590da3987a09 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:50.406810 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-284fa536-31d1-4dd3-852e-590da3987a09 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:50.407994 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-284fa536-31d1-4dd3-852e-590da3987a09 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:50.407994 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-284fa536-31d1-4dd3-852e-590da3987a09 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:50.408344 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-284fa536-31d1-4dd3-852e-590da3987a09 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:50.534652 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-284fa536-31d1-4dd3-852e-590da3987a09 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:50.543082 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-284fa536-31d1-4dd3-852e-590da3987a09 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:50.544544 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-284fa536-31d1-4dd3-852e-590da3987a09 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:50.545677 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-284fa536-31d1-4dd3-852e-590da3987a09 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.150009 Oct 11 06:59:50.546227 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1167/2316] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:50 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:51.129514 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f8b2abfc-4329-4739-a27b-74bca3652e7b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:51.130118 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f8b2abfc-4329-4739-a27b-74bca3652e7b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:51.136532 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f8b2abfc-4329-4739-a27b-74bca3652e7b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:51.137029 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f8b2abfc-4329-4739-a27b-74bca3652e7b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:51.137454 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f8b2abfc-4329-4739-a27b-74bca3652e7b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:51.138130 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f8b2abfc-4329-4739-a27b-74bca3652e7b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:51.138574 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f8b2abfc-4329-4739-a27b-74bca3652e7b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:51.139246 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f8b2abfc-4329-4739-a27b-74bca3652e7b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:51.264228 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f8b2abfc-4329-4739-a27b-74bca3652e7b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:51.272226 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f8b2abfc-4329-4739-a27b-74bca3652e7b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.147080 Oct 11 06:59:51.272781 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1150/2317] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:51 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:51.290007 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6cf63ce5-7457-4012-9876-3187b993bf50 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:51.290608 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6cf63ce5-7457-4012-9876-3187b993bf50 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:51.296647 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6cf63ce5-7457-4012-9876-3187b993bf50 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:51.297109 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6cf63ce5-7457-4012-9876-3187b993bf50 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:51.297539 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6cf63ce5-7457-4012-9876-3187b993bf50 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:51.298253 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6cf63ce5-7457-4012-9876-3187b993bf50 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:51.298702 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6cf63ce5-7457-4012-9876-3187b993bf50 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:51.299645 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6cf63ce5-7457-4012-9876-3187b993bf50 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:51.423483 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6cf63ce5-7457-4012-9876-3187b993bf50 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:51.432223 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6cf63ce5-7457-4012-9876-3187b993bf50 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.146148 Oct 11 06:59:51.432777 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1168/2318] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:51 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:51.570770 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d7dc1919-7d6c-4edb-98df-3a2e4a42c218 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:51.571381 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d7dc1919-7d6c-4edb-98df-3a2e4a42c218 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:51.577268 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d7dc1919-7d6c-4edb-98df-3a2e4a42c218 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:51.577747 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d7dc1919-7d6c-4edb-98df-3a2e4a42c218 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:51.578181 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d7dc1919-7d6c-4edb-98df-3a2e4a42c218 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:51.578872 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d7dc1919-7d6c-4edb-98df-3a2e4a42c218 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:51.579323 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d7dc1919-7d6c-4edb-98df-3a2e4a42c218 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:51.579774 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d7dc1919-7d6c-4edb-98df-3a2e4a42c218 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:51.710367 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d7dc1919-7d6c-4edb-98df-3a2e4a42c218 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:51.718897 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d7dc1919-7d6c-4edb-98df-3a2e4a42c218 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:51.720366 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d7dc1919-7d6c-4edb-98df-3a2e4a42c218 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:51.722058 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d7dc1919-7d6c-4edb-98df-3a2e4a42c218 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.155094 Oct 11 06:59:51.722619 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1151/2319] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:51 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:52.295239 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4263f919-e500-4070-b319-b2eab4fb1462 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:52.295801 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4263f919-e500-4070-b319-b2eab4fb1462 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:52.302092 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4263f919-e500-4070-b319-b2eab4fb1462 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:52.302565 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4263f919-e500-4070-b319-b2eab4fb1462 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:52.302987 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4263f919-e500-4070-b319-b2eab4fb1462 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:52.303691 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4263f919-e500-4070-b319-b2eab4fb1462 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:52.304128 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4263f919-e500-4070-b319-b2eab4fb1462 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:52.304541 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4263f919-e500-4070-b319-b2eab4fb1462 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:52.433089 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4263f919-e500-4070-b319-b2eab4fb1462 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:52.441772 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4263f919-e500-4070-b319-b2eab4fb1462 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150443 Oct 11 06:59:52.442327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1169/2320] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:52 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:52.456797 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-759c201a-9e46-4345-94a0-d860369ffe40 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:52.457435 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-759c201a-9e46-4345-94a0-d860369ffe40 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:52.463789 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-759c201a-9e46-4345-94a0-d860369ffe40 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:52.464291 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-759c201a-9e46-4345-94a0-d860369ffe40 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:52.464721 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-759c201a-9e46-4345-94a0-d860369ffe40 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:52.465403 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-759c201a-9e46-4345-94a0-d860369ffe40 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:52.465912 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-759c201a-9e46-4345-94a0-d860369ffe40 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:52.466342 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-759c201a-9e46-4345-94a0-d860369ffe40 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:52.593043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-759c201a-9e46-4345-94a0-d860369ffe40 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:52.601258 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-759c201a-9e46-4345-94a0-d860369ffe40 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.148920 Oct 11 06:59:52.601861 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1152/2321] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:52 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:52.748056 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bd6955a8-74a6-4838-bcea-217a901fa2ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:52.748655 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bd6955a8-74a6-4838-bcea-217a901fa2ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:52.755403 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bd6955a8-74a6-4838-bcea-217a901fa2ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:52.755913 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bd6955a8-74a6-4838-bcea-217a901fa2ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:52.756345 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bd6955a8-74a6-4838-bcea-217a901fa2ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:52.757065 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bd6955a8-74a6-4838-bcea-217a901fa2ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:52.757515 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bd6955a8-74a6-4838-bcea-217a901fa2ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:52.757935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bd6955a8-74a6-4838-bcea-217a901fa2ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:52.882791 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bd6955a8-74a6-4838-bcea-217a901fa2ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:52.891612 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bd6955a8-74a6-4838-bcea-217a901fa2ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:52.893050 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bd6955a8-74a6-4838-bcea-217a901fa2ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:52.894197 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bd6955a8-74a6-4838-bcea-217a901fa2ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.150102 Oct 11 06:59:52.894750 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1170/2322] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:52 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:53.465429 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5ff3ce0a-917c-469b-b226-2fd4034800aa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:53.466029 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5ff3ce0a-917c-469b-b226-2fd4034800aa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:53.472900 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ff3ce0a-917c-469b-b226-2fd4034800aa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:53.473364 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ff3ce0a-917c-469b-b226-2fd4034800aa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:53.473787 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ff3ce0a-917c-469b-b226-2fd4034800aa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:53.474464 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ff3ce0a-917c-469b-b226-2fd4034800aa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:53.474903 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ff3ce0a-917c-469b-b226-2fd4034800aa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:53.475316 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5ff3ce0a-917c-469b-b226-2fd4034800aa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:53.603815 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5ff3ce0a-917c-469b-b226-2fd4034800aa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:53.612283 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5ff3ce0a-917c-469b-b226-2fd4034800aa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150553 Oct 11 06:59:53.612900 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1153/2323] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:53 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:53.624666 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c2c434be-59e0-46ca-b8fa-4d22455d2d81 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:53.625273 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c2c434be-59e0-46ca-b8fa-4d22455d2d81 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:53.631876 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c2c434be-59e0-46ca-b8fa-4d22455d2d81 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:53.632381 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c2c434be-59e0-46ca-b8fa-4d22455d2d81 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:53.632807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c2c434be-59e0-46ca-b8fa-4d22455d2d81 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:53.633522 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c2c434be-59e0-46ca-b8fa-4d22455d2d81 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:53.634219 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c2c434be-59e0-46ca-b8fa-4d22455d2d81 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:53.634438 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c2c434be-59e0-46ca-b8fa-4d22455d2d81 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:53.764746 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c2c434be-59e0-46ca-b8fa-4d22455d2d81 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:53.773939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c2c434be-59e0-46ca-b8fa-4d22455d2d81 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.153043 Oct 11 06:59:53.774496 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1171/2324] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:53 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:53.918881 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-fd227584-01c7-4fc6-a74d-e758d5934a6f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:53.919438 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-fd227584-01c7-4fc6-a74d-e758d5934a6f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:53.925355 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fd227584-01c7-4fc6-a74d-e758d5934a6f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:53.925825 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fd227584-01c7-4fc6-a74d-e758d5934a6f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:53.926255 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fd227584-01c7-4fc6-a74d-e758d5934a6f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:53.926941 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fd227584-01c7-4fc6-a74d-e758d5934a6f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:53.927389 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fd227584-01c7-4fc6-a74d-e758d5934a6f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:53.927836 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fd227584-01c7-4fc6-a74d-e758d5934a6f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:54.054925 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-fd227584-01c7-4fc6-a74d-e758d5934a6f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:54.063592 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-fd227584-01c7-4fc6-a74d-e758d5934a6f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:54.065547 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-fd227584-01c7-4fc6-a74d-e758d5934a6f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:54.066695 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-fd227584-01c7-4fc6-a74d-e758d5934a6f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.151794 Oct 11 06:59:54.067241 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1154/2325] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:53 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:54.634156 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-49e21b33-d262-4f92-869d-2508fea9e2d1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:54.634766 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-49e21b33-d262-4f92-869d-2508fea9e2d1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:54.641445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49e21b33-d262-4f92-869d-2508fea9e2d1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:54.641921 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49e21b33-d262-4f92-869d-2508fea9e2d1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:54.642385 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49e21b33-d262-4f92-869d-2508fea9e2d1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:54.643075 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49e21b33-d262-4f92-869d-2508fea9e2d1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:54.643551 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49e21b33-d262-4f92-869d-2508fea9e2d1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:54.643978 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49e21b33-d262-4f92-869d-2508fea9e2d1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:54.774946 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-49e21b33-d262-4f92-869d-2508fea9e2d1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:54.783061 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-49e21b33-d262-4f92-869d-2508fea9e2d1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.152734 Oct 11 06:59:54.783659 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1172/2326] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:54 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:54.797088 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-13856ca4-ce72-46d5-a7b8-4e85723e0f6d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:54.797702 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-13856ca4-ce72-46d5-a7b8-4e85723e0f6d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:54.804094 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13856ca4-ce72-46d5-a7b8-4e85723e0f6d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:54.804575 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13856ca4-ce72-46d5-a7b8-4e85723e0f6d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:54.805011 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13856ca4-ce72-46d5-a7b8-4e85723e0f6d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:54.805697 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13856ca4-ce72-46d5-a7b8-4e85723e0f6d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:54.806150 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13856ca4-ce72-46d5-a7b8-4e85723e0f6d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:54.806574 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13856ca4-ce72-46d5-a7b8-4e85723e0f6d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:54.931368 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-13856ca4-ce72-46d5-a7b8-4e85723e0f6d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:54.939440 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-13856ca4-ce72-46d5-a7b8-4e85723e0f6d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.146128 Oct 11 06:59:54.940554 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1155/2327] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:54 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:55.092562 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bd6c320d-9e97-4283-92ee-ef930a22780c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:55.093165 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bd6c320d-9e97-4283-92ee-ef930a22780c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:55.099047 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bd6c320d-9e97-4283-92ee-ef930a22780c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:55.099551 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bd6c320d-9e97-4283-92ee-ef930a22780c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:55.099985 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bd6c320d-9e97-4283-92ee-ef930a22780c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:55.100663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bd6c320d-9e97-4283-92ee-ef930a22780c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:55.101109 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bd6c320d-9e97-4283-92ee-ef930a22780c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:55.101530 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bd6c320d-9e97-4283-92ee-ef930a22780c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:55.225301 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bd6c320d-9e97-4283-92ee-ef930a22780c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:55.233762 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bd6c320d-9e97-4283-92ee-ef930a22780c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:55.235184 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bd6c320d-9e97-4283-92ee-ef930a22780c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:55.236849 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bd6c320d-9e97-4283-92ee-ef930a22780c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.147656 Oct 11 06:59:55.237408 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1173/2328] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:55 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:55.805760 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f03c0815-0b59-43e4-bd5b-a3f03cdb954b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:55.806383 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f03c0815-0b59-43e4-bd5b-a3f03cdb954b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:55.812788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f03c0815-0b59-43e4-bd5b-a3f03cdb954b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:55.813266 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f03c0815-0b59-43e4-bd5b-a3f03cdb954b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:55.813699 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f03c0815-0b59-43e4-bd5b-a3f03cdb954b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:55.814387 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f03c0815-0b59-43e4-bd5b-a3f03cdb954b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:55.814868 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f03c0815-0b59-43e4-bd5b-a3f03cdb954b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:55.815286 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f03c0815-0b59-43e4-bd5b-a3f03cdb954b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:55.945655 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f03c0815-0b59-43e4-bd5b-a3f03cdb954b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:55.953757 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f03c0815-0b59-43e4-bd5b-a3f03cdb954b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.151833 Oct 11 06:59:55.954314 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1156/2329] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:55 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:55.963373 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c9b60a5b-2cf0-4d61-8978-57748e02df85 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:55.964023 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c9b60a5b-2cf0-4d61-8978-57748e02df85 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:55.970482 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c9b60a5b-2cf0-4d61-8978-57748e02df85 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:55.971624 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c9b60a5b-2cf0-4d61-8978-57748e02df85 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:55.972061 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c9b60a5b-2cf0-4d61-8978-57748e02df85 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:55.972751 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c9b60a5b-2cf0-4d61-8978-57748e02df85 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:55.973227 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c9b60a5b-2cf0-4d61-8978-57748e02df85 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:55.973651 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c9b60a5b-2cf0-4d61-8978-57748e02df85 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:56.100817 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c9b60a5b-2cf0-4d61-8978-57748e02df85 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:56.109040 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c9b60a5b-2cf0-4d61-8978-57748e02df85 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.149403 Oct 11 06:59:56.109598 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1174/2330] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:55 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:56.261661 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b6a5aa55-5c74-47ae-a4aa-9e48b23f6435 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:56.262274 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b6a5aa55-5c74-47ae-a4aa-9e48b23f6435 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:56.269336 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b6a5aa55-5c74-47ae-a4aa-9e48b23f6435 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:56.269820 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b6a5aa55-5c74-47ae-a4aa-9e48b23f6435 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:56.270259 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b6a5aa55-5c74-47ae-a4aa-9e48b23f6435 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:56.270958 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b6a5aa55-5c74-47ae-a4aa-9e48b23f6435 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:56.271410 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b6a5aa55-5c74-47ae-a4aa-9e48b23f6435 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:56.271854 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b6a5aa55-5c74-47ae-a4aa-9e48b23f6435 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:56.398266 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b6a5aa55-5c74-47ae-a4aa-9e48b23f6435 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:56.406752 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b6a5aa55-5c74-47ae-a4aa-9e48b23f6435 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:56.408211 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b6a5aa55-5c74-47ae-a4aa-9e48b23f6435 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:56.409365 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b6a5aa55-5c74-47ae-a4aa-9e48b23f6435 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.151591 Oct 11 06:59:56.409917 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1157/2331] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:56 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:56.978527 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-01700554-c696-4fae-ac0c-6c000887f559 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:56.979137 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-01700554-c696-4fae-ac0c-6c000887f559 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:56.985519 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-01700554-c696-4fae-ac0c-6c000887f559 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:56.985994 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-01700554-c696-4fae-ac0c-6c000887f559 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:56.987027 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-01700554-c696-4fae-ac0c-6c000887f559 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:56.987733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-01700554-c696-4fae-ac0c-6c000887f559 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:56.988181 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-01700554-c696-4fae-ac0c-6c000887f559 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:56.988600 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-01700554-c696-4fae-ac0c-6c000887f559 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:57.113307 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-01700554-c696-4fae-ac0c-6c000887f559 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:57.121522 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-01700554-c696-4fae-ac0c-6c000887f559 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.146842 Oct 11 06:59:57.122082 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1175/2332] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:56 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:57.131709 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ca122c9a-d441-4c66-9ae7-5f7ad4e562ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:57.132461 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ca122c9a-d441-4c66-9ae7-5f7ad4e562ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:57.139162 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca122c9a-d441-4c66-9ae7-5f7ad4e562ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:57.139673 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca122c9a-d441-4c66-9ae7-5f7ad4e562ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:57.140100 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca122c9a-d441-4c66-9ae7-5f7ad4e562ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:57.140777 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca122c9a-d441-4c66-9ae7-5f7ad4e562ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:57.141217 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca122c9a-d441-4c66-9ae7-5f7ad4e562ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:57.141631 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca122c9a-d441-4c66-9ae7-5f7ad4e562ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:57.271936 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ca122c9a-d441-4c66-9ae7-5f7ad4e562ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:57.280058 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ca122c9a-d441-4c66-9ae7-5f7ad4e562ce tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.152073 Oct 11 06:59:57.280619 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1158/2333] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:57 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:57.435182 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d7f7cc60-3d61-4835-a64b-e507ec8d6742 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:57.435822 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d7f7cc60-3d61-4835-a64b-e507ec8d6742 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:57.441838 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7f7cc60-3d61-4835-a64b-e507ec8d6742 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:57.442314 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7f7cc60-3d61-4835-a64b-e507ec8d6742 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:57.442745 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7f7cc60-3d61-4835-a64b-e507ec8d6742 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:57.443449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7f7cc60-3d61-4835-a64b-e507ec8d6742 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:57.443899 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7f7cc60-3d61-4835-a64b-e507ec8d6742 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:57.444319 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7f7cc60-3d61-4835-a64b-e507ec8d6742 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:57.573380 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d7f7cc60-3d61-4835-a64b-e507ec8d6742 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:57.582484 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d7f7cc60-3d61-4835-a64b-e507ec8d6742 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:57.583923 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d7f7cc60-3d61-4835-a64b-e507ec8d6742 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:57.585058 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d7f7cc60-3d61-4835-a64b-e507ec8d6742 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.153786 Oct 11 06:59:57.585605 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1176/2334] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:57 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:58.144510 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-499324d1-2044-4284-be04-5d5412ba1553 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:58.145128 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-499324d1-2044-4284-be04-5d5412ba1553 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:58.151427 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-499324d1-2044-4284-be04-5d5412ba1553 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:58.151928 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-499324d1-2044-4284-be04-5d5412ba1553 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:58.152361 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-499324d1-2044-4284-be04-5d5412ba1553 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:58.153053 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-499324d1-2044-4284-be04-5d5412ba1553 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:58.153501 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-499324d1-2044-4284-be04-5d5412ba1553 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:58.153925 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-499324d1-2044-4284-be04-5d5412ba1553 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:58.291518 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-499324d1-2044-4284-be04-5d5412ba1553 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:58.300114 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-499324d1-2044-4284-be04-5d5412ba1553 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.159405 Oct 11 06:59:58.300676 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1159/2335] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:58 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:58.304678 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-05892109-a810-426a-b6d4-d4f0f9d71dff tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:58.305365 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-05892109-a810-426a-b6d4-d4f0f9d71dff tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:58.312022 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05892109-a810-426a-b6d4-d4f0f9d71dff tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:58.312690 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05892109-a810-426a-b6d4-d4f0f9d71dff tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:58.313192 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05892109-a810-426a-b6d4-d4f0f9d71dff tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:58.314010 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05892109-a810-426a-b6d4-d4f0f9d71dff tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:58.314557 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05892109-a810-426a-b6d4-d4f0f9d71dff tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:58.315211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05892109-a810-426a-b6d4-d4f0f9d71dff tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:58.447298 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-05892109-a810-426a-b6d4-d4f0f9d71dff tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:58.455366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-05892109-a810-426a-b6d4-d4f0f9d71dff tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.154786 Oct 11 06:59:58.455940 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1177/2336] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:58 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:59:58.609848 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-46ed2d2f-de49-47c3-a499-6d15fa128bc6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:58.610453 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-46ed2d2f-de49-47c3-a499-6d15fa128bc6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:58.616849 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-46ed2d2f-de49-47c3-a499-6d15fa128bc6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:58.617319 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-46ed2d2f-de49-47c3-a499-6d15fa128bc6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:58.617744 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-46ed2d2f-de49-47c3-a499-6d15fa128bc6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:58.618425 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-46ed2d2f-de49-47c3-a499-6d15fa128bc6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:58.618903 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-46ed2d2f-de49-47c3-a499-6d15fa128bc6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:58.619313 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-46ed2d2f-de49-47c3-a499-6d15fa128bc6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:58.743765 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-46ed2d2f-de49-47c3-a499-6d15fa128bc6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:58.752689 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-46ed2d2f-de49-47c3-a499-6d15fa128bc6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:58.754194 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-46ed2d2f-de49-47c3-a499-6d15fa128bc6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:58.755384 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-46ed2d2f-de49-47c3-a499-6d15fa128bc6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.149306 Oct 11 06:59:58.755962 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1160/2337] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:58 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 06:59:59.323091 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e7d26650-825e-433e-813e-4b0ff6b7b068 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:59.323751 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e7d26650-825e-433e-813e-4b0ff6b7b068 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:59.330301 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7d26650-825e-433e-813e-4b0ff6b7b068 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:59.330840 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7d26650-825e-433e-813e-4b0ff6b7b068 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:59.331342 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7d26650-825e-433e-813e-4b0ff6b7b068 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:59.332752 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7d26650-825e-433e-813e-4b0ff6b7b068 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:59.333278 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7d26650-825e-433e-813e-4b0ff6b7b068 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:59.333758 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7d26650-825e-433e-813e-4b0ff6b7b068 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:59.461934 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e7d26650-825e-433e-813e-4b0ff6b7b068 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:59.470199 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e7d26650-825e-433e-813e-4b0ff6b7b068 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.151128 Oct 11 06:59:59.470748 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1178/2338] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:59 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:59.477932 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a4b4103b-2b69-4933-8a80-6938fafc3b33 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:59.478539 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a4b4103b-2b69-4933-8a80-6938fafc3b33 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:59.485030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a4b4103b-2b69-4933-8a80-6938fafc3b33 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:59.485512 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a4b4103b-2b69-4933-8a80-6938fafc3b33 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:59.485948 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a4b4103b-2b69-4933-8a80-6938fafc3b33 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:59.486641 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a4b4103b-2b69-4933-8a80-6938fafc3b33 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:59.487095 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a4b4103b-2b69-4933-8a80-6938fafc3b33 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:59.487552 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a4b4103b-2b69-4933-8a80-6938fafc3b33 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:59.492913 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:59:59.620110 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a4b4103b-2b69-4933-8a80-6938fafc3b33 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:59.630126 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a4b4103b-2b69-4933-8a80-6938fafc3b33 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.155983 Oct 11 06:59:59.630689 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1161/2339] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 06:59:59 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:59:59.780863 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-82e19908-54a3-4bfe-9343-1834e2b717c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:59:59.781507 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-82e19908-54a3-4bfe-9343-1834e2b717c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:59:59.787981 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-82e19908-54a3-4bfe-9343-1834e2b717c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:59.788458 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-82e19908-54a3-4bfe-9343-1834e2b717c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:59.788892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-82e19908-54a3-4bfe-9343-1834e2b717c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:59.789574 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-82e19908-54a3-4bfe-9343-1834e2b717c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:59:59.790026 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-82e19908-54a3-4bfe-9343-1834e2b717c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:59:59.790446 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-82e19908-54a3-4bfe-9343-1834e2b717c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:59:59.914323 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-82e19908-54a3-4bfe-9343-1834e2b717c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:59.922926 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-82e19908-54a3-4bfe-9343-1834e2b717c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:59.924387 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-82e19908-54a3-4bfe-9343-1834e2b717c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:59:59.926141 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-82e19908-54a3-4bfe-9343-1834e2b717c2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.148623 Oct 11 06:59:59.926696 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1179/2340] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 06:59:59 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:00:00.493662 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a409d6c7-3324-45df-a9e5-0d1d7dc6d271 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:00.494272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a409d6c7-3324-45df-a9e5-0d1d7dc6d271 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:00.500679 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a409d6c7-3324-45df-a9e5-0d1d7dc6d271 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:00.501150 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a409d6c7-3324-45df-a9e5-0d1d7dc6d271 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:00.501575 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a409d6c7-3324-45df-a9e5-0d1d7dc6d271 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:00.502249 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a409d6c7-3324-45df-a9e5-0d1d7dc6d271 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:00.502690 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a409d6c7-3324-45df-a9e5-0d1d7dc6d271 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:00.503101 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a409d6c7-3324-45df-a9e5-0d1d7dc6d271 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:00.627270 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a409d6c7-3324-45df-a9e5-0d1d7dc6d271 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:00.635849 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a409d6c7-3324-45df-a9e5-0d1d7dc6d271 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.146028 Oct 11 07:00:00.636398 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1162/2341] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:00 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:00:00.653766 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1a61b5de-17ae-4eef-b104-174e93cf19bf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:00.654369 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1a61b5de-17ae-4eef-b104-174e93cf19bf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:00.660779 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1a61b5de-17ae-4eef-b104-174e93cf19bf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:00.661250 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1a61b5de-17ae-4eef-b104-174e93cf19bf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:00.661676 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1a61b5de-17ae-4eef-b104-174e93cf19bf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:00.662357 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1a61b5de-17ae-4eef-b104-174e93cf19bf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:00.662807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1a61b5de-17ae-4eef-b104-174e93cf19bf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:00.663223 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1a61b5de-17ae-4eef-b104-174e93cf19bf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:00.789211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1a61b5de-17ae-4eef-b104-174e93cf19bf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:00.797341 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1a61b5de-17ae-4eef-b104-174e93cf19bf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.147425 Oct 11 07:00:00.797895 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1180/2342] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:00 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:00.951319 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b6640e46-6989-46a2-aaa9-6e11cc10857e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:00.951904 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b6640e46-6989-46a2-aaa9-6e11cc10857e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:00.957820 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b6640e46-6989-46a2-aaa9-6e11cc10857e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:00.958304 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b6640e46-6989-46a2-aaa9-6e11cc10857e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:00.958731 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b6640e46-6989-46a2-aaa9-6e11cc10857e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:00.959495 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b6640e46-6989-46a2-aaa9-6e11cc10857e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:00.959890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b6640e46-6989-46a2-aaa9-6e11cc10857e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:00.960309 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b6640e46-6989-46a2-aaa9-6e11cc10857e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:01.091143 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b6640e46-6989-46a2-aaa9-6e11cc10857e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:01.099737 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b6640e46-6989-46a2-aaa9-6e11cc10857e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:01.101169 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b6640e46-6989-46a2-aaa9-6e11cc10857e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:01.102303 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b6640e46-6989-46a2-aaa9-6e11cc10857e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.154985 Oct 11 07:00:01.102864 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1163/2343] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:00 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:00:01.660327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9482e4a6-c120-44ef-960e-57f91e601825 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:01.660861 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9482e4a6-c120-44ef-960e-57f91e601825 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:01.667256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9482e4a6-c120-44ef-960e-57f91e601825 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:01.667762 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9482e4a6-c120-44ef-960e-57f91e601825 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:01.668192 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9482e4a6-c120-44ef-960e-57f91e601825 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:01.668862 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9482e4a6-c120-44ef-960e-57f91e601825 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:01.670214 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9482e4a6-c120-44ef-960e-57f91e601825 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:01.670638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9482e4a6-c120-44ef-960e-57f91e601825 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:01.688115 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:00:01.820781 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9937ff2d-a892-4eab-ab27-430c24c44dea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:01.821548 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9937ff2d-a892-4eab-ab27-430c24c44dea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:01.829902 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9937ff2d-a892-4eab-ab27-430c24c44dea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:01.830387 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9937ff2d-a892-4eab-ab27-430c24c44dea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:01.830815 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9937ff2d-a892-4eab-ab27-430c24c44dea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:01.832178 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9937ff2d-a892-4eab-ab27-430c24c44dea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:01.832911 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9937ff2d-a892-4eab-ab27-430c24c44dea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:01.833544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9937ff2d-a892-4eab-ab27-430c24c44dea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:01.975409 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9937ff2d-a892-4eab-ab27-430c24c44dea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:01.983903 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9937ff2d-a892-4eab-ab27-430c24c44dea tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.166888 Oct 11 07:00:01.984483 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1164/2344] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:01 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:00:02.054558 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9482e4a6-c120-44ef-960e-57f91e601825 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:02.062745 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9482e4a6-c120-44ef-960e-57f91e601825 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.406840 Oct 11 07:00:02.063291 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1181/2345] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:01 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:02.127998 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-522d2b65-37cb-4968-be3e-c5707c6fb3a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:02.129120 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-522d2b65-37cb-4968-be3e-c5707c6fb3a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:02.134898 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-522d2b65-37cb-4968-be3e-c5707c6fb3a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:02.135369 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-522d2b65-37cb-4968-be3e-c5707c6fb3a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:02.135829 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-522d2b65-37cb-4968-be3e-c5707c6fb3a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:02.136505 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-522d2b65-37cb-4968-be3e-c5707c6fb3a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:02.136947 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-522d2b65-37cb-4968-be3e-c5707c6fb3a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:02.137378 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-522d2b65-37cb-4968-be3e-c5707c6fb3a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:02.267047 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-522d2b65-37cb-4968-be3e-c5707c6fb3a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:02.276032 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-522d2b65-37cb-4968-be3e-c5707c6fb3a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:02.277445 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-522d2b65-37cb-4968-be3e-c5707c6fb3a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:02.278587 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-522d2b65-37cb-4968-be3e-c5707c6fb3a1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.154399 Oct 11 07:00:02.279132 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1165/2346] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:02 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:00:03.007599 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3e9ae8db-98a5-451c-b1d3-168cf456b6ca tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:03.008200 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3e9ae8db-98a5-451c-b1d3-168cf456b6ca tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:03.014815 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e9ae8db-98a5-451c-b1d3-168cf456b6ca tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:03.015281 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e9ae8db-98a5-451c-b1d3-168cf456b6ca tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:03.015736 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e9ae8db-98a5-451c-b1d3-168cf456b6ca tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:03.016411 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e9ae8db-98a5-451c-b1d3-168cf456b6ca tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:03.016852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e9ae8db-98a5-451c-b1d3-168cf456b6ca tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:03.017274 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e9ae8db-98a5-451c-b1d3-168cf456b6ca tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:03.086579 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3c6053c0-41aa-449f-bc46-ffcad6e77a05 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:03.087198 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3c6053c0-41aa-449f-bc46-ffcad6e77a05 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:03.093533 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c6053c0-41aa-449f-bc46-ffcad6e77a05 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:03.094004 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c6053c0-41aa-449f-bc46-ffcad6e77a05 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:03.094430 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c6053c0-41aa-449f-bc46-ffcad6e77a05 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:03.095112 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c6053c0-41aa-449f-bc46-ffcad6e77a05 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:03.095596 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c6053c0-41aa-449f-bc46-ffcad6e77a05 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:03.096010 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c6053c0-41aa-449f-bc46-ffcad6e77a05 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:03.146965 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3e9ae8db-98a5-451c-b1d3-168cf456b6ca tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:03.155740 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3e9ae8db-98a5-451c-b1d3-168cf456b6ca tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.151860 Oct 11 07:00:03.156698 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1182/2347] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:03 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:03.303533 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-dbb679d9-3a1f-4d38-bf24-18a44dcdc938 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:03.304041 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-dbb679d9-3a1f-4d38-bf24-18a44dcdc938 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:03.310585 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dbb679d9-3a1f-4d38-bf24-18a44dcdc938 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:03.311282 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dbb679d9-3a1f-4d38-bf24-18a44dcdc938 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:03.311730 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dbb679d9-3a1f-4d38-bf24-18a44dcdc938 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:03.312408 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dbb679d9-3a1f-4d38-bf24-18a44dcdc938 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:03.312847 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dbb679d9-3a1f-4d38-bf24-18a44dcdc938 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:03.313265 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dbb679d9-3a1f-4d38-bf24-18a44dcdc938 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:03.375891 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3c6053c0-41aa-449f-bc46-ffcad6e77a05 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:03.384099 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3c6053c0-41aa-449f-bc46-ffcad6e77a05 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.301302 Oct 11 07:00:03.384657 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1166/2348] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:03 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:00:03.446180 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-dbb679d9-3a1f-4d38-bf24-18a44dcdc938 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:03.454709 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-dbb679d9-3a1f-4d38-bf24-18a44dcdc938 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:03.456175 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-dbb679d9-3a1f-4d38-bf24-18a44dcdc938 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:03.457981 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-dbb679d9-3a1f-4d38-bf24-18a44dcdc938 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.158435 Oct 11 07:00:03.458535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1183/2349] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:03 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:00:04.180627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d48407a2-131d-48be-a14a-a4acaaf55f20 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:04.181259 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d48407a2-131d-48be-a14a-a4acaaf55f20 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:04.187665 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d48407a2-131d-48be-a14a-a4acaaf55f20 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:04.188144 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d48407a2-131d-48be-a14a-a4acaaf55f20 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:04.188577 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d48407a2-131d-48be-a14a-a4acaaf55f20 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:04.189259 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d48407a2-131d-48be-a14a-a4acaaf55f20 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:04.189713 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d48407a2-131d-48be-a14a-a4acaaf55f20 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:04.190136 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d48407a2-131d-48be-a14a-a4acaaf55f20 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:04.316723 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d48407a2-131d-48be-a14a-a4acaaf55f20 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:04.324717 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d48407a2-131d-48be-a14a-a4acaaf55f20 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.147907 Oct 11 07:00:04.325262 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1167/2350] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:04 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:04.408003 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cacf9d9d-b717-4239-a7c7-74b3996e3861 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:04.408546 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cacf9d9d-b717-4239-a7c7-74b3996e3861 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:04.416217 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cacf9d9d-b717-4239-a7c7-74b3996e3861 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:04.417896 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cacf9d9d-b717-4239-a7c7-74b3996e3861 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:04.418329 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cacf9d9d-b717-4239-a7c7-74b3996e3861 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:04.419024 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cacf9d9d-b717-4239-a7c7-74b3996e3861 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:04.419499 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cacf9d9d-b717-4239-a7c7-74b3996e3861 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:04.419926 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cacf9d9d-b717-4239-a7c7-74b3996e3861 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:04.482289 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a9775f80-4c7c-4a63-91b9-16d492f3e817 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:04.482832 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a9775f80-4c7c-4a63-91b9-16d492f3e817 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:04.489233 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a9775f80-4c7c-4a63-91b9-16d492f3e817 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:04.489703 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a9775f80-4c7c-4a63-91b9-16d492f3e817 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:04.490131 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a9775f80-4c7c-4a63-91b9-16d492f3e817 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:04.490817 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a9775f80-4c7c-4a63-91b9-16d492f3e817 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:04.491260 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a9775f80-4c7c-4a63-91b9-16d492f3e817 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:04.491704 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a9775f80-4c7c-4a63-91b9-16d492f3e817 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:04.545512 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cacf9d9d-b717-4239-a7c7-74b3996e3861 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:04.554565 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cacf9d9d-b717-4239-a7c7-74b3996e3861 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150438 Oct 11 07:00:04.555143 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1184/2351] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:04 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:04.622910 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a9775f80-4c7c-4a63-91b9-16d492f3e817 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:04.631944 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a9775f80-4c7c-4a63-91b9-16d492f3e817 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:04.633356 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a9775f80-4c7c-4a63-91b9-16d492f3e817 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:04.634484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a9775f80-4c7c-4a63-91b9-16d492f3e817 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.156122 Oct 11 07:00:04.635016 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1168/2352] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:04 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:00:05.349171 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f22097b1-ebfa-464a-8df9-fcf74b66f204 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:05.349777 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f22097b1-ebfa-464a-8df9-fcf74b66f204 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:05.355707 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f22097b1-ebfa-464a-8df9-fcf74b66f204 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:05.356145 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f22097b1-ebfa-464a-8df9-fcf74b66f204 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:05.356561 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f22097b1-ebfa-464a-8df9-fcf74b66f204 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:05.357240 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f22097b1-ebfa-464a-8df9-fcf74b66f204 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:05.357682 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f22097b1-ebfa-464a-8df9-fcf74b66f204 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:05.358106 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f22097b1-ebfa-464a-8df9-fcf74b66f204 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:05.486800 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f22097b1-ebfa-464a-8df9-fcf74b66f204 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:05.494847 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f22097b1-ebfa-464a-8df9-fcf74b66f204 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.150137 Oct 11 07:00:05.495396 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1185/2353] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:05 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:05.578032 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-dfd69212-19ee-4ad6-9a10-4aaea8a760e1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:05.578637 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-dfd69212-19ee-4ad6-9a10-4aaea8a760e1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:05.585554 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dfd69212-19ee-4ad6-9a10-4aaea8a760e1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:05.586017 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dfd69212-19ee-4ad6-9a10-4aaea8a760e1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:05.586447 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dfd69212-19ee-4ad6-9a10-4aaea8a760e1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:05.587126 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dfd69212-19ee-4ad6-9a10-4aaea8a760e1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:05.587613 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dfd69212-19ee-4ad6-9a10-4aaea8a760e1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:05.588033 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dfd69212-19ee-4ad6-9a10-4aaea8a760e1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:05.661172 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a6fac946-5e24-4e34-b03f-b860d24dae89 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:05.662010 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a6fac946-5e24-4e34-b03f-b860d24dae89 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:05.674659 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6fac946-5e24-4e34-b03f-b860d24dae89 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:05.675145 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6fac946-5e24-4e34-b03f-b860d24dae89 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:05.675699 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6fac946-5e24-4e34-b03f-b860d24dae89 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:05.676547 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6fac946-5e24-4e34-b03f-b860d24dae89 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:05.676957 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6fac946-5e24-4e34-b03f-b860d24dae89 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:05.677378 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6fac946-5e24-4e34-b03f-b860d24dae89 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:05.715842 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-dfd69212-19ee-4ad6-9a10-4aaea8a760e1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:05.725369 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-dfd69212-19ee-4ad6-9a10-4aaea8a760e1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.151030 Oct 11 07:00:05.725940 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1169/2354] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:05 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:05.811685 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a6fac946-5e24-4e34-b03f-b860d24dae89 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:05.820948 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a6fac946-5e24-4e34-b03f-b860d24dae89 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:05.822390 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a6fac946-5e24-4e34-b03f-b860d24dae89 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:05.823633 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a6fac946-5e24-4e34-b03f-b860d24dae89 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.167666 Oct 11 07:00:05.824183 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1186/2355] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:05 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:00:06.518352 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c4a5926e-0e5d-4518-8700-cc741ca4aaa5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:06.519004 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c4a5926e-0e5d-4518-8700-cc741ca4aaa5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:06.524980 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4a5926e-0e5d-4518-8700-cc741ca4aaa5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:06.525464 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4a5926e-0e5d-4518-8700-cc741ca4aaa5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:06.525931 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4a5926e-0e5d-4518-8700-cc741ca4aaa5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:06.526627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4a5926e-0e5d-4518-8700-cc741ca4aaa5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:06.527083 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4a5926e-0e5d-4518-8700-cc741ca4aaa5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:06.527532 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4a5926e-0e5d-4518-8700-cc741ca4aaa5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:06.654027 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c4a5926e-0e5d-4518-8700-cc741ca4aaa5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:06.662614 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c4a5926e-0e5d-4518-8700-cc741ca4aaa5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.148162 Oct 11 07:00:06.663162 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1170/2356] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:06 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:06.748515 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-910563af-5647-4150-9dc2-12d09b6d48ab tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:06.749130 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-910563af-5647-4150-9dc2-12d09b6d48ab tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:06.755942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-910563af-5647-4150-9dc2-12d09b6d48ab tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:06.756418 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-910563af-5647-4150-9dc2-12d09b6d48ab tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:06.756854 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-910563af-5647-4150-9dc2-12d09b6d48ab tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:06.757539 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-910563af-5647-4150-9dc2-12d09b6d48ab tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:06.757990 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-910563af-5647-4150-9dc2-12d09b6d48ab tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:06.758414 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-910563af-5647-4150-9dc2-12d09b6d48ab tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:06.850390 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-141f069c-7636-495b-9ce9-5d567d7b2831 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:06.851089 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-141f069c-7636-495b-9ce9-5d567d7b2831 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:06.857094 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-141f069c-7636-495b-9ce9-5d567d7b2831 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:06.857582 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-141f069c-7636-495b-9ce9-5d567d7b2831 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:06.858019 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-141f069c-7636-495b-9ce9-5d567d7b2831 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:06.858707 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-141f069c-7636-495b-9ce9-5d567d7b2831 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:06.859229 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-141f069c-7636-495b-9ce9-5d567d7b2831 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:06.859685 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-141f069c-7636-495b-9ce9-5d567d7b2831 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:06.889108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-910563af-5647-4150-9dc2-12d09b6d48ab tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:06.897896 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-910563af-5647-4150-9dc2-12d09b6d48ab tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.153206 Oct 11 07:00:06.898470 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1187/2357] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:06 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:06.986842 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-141f069c-7636-495b-9ce9-5d567d7b2831 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:06.995375 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-141f069c-7636-495b-9ce9-5d567d7b2831 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:06.996836 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-141f069c-7636-495b-9ce9-5d567d7b2831 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:06.997992 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-141f069c-7636-495b-9ce9-5d567d7b2831 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152142 Oct 11 07:00:06.998544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1171/2358] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:06 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:00:07.686050 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-45497833-a50d-446b-ae2f-44b42694bfac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:07.686583 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-45497833-a50d-446b-ae2f-44b42694bfac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:07.688487 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=76 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:00:07.694434 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-45497833-a50d-446b-ae2f-44b42694bfac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:07.694920 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-45497833-a50d-446b-ae2f-44b42694bfac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:07.695354 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-45497833-a50d-446b-ae2f-44b42694bfac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:07.696066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-45497833-a50d-446b-ae2f-44b42694bfac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:07.696511 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-45497833-a50d-446b-ae2f-44b42694bfac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:07.696930 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-45497833-a50d-446b-ae2f-44b42694bfac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:07.823756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-45497833-a50d-446b-ae2f-44b42694bfac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:07.832528 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-45497833-a50d-446b-ae2f-44b42694bfac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.150356 Oct 11 07:00:07.833082 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1188/2359] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:07 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:07.921857 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-55540271-5036-4093-95ec-01eaef50150f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:07.922615 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-55540271-5036-4093-95ec-01eaef50150f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:07.929854 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-55540271-5036-4093-95ec-01eaef50150f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:07.930393 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-55540271-5036-4093-95ec-01eaef50150f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:07.930851 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-55540271-5036-4093-95ec-01eaef50150f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:07.931645 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-55540271-5036-4093-95ec-01eaef50150f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:07.932102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-55540271-5036-4093-95ec-01eaef50150f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:07.932528 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-55540271-5036-4093-95ec-01eaef50150f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:08.023451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c7b8cb1e-475d-4eda-a746-65396c9afc4e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:08.024159 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c7b8cb1e-475d-4eda-a746-65396c9afc4e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:08.030268 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c7b8cb1e-475d-4eda-a746-65396c9afc4e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:08.030765 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c7b8cb1e-475d-4eda-a746-65396c9afc4e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:08.031183 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c7b8cb1e-475d-4eda-a746-65396c9afc4e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:08.031902 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c7b8cb1e-475d-4eda-a746-65396c9afc4e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:08.032351 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c7b8cb1e-475d-4eda-a746-65396c9afc4e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:08.032771 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c7b8cb1e-475d-4eda-a746-65396c9afc4e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:08.062014 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-55540271-5036-4093-95ec-01eaef50150f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:08.070271 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-55540271-5036-4093-95ec-01eaef50150f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.152198 Oct 11 07:00:08.070826 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1172/2360] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:07 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:08.158226 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c7b8cb1e-475d-4eda-a746-65396c9afc4e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:08.167434 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c7b8cb1e-475d-4eda-a746-65396c9afc4e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:08.168863 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c7b8cb1e-475d-4eda-a746-65396c9afc4e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:08.170003 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c7b8cb1e-475d-4eda-a746-65396c9afc4e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.150506 Oct 11 07:00:08.170552 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1189/2361] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:08 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:00:08.855626 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-739ee0fe-9690-4277-a426-a02fa6e93bcf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:08.856235 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-739ee0fe-9690-4277-a426-a02fa6e93bcf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:08.862184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-739ee0fe-9690-4277-a426-a02fa6e93bcf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:08.862657 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-739ee0fe-9690-4277-a426-a02fa6e93bcf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:08.863087 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-739ee0fe-9690-4277-a426-a02fa6e93bcf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:08.863802 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-739ee0fe-9690-4277-a426-a02fa6e93bcf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:08.864250 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-739ee0fe-9690-4277-a426-a02fa6e93bcf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:08.864695 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-739ee0fe-9690-4277-a426-a02fa6e93bcf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:08.992703 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-739ee0fe-9690-4277-a426-a02fa6e93bcf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:09.000875 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-739ee0fe-9690-4277-a426-a02fa6e93bcf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.149048 Oct 11 07:00:09.001420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1173/2362] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:08 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:09.093269 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f5d9ff09-eaa1-4bca-9f5f-699bd868dc1f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:09.093799 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f5d9ff09-eaa1-4bca-9f5f-699bd868dc1f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:09.100251 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f5d9ff09-eaa1-4bca-9f5f-699bd868dc1f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:09.100717 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f5d9ff09-eaa1-4bca-9f5f-699bd868dc1f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:09.101138 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f5d9ff09-eaa1-4bca-9f5f-699bd868dc1f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:09.101811 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f5d9ff09-eaa1-4bca-9f5f-699bd868dc1f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:09.102253 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f5d9ff09-eaa1-4bca-9f5f-699bd868dc1f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:09.102666 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f5d9ff09-eaa1-4bca-9f5f-699bd868dc1f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:09.196333 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ce5f4465-c85a-452a-bd00-b9665f5c7ec7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:09.196932 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ce5f4465-c85a-452a-bd00-b9665f5c7ec7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:09.202745 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ce5f4465-c85a-452a-bd00-b9665f5c7ec7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:09.203222 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ce5f4465-c85a-452a-bd00-b9665f5c7ec7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:09.203683 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ce5f4465-c85a-452a-bd00-b9665f5c7ec7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:09.204381 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ce5f4465-c85a-452a-bd00-b9665f5c7ec7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:09.204814 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ce5f4465-c85a-452a-bd00-b9665f5c7ec7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:09.205233 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ce5f4465-c85a-452a-bd00-b9665f5c7ec7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:09.235594 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f5d9ff09-eaa1-4bca-9f5f-699bd868dc1f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:09.244647 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f5d9ff09-eaa1-4bca-9f5f-699bd868dc1f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.155265 Oct 11 07:00:09.245204 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1190/2363] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:09 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:09.332662 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ce5f4465-c85a-452a-bd00-b9665f5c7ec7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:09.341148 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ce5f4465-c85a-452a-bd00-b9665f5c7ec7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:09.342574 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ce5f4465-c85a-452a-bd00-b9665f5c7ec7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:09.343805 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ce5f4465-c85a-452a-bd00-b9665f5c7ec7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.151186 Oct 11 07:00:09.344302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1174/2364] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:09 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:00:10.025345 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-dfc2c339-f7b8-4b45-8df0-53c2545e2c65 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:10.025952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-dfc2c339-f7b8-4b45-8df0-53c2545e2c65 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:10.031939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dfc2c339-f7b8-4b45-8df0-53c2545e2c65 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:10.032417 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dfc2c339-f7b8-4b45-8df0-53c2545e2c65 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:10.032843 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dfc2c339-f7b8-4b45-8df0-53c2545e2c65 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:10.033523 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dfc2c339-f7b8-4b45-8df0-53c2545e2c65 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:10.033966 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dfc2c339-f7b8-4b45-8df0-53c2545e2c65 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:10.035035 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dfc2c339-f7b8-4b45-8df0-53c2545e2c65 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:10.157667 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-dfc2c339-f7b8-4b45-8df0-53c2545e2c65 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:10.166333 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-dfc2c339-f7b8-4b45-8df0-53c2545e2c65 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.144798 Oct 11 07:00:10.166888 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1191/2365] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:10 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:10.269346 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-dedeec2c-492b-4676-8b2f-ff9872f05f44 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:10.269963 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-dedeec2c-492b-4676-8b2f-ff9872f05f44 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:10.276694 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dedeec2c-492b-4676-8b2f-ff9872f05f44 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:10.277181 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dedeec2c-492b-4676-8b2f-ff9872f05f44 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:10.277612 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dedeec2c-492b-4676-8b2f-ff9872f05f44 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:10.278316 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dedeec2c-492b-4676-8b2f-ff9872f05f44 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:10.278762 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dedeec2c-492b-4676-8b2f-ff9872f05f44 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:10.279181 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dedeec2c-492b-4676-8b2f-ff9872f05f44 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:10.369121 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9df41bef-7821-4ed4-8b41-3306f69a441a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:10.369759 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9df41bef-7821-4ed4-8b41-3306f69a441a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:10.375852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9df41bef-7821-4ed4-8b41-3306f69a441a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:10.376330 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9df41bef-7821-4ed4-8b41-3306f69a441a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:10.376753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9df41bef-7821-4ed4-8b41-3306f69a441a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:10.377441 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9df41bef-7821-4ed4-8b41-3306f69a441a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:10.377884 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9df41bef-7821-4ed4-8b41-3306f69a441a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:10.378847 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9df41bef-7821-4ed4-8b41-3306f69a441a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:10.423688 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-dedeec2c-492b-4676-8b2f-ff9872f05f44 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:10.431852 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-dedeec2c-492b-4676-8b2f-ff9872f05f44 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.166941 Oct 11 07:00:10.432412 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1175/2366] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:10 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:10.522659 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9df41bef-7821-4ed4-8b41-3306f69a441a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:10.531139 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9df41bef-7821-4ed4-8b41-3306f69a441a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:10.532602 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9df41bef-7821-4ed4-8b41-3306f69a441a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:10.533748 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9df41bef-7821-4ed4-8b41-3306f69a441a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.168604 Oct 11 07:00:10.534305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1192/2367] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:10 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:00:11.189001 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e8096a68-b62a-4f5e-a01a-b2eddc08c84d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:11.189612 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e8096a68-b62a-4f5e-a01a-b2eddc08c84d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:11.195747 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e8096a68-b62a-4f5e-a01a-b2eddc08c84d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:11.196222 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e8096a68-b62a-4f5e-a01a-b2eddc08c84d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:11.196653 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e8096a68-b62a-4f5e-a01a-b2eddc08c84d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:11.197335 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e8096a68-b62a-4f5e-a01a-b2eddc08c84d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:11.197781 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e8096a68-b62a-4f5e-a01a-b2eddc08c84d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:11.198197 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e8096a68-b62a-4f5e-a01a-b2eddc08c84d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:11.324474 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e8096a68-b62a-4f5e-a01a-b2eddc08c84d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:11.333192 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e8096a68-b62a-4f5e-a01a-b2eddc08c84d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.148044 Oct 11 07:00:11.333749 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1176/2368] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:11 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:11.455269 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-85bd0297-7ff1-4fa0-b8e2-961ae8d8526c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:11.455895 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-85bd0297-7ff1-4fa0-b8e2-961ae8d8526c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:11.462823 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-85bd0297-7ff1-4fa0-b8e2-961ae8d8526c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:11.463293 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-85bd0297-7ff1-4fa0-b8e2-961ae8d8526c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:11.463771 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-85bd0297-7ff1-4fa0-b8e2-961ae8d8526c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:11.464447 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-85bd0297-7ff1-4fa0-b8e2-961ae8d8526c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:11.464891 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-85bd0297-7ff1-4fa0-b8e2-961ae8d8526c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:11.465307 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-85bd0297-7ff1-4fa0-b8e2-961ae8d8526c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:11.557953 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c22eb87f-80e2-4b13-877a-19a1735a74b3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:11.558563 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c22eb87f-80e2-4b13-877a-19a1735a74b3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:11.564469 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c22eb87f-80e2-4b13-877a-19a1735a74b3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:11.564944 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c22eb87f-80e2-4b13-877a-19a1735a74b3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:11.565385 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c22eb87f-80e2-4b13-877a-19a1735a74b3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:11.566076 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c22eb87f-80e2-4b13-877a-19a1735a74b3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:11.566524 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c22eb87f-80e2-4b13-877a-19a1735a74b3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:11.566947 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c22eb87f-80e2-4b13-877a-19a1735a74b3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:11.590038 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-85bd0297-7ff1-4fa0-b8e2-961ae8d8526c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:11.599442 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-85bd0297-7ff1-4fa0-b8e2-961ae8d8526c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.147970 Oct 11 07:00:11.600253 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1193/2369] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:11 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:11.698971 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c22eb87f-80e2-4b13-877a-19a1735a74b3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:11.702366 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:00:11.708976 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c22eb87f-80e2-4b13-877a-19a1735a74b3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:11.710337 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c22eb87f-80e2-4b13-877a-19a1735a74b3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:11.711512 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c22eb87f-80e2-4b13-877a-19a1735a74b3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.157376 Oct 11 07:00:11.712057 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1177/2370] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:11 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:00:12.356794 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-35a94570-d371-4b15-b01b-ccde85e58a77 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:12.357399 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-35a94570-d371-4b15-b01b-ccde85e58a77 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:12.363799 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-35a94570-d371-4b15-b01b-ccde85e58a77 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:12.364263 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-35a94570-d371-4b15-b01b-ccde85e58a77 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:12.364686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-35a94570-d371-4b15-b01b-ccde85e58a77 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:12.365354 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-35a94570-d371-4b15-b01b-ccde85e58a77 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:12.365794 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-35a94570-d371-4b15-b01b-ccde85e58a77 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:12.366208 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-35a94570-d371-4b15-b01b-ccde85e58a77 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:12.491344 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-35a94570-d371-4b15-b01b-ccde85e58a77 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:12.499493 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-35a94570-d371-4b15-b01b-ccde85e58a77 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.146490 Oct 11 07:00:12.500047 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1194/2371] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:12 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:12.622633 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-acdcfb7e-ec6a-4115-b74c-1d20d94a321e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:12.623176 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-acdcfb7e-ec6a-4115-b74c-1d20d94a321e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:12.629710 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-acdcfb7e-ec6a-4115-b74c-1d20d94a321e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:12.630185 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-acdcfb7e-ec6a-4115-b74c-1d20d94a321e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:12.630613 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-acdcfb7e-ec6a-4115-b74c-1d20d94a321e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:12.631300 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-acdcfb7e-ec6a-4115-b74c-1d20d94a321e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:12.631776 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-acdcfb7e-ec6a-4115-b74c-1d20d94a321e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:12.632198 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-acdcfb7e-ec6a-4115-b74c-1d20d94a321e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:12.737149 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8713e1e3-b2a7-49b5-a9b4-3410865b1cee tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:12.737751 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8713e1e3-b2a7-49b5-a9b4-3410865b1cee tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:12.744170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8713e1e3-b2a7-49b5-a9b4-3410865b1cee tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:12.744641 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8713e1e3-b2a7-49b5-a9b4-3410865b1cee tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:12.745066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8713e1e3-b2a7-49b5-a9b4-3410865b1cee tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:12.745748 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8713e1e3-b2a7-49b5-a9b4-3410865b1cee tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:12.746189 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8713e1e3-b2a7-49b5-a9b4-3410865b1cee tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:12.746610 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8713e1e3-b2a7-49b5-a9b4-3410865b1cee tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:12.762692 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-acdcfb7e-ec6a-4115-b74c-1d20d94a321e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:12.771479 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-acdcfb7e-ec6a-4115-b74c-1d20d94a321e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.153098 Oct 11 07:00:12.772050 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1178/2372] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:12 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:12.876891 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8713e1e3-b2a7-49b5-a9b4-3410865b1cee tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:12.885350 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8713e1e3-b2a7-49b5-a9b4-3410865b1cee tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:12.886759 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8713e1e3-b2a7-49b5-a9b4-3410865b1cee tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:12.887939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8713e1e3-b2a7-49b5-a9b4-3410865b1cee tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.154655 Oct 11 07:00:12.888486 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1195/2373] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:12 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:00:13.523325 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bab3dd21-9ad2-4263-84e6-4766ad5dd176 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:13.523953 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bab3dd21-9ad2-4263-84e6-4766ad5dd176 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:13.529862 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bab3dd21-9ad2-4263-84e6-4766ad5dd176 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:13.530330 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bab3dd21-9ad2-4263-84e6-4766ad5dd176 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:13.530755 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bab3dd21-9ad2-4263-84e6-4766ad5dd176 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:13.531454 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bab3dd21-9ad2-4263-84e6-4766ad5dd176 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:13.531906 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bab3dd21-9ad2-4263-84e6-4766ad5dd176 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:13.532323 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bab3dd21-9ad2-4263-84e6-4766ad5dd176 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:13.655883 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-bab3dd21-9ad2-4263-84e6-4766ad5dd176 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:13.664025 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bab3dd21-9ad2-4263-84e6-4766ad5dd176 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.145099 Oct 11 07:00:13.664598 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1179/2374] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:13 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:13.795332 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-69fb9f69-d906-4f85-bf2c-9073e947f869 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:13.795970 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-69fb9f69-d906-4f85-bf2c-9073e947f869 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:13.802788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-69fb9f69-d906-4f85-bf2c-9073e947f869 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:13.803259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-69fb9f69-d906-4f85-bf2c-9073e947f869 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:13.803715 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-69fb9f69-d906-4f85-bf2c-9073e947f869 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:13.804389 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-69fb9f69-d906-4f85-bf2c-9073e947f869 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:13.804831 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-69fb9f69-d906-4f85-bf2c-9073e947f869 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:13.805263 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-69fb9f69-d906-4f85-bf2c-9073e947f869 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:13.913543 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-412793f8-a6d3-431d-abf3-018db814312f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:13.914066 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-412793f8-a6d3-431d-abf3-018db814312f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:13.920046 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-412793f8-a6d3-431d-abf3-018db814312f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:13.920525 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-412793f8-a6d3-431d-abf3-018db814312f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:13.920957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-412793f8-a6d3-431d-abf3-018db814312f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:13.921644 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-412793f8-a6d3-431d-abf3-018db814312f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:13.922099 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-412793f8-a6d3-431d-abf3-018db814312f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:13.922517 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-412793f8-a6d3-431d-abf3-018db814312f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:13.930138 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-69fb9f69-d906-4f85-bf2c-9073e947f869 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:13.938314 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-69fb9f69-d906-4f85-bf2c-9073e947f869 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.146839 Oct 11 07:00:13.938883 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1196/2375] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:13 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:14.054037 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-412793f8-a6d3-431d-abf3-018db814312f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:14.062665 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-412793f8-a6d3-431d-abf3-018db814312f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:14.064153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-412793f8-a6d3-431d-abf3-018db814312f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:14.065588 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-412793f8-a6d3-431d-abf3-018db814312f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.155976 Oct 11 07:00:14.066163 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1180/2376] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:13 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:00:14.687997 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ffdbec72-1e51-4a35-92d6-5df6beb0b0cd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:14.688536 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ffdbec72-1e51-4a35-92d6-5df6beb0b0cd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:14.695016 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ffdbec72-1e51-4a35-92d6-5df6beb0b0cd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:14.695517 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ffdbec72-1e51-4a35-92d6-5df6beb0b0cd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:14.695950 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ffdbec72-1e51-4a35-92d6-5df6beb0b0cd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:14.696627 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ffdbec72-1e51-4a35-92d6-5df6beb0b0cd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:14.697070 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ffdbec72-1e51-4a35-92d6-5df6beb0b0cd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:14.697487 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ffdbec72-1e51-4a35-92d6-5df6beb0b0cd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:14.831983 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ffdbec72-1e51-4a35-92d6-5df6beb0b0cd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:14.840722 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ffdbec72-1e51-4a35-92d6-5df6beb0b0cd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.156619 Oct 11 07:00:14.841269 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1197/2377] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:14 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:14.962793 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-28242432-028e-4ba6-ab37-6bad612147e9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:14.963325 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-28242432-028e-4ba6-ab37-6bad612147e9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:14.969677 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-28242432-028e-4ba6-ab37-6bad612147e9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:14.970147 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-28242432-028e-4ba6-ab37-6bad612147e9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:14.970571 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-28242432-028e-4ba6-ab37-6bad612147e9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:14.971252 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-28242432-028e-4ba6-ab37-6bad612147e9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:14.971728 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-28242432-028e-4ba6-ab37-6bad612147e9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:14.972142 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-28242432-028e-4ba6-ab37-6bad612147e9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:15.090796 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0cd6910c-0f29-424d-b658-b35a73f72022 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:15.091398 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0cd6910c-0f29-424d-b658-b35a73f72022 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:15.093396 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 07:00:15.093536 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Tue Oct 11 07:00:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff (ip 10.222.0.39) !!! Oct 11 07:00:15.098591 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-28242432-028e-4ba6-ab37-6bad612147e9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:15.099565 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0cd6910c-0f29-424d-b658-b35a73f72022 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:15.100041 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0cd6910c-0f29-424d-b658-b35a73f72022 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:15.100467 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0cd6910c-0f29-424d-b658-b35a73f72022 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:15.101157 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0cd6910c-0f29-424d-b658-b35a73f72022 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:15.101595 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0cd6910c-0f29-424d-b658-b35a73f72022 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:15.102016 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0cd6910c-0f29-424d-b658-b35a73f72022 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:15.106877 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:00:15.107058 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-28242432-028e-4ba6-ab37-6bad612147e9 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.148191 Oct 11 07:00:15.107828 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1181/2378] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:14 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:15.229962 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0cd6910c-0f29-424d-b658-b35a73f72022 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:15.238566 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0cd6910c-0f29-424d-b658-b35a73f72022 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:15.240540 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0cd6910c-0f29-424d-b658-b35a73f72022 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:15.241694 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0cd6910c-0f29-424d-b658-b35a73f72022 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.154761 Oct 11 07:00:15.242274 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1198/2379] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:15 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:00:15.863954 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-42f5e3ec-644a-4566-99e6-17795dcb44ef tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:15.864564 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-42f5e3ec-644a-4566-99e6-17795dcb44ef tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:15.870387 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42f5e3ec-644a-4566-99e6-17795dcb44ef tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:15.870870 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42f5e3ec-644a-4566-99e6-17795dcb44ef tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:15.871307 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42f5e3ec-644a-4566-99e6-17795dcb44ef tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:15.872022 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42f5e3ec-644a-4566-99e6-17795dcb44ef tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:15.872478 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42f5e3ec-644a-4566-99e6-17795dcb44ef tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:15.872902 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-42f5e3ec-644a-4566-99e6-17795dcb44ef tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:15.999821 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-42f5e3ec-644a-4566-99e6-17795dcb44ef tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:16.008079 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-42f5e3ec-644a-4566-99e6-17795dcb44ef tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.148028 Oct 11 07:00:16.008635 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1182/2380] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:15 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:16.130521 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d721b7e9-627d-492d-9b4d-8967860dd79e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:16.131133 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d721b7e9-627d-492d-9b4d-8967860dd79e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:16.137552 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d721b7e9-627d-492d-9b4d-8967860dd79e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:16.138034 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d721b7e9-627d-492d-9b4d-8967860dd79e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:16.138467 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d721b7e9-627d-492d-9b4d-8967860dd79e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:16.139466 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d721b7e9-627d-492d-9b4d-8967860dd79e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:16.139916 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d721b7e9-627d-492d-9b4d-8967860dd79e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:16.140338 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d721b7e9-627d-492d-9b4d-8967860dd79e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:16.267791 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-885ffbd0-e14c-45b1-9fd1-c230604f7e2d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:16.268402 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-885ffbd0-e14c-45b1-9fd1-c230604f7e2d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:16.272053 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d721b7e9-627d-492d-9b4d-8967860dd79e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:16.274392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 07:00:16.274716 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Tue Oct 11 07:00:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff (ip 10.222.0.39) !!! Oct 11 07:00:16.276608 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-885ffbd0-e14c-45b1-9fd1-c230604f7e2d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:16.277502 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-885ffbd0-e14c-45b1-9fd1-c230604f7e2d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:16.278093 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-885ffbd0-e14c-45b1-9fd1-c230604f7e2d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:16.278965 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-885ffbd0-e14c-45b1-9fd1-c230604f7e2d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:16.279617 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-885ffbd0-e14c-45b1-9fd1-c230604f7e2d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:16.280825 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-885ffbd0-e14c-45b1-9fd1-c230604f7e2d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:16.288112 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d721b7e9-627d-492d-9b4d-8967860dd79e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.161355 Oct 11 07:00:16.288902 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1199/2381] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:16 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:16.408921 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-885ffbd0-e14c-45b1-9fd1-c230604f7e2d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:16.417660 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-885ffbd0-e14c-45b1-9fd1-c230604f7e2d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:16.419097 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-885ffbd0-e14c-45b1-9fd1-c230604f7e2d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:16.420304 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-885ffbd0-e14c-45b1-9fd1-c230604f7e2d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.156633 Oct 11 07:00:16.420846 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1183/2382] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:16 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:00:17.031865 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1866648a-4a96-4086-a912-d42d0bc7d019 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:17.032475 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1866648a-4a96-4086-a912-d42d0bc7d019 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:17.038808 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1866648a-4a96-4086-a912-d42d0bc7d019 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:17.039280 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1866648a-4a96-4086-a912-d42d0bc7d019 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:17.039738 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1866648a-4a96-4086-a912-d42d0bc7d019 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:17.040468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1866648a-4a96-4086-a912-d42d0bc7d019 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:17.040883 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1866648a-4a96-4086-a912-d42d0bc7d019 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:17.041301 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1866648a-4a96-4086-a912-d42d0bc7d019 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:17.169162 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1866648a-4a96-4086-a912-d42d0bc7d019 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:17.177908 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1866648a-4a96-4086-a912-d42d0bc7d019 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.149843 Oct 11 07:00:17.178462 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1200/2383] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:17 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:17.309877 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-118ebcff-a5bc-4c12-aad7-77fc69a01df6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:17.310511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-118ebcff-a5bc-4c12-aad7-77fc69a01df6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:17.317076 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-118ebcff-a5bc-4c12-aad7-77fc69a01df6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:17.317544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-118ebcff-a5bc-4c12-aad7-77fc69a01df6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:17.317970 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-118ebcff-a5bc-4c12-aad7-77fc69a01df6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:17.318646 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-118ebcff-a5bc-4c12-aad7-77fc69a01df6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:17.319090 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-118ebcff-a5bc-4c12-aad7-77fc69a01df6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:17.319541 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-118ebcff-a5bc-4c12-aad7-77fc69a01df6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:17.446115 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-652c4e93-5e63-4b93-93e0-53ed16bc202b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:17.446965 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-652c4e93-5e63-4b93-93e0-53ed16bc202b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:17.448459 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-118ebcff-a5bc-4c12-aad7-77fc69a01df6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:17.452874 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-652c4e93-5e63-4b93-93e0-53ed16bc202b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:17.453349 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-652c4e93-5e63-4b93-93e0-53ed16bc202b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:17.453780 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-652c4e93-5e63-4b93-93e0-53ed16bc202b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:17.454503 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-652c4e93-5e63-4b93-93e0-53ed16bc202b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:17.454947 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-652c4e93-5e63-4b93-93e0-53ed16bc202b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:17.455368 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-652c4e93-5e63-4b93-93e0-53ed16bc202b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:17.456817 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-118ebcff-a5bc-4c12-aad7-77fc69a01df6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150773 Oct 11 07:00:17.457386 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1184/2384] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:17 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:17.580717 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-652c4e93-5e63-4b93-93e0-53ed16bc202b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:17.589725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-652c4e93-5e63-4b93-93e0-53ed16bc202b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:17.591188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-652c4e93-5e63-4b93-93e0-53ed16bc202b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:17.592365 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-652c4e93-5e63-4b93-93e0-53ed16bc202b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.150502 Oct 11 07:00:17.592925 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1201/2385] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:17 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:00:18.201332 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6a6262bf-fe3a-4261-b18f-46828516993a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:18.201862 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6a6262bf-fe3a-4261-b18f-46828516993a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:18.207843 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6a6262bf-fe3a-4261-b18f-46828516993a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:18.208318 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6a6262bf-fe3a-4261-b18f-46828516993a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:18.208748 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6a6262bf-fe3a-4261-b18f-46828516993a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:18.209436 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6a6262bf-fe3a-4261-b18f-46828516993a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:18.209898 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6a6262bf-fe3a-4261-b18f-46828516993a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:18.210318 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6a6262bf-fe3a-4261-b18f-46828516993a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:18.339469 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6a6262bf-fe3a-4261-b18f-46828516993a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:18.348028 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6a6262bf-fe3a-4261-b18f-46828516993a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.150775 Oct 11 07:00:18.348642 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1185/2386] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:18 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:18.480724 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-97ecfd47-bb5a-4203-98d1-c1b44a909478 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:18.481265 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-97ecfd47-bb5a-4203-98d1-c1b44a909478 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:18.487883 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-97ecfd47-bb5a-4203-98d1-c1b44a909478 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:18.488363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-97ecfd47-bb5a-4203-98d1-c1b44a909478 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:18.489401 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-97ecfd47-bb5a-4203-98d1-c1b44a909478 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:18.490098 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-97ecfd47-bb5a-4203-98d1-c1b44a909478 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:18.490548 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-97ecfd47-bb5a-4203-98d1-c1b44a909478 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:18.490972 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-97ecfd47-bb5a-4203-98d1-c1b44a909478 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:18.618757 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d85e96e3-4f55-4609-8f84-8221452fbbb5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:18.619373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d85e96e3-4f55-4609-8f84-8221452fbbb5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:18.620604 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-97ecfd47-bb5a-4203-98d1-c1b44a909478 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:18.625365 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d85e96e3-4f55-4609-8f84-8221452fbbb5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:18.625850 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d85e96e3-4f55-4609-8f84-8221452fbbb5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:18.626282 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d85e96e3-4f55-4609-8f84-8221452fbbb5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:18.627184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d85e96e3-4f55-4609-8f84-8221452fbbb5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:18.627669 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d85e96e3-4f55-4609-8f84-8221452fbbb5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:18.628097 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d85e96e3-4f55-4609-8f84-8221452fbbb5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:18.628958 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-97ecfd47-bb5a-4203-98d1-c1b44a909478 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.152169 Oct 11 07:00:18.629516 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1202/2387] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:18 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:18.754099 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d85e96e3-4f55-4609-8f84-8221452fbbb5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:18.762679 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d85e96e3-4f55-4609-8f84-8221452fbbb5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:18.764437 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d85e96e3-4f55-4609-8f84-8221452fbbb5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:18.765586 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d85e96e3-4f55-4609-8f84-8221452fbbb5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.150719 Oct 11 07:00:18.766143 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1186/2388] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:18 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:00:19.371271 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cf0c250c-4e0b-41d7-8559-7447ae838db0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:19.371910 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cf0c250c-4e0b-41d7-8559-7447ae838db0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:19.378459 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf0c250c-4e0b-41d7-8559-7447ae838db0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:19.378943 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf0c250c-4e0b-41d7-8559-7447ae838db0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:19.379944 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf0c250c-4e0b-41d7-8559-7447ae838db0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:19.380640 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf0c250c-4e0b-41d7-8559-7447ae838db0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:19.381092 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf0c250c-4e0b-41d7-8559-7447ae838db0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:19.381515 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf0c250c-4e0b-41d7-8559-7447ae838db0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:19.517836 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cf0c250c-4e0b-41d7-8559-7447ae838db0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:19.526620 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cf0c250c-4e0b-41d7-8559-7447ae838db0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.159179 Oct 11 07:00:19.527172 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1203/2389] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:19 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:19.651358 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-10215ee6-b748-4ec5-b36d-c8197b644081 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:19.651915 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-10215ee6-b748-4ec5-b36d-c8197b644081 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:19.658623 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-10215ee6-b748-4ec5-b36d-c8197b644081 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:19.659104 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-10215ee6-b748-4ec5-b36d-c8197b644081 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:19.659563 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-10215ee6-b748-4ec5-b36d-c8197b644081 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:19.660252 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-10215ee6-b748-4ec5-b36d-c8197b644081 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:19.660703 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-10215ee6-b748-4ec5-b36d-c8197b644081 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:19.661151 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-10215ee6-b748-4ec5-b36d-c8197b644081 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:19.791317 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-af55be0e-d975-4ed3-89dc-ff87057fbae5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:19.791952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-af55be0e-d975-4ed3-89dc-ff87057fbae5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:19.792296 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-10215ee6-b748-4ec5-b36d-c8197b644081 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:19.797950 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af55be0e-d975-4ed3-89dc-ff87057fbae5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:19.798427 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af55be0e-d975-4ed3-89dc-ff87057fbae5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:19.798851 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af55be0e-d975-4ed3-89dc-ff87057fbae5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:19.799564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af55be0e-d975-4ed3-89dc-ff87057fbae5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:19.800011 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af55be0e-d975-4ed3-89dc-ff87057fbae5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:19.800379 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-10215ee6-b748-4ec5-b36d-c8197b644081 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.152922 Oct 11 07:00:19.800493 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af55be0e-d975-4ed3-89dc-ff87057fbae5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:19.800934 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1187/2390] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:19 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:19.931066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-af55be0e-d975-4ed3-89dc-ff87057fbae5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:19.939569 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-af55be0e-d975-4ed3-89dc-ff87057fbae5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:19.940998 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-af55be0e-d975-4ed3-89dc-ff87057fbae5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:19.942142 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-af55be0e-d975-4ed3-89dc-ff87057fbae5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.154771 Oct 11 07:00:19.942689 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1204/2391] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:19 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:00:20.550793 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2ec2d48c-6d84-41ae-8d26-f367d43aa648 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:20.551399 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2ec2d48c-6d84-41ae-8d26-f367d43aa648 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:20.553318 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=78 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:00:20.558456 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2ec2d48c-6d84-41ae-8d26-f367d43aa648 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:20.558931 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2ec2d48c-6d84-41ae-8d26-f367d43aa648 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:20.559362 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2ec2d48c-6d84-41ae-8d26-f367d43aa648 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:20.560078 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2ec2d48c-6d84-41ae-8d26-f367d43aa648 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:20.560524 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2ec2d48c-6d84-41ae-8d26-f367d43aa648 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:20.560945 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2ec2d48c-6d84-41ae-8d26-f367d43aa648 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:20.685737 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2ec2d48c-6d84-41ae-8d26-f367d43aa648 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:20.694631 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2ec2d48c-6d84-41ae-8d26-f367d43aa648 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.147616 Oct 11 07:00:20.695196 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1188/2392] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:20 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:20.824402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-29e219eb-61e6-4817-852b-664889a75a95 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:20.825013 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-29e219eb-61e6-4817-852b-664889a75a95 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:20.831434 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-29e219eb-61e6-4817-852b-664889a75a95 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:20.831913 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-29e219eb-61e6-4817-852b-664889a75a95 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:20.832345 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-29e219eb-61e6-4817-852b-664889a75a95 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:20.833675 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-29e219eb-61e6-4817-852b-664889a75a95 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:20.834133 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-29e219eb-61e6-4817-852b-664889a75a95 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:20.834554 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-29e219eb-61e6-4817-852b-664889a75a95 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:20.957922 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-29e219eb-61e6-4817-852b-664889a75a95 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:20.966564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-29e219eb-61e6-4817-852b-664889a75a95 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.145957 Oct 11 07:00:20.967129 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1205/2393] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:20 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:20.967264 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3a1d9ea6-a771-40a7-a130-4dfce7f94df5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:20.967788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3a1d9ea6-a771-40a7-a130-4dfce7f94df5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:20.974252 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a1d9ea6-a771-40a7-a130-4dfce7f94df5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:20.974722 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a1d9ea6-a771-40a7-a130-4dfce7f94df5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:20.975149 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a1d9ea6-a771-40a7-a130-4dfce7f94df5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:20.975870 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a1d9ea6-a771-40a7-a130-4dfce7f94df5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:20.976309 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a1d9ea6-a771-40a7-a130-4dfce7f94df5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:20.976722 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a1d9ea6-a771-40a7-a130-4dfce7f94df5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:21.103546 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3a1d9ea6-a771-40a7-a130-4dfce7f94df5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:21.112043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3a1d9ea6-a771-40a7-a130-4dfce7f94df5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:21.113458 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3a1d9ea6-a771-40a7-a130-4dfce7f94df5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:21.114678 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3a1d9ea6-a771-40a7-a130-4dfce7f94df5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.151297 Oct 11 07:00:21.115203 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1189/2394] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:20 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:00:21.718411 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d779a858-24ac-4de4-95ea-4d9aceb79a93 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:21.719027 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d779a858-24ac-4de4-95ea-4d9aceb79a93 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:21.725007 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d779a858-24ac-4de4-95ea-4d9aceb79a93 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:21.725484 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d779a858-24ac-4de4-95ea-4d9aceb79a93 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:21.725926 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d779a858-24ac-4de4-95ea-4d9aceb79a93 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:21.726614 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d779a858-24ac-4de4-95ea-4d9aceb79a93 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:21.727059 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d779a858-24ac-4de4-95ea-4d9aceb79a93 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:21.727582 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d779a858-24ac-4de4-95ea-4d9aceb79a93 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:21.851268 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d779a858-24ac-4de4-95ea-4d9aceb79a93 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:21.859500 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d779a858-24ac-4de4-95ea-4d9aceb79a93 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.144873 Oct 11 07:00:21.860059 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1206/2395] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:21 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:21.990681 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1410a2f6-d628-4ec3-8eae-6bcbec3a613b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:21.991298 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1410a2f6-d628-4ec3-8eae-6bcbec3a613b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:21.997727 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1410a2f6-d628-4ec3-8eae-6bcbec3a613b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:21.998203 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1410a2f6-d628-4ec3-8eae-6bcbec3a613b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:21.998638 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1410a2f6-d628-4ec3-8eae-6bcbec3a613b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:21.999321 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1410a2f6-d628-4ec3-8eae-6bcbec3a613b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:21.999797 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1410a2f6-d628-4ec3-8eae-6bcbec3a613b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:22.000219 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1410a2f6-d628-4ec3-8eae-6bcbec3a613b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:22.126153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1410a2f6-d628-4ec3-8eae-6bcbec3a613b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:22.135017 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1410a2f6-d628-4ec3-8eae-6bcbec3a613b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.148652 Oct 11 07:00:22.135598 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1190/2396] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:21 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:22.140435 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-88cebc4d-a653-4fb9-87a7-7d37b0d9300d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:22.141038 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-88cebc4d-a653-4fb9-87a7-7d37b0d9300d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:22.147390 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-88cebc4d-a653-4fb9-87a7-7d37b0d9300d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:22.147894 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-88cebc4d-a653-4fb9-87a7-7d37b0d9300d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:22.148328 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-88cebc4d-a653-4fb9-87a7-7d37b0d9300d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:22.149027 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-88cebc4d-a653-4fb9-87a7-7d37b0d9300d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:22.149474 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-88cebc4d-a653-4fb9-87a7-7d37b0d9300d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:22.149892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-88cebc4d-a653-4fb9-87a7-7d37b0d9300d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:22.279874 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-88cebc4d-a653-4fb9-87a7-7d37b0d9300d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:22.288988 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-88cebc4d-a653-4fb9-87a7-7d37b0d9300d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:22.290406 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-88cebc4d-a653-4fb9-87a7-7d37b0d9300d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:22.291585 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-88cebc4d-a653-4fb9-87a7-7d37b0d9300d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.155231 Oct 11 07:00:22.292127 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1207/2397] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:22 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:00:22.884100 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-696f9e26-276a-4057-890c-9a768c1365bb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:22.884735 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-696f9e26-276a-4057-890c-9a768c1365bb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:22.890978 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-696f9e26-276a-4057-890c-9a768c1365bb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:22.891485 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-696f9e26-276a-4057-890c-9a768c1365bb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:22.891924 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-696f9e26-276a-4057-890c-9a768c1365bb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:22.892614 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-696f9e26-276a-4057-890c-9a768c1365bb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:22.893067 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-696f9e26-276a-4057-890c-9a768c1365bb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:22.893492 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-696f9e26-276a-4057-890c-9a768c1365bb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:23.017508 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-696f9e26-276a-4057-890c-9a768c1365bb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:23.026268 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-696f9e26-276a-4057-890c-9a768c1365bb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.146775 Oct 11 07:00:23.026825 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1191/2398] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:22 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:23.158111 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-25394fc6-cc1c-4fab-882d-6e6b4bfc6bdf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:23.158653 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-25394fc6-cc1c-4fab-882d-6e6b4bfc6bdf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:23.165190 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25394fc6-cc1c-4fab-882d-6e6b4bfc6bdf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:23.165660 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25394fc6-cc1c-4fab-882d-6e6b4bfc6bdf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:23.166085 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25394fc6-cc1c-4fab-882d-6e6b4bfc6bdf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:23.166767 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25394fc6-cc1c-4fab-882d-6e6b4bfc6bdf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:23.167213 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25394fc6-cc1c-4fab-882d-6e6b4bfc6bdf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:23.167729 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25394fc6-cc1c-4fab-882d-6e6b4bfc6bdf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:23.298935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-25394fc6-cc1c-4fab-882d-6e6b4bfc6bdf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:23.307575 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-25394fc6-cc1c-4fab-882d-6e6b4bfc6bdf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.153322 Oct 11 07:00:23.308131 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1208/2399] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:23 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:23.317183 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e873ef9b-b4da-4480-b886-6eb9cb120eb7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:23.318539 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e873ef9b-b4da-4480-b886-6eb9cb120eb7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:23.324467 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e873ef9b-b4da-4480-b886-6eb9cb120eb7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:23.324936 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e873ef9b-b4da-4480-b886-6eb9cb120eb7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:23.325365 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e873ef9b-b4da-4480-b886-6eb9cb120eb7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:23.326043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e873ef9b-b4da-4480-b886-6eb9cb120eb7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:23.326488 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e873ef9b-b4da-4480-b886-6eb9cb120eb7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:23.326912 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e873ef9b-b4da-4480-b886-6eb9cb120eb7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:23.455189 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e873ef9b-b4da-4480-b886-6eb9cb120eb7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:23.463768 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e873ef9b-b4da-4480-b886-6eb9cb120eb7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:23.465236 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e873ef9b-b4da-4480-b886-6eb9cb120eb7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:23.466398 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e873ef9b-b4da-4480-b886-6eb9cb120eb7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.153012 Oct 11 07:00:23.466991 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1192/2400] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:23 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:00:24.049781 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a327e953-d5c1-4d0b-95c1-d79f693b19a0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:24.050384 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a327e953-d5c1-4d0b-95c1-d79f693b19a0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:24.056371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a327e953-d5c1-4d0b-95c1-d79f693b19a0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:24.056851 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a327e953-d5c1-4d0b-95c1-d79f693b19a0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:24.057275 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a327e953-d5c1-4d0b-95c1-d79f693b19a0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:24.057952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a327e953-d5c1-4d0b-95c1-d79f693b19a0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:24.058395 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a327e953-d5c1-4d0b-95c1-d79f693b19a0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:24.058814 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a327e953-d5c1-4d0b-95c1-d79f693b19a0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:24.186164 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a327e953-d5c1-4d0b-95c1-d79f693b19a0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:24.194449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a327e953-d5c1-4d0b-95c1-d79f693b19a0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.148593 Oct 11 07:00:24.194992 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1209/2401] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:24 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:24.332798 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b32bdce9-8169-458b-a099-725bee0c63af tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:24.335340 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b32bdce9-8169-458b-a099-725bee0c63af tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:24.342858 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b32bdce9-8169-458b-a099-725bee0c63af tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:24.343346 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b32bdce9-8169-458b-a099-725bee0c63af tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:24.343815 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b32bdce9-8169-458b-a099-725bee0c63af tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:24.344518 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b32bdce9-8169-458b-a099-725bee0c63af tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:24.345002 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b32bdce9-8169-458b-a099-725bee0c63af tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:24.345425 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b32bdce9-8169-458b-a099-725bee0c63af tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:24.471999 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b32bdce9-8169-458b-a099-725bee0c63af tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:24.481298 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b32bdce9-8169-458b-a099-725bee0c63af tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.154630 Oct 11 07:00:24.482103 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1193/2402] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:24 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:24.490672 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c9bc52ed-4d25-4be3-a354-76f3d98482df tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:24.491665 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c9bc52ed-4d25-4be3-a354-76f3d98482df tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:24.497652 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c9bc52ed-4d25-4be3-a354-76f3d98482df tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:24.498122 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c9bc52ed-4d25-4be3-a354-76f3d98482df tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:24.498547 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c9bc52ed-4d25-4be3-a354-76f3d98482df tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:24.499221 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c9bc52ed-4d25-4be3-a354-76f3d98482df tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:24.499693 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c9bc52ed-4d25-4be3-a354-76f3d98482df tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:24.500114 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c9bc52ed-4d25-4be3-a354-76f3d98482df tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:24.630470 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c9bc52ed-4d25-4be3-a354-76f3d98482df tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:24.639630 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c9bc52ed-4d25-4be3-a354-76f3d98482df tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:24.641080 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c9bc52ed-4d25-4be3-a354-76f3d98482df tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:24.642242 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c9bc52ed-4d25-4be3-a354-76f3d98482df tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.155454 Oct 11 07:00:24.642800 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1210/2403] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:24 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:00:25.217972 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b91efefa-0221-4106-b04a-c403af555b61 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:25.218592 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b91efefa-0221-4106-b04a-c403af555b61 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:25.224896 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b91efefa-0221-4106-b04a-c403af555b61 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:25.225375 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b91efefa-0221-4106-b04a-c403af555b61 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:25.225811 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b91efefa-0221-4106-b04a-c403af555b61 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:25.226565 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b91efefa-0221-4106-b04a-c403af555b61 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:25.227016 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b91efefa-0221-4106-b04a-c403af555b61 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:25.227458 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b91efefa-0221-4106-b04a-c403af555b61 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:25.244704 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:00:25.356527 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b91efefa-0221-4106-b04a-c403af555b61 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:25.365016 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b91efefa-0221-4106-b04a-c403af555b61 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.150487 Oct 11 07:00:25.365147 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1194/2404] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:25 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:25.504192 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-557dbb6d-da70-407d-b3e8-b1fcb2d080ac tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:25.504798 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-557dbb6d-da70-407d-b3e8-b1fcb2d080ac tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:25.511821 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-557dbb6d-da70-407d-b3e8-b1fcb2d080ac tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:25.512294 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-557dbb6d-da70-407d-b3e8-b1fcb2d080ac tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:25.512726 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-557dbb6d-da70-407d-b3e8-b1fcb2d080ac tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:25.513406 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-557dbb6d-da70-407d-b3e8-b1fcb2d080ac tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:25.514111 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-557dbb6d-da70-407d-b3e8-b1fcb2d080ac tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:25.514557 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-557dbb6d-da70-407d-b3e8-b1fcb2d080ac tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:25.642567 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-557dbb6d-da70-407d-b3e8-b1fcb2d080ac tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:25.650769 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-557dbb6d-da70-407d-b3e8-b1fcb2d080ac tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150388 Oct 11 07:00:25.651323 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1211/2405] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:25 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:25.667892 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bf6e9a10-153c-41f0-a9f7-a960383b2f86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:25.668492 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bf6e9a10-153c-41f0-a9f7-a960383b2f86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:25.670414 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 07:00:25.670558 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Tue Oct 11 07:00:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff (ip 10.222.0.39) !!! Oct 11 07:00:25.679888 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bf6e9a10-153c-41f0-a9f7-a960383b2f86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:25.680383 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bf6e9a10-153c-41f0-a9f7-a960383b2f86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:25.680821 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bf6e9a10-153c-41f0-a9f7-a960383b2f86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:25.681522 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bf6e9a10-153c-41f0-a9f7-a960383b2f86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:25.681973 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bf6e9a10-153c-41f0-a9f7-a960383b2f86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:25.682396 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bf6e9a10-153c-41f0-a9f7-a960383b2f86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:25.810690 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-bf6e9a10-153c-41f0-a9f7-a960383b2f86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:25.819931 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-bf6e9a10-153c-41f0-a9f7-a960383b2f86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:25.821352 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-bf6e9a10-153c-41f0-a9f7-a960383b2f86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:25.822489 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bf6e9a10-153c-41f0-a9f7-a960383b2f86 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.158434 Oct 11 07:00:25.823029 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1195/2406] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:25 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:00:26.387647 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-030bf12d-7ec0-4bef-b56a-9bf66f701ef7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:26.388275 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-030bf12d-7ec0-4bef-b56a-9bf66f701ef7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:26.390485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 07:00:26.390613 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Tue Oct 11 07:00:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e (ip 10.222.0.39) !!! Oct 11 07:00:26.396504 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-030bf12d-7ec0-4bef-b56a-9bf66f701ef7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:26.396969 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-030bf12d-7ec0-4bef-b56a-9bf66f701ef7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:26.397904 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-030bf12d-7ec0-4bef-b56a-9bf66f701ef7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:26.398578 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-030bf12d-7ec0-4bef-b56a-9bf66f701ef7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:26.399013 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-030bf12d-7ec0-4bef-b56a-9bf66f701ef7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:26.399440 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-030bf12d-7ec0-4bef-b56a-9bf66f701ef7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:26.527473 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-030bf12d-7ec0-4bef-b56a-9bf66f701ef7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:26.535524 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-030bf12d-7ec0-4bef-b56a-9bf66f701ef7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.151732 Oct 11 07:00:26.536075 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1212/2407] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:26 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:26.674111 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9939ec6e-23e1-4573-a481-3406b0b61ef2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:26.674662 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9939ec6e-23e1-4573-a481-3406b0b61ef2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:26.681247 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9939ec6e-23e1-4573-a481-3406b0b61ef2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:26.681720 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9939ec6e-23e1-4573-a481-3406b0b61ef2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:26.682149 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9939ec6e-23e1-4573-a481-3406b0b61ef2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:26.682833 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9939ec6e-23e1-4573-a481-3406b0b61ef2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:26.683283 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9939ec6e-23e1-4573-a481-3406b0b61ef2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:26.683732 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9939ec6e-23e1-4573-a481-3406b0b61ef2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:26.811682 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9939ec6e-23e1-4573-a481-3406b0b61ef2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:26.820518 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9939ec6e-23e1-4573-a481-3406b0b61ef2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150713 Oct 11 07:00:26.821075 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1196/2408] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:26 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:26.847681 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-953fd518-e671-4ac2-b0ba-59eb8daaa3f6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:26.848287 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-953fd518-e671-4ac2-b0ba-59eb8daaa3f6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:26.854130 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-953fd518-e671-4ac2-b0ba-59eb8daaa3f6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:26.854608 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-953fd518-e671-4ac2-b0ba-59eb8daaa3f6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:26.855044 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-953fd518-e671-4ac2-b0ba-59eb8daaa3f6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:26.855772 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-953fd518-e671-4ac2-b0ba-59eb8daaa3f6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:26.856219 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-953fd518-e671-4ac2-b0ba-59eb8daaa3f6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:26.856643 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-953fd518-e671-4ac2-b0ba-59eb8daaa3f6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:26.979482 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-953fd518-e671-4ac2-b0ba-59eb8daaa3f6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:26.987930 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-953fd518-e671-4ac2-b0ba-59eb8daaa3f6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:26.989371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-953fd518-e671-4ac2-b0ba-59eb8daaa3f6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:26.990523 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-953fd518-e671-4ac2-b0ba-59eb8daaa3f6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.146646 Oct 11 07:00:26.991616 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1213/2409] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:26 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:00:27.559741 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a3d56310-3720-4f63-a990-2d0e636fed6e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:27.560370 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a3d56310-3720-4f63-a990-2d0e636fed6e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:27.566320 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a3d56310-3720-4f63-a990-2d0e636fed6e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:27.566799 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a3d56310-3720-4f63-a990-2d0e636fed6e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:27.567236 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a3d56310-3720-4f63-a990-2d0e636fed6e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:27.567949 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a3d56310-3720-4f63-a990-2d0e636fed6e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:27.568403 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a3d56310-3720-4f63-a990-2d0e636fed6e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:27.568833 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a3d56310-3720-4f63-a990-2d0e636fed6e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:27.697784 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a3d56310-3720-4f63-a990-2d0e636fed6e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:27.705943 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a3d56310-3720-4f63-a990-2d0e636fed6e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.150171 Oct 11 07:00:27.706501 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1197/2410] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:27 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:27.843769 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f4525074-a2a0-42e3-aef6-fba070ff3d1d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:27.844380 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f4525074-a2a0-42e3-aef6-fba070ff3d1d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:27.851081 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f4525074-a2a0-42e3-aef6-fba070ff3d1d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:27.851580 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f4525074-a2a0-42e3-aef6-fba070ff3d1d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:27.852021 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f4525074-a2a0-42e3-aef6-fba070ff3d1d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:27.852702 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f4525074-a2a0-42e3-aef6-fba070ff3d1d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:27.853148 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f4525074-a2a0-42e3-aef6-fba070ff3d1d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:27.853564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f4525074-a2a0-42e3-aef6-fba070ff3d1d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:27.983290 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f4525074-a2a0-42e3-aef6-fba070ff3d1d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:27.986708 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:00:27.992210 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f4525074-a2a0-42e3-aef6-fba070ff3d1d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.152211 Oct 11 07:00:27.992771 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1214/2411] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:27 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:28.016078 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-87ebfab3-8dc1-44f3-a74d-da38f6670513 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:28.016693 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-87ebfab3-8dc1-44f3-a74d-da38f6670513 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:28.023198 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87ebfab3-8dc1-44f3-a74d-da38f6670513 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:28.023706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87ebfab3-8dc1-44f3-a74d-da38f6670513 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:28.024146 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87ebfab3-8dc1-44f3-a74d-da38f6670513 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:28.024835 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87ebfab3-8dc1-44f3-a74d-da38f6670513 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:28.025289 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87ebfab3-8dc1-44f3-a74d-da38f6670513 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:28.025712 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87ebfab3-8dc1-44f3-a74d-da38f6670513 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:28.150425 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-87ebfab3-8dc1-44f3-a74d-da38f6670513 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:28.158944 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-87ebfab3-8dc1-44f3-a74d-da38f6670513 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:28.160425 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-87ebfab3-8dc1-44f3-a74d-da38f6670513 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:28.161591 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-87ebfab3-8dc1-44f3-a74d-da38f6670513 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.149613 Oct 11 07:00:28.162164 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1198/2412] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:28 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:00:28.729403 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1163f987-c0b0-40ad-9a36-d7ac62266810 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:28.729934 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1163f987-c0b0-40ad-9a36-d7ac62266810 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:28.735876 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1163f987-c0b0-40ad-9a36-d7ac62266810 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:28.736347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1163f987-c0b0-40ad-9a36-d7ac62266810 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:28.736777 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1163f987-c0b0-40ad-9a36-d7ac62266810 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:28.737457 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1163f987-c0b0-40ad-9a36-d7ac62266810 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:28.737903 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1163f987-c0b0-40ad-9a36-d7ac62266810 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:28.738319 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1163f987-c0b0-40ad-9a36-d7ac62266810 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:28.868221 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1163f987-c0b0-40ad-9a36-d7ac62266810 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:28.876256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1163f987-c0b0-40ad-9a36-d7ac62266810 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.150961 Oct 11 07:00:28.876820 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1215/2413] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:28 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:29.015798 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-38d2feee-4bbb-41f2-a1f7-e476e270c05b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:29.016346 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-38d2feee-4bbb-41f2-a1f7-e476e270c05b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:29.022912 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38d2feee-4bbb-41f2-a1f7-e476e270c05b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:29.023393 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38d2feee-4bbb-41f2-a1f7-e476e270c05b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:29.023933 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38d2feee-4bbb-41f2-a1f7-e476e270c05b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:29.024627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38d2feee-4bbb-41f2-a1f7-e476e270c05b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:29.025080 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38d2feee-4bbb-41f2-a1f7-e476e270c05b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:29.025506 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38d2feee-4bbb-41f2-a1f7-e476e270c05b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:29.153555 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-38d2feee-4bbb-41f2-a1f7-e476e270c05b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:29.161678 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-38d2feee-4bbb-41f2-a1f7-e476e270c05b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150112 Oct 11 07:00:29.162318 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1199/2414] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:29 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:29.185903 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8309d1f3-2297-427a-9cde-c2f8e09c81c8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:29.186508 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8309d1f3-2297-427a-9cde-c2f8e09c81c8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:29.192384 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8309d1f3-2297-427a-9cde-c2f8e09c81c8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:29.192855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8309d1f3-2297-427a-9cde-c2f8e09c81c8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:29.193286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8309d1f3-2297-427a-9cde-c2f8e09c81c8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:29.193966 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8309d1f3-2297-427a-9cde-c2f8e09c81c8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:29.194408 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8309d1f3-2297-427a-9cde-c2f8e09c81c8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:29.194831 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8309d1f3-2297-427a-9cde-c2f8e09c81c8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:29.324003 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8309d1f3-2297-427a-9cde-c2f8e09c81c8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:29.332780 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8309d1f3-2297-427a-9cde-c2f8e09c81c8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:29.334207 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8309d1f3-2297-427a-9cde-c2f8e09c81c8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:29.335888 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8309d1f3-2297-427a-9cde-c2f8e09c81c8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.153805 Oct 11 07:00:29.336442 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1216/2415] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:29 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:00:29.900690 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-776d9111-9590-41c5-aa95-4f95831093d5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:29.901334 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-776d9111-9590-41c5-aa95-4f95831093d5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:29.907274 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-776d9111-9590-41c5-aa95-4f95831093d5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:29.907785 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-776d9111-9590-41c5-aa95-4f95831093d5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:29.908227 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-776d9111-9590-41c5-aa95-4f95831093d5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:29.908914 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-776d9111-9590-41c5-aa95-4f95831093d5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:29.909369 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-776d9111-9590-41c5-aa95-4f95831093d5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:29.909794 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-776d9111-9590-41c5-aa95-4f95831093d5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:30.034487 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-776d9111-9590-41c5-aa95-4f95831093d5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:30.042722 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-776d9111-9590-41c5-aa95-4f95831093d5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.146506 Oct 11 07:00:30.043279 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1200/2416] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:29 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:30.185205 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2dd1ded0-dc2b-4aba-a8cb-d538217b90ef tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:30.185729 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2dd1ded0-dc2b-4aba-a8cb-d538217b90ef tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:30.192202 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2dd1ded0-dc2b-4aba-a8cb-d538217b90ef tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:30.192671 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2dd1ded0-dc2b-4aba-a8cb-d538217b90ef tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:30.193094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2dd1ded0-dc2b-4aba-a8cb-d538217b90ef tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:30.193764 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2dd1ded0-dc2b-4aba-a8cb-d538217b90ef tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:30.194807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2dd1ded0-dc2b-4aba-a8cb-d538217b90ef tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:30.195223 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2dd1ded0-dc2b-4aba-a8cb-d538217b90ef tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:30.321099 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2dd1ded0-dc2b-4aba-a8cb-d538217b90ef tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:30.329240 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2dd1ded0-dc2b-4aba-a8cb-d538217b90ef tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.147895 Oct 11 07:00:30.329801 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1217/2417] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:30 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:30.361293 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c7741833-f843-402e-a2e2-1e08c3ec5e63 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:30.361902 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c7741833-f843-402e-a2e2-1e08c3ec5e63 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:30.368372 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c7741833-f843-402e-a2e2-1e08c3ec5e63 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:30.368864 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c7741833-f843-402e-a2e2-1e08c3ec5e63 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:30.369301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c7741833-f843-402e-a2e2-1e08c3ec5e63 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:30.369991 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c7741833-f843-402e-a2e2-1e08c3ec5e63 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:30.370443 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c7741833-f843-402e-a2e2-1e08c3ec5e63 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:30.370866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c7741833-f843-402e-a2e2-1e08c3ec5e63 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:30.498195 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c7741833-f843-402e-a2e2-1e08c3ec5e63 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:30.506677 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c7741833-f843-402e-a2e2-1e08c3ec5e63 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:30.508185 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c7741833-f843-402e-a2e2-1e08c3ec5e63 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:30.509338 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c7741833-f843-402e-a2e2-1e08c3ec5e63 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.151924 Oct 11 07:00:30.509883 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1201/2418] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:30 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:00:31.065862 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0db73a8a-a393-46e8-b398-ba5ba99df5af tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:31.066459 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0db73a8a-a393-46e8-b398-ba5ba99df5af tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:31.072350 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0db73a8a-a393-46e8-b398-ba5ba99df5af tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:31.072817 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0db73a8a-a393-46e8-b398-ba5ba99df5af tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:31.073242 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0db73a8a-a393-46e8-b398-ba5ba99df5af tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:31.073912 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0db73a8a-a393-46e8-b398-ba5ba99df5af tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:31.074360 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0db73a8a-a393-46e8-b398-ba5ba99df5af tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:31.074772 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0db73a8a-a393-46e8-b398-ba5ba99df5af tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:31.198611 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0db73a8a-a393-46e8-b398-ba5ba99df5af tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:31.206649 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0db73a8a-a393-46e8-b398-ba5ba99df5af tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.144584 Oct 11 07:00:31.207198 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1218/2419] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:31 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:31.352187 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-64024f4f-5152-4cfe-b04f-ef8d8077f858 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:31.352801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-64024f4f-5152-4cfe-b04f-ef8d8077f858 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:31.359209 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-64024f4f-5152-4cfe-b04f-ef8d8077f858 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:31.359720 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-64024f4f-5152-4cfe-b04f-ef8d8077f858 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:31.360152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-64024f4f-5152-4cfe-b04f-ef8d8077f858 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:31.360834 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-64024f4f-5152-4cfe-b04f-ef8d8077f858 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:31.361283 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-64024f4f-5152-4cfe-b04f-ef8d8077f858 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:31.361703 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-64024f4f-5152-4cfe-b04f-ef8d8077f858 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:31.486736 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-64024f4f-5152-4cfe-b04f-ef8d8077f858 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:31.495352 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-64024f4f-5152-4cfe-b04f-ef8d8077f858 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.147042 Oct 11 07:00:31.495931 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1202/2420] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:31 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:31.533918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0848fc4b-fd08-47a9-a0e7-ecfe3bdced62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:31.534537 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0848fc4b-fd08-47a9-a0e7-ecfe3bdced62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:31.540419 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0848fc4b-fd08-47a9-a0e7-ecfe3bdced62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:31.540900 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0848fc4b-fd08-47a9-a0e7-ecfe3bdced62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:31.541356 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0848fc4b-fd08-47a9-a0e7-ecfe3bdced62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:31.542038 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0848fc4b-fd08-47a9-a0e7-ecfe3bdced62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:31.542487 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0848fc4b-fd08-47a9-a0e7-ecfe3bdced62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:31.542936 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0848fc4b-fd08-47a9-a0e7-ecfe3bdced62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:31.670546 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0848fc4b-fd08-47a9-a0e7-ecfe3bdced62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:31.679587 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0848fc4b-fd08-47a9-a0e7-ecfe3bdced62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:31.681023 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0848fc4b-fd08-47a9-a0e7-ecfe3bdced62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:31.682180 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0848fc4b-fd08-47a9-a0e7-ecfe3bdced62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152080 Oct 11 07:00:31.682741 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1219/2421] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:31 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:00:32.230695 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6c713073-1907-473b-9d96-ee5ab490cea1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:32.231309 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6c713073-1907-473b-9d96-ee5ab490cea1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:32.237294 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c713073-1907-473b-9d96-ee5ab490cea1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:32.237776 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c713073-1907-473b-9d96-ee5ab490cea1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:32.238209 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c713073-1907-473b-9d96-ee5ab490cea1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:32.238898 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c713073-1907-473b-9d96-ee5ab490cea1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:32.239352 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c713073-1907-473b-9d96-ee5ab490cea1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:32.239800 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c713073-1907-473b-9d96-ee5ab490cea1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:32.363975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6c713073-1907-473b-9d96-ee5ab490cea1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:32.372117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6c713073-1907-473b-9d96-ee5ab490cea1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.145769 Oct 11 07:00:32.372683 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1203/2422] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:32 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:32.518863 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-56953cb6-a986-4bdb-82d3-0189473c4c47 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:32.519497 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-56953cb6-a986-4bdb-82d3-0189473c4c47 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:32.526321 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-56953cb6-a986-4bdb-82d3-0189473c4c47 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:32.526800 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-56953cb6-a986-4bdb-82d3-0189473c4c47 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:32.527233 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-56953cb6-a986-4bdb-82d3-0189473c4c47 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:32.527948 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-56953cb6-a986-4bdb-82d3-0189473c4c47 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:32.528402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-56953cb6-a986-4bdb-82d3-0189473c4c47 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:32.528823 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-56953cb6-a986-4bdb-82d3-0189473c4c47 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:32.655097 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-56953cb6-a986-4bdb-82d3-0189473c4c47 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:32.663266 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-56953cb6-a986-4bdb-82d3-0189473c4c47 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.148244 Oct 11 07:00:32.663873 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1220/2423] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:32 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:32.707814 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9acc5996-05c9-4827-b509-7c36a8fc7087 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:32.708541 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9acc5996-05c9-4827-b509-7c36a8fc7087 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:32.715248 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9acc5996-05c9-4827-b509-7c36a8fc7087 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:32.715754 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9acc5996-05c9-4827-b509-7c36a8fc7087 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:32.716189 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9acc5996-05c9-4827-b509-7c36a8fc7087 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:32.716876 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9acc5996-05c9-4827-b509-7c36a8fc7087 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:32.717323 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9acc5996-05c9-4827-b509-7c36a8fc7087 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:32.717741 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9acc5996-05c9-4827-b509-7c36a8fc7087 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:33.063253 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9acc5996-05c9-4827-b509-7c36a8fc7087 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:33.072327 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9acc5996-05c9-4827-b509-7c36a8fc7087 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:33.073756 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9acc5996-05c9-4827-b509-7c36a8fc7087 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:33.074897 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9acc5996-05c9-4827-b509-7c36a8fc7087 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.371007 Oct 11 07:00:33.075458 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1204/2424] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:32 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:00:33.396570 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-739d097e-ccc5-4cd0-9699-82ad98d513c5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:33.397196 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-739d097e-ccc5-4cd0-9699-82ad98d513c5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:33.403167 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-739d097e-ccc5-4cd0-9699-82ad98d513c5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:33.403666 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-739d097e-ccc5-4cd0-9699-82ad98d513c5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:33.404092 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-739d097e-ccc5-4cd0-9699-82ad98d513c5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:33.404777 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-739d097e-ccc5-4cd0-9699-82ad98d513c5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:33.405217 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-739d097e-ccc5-4cd0-9699-82ad98d513c5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:33.405692 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-739d097e-ccc5-4cd0-9699-82ad98d513c5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:33.533492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-739d097e-ccc5-4cd0-9699-82ad98d513c5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:33.541980 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-739d097e-ccc5-4cd0-9699-82ad98d513c5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.149199 Oct 11 07:00:33.542528 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1221/2425] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:33 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:33.686163 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2a05df65-d13a-44a1-88dc-a86788929e12 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:33.687136 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2a05df65-d13a-44a1-88dc-a86788929e12 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:33.693459 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2a05df65-d13a-44a1-88dc-a86788929e12 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:33.693943 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2a05df65-d13a-44a1-88dc-a86788929e12 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:33.694377 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2a05df65-d13a-44a1-88dc-a86788929e12 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:33.695079 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2a05df65-d13a-44a1-88dc-a86788929e12 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:33.695556 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2a05df65-d13a-44a1-88dc-a86788929e12 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:33.695976 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2a05df65-d13a-44a1-88dc-a86788929e12 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:33.822555 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2a05df65-d13a-44a1-88dc-a86788929e12 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:33.831174 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2a05df65-d13a-44a1-88dc-a86788929e12 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.148847 Oct 11 07:00:33.831923 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1205/2426] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:33 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:34.099963 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4bce7fb7-6cd5-4915-a188-f31190c68e34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:34.100562 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4bce7fb7-6cd5-4915-a188-f31190c68e34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:34.106427 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4bce7fb7-6cd5-4915-a188-f31190c68e34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:34.106897 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4bce7fb7-6cd5-4915-a188-f31190c68e34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:34.107324 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4bce7fb7-6cd5-4915-a188-f31190c68e34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:34.108019 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4bce7fb7-6cd5-4915-a188-f31190c68e34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:34.108460 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4bce7fb7-6cd5-4915-a188-f31190c68e34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:34.108874 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4bce7fb7-6cd5-4915-a188-f31190c68e34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:34.234354 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4bce7fb7-6cd5-4915-a188-f31190c68e34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:34.243069 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4bce7fb7-6cd5-4915-a188-f31190c68e34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:34.244555 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4bce7fb7-6cd5-4915-a188-f31190c68e34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:34.245705 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4bce7fb7-6cd5-4915-a188-f31190c68e34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.149619 Oct 11 07:00:34.246292 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1222/2427] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:34 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:00:34.565762 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-68260c11-5f69-4b85-856e-d586c4ad74f4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:34.566371 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-68260c11-5f69-4b85-856e-d586c4ad74f4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:34.572977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-68260c11-5f69-4b85-856e-d586c4ad74f4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:34.573455 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-68260c11-5f69-4b85-856e-d586c4ad74f4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:34.573893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-68260c11-5f69-4b85-856e-d586c4ad74f4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:34.574580 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-68260c11-5f69-4b85-856e-d586c4ad74f4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:34.575026 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-68260c11-5f69-4b85-856e-d586c4ad74f4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:34.575469 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-68260c11-5f69-4b85-856e-d586c4ad74f4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:34.703398 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-68260c11-5f69-4b85-856e-d586c4ad74f4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:34.711587 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-68260c11-5f69-4b85-856e-d586c4ad74f4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.149629 Oct 11 07:00:34.712146 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1206/2428] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:34 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:34.855549 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e1404453-88cc-4060-885c-e8fca3e8d6d4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:34.856165 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e1404453-88cc-4060-885c-e8fca3e8d6d4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:34.862535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e1404453-88cc-4060-885c-e8fca3e8d6d4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:34.863009 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e1404453-88cc-4060-885c-e8fca3e8d6d4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:34.863461 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e1404453-88cc-4060-885c-e8fca3e8d6d4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:34.864146 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e1404453-88cc-4060-885c-e8fca3e8d6d4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:34.864592 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e1404453-88cc-4060-885c-e8fca3e8d6d4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:34.865009 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e1404453-88cc-4060-885c-e8fca3e8d6d4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:34.994759 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e1404453-88cc-4060-885c-e8fca3e8d6d4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:35.002843 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e1404453-88cc-4060-885c-e8fca3e8d6d4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.151875 Oct 11 07:00:35.003404 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1223/2429] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:34 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:35.270902 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c87a86a5-a5c3-42c8-a406-8d809c616e01 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:35.271548 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c87a86a5-a5c3-42c8-a406-8d809c616e01 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:35.278047 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c87a86a5-a5c3-42c8-a406-8d809c616e01 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:35.278522 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c87a86a5-a5c3-42c8-a406-8d809c616e01 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:35.278953 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c87a86a5-a5c3-42c8-a406-8d809c616e01 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:35.279667 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c87a86a5-a5c3-42c8-a406-8d809c616e01 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:35.280114 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c87a86a5-a5c3-42c8-a406-8d809c616e01 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:35.280533 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c87a86a5-a5c3-42c8-a406-8d809c616e01 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:35.404013 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c87a86a5-a5c3-42c8-a406-8d809c616e01 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:35.412735 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c87a86a5-a5c3-42c8-a406-8d809c616e01 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:35.414731 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c87a86a5-a5c3-42c8-a406-8d809c616e01 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:35.415943 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c87a86a5-a5c3-42c8-a406-8d809c616e01 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.148870 Oct 11 07:00:35.416518 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1207/2430] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:35 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:00:35.734212 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2518fb02-e603-4852-95e3-d7f50cf5eef1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:35.734812 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2518fb02-e603-4852-95e3-d7f50cf5eef1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:35.740753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2518fb02-e603-4852-95e3-d7f50cf5eef1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:35.741232 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2518fb02-e603-4852-95e3-d7f50cf5eef1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:35.741665 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2518fb02-e603-4852-95e3-d7f50cf5eef1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:35.742352 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2518fb02-e603-4852-95e3-d7f50cf5eef1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:35.742788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2518fb02-e603-4852-95e3-d7f50cf5eef1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:35.743201 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2518fb02-e603-4852-95e3-d7f50cf5eef1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:35.870081 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2518fb02-e603-4852-95e3-d7f50cf5eef1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:35.878202 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2518fb02-e603-4852-95e3-d7f50cf5eef1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.147866 Oct 11 07:00:35.878763 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1224/2431] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:35 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:36.026413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ee0da797-eaeb-4a6a-869f-525ea7bd514a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:36.027021 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ee0da797-eaeb-4a6a-869f-525ea7bd514a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:36.033388 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ee0da797-eaeb-4a6a-869f-525ea7bd514a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:36.033858 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ee0da797-eaeb-4a6a-869f-525ea7bd514a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:36.034283 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ee0da797-eaeb-4a6a-869f-525ea7bd514a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:36.034982 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ee0da797-eaeb-4a6a-869f-525ea7bd514a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:36.035434 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ee0da797-eaeb-4a6a-869f-525ea7bd514a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:36.035872 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ee0da797-eaeb-4a6a-869f-525ea7bd514a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:36.166345 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ee0da797-eaeb-4a6a-869f-525ea7bd514a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:36.174433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ee0da797-eaeb-4a6a-869f-525ea7bd514a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.152356 Oct 11 07:00:36.174980 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1208/2432] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:36 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:36.441175 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b3ca156c-feec-4e4e-9afd-be93765714b5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:36.441786 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b3ca156c-feec-4e4e-9afd-be93765714b5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:36.448234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b3ca156c-feec-4e4e-9afd-be93765714b5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:36.448717 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b3ca156c-feec-4e4e-9afd-be93765714b5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:36.449142 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b3ca156c-feec-4e4e-9afd-be93765714b5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:36.449817 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b3ca156c-feec-4e4e-9afd-be93765714b5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:36.450262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b3ca156c-feec-4e4e-9afd-be93765714b5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:36.450679 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b3ca156c-feec-4e4e-9afd-be93765714b5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:36.576911 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b3ca156c-feec-4e4e-9afd-be93765714b5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:36.586003 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b3ca156c-feec-4e4e-9afd-be93765714b5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:36.587447 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b3ca156c-feec-4e4e-9afd-be93765714b5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:36.588598 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b3ca156c-feec-4e4e-9afd-be93765714b5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.151388 Oct 11 07:00:36.589150 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1225/2433] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:36 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:00:36.901599 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8d071c03-7d29-4667-a0a0-72ee1ae2335a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:36.902197 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8d071c03-7d29-4667-a0a0-72ee1ae2335a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:36.908140 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d071c03-7d29-4667-a0a0-72ee1ae2335a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:36.908616 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d071c03-7d29-4667-a0a0-72ee1ae2335a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:36.909041 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d071c03-7d29-4667-a0a0-72ee1ae2335a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:36.909718 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d071c03-7d29-4667-a0a0-72ee1ae2335a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:36.910163 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d071c03-7d29-4667-a0a0-72ee1ae2335a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:36.910577 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d071c03-7d29-4667-a0a0-72ee1ae2335a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:37.034963 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8d071c03-7d29-4667-a0a0-72ee1ae2335a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:37.043477 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8d071c03-7d29-4667-a0a0-72ee1ae2335a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.145697 Oct 11 07:00:37.044033 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1209/2434] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:36 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:37.197325 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e3843730-32dc-46a7-a55e-bef82f375ad0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:37.197900 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e3843730-32dc-46a7-a55e-bef82f375ad0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:37.204433 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e3843730-32dc-46a7-a55e-bef82f375ad0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:37.204906 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e3843730-32dc-46a7-a55e-bef82f375ad0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:37.205333 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e3843730-32dc-46a7-a55e-bef82f375ad0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:37.206016 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e3843730-32dc-46a7-a55e-bef82f375ad0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:37.206464 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e3843730-32dc-46a7-a55e-bef82f375ad0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:37.206880 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e3843730-32dc-46a7-a55e-bef82f375ad0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:37.335730 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e3843730-32dc-46a7-a55e-bef82f375ad0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:37.344138 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e3843730-32dc-46a7-a55e-bef82f375ad0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150654 Oct 11 07:00:37.344706 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1226/2435] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:37 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:37.613588 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-82155615-45d3-4e1f-a1a2-0fe321d90767 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:37.614228 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-82155615-45d3-4e1f-a1a2-0fe321d90767 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:37.620207 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82155615-45d3-4e1f-a1a2-0fe321d90767 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:37.620683 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82155615-45d3-4e1f-a1a2-0fe321d90767 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:37.621114 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82155615-45d3-4e1f-a1a2-0fe321d90767 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:37.621797 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82155615-45d3-4e1f-a1a2-0fe321d90767 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:37.622246 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82155615-45d3-4e1f-a1a2-0fe321d90767 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:37.622662 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82155615-45d3-4e1f-a1a2-0fe321d90767 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:37.747463 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-82155615-45d3-4e1f-a1a2-0fe321d90767 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:37.755945 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-82155615-45d3-4e1f-a1a2-0fe321d90767 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:37.757374 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-82155615-45d3-4e1f-a1a2-0fe321d90767 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:37.758535 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-82155615-45d3-4e1f-a1a2-0fe321d90767 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.148916 Oct 11 07:00:37.759092 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1210/2436] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:37 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:00:38.066361 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0490f789-1952-4929-9ad1-33cdd8e5851a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:38.066968 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0490f789-1952-4929-9ad1-33cdd8e5851a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:38.068888 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=78 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:00:38.075185 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0490f789-1952-4929-9ad1-33cdd8e5851a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:38.075727 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0490f789-1952-4929-9ad1-33cdd8e5851a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:38.076150 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0490f789-1952-4929-9ad1-33cdd8e5851a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:38.076868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0490f789-1952-4929-9ad1-33cdd8e5851a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:38.077309 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0490f789-1952-4929-9ad1-33cdd8e5851a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:38.077720 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0490f789-1952-4929-9ad1-33cdd8e5851a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:38.202548 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0490f789-1952-4929-9ad1-33cdd8e5851a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:38.211722 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0490f789-1952-4929-9ad1-33cdd8e5851a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.149120 Oct 11 07:00:38.212276 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1227/2437] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:38 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:00:38.368205 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a5fd33c8-2408-464b-9bb5-86a80f1b8c52 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:38.368873 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a5fd33c8-2408-464b-9bb5-86a80f1b8c52 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:38.375505 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a5fd33c8-2408-464b-9bb5-86a80f1b8c52 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:38.375978 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a5fd33c8-2408-464b-9bb5-86a80f1b8c52 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:38.376401 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a5fd33c8-2408-464b-9bb5-86a80f1b8c52 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:38.377080 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a5fd33c8-2408-464b-9bb5-86a80f1b8c52 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:38.377523 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a5fd33c8-2408-464b-9bb5-86a80f1b8c52 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:38.377933 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a5fd33c8-2408-464b-9bb5-86a80f1b8c52 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:38.381918 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:00:38.508511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a5fd33c8-2408-464b-9bb5-86a80f1b8c52 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:38.516865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a5fd33c8-2408-464b-9bb5-86a80f1b8c52 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.153307 Oct 11 07:00:38.517430 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1211/2438] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:38 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:38.784634 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3a7e926d-261e-4f0b-8aec-fa84be9bf0d8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:38.785159 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3a7e926d-261e-4f0b-8aec-fa84be9bf0d8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:38.791858 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3a7e926d-261e-4f0b-8aec-fa84be9bf0d8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:38.792339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3a7e926d-261e-4f0b-8aec-fa84be9bf0d8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:38.792774 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3a7e926d-261e-4f0b-8aec-fa84be9bf0d8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:38.793494 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3a7e926d-261e-4f0b-8aec-fa84be9bf0d8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:38.793946 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3a7e926d-261e-4f0b-8aec-fa84be9bf0d8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:38.794367 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3a7e926d-261e-4f0b-8aec-fa84be9bf0d8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:38.922052 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3a7e926d-261e-4f0b-8aec-fa84be9bf0d8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:38.931168 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3a7e926d-261e-4f0b-8aec-fa84be9bf0d8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:38.932627 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3a7e926d-261e-4f0b-8aec-fa84be9bf0d8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:38.933784 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3a7e926d-261e-4f0b-8aec-fa84be9bf0d8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.153149 Oct 11 07:00:38.934345 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1228/2439] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:38 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:00:39.234235 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d9dbe95a-01c2-42c7-a065-62635728f790 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:39.234849 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d9dbe95a-01c2-42c7-a065-62635728f790 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:39.240839 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d9dbe95a-01c2-42c7-a065-62635728f790 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:39.241347 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d9dbe95a-01c2-42c7-a065-62635728f790 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:39.241783 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d9dbe95a-01c2-42c7-a065-62635728f790 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:39.242459 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d9dbe95a-01c2-42c7-a065-62635728f790 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:39.242905 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d9dbe95a-01c2-42c7-a065-62635728f790 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:39.243322 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d9dbe95a-01c2-42c7-a065-62635728f790 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:39.366452 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d9dbe95a-01c2-42c7-a065-62635728f790 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:39.375105 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d9dbe95a-01c2-42c7-a065-62635728f790 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.144783 Oct 11 07:00:39.375701 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1212/2440] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:39 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:39.539833 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d7c054ec-f884-4580-9357-bd53fe84ecfb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:39.540444 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d7c054ec-f884-4580-9357-bd53fe84ecfb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:39.546726 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7c054ec-f884-4580-9357-bd53fe84ecfb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:39.547202 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7c054ec-f884-4580-9357-bd53fe84ecfb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:39.547683 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7c054ec-f884-4580-9357-bd53fe84ecfb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:39.548360 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7c054ec-f884-4580-9357-bd53fe84ecfb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:39.548991 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7c054ec-f884-4580-9357-bd53fe84ecfb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:39.549419 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7c054ec-f884-4580-9357-bd53fe84ecfb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:39.674000 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d7c054ec-f884-4580-9357-bd53fe84ecfb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:39.682097 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d7c054ec-f884-4580-9357-bd53fe84ecfb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.146039 Oct 11 07:00:39.682651 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1229/2441] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:39 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:39.958938 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-aa074aad-7f9e-4d4e-a4ee-f1f66d530403 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:39.959509 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-aa074aad-7f9e-4d4e-a4ee-f1f66d530403 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:39.965455 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aa074aad-7f9e-4d4e-a4ee-f1f66d530403 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:39.965936 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aa074aad-7f9e-4d4e-a4ee-f1f66d530403 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:39.966374 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aa074aad-7f9e-4d4e-a4ee-f1f66d530403 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:39.967066 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aa074aad-7f9e-4d4e-a4ee-f1f66d530403 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:39.967548 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aa074aad-7f9e-4d4e-a4ee-f1f66d530403 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:39.967977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aa074aad-7f9e-4d4e-a4ee-f1f66d530403 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:40.095686 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-aa074aad-7f9e-4d4e-a4ee-f1f66d530403 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:40.104798 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-aa074aad-7f9e-4d4e-a4ee-f1f66d530403 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:40.106234 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-aa074aad-7f9e-4d4e-a4ee-f1f66d530403 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:40.107383 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-aa074aad-7f9e-4d4e-a4ee-f1f66d530403 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152430 Oct 11 07:00:40.107954 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1213/2442] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:39 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:00:40.399209 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f37644df-4618-42ca-b61d-dfd982aa2b73 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:40.399840 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f37644df-4618-42ca-b61d-dfd982aa2b73 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:40.406060 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f37644df-4618-42ca-b61d-dfd982aa2b73 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:40.406546 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f37644df-4618-42ca-b61d-dfd982aa2b73 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:40.407557 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f37644df-4618-42ca-b61d-dfd982aa2b73 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:40.407705 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f37644df-4618-42ca-b61d-dfd982aa2b73 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:40.408156 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f37644df-4618-42ca-b61d-dfd982aa2b73 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:40.408585 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f37644df-4618-42ca-b61d-dfd982aa2b73 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:40.535148 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f37644df-4618-42ca-b61d-dfd982aa2b73 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:40.544019 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f37644df-4618-42ca-b61d-dfd982aa2b73 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.148672 Oct 11 07:00:40.544604 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1230/2443] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:40 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:40.705063 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ca74b386-bb47-4dc9-aba3-3a372572d582 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:40.705680 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ca74b386-bb47-4dc9-aba3-3a372572d582 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:40.712579 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca74b386-bb47-4dc9-aba3-3a372572d582 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:40.713057 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca74b386-bb47-4dc9-aba3-3a372572d582 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:40.713490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca74b386-bb47-4dc9-aba3-3a372572d582 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:40.714175 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca74b386-bb47-4dc9-aba3-3a372572d582 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:40.714625 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca74b386-bb47-4dc9-aba3-3a372572d582 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:40.715076 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ca74b386-bb47-4dc9-aba3-3a372572d582 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:40.846894 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ca74b386-bb47-4dc9-aba3-3a372572d582 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:40.855236 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ca74b386-bb47-4dc9-aba3-3a372572d582 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.153965 Oct 11 07:00:40.855820 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1214/2444] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:40 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:41.134574 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ba2f9494-cfb8-4b06-b5e6-621dc8fb5843 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:41.135179 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ba2f9494-cfb8-4b06-b5e6-621dc8fb5843 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:41.141844 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ba2f9494-cfb8-4b06-b5e6-621dc8fb5843 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:41.142315 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ba2f9494-cfb8-4b06-b5e6-621dc8fb5843 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:41.142744 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ba2f9494-cfb8-4b06-b5e6-621dc8fb5843 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:41.143439 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ba2f9494-cfb8-4b06-b5e6-621dc8fb5843 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:41.143895 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ba2f9494-cfb8-4b06-b5e6-621dc8fb5843 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:41.144313 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ba2f9494-cfb8-4b06-b5e6-621dc8fb5843 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:41.162756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:00:41.281633 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ba2f9494-cfb8-4b06-b5e6-621dc8fb5843 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:41.290558 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ba2f9494-cfb8-4b06-b5e6-621dc8fb5843 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:41.292024 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ba2f9494-cfb8-4b06-b5e6-621dc8fb5843 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:41.293183 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ba2f9494-cfb8-4b06-b5e6-621dc8fb5843 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.163051 Oct 11 07:00:41.294038 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1231/2445] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:41 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:00:41.567302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4fe889a1-1ffc-47fd-944d-9bfbba759b06 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:41.567952 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4fe889a1-1ffc-47fd-944d-9bfbba759b06 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:41.574682 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4fe889a1-1ffc-47fd-944d-9bfbba759b06 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:41.575168 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4fe889a1-1ffc-47fd-944d-9bfbba759b06 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:41.575634 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4fe889a1-1ffc-47fd-944d-9bfbba759b06 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:41.576336 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4fe889a1-1ffc-47fd-944d-9bfbba759b06 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:41.576901 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4fe889a1-1ffc-47fd-944d-9bfbba759b06 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:41.577455 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4fe889a1-1ffc-47fd-944d-9bfbba759b06 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:41.702896 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4fe889a1-1ffc-47fd-944d-9bfbba759b06 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:41.711461 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4fe889a1-1ffc-47fd-944d-9bfbba759b06 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.148005 Oct 11 07:00:41.712050 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1215/2446] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:41 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:41.878207 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3b4553e6-5d03-4af3-b053-3616cd99e168 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:41.878851 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3b4553e6-5d03-4af3-b053-3616cd99e168 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:41.884788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b4553e6-5d03-4af3-b053-3616cd99e168 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:41.885261 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b4553e6-5d03-4af3-b053-3616cd99e168 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:41.885692 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b4553e6-5d03-4af3-b053-3616cd99e168 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:41.886371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b4553e6-5d03-4af3-b053-3616cd99e168 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:41.886814 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b4553e6-5d03-4af3-b053-3616cd99e168 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:41.887234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b4553e6-5d03-4af3-b053-3616cd99e168 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:42.011114 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3b4553e6-5d03-4af3-b053-3616cd99e168 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:42.019491 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3b4553e6-5d03-4af3-b053-3616cd99e168 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.145055 Oct 11 07:00:42.020056 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1232/2447] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:41 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:42.317999 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c5ee13f0-e2a1-45fb-862f-901031d2cda9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:42.318612 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c5ee13f0-e2a1-45fb-862f-901031d2cda9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:42.325215 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c5ee13f0-e2a1-45fb-862f-901031d2cda9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:42.325699 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c5ee13f0-e2a1-45fb-862f-901031d2cda9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:42.326130 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c5ee13f0-e2a1-45fb-862f-901031d2cda9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:42.326822 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c5ee13f0-e2a1-45fb-862f-901031d2cda9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:42.327270 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c5ee13f0-e2a1-45fb-862f-901031d2cda9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:42.327726 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c5ee13f0-e2a1-45fb-862f-901031d2cda9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:42.456418 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c5ee13f0-e2a1-45fb-862f-901031d2cda9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:42.465437 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c5ee13f0-e2a1-45fb-862f-901031d2cda9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:42.466878 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c5ee13f0-e2a1-45fb-862f-901031d2cda9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:42.468064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c5ee13f0-e2a1-45fb-862f-901031d2cda9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.153983 Oct 11 07:00:42.468614 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1216/2448] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:42 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:00:42.735606 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-82b8ecb6-103a-45e7-a32d-fcabb21fc7ff tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:42.736211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-82b8ecb6-103a-45e7-a32d-fcabb21fc7ff tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:42.743046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-82b8ecb6-103a-45e7-a32d-fcabb21fc7ff tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:42.743555 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-82b8ecb6-103a-45e7-a32d-fcabb21fc7ff tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:42.743985 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-82b8ecb6-103a-45e7-a32d-fcabb21fc7ff tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:42.744667 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-82b8ecb6-103a-45e7-a32d-fcabb21fc7ff tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:42.745113 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-82b8ecb6-103a-45e7-a32d-fcabb21fc7ff tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:42.745533 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-82b8ecb6-103a-45e7-a32d-fcabb21fc7ff tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:42.877747 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-82b8ecb6-103a-45e7-a32d-fcabb21fc7ff tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:42.886567 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-82b8ecb6-103a-45e7-a32d-fcabb21fc7ff tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.154824 Oct 11 07:00:42.887160 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1233/2449] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:42 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:43.043401 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7eefcbd5-f24d-47ff-9c86-e1e1b4d41d50 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:43.044041 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7eefcbd5-f24d-47ff-9c86-e1e1b4d41d50 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:43.050588 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7eefcbd5-f24d-47ff-9c86-e1e1b4d41d50 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:43.051066 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7eefcbd5-f24d-47ff-9c86-e1e1b4d41d50 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:43.051523 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7eefcbd5-f24d-47ff-9c86-e1e1b4d41d50 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:43.052215 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7eefcbd5-f24d-47ff-9c86-e1e1b4d41d50 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:43.052664 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7eefcbd5-f24d-47ff-9c86-e1e1b4d41d50 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:43.053086 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7eefcbd5-f24d-47ff-9c86-e1e1b4d41d50 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:43.177972 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7eefcbd5-f24d-47ff-9c86-e1e1b4d41d50 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:43.186107 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7eefcbd5-f24d-47ff-9c86-e1e1b4d41d50 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.146530 Oct 11 07:00:43.186668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1217/2450] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:43 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:43.493726 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2112401a-ae7f-4b0f-9659-523859dcece1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:43.494246 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2112401a-ae7f-4b0f-9659-523859dcece1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:43.500127 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2112401a-ae7f-4b0f-9659-523859dcece1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:43.500603 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2112401a-ae7f-4b0f-9659-523859dcece1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:43.501031 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2112401a-ae7f-4b0f-9659-523859dcece1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:43.501700 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2112401a-ae7f-4b0f-9659-523859dcece1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:43.502139 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2112401a-ae7f-4b0f-9659-523859dcece1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:43.502553 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2112401a-ae7f-4b0f-9659-523859dcece1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:43.626410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2112401a-ae7f-4b0f-9659-523859dcece1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:43.635436 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2112401a-ae7f-4b0f-9659-523859dcece1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:43.636846 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2112401a-ae7f-4b0f-9659-523859dcece1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:43.637987 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2112401a-ae7f-4b0f-9659-523859dcece1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.148751 Oct 11 07:00:43.638788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1234/2451] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:43 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:00:43.909399 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4748b7a9-dbe7-4099-92f6-c8521099b988 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:43.910015 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4748b7a9-dbe7-4099-92f6-c8521099b988 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:43.916521 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4748b7a9-dbe7-4099-92f6-c8521099b988 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:43.917000 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4748b7a9-dbe7-4099-92f6-c8521099b988 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:43.917437 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4748b7a9-dbe7-4099-92f6-c8521099b988 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:43.918126 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4748b7a9-dbe7-4099-92f6-c8521099b988 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:43.918580 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4748b7a9-dbe7-4099-92f6-c8521099b988 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:43.919005 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4748b7a9-dbe7-4099-92f6-c8521099b988 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:44.046350 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4748b7a9-dbe7-4099-92f6-c8521099b988 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:44.055632 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4748b7a9-dbe7-4099-92f6-c8521099b988 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.150031 Oct 11 07:00:44.056188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1218/2452] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:43 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:44.209392 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-dc09aced-6943-4459-89c3-333d040c9015 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:44.210432 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-dc09aced-6943-4459-89c3-333d040c9015 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:44.216856 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc09aced-6943-4459-89c3-333d040c9015 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:44.217329 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc09aced-6943-4459-89c3-333d040c9015 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:44.217754 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc09aced-6943-4459-89c3-333d040c9015 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:44.218435 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc09aced-6943-4459-89c3-333d040c9015 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:44.218876 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc09aced-6943-4459-89c3-333d040c9015 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:44.219293 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc09aced-6943-4459-89c3-333d040c9015 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:44.346205 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-dc09aced-6943-4459-89c3-333d040c9015 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:44.354921 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-dc09aced-6943-4459-89c3-333d040c9015 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.149370 Oct 11 07:00:44.355491 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1235/2453] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:44 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:44.663553 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3c9b47a1-10da-4186-b025-d2c304c31d62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:44.664158 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3c9b47a1-10da-4186-b025-d2c304c31d62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:44.670171 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c9b47a1-10da-4186-b025-d2c304c31d62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:44.670648 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c9b47a1-10da-4186-b025-d2c304c31d62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:44.671075 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c9b47a1-10da-4186-b025-d2c304c31d62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:44.671793 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c9b47a1-10da-4186-b025-d2c304c31d62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:44.672245 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c9b47a1-10da-4186-b025-d2c304c31d62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:44.672664 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c9b47a1-10da-4186-b025-d2c304c31d62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:44.803568 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3c9b47a1-10da-4186-b025-d2c304c31d62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:44.812683 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3c9b47a1-10da-4186-b025-d2c304c31d62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:44.814130 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3c9b47a1-10da-4186-b025-d2c304c31d62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:44.815365 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3c9b47a1-10da-4186-b025-d2c304c31d62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.155787 Oct 11 07:00:44.815958 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1219/2454] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:44 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:00:45.078159 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-48ee6089-d44a-4c69-88a7-1090e43c80bc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:45.078666 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-48ee6089-d44a-4c69-88a7-1090e43c80bc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:45.080653 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 07:00:45.080800 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Tue Oct 11 07:00:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e (ip 10.222.0.39) !!! Oct 11 07:00:45.087109 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-48ee6089-d44a-4c69-88a7-1090e43c80bc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:45.087623 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-48ee6089-d44a-4c69-88a7-1090e43c80bc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:45.088053 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-48ee6089-d44a-4c69-88a7-1090e43c80bc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:45.088736 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-48ee6089-d44a-4c69-88a7-1090e43c80bc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:45.089178 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-48ee6089-d44a-4c69-88a7-1090e43c80bc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:45.089594 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-48ee6089-d44a-4c69-88a7-1090e43c80bc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:45.213407 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-48ee6089-d44a-4c69-88a7-1090e43c80bc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:45.221923 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-48ee6089-d44a-4c69-88a7-1090e43c80bc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.147685 Oct 11 07:00:45.222475 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1236/2455] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:45 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:45.377586 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-82761d8a-66f6-4014-b279-22e0495ea0f7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:45.378197 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-82761d8a-66f6-4014-b279-22e0495ea0f7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:45.384826 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82761d8a-66f6-4014-b279-22e0495ea0f7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:45.385340 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82761d8a-66f6-4014-b279-22e0495ea0f7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:45.385775 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82761d8a-66f6-4014-b279-22e0495ea0f7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:45.386469 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82761d8a-66f6-4014-b279-22e0495ea0f7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:45.386920 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82761d8a-66f6-4014-b279-22e0495ea0f7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:45.387369 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-82761d8a-66f6-4014-b279-22e0495ea0f7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:45.519458 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-82761d8a-66f6-4014-b279-22e0495ea0f7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:45.527510 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-82761d8a-66f6-4014-b279-22e0495ea0f7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.153730 Oct 11 07:00:45.528063 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1220/2456] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:45 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:45.841593 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-482c19f5-28ac-46ae-a22c-69db7da6c188 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:45.842205 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-482c19f5-28ac-46ae-a22c-69db7da6c188 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:45.848213 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-482c19f5-28ac-46ae-a22c-69db7da6c188 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:45.848694 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-482c19f5-28ac-46ae-a22c-69db7da6c188 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:45.849125 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-482c19f5-28ac-46ae-a22c-69db7da6c188 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:45.849814 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-482c19f5-28ac-46ae-a22c-69db7da6c188 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:45.850263 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-482c19f5-28ac-46ae-a22c-69db7da6c188 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:45.851306 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-482c19f5-28ac-46ae-a22c-69db7da6c188 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:45.977857 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-482c19f5-28ac-46ae-a22c-69db7da6c188 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:45.986283 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-482c19f5-28ac-46ae-a22c-69db7da6c188 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:45.987718 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-482c19f5-28ac-46ae-a22c-69db7da6c188 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:45.988852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-482c19f5-28ac-46ae-a22c-69db7da6c188 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.151146 Oct 11 07:00:45.989398 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1237/2457] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:45 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:00:46.244875 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-efece410-4cef-4a85-9d21-38c9f227e747 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:46.245485 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-efece410-4cef-4a85-9d21-38c9f227e747 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:46.251363 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-efece410-4cef-4a85-9d21-38c9f227e747 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:46.251867 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-efece410-4cef-4a85-9d21-38c9f227e747 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:46.252298 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-efece410-4cef-4a85-9d21-38c9f227e747 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:46.253003 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-efece410-4cef-4a85-9d21-38c9f227e747 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:46.253514 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-efece410-4cef-4a85-9d21-38c9f227e747 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:46.253876 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-efece410-4cef-4a85-9d21-38c9f227e747 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:46.381346 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-efece410-4cef-4a85-9d21-38c9f227e747 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:46.390142 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-efece410-4cef-4a85-9d21-38c9f227e747 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.149100 Oct 11 07:00:46.390700 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1221/2458] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:46 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:46.549871 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d80cfe17-66f5-463a-aa45-d2b8f32f0523 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:46.550478 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d80cfe17-66f5-463a-aa45-d2b8f32f0523 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:46.556956 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d80cfe17-66f5-463a-aa45-d2b8f32f0523 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:46.557574 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d80cfe17-66f5-463a-aa45-d2b8f32f0523 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:46.557854 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d80cfe17-66f5-463a-aa45-d2b8f32f0523 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:46.558539 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d80cfe17-66f5-463a-aa45-d2b8f32f0523 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:46.558986 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d80cfe17-66f5-463a-aa45-d2b8f32f0523 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:46.559404 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d80cfe17-66f5-463a-aa45-d2b8f32f0523 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:46.689710 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d80cfe17-66f5-463a-aa45-d2b8f32f0523 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:46.697888 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d80cfe17-66f5-463a-aa45-d2b8f32f0523 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.151829 Oct 11 07:00:46.698442 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1238/2459] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:46 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:47.013875 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cc613808-a8b3-458f-b239-20b2cd9d9ed7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:47.014787 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cc613808-a8b3-458f-b239-20b2cd9d9ed7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:47.020990 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc613808-a8b3-458f-b239-20b2cd9d9ed7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:47.021460 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc613808-a8b3-458f-b239-20b2cd9d9ed7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:47.021887 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc613808-a8b3-458f-b239-20b2cd9d9ed7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:47.023156 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc613808-a8b3-458f-b239-20b2cd9d9ed7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:47.023635 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc613808-a8b3-458f-b239-20b2cd9d9ed7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:47.024054 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cc613808-a8b3-458f-b239-20b2cd9d9ed7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:47.148957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cc613808-a8b3-458f-b239-20b2cd9d9ed7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:47.157416 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cc613808-a8b3-458f-b239-20b2cd9d9ed7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:47.158834 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cc613808-a8b3-458f-b239-20b2cd9d9ed7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:47.160005 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cc613808-a8b3-458f-b239-20b2cd9d9ed7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.150234 Oct 11 07:00:47.160547 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1222/2460] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:47 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:00:47.414839 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-64c353ca-ee62-493f-86e1-16c2143b8f4e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:47.415632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-64c353ca-ee62-493f-86e1-16c2143b8f4e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:47.421932 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-64c353ca-ee62-493f-86e1-16c2143b8f4e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:47.422410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-64c353ca-ee62-493f-86e1-16c2143b8f4e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:47.422839 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-64c353ca-ee62-493f-86e1-16c2143b8f4e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:47.423561 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-64c353ca-ee62-493f-86e1-16c2143b8f4e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:47.424011 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-64c353ca-ee62-493f-86e1-16c2143b8f4e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:47.424436 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-64c353ca-ee62-493f-86e1-16c2143b8f4e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:47.550189 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-64c353ca-ee62-493f-86e1-16c2143b8f4e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:47.558388 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-64c353ca-ee62-493f-86e1-16c2143b8f4e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.147490 Oct 11 07:00:47.558947 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1239/2461] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:47 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:47.721187 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3c7c85a1-b315-46f3-9b3f-07305760bd46 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:47.721736 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3c7c85a1-b315-46f3-9b3f-07305760bd46 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:47.727795 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c7c85a1-b315-46f3-9b3f-07305760bd46 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:47.728273 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c7c85a1-b315-46f3-9b3f-07305760bd46 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:47.728720 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c7c85a1-b315-46f3-9b3f-07305760bd46 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:47.729405 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c7c85a1-b315-46f3-9b3f-07305760bd46 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:47.729850 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c7c85a1-b315-46f3-9b3f-07305760bd46 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:47.730270 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3c7c85a1-b315-46f3-9b3f-07305760bd46 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:47.859096 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3c7c85a1-b315-46f3-9b3f-07305760bd46 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:47.867132 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3c7c85a1-b315-46f3-9b3f-07305760bd46 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.149836 Oct 11 07:00:47.867717 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1223/2462] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:47 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:48.185616 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b80597fe-9a0c-4e15-bd68-b99df5219b46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:48.186219 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b80597fe-9a0c-4e15-bd68-b99df5219b46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:48.192176 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b80597fe-9a0c-4e15-bd68-b99df5219b46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:48.192653 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b80597fe-9a0c-4e15-bd68-b99df5219b46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:48.193080 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b80597fe-9a0c-4e15-bd68-b99df5219b46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:48.193758 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b80597fe-9a0c-4e15-bd68-b99df5219b46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:48.194787 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b80597fe-9a0c-4e15-bd68-b99df5219b46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:48.195206 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b80597fe-9a0c-4e15-bd68-b99df5219b46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:48.324500 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b80597fe-9a0c-4e15-bd68-b99df5219b46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:48.333056 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b80597fe-9a0c-4e15-bd68-b99df5219b46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:48.334474 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b80597fe-9a0c-4e15-bd68-b99df5219b46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:48.335653 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b80597fe-9a0c-4e15-bd68-b99df5219b46 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.153833 Oct 11 07:00:48.336205 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1240/2463] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:48 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:00:48.582148 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-96653276-5bf3-468a-b019-a9193f8def10 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:48.582666 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-96653276-5bf3-468a-b019-a9193f8def10 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:48.588649 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-96653276-5bf3-468a-b019-a9193f8def10 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:48.589118 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-96653276-5bf3-468a-b019-a9193f8def10 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:48.589551 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-96653276-5bf3-468a-b019-a9193f8def10 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:48.590258 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-96653276-5bf3-468a-b019-a9193f8def10 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:48.590703 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-96653276-5bf3-468a-b019-a9193f8def10 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:48.591117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-96653276-5bf3-468a-b019-a9193f8def10 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:48.719649 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-96653276-5bf3-468a-b019-a9193f8def10 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:48.728896 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-96653276-5bf3-468a-b019-a9193f8def10 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.150711 Oct 11 07:00:48.729483 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1224/2464] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:48 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:48.890228 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d6d5e248-0ad1-419b-aa83-c92ba70ac383 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:48.890810 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d6d5e248-0ad1-419b-aa83-c92ba70ac383 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:48.897875 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d6d5e248-0ad1-419b-aa83-c92ba70ac383 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:48.898364 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d6d5e248-0ad1-419b-aa83-c92ba70ac383 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:48.898799 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d6d5e248-0ad1-419b-aa83-c92ba70ac383 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:48.899562 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d6d5e248-0ad1-419b-aa83-c92ba70ac383 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:48.900018 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d6d5e248-0ad1-419b-aa83-c92ba70ac383 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:48.900444 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d6d5e248-0ad1-419b-aa83-c92ba70ac383 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:49.026879 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d6d5e248-0ad1-419b-aa83-c92ba70ac383 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:49.035103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d6d5e248-0ad1-419b-aa83-c92ba70ac383 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.148920 Oct 11 07:00:49.035698 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1241/2465] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:48 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:49.361399 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-068fec7c-0a64-48ad-8a48-090dc3ee925c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:49.362012 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-068fec7c-0a64-48ad-8a48-090dc3ee925c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:49.368082 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-068fec7c-0a64-48ad-8a48-090dc3ee925c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:49.368563 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-068fec7c-0a64-48ad-8a48-090dc3ee925c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:49.369000 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-068fec7c-0a64-48ad-8a48-090dc3ee925c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:49.369690 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-068fec7c-0a64-48ad-8a48-090dc3ee925c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:49.370141 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-068fec7c-0a64-48ad-8a48-090dc3ee925c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:49.370569 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-068fec7c-0a64-48ad-8a48-090dc3ee925c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:49.500484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-068fec7c-0a64-48ad-8a48-090dc3ee925c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:49.509635 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-068fec7c-0a64-48ad-8a48-090dc3ee925c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:49.511068 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-068fec7c-0a64-48ad-8a48-090dc3ee925c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:49.512251 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-068fec7c-0a64-48ad-8a48-090dc3ee925c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.154854 Oct 11 07:00:49.512806 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1225/2466] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:49 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:00:49.751959 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d2d92c72-45f2-4060-b26d-8df9eb479453 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:49.752563 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d2d92c72-45f2-4060-b26d-8df9eb479453 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:49.759047 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d2d92c72-45f2-4060-b26d-8df9eb479453 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:49.759559 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d2d92c72-45f2-4060-b26d-8df9eb479453 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:49.759994 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d2d92c72-45f2-4060-b26d-8df9eb479453 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:49.760675 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d2d92c72-45f2-4060-b26d-8df9eb479453 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:49.761120 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d2d92c72-45f2-4060-b26d-8df9eb479453 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:49.761575 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d2d92c72-45f2-4060-b26d-8df9eb479453 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:49.886001 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d2d92c72-45f2-4060-b26d-8df9eb479453 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:49.894313 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d2d92c72-45f2-4060-b26d-8df9eb479453 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.146176 Oct 11 07:00:49.894913 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1242/2467] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:49 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:50.058695 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8e3be78b-251a-4acd-9f75-38e2ea54c8aa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:50.059304 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8e3be78b-251a-4acd-9f75-38e2ea54c8aa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:50.065563 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e3be78b-251a-4acd-9f75-38e2ea54c8aa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:50.066034 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e3be78b-251a-4acd-9f75-38e2ea54c8aa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:50.066459 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e3be78b-251a-4acd-9f75-38e2ea54c8aa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:50.067136 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e3be78b-251a-4acd-9f75-38e2ea54c8aa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:50.067613 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e3be78b-251a-4acd-9f75-38e2ea54c8aa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:50.068030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e3be78b-251a-4acd-9f75-38e2ea54c8aa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:50.193637 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8e3be78b-251a-4acd-9f75-38e2ea54c8aa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:50.201696 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8e3be78b-251a-4acd-9f75-38e2ea54c8aa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.147012 Oct 11 07:00:50.202247 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1226/2468] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:50 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:50.537516 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-31fa2505-cab8-4cb4-b3df-8540b9a3fd37 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:50.538710 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-31fa2505-cab8-4cb4-b3df-8540b9a3fd37 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:50.545205 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-31fa2505-cab8-4cb4-b3df-8540b9a3fd37 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:50.545676 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-31fa2505-cab8-4cb4-b3df-8540b9a3fd37 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:50.546103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-31fa2505-cab8-4cb4-b3df-8540b9a3fd37 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:50.546780 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-31fa2505-cab8-4cb4-b3df-8540b9a3fd37 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:50.547223 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-31fa2505-cab8-4cb4-b3df-8540b9a3fd37 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:50.547671 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-31fa2505-cab8-4cb4-b3df-8540b9a3fd37 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:50.675355 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-31fa2505-cab8-4cb4-b3df-8540b9a3fd37 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:50.683884 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-31fa2505-cab8-4cb4-b3df-8540b9a3fd37 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:50.685318 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-31fa2505-cab8-4cb4-b3df-8540b9a3fd37 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:50.686458 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-31fa2505-cab8-4cb4-b3df-8540b9a3fd37 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152785 Oct 11 07:00:50.687011 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1243/2469] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:50 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:00:50.917496 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d06a56c1-be9a-41e3-9a0f-9a954a70e78e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:50.918106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d06a56c1-be9a-41e3-9a0f-9a954a70e78e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:50.920065 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 07:00:50.920195 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Tue Oct 11 07:00:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e (ip 10.222.0.39) !!! Oct 11 07:00:50.921116 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=78 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:00:50.927556 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d06a56c1-be9a-41e3-9a0f-9a954a70e78e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:50.928004 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d06a56c1-be9a-41e3-9a0f-9a954a70e78e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:50.928433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d06a56c1-be9a-41e3-9a0f-9a954a70e78e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:50.929121 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d06a56c1-be9a-41e3-9a0f-9a954a70e78e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:50.929569 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d06a56c1-be9a-41e3-9a0f-9a954a70e78e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:50.929990 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d06a56c1-be9a-41e3-9a0f-9a954a70e78e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:51.055900 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d06a56c1-be9a-41e3-9a0f-9a954a70e78e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:51.059292 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:00:51.065534 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d06a56c1-be9a-41e3-9a0f-9a954a70e78e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.151940 Oct 11 07:00:51.066097 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1227/2470] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:50 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:51.224936 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7dddf82e-6601-4783-bb2a-39f64ad4901e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:51.225481 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7dddf82e-6601-4783-bb2a-39f64ad4901e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:51.231376 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7dddf82e-6601-4783-bb2a-39f64ad4901e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:51.231883 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7dddf82e-6601-4783-bb2a-39f64ad4901e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:51.232318 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7dddf82e-6601-4783-bb2a-39f64ad4901e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:51.233035 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7dddf82e-6601-4783-bb2a-39f64ad4901e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:51.233486 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7dddf82e-6601-4783-bb2a-39f64ad4901e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:51.233909 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7dddf82e-6601-4783-bb2a-39f64ad4901e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:51.359754 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7dddf82e-6601-4783-bb2a-39f64ad4901e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:51.368521 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7dddf82e-6601-4783-bb2a-39f64ad4901e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.147571 Oct 11 07:00:51.369080 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1244/2471] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:51 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:51.713032 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b0a7267b-a785-41e7-aaac-8e70041172fb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:51.713631 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b0a7267b-a785-41e7-aaac-8e70041172fb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:51.719501 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b0a7267b-a785-41e7-aaac-8e70041172fb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:51.719972 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b0a7267b-a785-41e7-aaac-8e70041172fb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:51.720402 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b0a7267b-a785-41e7-aaac-8e70041172fb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:51.721076 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b0a7267b-a785-41e7-aaac-8e70041172fb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:51.721518 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b0a7267b-a785-41e7-aaac-8e70041172fb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:51.721936 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b0a7267b-a785-41e7-aaac-8e70041172fb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:51.852581 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b0a7267b-a785-41e7-aaac-8e70041172fb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:51.861197 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b0a7267b-a785-41e7-aaac-8e70041172fb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:51.862640 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b0a7267b-a785-41e7-aaac-8e70041172fb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:51.863825 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b0a7267b-a785-41e7-aaac-8e70041172fb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.155483 Oct 11 07:00:51.864367 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1228/2472] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:51 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:00:52.090244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b5e8f4ec-1b5c-4669-a4b0-937c7f1cc5ab tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:52.090784 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b5e8f4ec-1b5c-4669-a4b0-937c7f1cc5ab tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:52.096661 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b5e8f4ec-1b5c-4669-a4b0-937c7f1cc5ab tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:52.097146 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b5e8f4ec-1b5c-4669-a4b0-937c7f1cc5ab tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:52.097580 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b5e8f4ec-1b5c-4669-a4b0-937c7f1cc5ab tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:52.098269 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b5e8f4ec-1b5c-4669-a4b0-937c7f1cc5ab tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:52.098724 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b5e8f4ec-1b5c-4669-a4b0-937c7f1cc5ab tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:52.099144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b5e8f4ec-1b5c-4669-a4b0-937c7f1cc5ab tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:52.227605 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b5e8f4ec-1b5c-4669-a4b0-937c7f1cc5ab tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:52.235768 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b5e8f4ec-1b5c-4669-a4b0-937c7f1cc5ab tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.149359 Oct 11 07:00:52.236334 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1245/2473] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:52 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:52.391569 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5306dcdc-7cd4-47a4-9af1-fc11be425b59 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:52.392214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5306dcdc-7cd4-47a4-9af1-fc11be425b59 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:52.398844 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5306dcdc-7cd4-47a4-9af1-fc11be425b59 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:52.399325 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5306dcdc-7cd4-47a4-9af1-fc11be425b59 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:52.399825 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5306dcdc-7cd4-47a4-9af1-fc11be425b59 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:52.400518 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5306dcdc-7cd4-47a4-9af1-fc11be425b59 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:52.400975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5306dcdc-7cd4-47a4-9af1-fc11be425b59 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:52.401431 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5306dcdc-7cd4-47a4-9af1-fc11be425b59 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:52.529652 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5306dcdc-7cd4-47a4-9af1-fc11be425b59 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:52.538437 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5306dcdc-7cd4-47a4-9af1-fc11be425b59 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150443 Oct 11 07:00:52.538997 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1229/2474] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:52 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:52.889354 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6314fe5e-f440-4cf9-8bbf-7836c4161050 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:52.889964 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6314fe5e-f440-4cf9-8bbf-7836c4161050 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:52.895906 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6314fe5e-f440-4cf9-8bbf-7836c4161050 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:52.896413 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6314fe5e-f440-4cf9-8bbf-7836c4161050 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:52.896852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6314fe5e-f440-4cf9-8bbf-7836c4161050 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:52.898139 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6314fe5e-f440-4cf9-8bbf-7836c4161050 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:52.898588 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6314fe5e-f440-4cf9-8bbf-7836c4161050 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:52.899020 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6314fe5e-f440-4cf9-8bbf-7836c4161050 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:53.024123 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6314fe5e-f440-4cf9-8bbf-7836c4161050 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:53.032564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6314fe5e-f440-4cf9-8bbf-7836c4161050 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:53.033990 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6314fe5e-f440-4cf9-8bbf-7836c4161050 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:53.035143 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6314fe5e-f440-4cf9-8bbf-7836c4161050 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.149964 Oct 11 07:00:53.035728 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1246/2475] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:52 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:00:53.259637 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b29dc946-8166-41d2-9a02-78d1d8705acb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:53.260373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b29dc946-8166-41d2-9a02-78d1d8705acb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:53.266678 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b29dc946-8166-41d2-9a02-78d1d8705acb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:53.267152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b29dc946-8166-41d2-9a02-78d1d8705acb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:53.267621 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b29dc946-8166-41d2-9a02-78d1d8705acb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:53.268306 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b29dc946-8166-41d2-9a02-78d1d8705acb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:53.268753 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b29dc946-8166-41d2-9a02-78d1d8705acb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:53.269173 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b29dc946-8166-41d2-9a02-78d1d8705acb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:53.396479 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b29dc946-8166-41d2-9a02-78d1d8705acb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:53.405798 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b29dc946-8166-41d2-9a02-78d1d8705acb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.150604 Oct 11 07:00:53.406491 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1230/2476] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:53 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:53.561196 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9c099972-85d0-4a6e-bd92-313352c2b100 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:53.561732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9c099972-85d0-4a6e-bd92-313352c2b100 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:53.568169 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c099972-85d0-4a6e-bd92-313352c2b100 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:53.568643 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c099972-85d0-4a6e-bd92-313352c2b100 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:53.569581 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c099972-85d0-4a6e-bd92-313352c2b100 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:53.570258 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c099972-85d0-4a6e-bd92-313352c2b100 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:53.570703 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c099972-85d0-4a6e-bd92-313352c2b100 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:53.571122 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c099972-85d0-4a6e-bd92-313352c2b100 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:53.701229 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9c099972-85d0-4a6e-bd92-313352c2b100 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:53.709336 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9c099972-85d0-4a6e-bd92-313352c2b100 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.152020 Oct 11 07:00:53.710576 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1247/2477] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:53 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:54.060368 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6c9af650-d9d5-4060-847e-42ad6789a418 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:54.060974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6c9af650-d9d5-4060-847e-42ad6789a418 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:54.066958 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c9af650-d9d5-4060-847e-42ad6789a418 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:54.067454 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c9af650-d9d5-4060-847e-42ad6789a418 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:54.067892 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c9af650-d9d5-4060-847e-42ad6789a418 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:54.068578 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c9af650-d9d5-4060-847e-42ad6789a418 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:54.069634 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c9af650-d9d5-4060-847e-42ad6789a418 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:54.070058 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c9af650-d9d5-4060-847e-42ad6789a418 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:54.195861 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6c9af650-d9d5-4060-847e-42ad6789a418 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:54.204354 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6c9af650-d9d5-4060-847e-42ad6789a418 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:54.205777 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6c9af650-d9d5-4060-847e-42ad6789a418 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:54.206953 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6c9af650-d9d5-4060-847e-42ad6789a418 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.150495 Oct 11 07:00:54.207521 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1231/2478] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:54 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:00:54.430586 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2b4be2da-73cf-4657-8ce4-99387e742829 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:54.431122 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2b4be2da-73cf-4657-8ce4-99387e742829 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:54.437020 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2b4be2da-73cf-4657-8ce4-99387e742829 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:54.437488 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2b4be2da-73cf-4657-8ce4-99387e742829 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:54.437914 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2b4be2da-73cf-4657-8ce4-99387e742829 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:54.438584 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2b4be2da-73cf-4657-8ce4-99387e742829 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:54.439024 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2b4be2da-73cf-4657-8ce4-99387e742829 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:54.439463 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2b4be2da-73cf-4657-8ce4-99387e742829 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:54.443318 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:00:54.564578 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2b4be2da-73cf-4657-8ce4-99387e742829 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:54.573162 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2b4be2da-73cf-4657-8ce4-99387e742829 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.147047 Oct 11 07:00:54.573720 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1248/2479] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:54 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:54.732656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4c826e28-7662-45a4-9da7-9c121050b76d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:54.733205 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4c826e28-7662-45a4-9da7-9c121050b76d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:54.739619 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4c826e28-7662-45a4-9da7-9c121050b76d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:54.740088 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4c826e28-7662-45a4-9da7-9c121050b76d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:54.740513 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4c826e28-7662-45a4-9da7-9c121050b76d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:54.741187 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4c826e28-7662-45a4-9da7-9c121050b76d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:54.741629 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4c826e28-7662-45a4-9da7-9c121050b76d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:54.742043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4c826e28-7662-45a4-9da7-9c121050b76d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:54.873949 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4c826e28-7662-45a4-9da7-9c121050b76d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:54.882186 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4c826e28-7662-45a4-9da7-9c121050b76d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.153399 Oct 11 07:00:54.882739 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1232/2480] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:54 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:55.232127 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a09080d9-c811-4aab-b228-51f18d7fdea9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:55.232730 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a09080d9-c811-4aab-b228-51f18d7fdea9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:55.238691 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a09080d9-c811-4aab-b228-51f18d7fdea9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:55.239180 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a09080d9-c811-4aab-b228-51f18d7fdea9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:55.239642 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a09080d9-c811-4aab-b228-51f18d7fdea9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:55.240323 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a09080d9-c811-4aab-b228-51f18d7fdea9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:55.240771 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a09080d9-c811-4aab-b228-51f18d7fdea9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:55.241186 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a09080d9-c811-4aab-b228-51f18d7fdea9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:55.367988 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a09080d9-c811-4aab-b228-51f18d7fdea9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:55.376783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a09080d9-c811-4aab-b228-51f18d7fdea9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:55.378198 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a09080d9-c811-4aab-b228-51f18d7fdea9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:55.379336 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a09080d9-c811-4aab-b228-51f18d7fdea9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.151080 Oct 11 07:00:55.379911 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1249/2481] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:55 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:00:55.596287 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-46b364f5-5205-4e99-9ddc-2015746153bc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:55.596894 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-46b364f5-5205-4e99-9ddc-2015746153bc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:55.602879 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-46b364f5-5205-4e99-9ddc-2015746153bc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:55.603354 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-46b364f5-5205-4e99-9ddc-2015746153bc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:55.603827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-46b364f5-5205-4e99-9ddc-2015746153bc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:55.604513 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-46b364f5-5205-4e99-9ddc-2015746153bc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:55.604965 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-46b364f5-5205-4e99-9ddc-2015746153bc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:55.605417 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-46b364f5-5205-4e99-9ddc-2015746153bc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:55.729728 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-46b364f5-5205-4e99-9ddc-2015746153bc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:55.738358 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-46b364f5-5205-4e99-9ddc-2015746153bc tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.145973 Oct 11 07:00:55.738933 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1233/2482] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:55 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:55.905957 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-98775ab8-5608-456e-ae32-b2be6b9cdbd4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:55.906564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-98775ab8-5608-456e-ae32-b2be6b9cdbd4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:55.912901 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-98775ab8-5608-456e-ae32-b2be6b9cdbd4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:55.913382 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-98775ab8-5608-456e-ae32-b2be6b9cdbd4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:55.913814 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-98775ab8-5608-456e-ae32-b2be6b9cdbd4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:55.914490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-98775ab8-5608-456e-ae32-b2be6b9cdbd4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:55.914939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-98775ab8-5608-456e-ae32-b2be6b9cdbd4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:55.915360 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-98775ab8-5608-456e-ae32-b2be6b9cdbd4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:56.044413 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-98775ab8-5608-456e-ae32-b2be6b9cdbd4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:56.052537 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-98775ab8-5608-456e-ae32-b2be6b9cdbd4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150509 Oct 11 07:00:56.053096 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1250/2483] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:55 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:56.405787 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b8adf97d-f1c9-4683-949e-c55b76a8976f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:56.406505 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b8adf97d-f1c9-4683-949e-c55b76a8976f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:56.412728 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8adf97d-f1c9-4683-949e-c55b76a8976f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:56.413282 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8adf97d-f1c9-4683-949e-c55b76a8976f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:56.413791 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8adf97d-f1c9-4683-949e-c55b76a8976f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:56.414559 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8adf97d-f1c9-4683-949e-c55b76a8976f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:56.415189 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8adf97d-f1c9-4683-949e-c55b76a8976f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:56.415662 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8adf97d-f1c9-4683-949e-c55b76a8976f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:56.540396 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b8adf97d-f1c9-4683-949e-c55b76a8976f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:56.549255 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b8adf97d-f1c9-4683-949e-c55b76a8976f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:56.550685 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b8adf97d-f1c9-4683-949e-c55b76a8976f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:56.551870 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b8adf97d-f1c9-4683-949e-c55b76a8976f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.150152 Oct 11 07:00:56.552413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1234/2484] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:56 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:00:56.762257 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-33dfc788-2243-4ed5-896c-f13c87273a22 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:56.762790 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-33dfc788-2243-4ed5-896c-f13c87273a22 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:56.769005 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-33dfc788-2243-4ed5-896c-f13c87273a22 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:56.769482 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-33dfc788-2243-4ed5-896c-f13c87273a22 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:56.769917 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-33dfc788-2243-4ed5-896c-f13c87273a22 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:56.770603 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-33dfc788-2243-4ed5-896c-f13c87273a22 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:56.771054 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-33dfc788-2243-4ed5-896c-f13c87273a22 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:56.771502 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-33dfc788-2243-4ed5-896c-f13c87273a22 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:56.898648 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-33dfc788-2243-4ed5-896c-f13c87273a22 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:56.906884 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-33dfc788-2243-4ed5-896c-f13c87273a22 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.148664 Oct 11 07:00:56.907490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1251/2485] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:56 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:57.075176 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4eb5dcf2-5dd5-4b06-b3be-ca8a8f104a68 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:57.075749 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4eb5dcf2-5dd5-4b06-b3be-ca8a8f104a68 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:57.082066 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4eb5dcf2-5dd5-4b06-b3be-ca8a8f104a68 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:57.082540 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4eb5dcf2-5dd5-4b06-b3be-ca8a8f104a68 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:57.082968 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4eb5dcf2-5dd5-4b06-b3be-ca8a8f104a68 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:57.083675 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4eb5dcf2-5dd5-4b06-b3be-ca8a8f104a68 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:57.084121 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4eb5dcf2-5dd5-4b06-b3be-ca8a8f104a68 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:57.085035 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4eb5dcf2-5dd5-4b06-b3be-ca8a8f104a68 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:57.212725 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4eb5dcf2-5dd5-4b06-b3be-ca8a8f104a68 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:57.220931 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4eb5dcf2-5dd5-4b06-b3be-ca8a8f104a68 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.149589 Oct 11 07:00:57.221517 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1235/2486] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:57 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:57.577791 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-53f0fcc5-a69e-4e36-a75c-4979740dd987 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:57.578397 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-53f0fcc5-a69e-4e36-a75c-4979740dd987 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:57.584688 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-53f0fcc5-a69e-4e36-a75c-4979740dd987 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:57.585164 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-53f0fcc5-a69e-4e36-a75c-4979740dd987 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:57.586258 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-53f0fcc5-a69e-4e36-a75c-4979740dd987 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:57.586941 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-53f0fcc5-a69e-4e36-a75c-4979740dd987 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:57.587385 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-53f0fcc5-a69e-4e36-a75c-4979740dd987 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:57.587832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-53f0fcc5-a69e-4e36-a75c-4979740dd987 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:57.715609 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-53f0fcc5-a69e-4e36-a75c-4979740dd987 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:57.724115 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-53f0fcc5-a69e-4e36-a75c-4979740dd987 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:57.725539 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-53f0fcc5-a69e-4e36-a75c-4979740dd987 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:57.726680 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-53f0fcc5-a69e-4e36-a75c-4979740dd987 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152740 Oct 11 07:00:57.727225 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1252/2487] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:57 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:00:57.931297 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6a50179d-92e2-4321-b4a9-227acc4c49b7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:57.932126 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6a50179d-92e2-4321-b4a9-227acc4c49b7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:57.938150 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6a50179d-92e2-4321-b4a9-227acc4c49b7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:57.938638 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6a50179d-92e2-4321-b4a9-227acc4c49b7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:57.939060 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6a50179d-92e2-4321-b4a9-227acc4c49b7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:57.939779 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6a50179d-92e2-4321-b4a9-227acc4c49b7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:57.940225 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6a50179d-92e2-4321-b4a9-227acc4c49b7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:57.940641 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6a50179d-92e2-4321-b4a9-227acc4c49b7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:58.065700 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6a50179d-92e2-4321-b4a9-227acc4c49b7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:58.074717 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6a50179d-92e2-4321-b4a9-227acc4c49b7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.148006 Oct 11 07:00:58.075289 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1236/2488] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:57 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:58.244793 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9dbb96c3-dfee-40a5-9f09-e22d07fae035 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:58.245426 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9dbb96c3-dfee-40a5-9f09-e22d07fae035 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:58.251203 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9dbb96c3-dfee-40a5-9f09-e22d07fae035 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:58.251709 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9dbb96c3-dfee-40a5-9f09-e22d07fae035 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:58.252134 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9dbb96c3-dfee-40a5-9f09-e22d07fae035 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:58.252992 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9dbb96c3-dfee-40a5-9f09-e22d07fae035 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:58.253430 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9dbb96c3-dfee-40a5-9f09-e22d07fae035 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:58.253842 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9dbb96c3-dfee-40a5-9f09-e22d07fae035 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:58.387808 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9dbb96c3-dfee-40a5-9f09-e22d07fae035 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:58.396359 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9dbb96c3-dfee-40a5-9f09-e22d07fae035 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.155863 Oct 11 07:00:58.396921 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1253/2489] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:58 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:58.752418 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0f3d0a66-ec0e-47f5-bf0f-16d9842f0ae5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:58.752941 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0f3d0a66-ec0e-47f5-bf0f-16d9842f0ae5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:58.759332 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0f3d0a66-ec0e-47f5-bf0f-16d9842f0ae5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:58.759837 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0f3d0a66-ec0e-47f5-bf0f-16d9842f0ae5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:58.760267 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0f3d0a66-ec0e-47f5-bf0f-16d9842f0ae5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:58.760955 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0f3d0a66-ec0e-47f5-bf0f-16d9842f0ae5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:58.761402 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0f3d0a66-ec0e-47f5-bf0f-16d9842f0ae5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:58.761826 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0f3d0a66-ec0e-47f5-bf0f-16d9842f0ae5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:58.893015 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0f3d0a66-ec0e-47f5-bf0f-16d9842f0ae5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:58.902496 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0f3d0a66-ec0e-47f5-bf0f-16d9842f0ae5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:58.904011 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0f3d0a66-ec0e-47f5-bf0f-16d9842f0ae5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:58.905200 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0f3d0a66-ec0e-47f5-bf0f-16d9842f0ae5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.156727 Oct 11 07:00:58.905773 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1237/2490] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:58 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:00:59.097995 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a1ffb6a4-e6a8-485c-899c-3bc6555c4bd8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:59.098555 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a1ffb6a4-e6a8-485c-899c-3bc6555c4bd8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:59.105463 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a1ffb6a4-e6a8-485c-899c-3bc6555c4bd8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:59.105937 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a1ffb6a4-e6a8-485c-899c-3bc6555c4bd8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:59.106367 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a1ffb6a4-e6a8-485c-899c-3bc6555c4bd8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:59.107079 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a1ffb6a4-e6a8-485c-899c-3bc6555c4bd8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:59.107553 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a1ffb6a4-e6a8-485c-899c-3bc6555c4bd8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:59.107977 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a1ffb6a4-e6a8-485c-899c-3bc6555c4bd8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:59.233394 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a1ffb6a4-e6a8-485c-899c-3bc6555c4bd8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:59.241560 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a1ffb6a4-e6a8-485c-899c-3bc6555c4bd8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.147435 Oct 11 07:00:59.242125 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1254/2491] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:59 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:59.420286 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f0045ae8-e22b-4367-9f8d-c1873703ba49 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:59.420897 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f0045ae8-e22b-4367-9f8d-c1873703ba49 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:59.426971 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f0045ae8-e22b-4367-9f8d-c1873703ba49 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:59.427470 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f0045ae8-e22b-4367-9f8d-c1873703ba49 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:59.427906 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f0045ae8-e22b-4367-9f8d-c1873703ba49 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:59.428590 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f0045ae8-e22b-4367-9f8d-c1873703ba49 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:59.429076 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f0045ae8-e22b-4367-9f8d-c1873703ba49 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:59.429497 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f0045ae8-e22b-4367-9f8d-c1873703ba49 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:59.555330 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f0045ae8-e22b-4367-9f8d-c1873703ba49 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:00:59.563693 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f0045ae8-e22b-4367-9f8d-c1873703ba49 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.147153 Oct 11 07:00:59.564346 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1238/2492] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:00:59 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:00:59.930945 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a0d137c1-c358-4c54-9e7c-b00f6d86165e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:00:59.931577 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a0d137c1-c358-4c54-9e7c-b00f6d86165e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:00:59.937600 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a0d137c1-c358-4c54-9e7c-b00f6d86165e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:59.938076 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a0d137c1-c358-4c54-9e7c-b00f6d86165e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:59.938509 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a0d137c1-c358-4c54-9e7c-b00f6d86165e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:00:59.939189 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a0d137c1-c358-4c54-9e7c-b00f6d86165e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:00:59.939658 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a0d137c1-c358-4c54-9e7c-b00f6d86165e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:00:59.940079 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a0d137c1-c358-4c54-9e7c-b00f6d86165e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:00.066109 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a0d137c1-c358-4c54-9e7c-b00f6d86165e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:00.075194 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a0d137c1-c358-4c54-9e7c-b00f6d86165e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:00.076684 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a0d137c1-c358-4c54-9e7c-b00f6d86165e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:00.077837 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a0d137c1-c358-4c54-9e7c-b00f6d86165e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.151237 Oct 11 07:01:00.078399 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1255/2493] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:00:59 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:00.264520 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-413c0d2e-7ec7-4ba0-89ab-081d7a85109d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:00.265058 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-413c0d2e-7ec7-4ba0-89ab-081d7a85109d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:00.271526 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-413c0d2e-7ec7-4ba0-89ab-081d7a85109d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:00.272008 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-413c0d2e-7ec7-4ba0-89ab-081d7a85109d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:00.272444 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-413c0d2e-7ec7-4ba0-89ab-081d7a85109d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:00.273156 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-413c0d2e-7ec7-4ba0-89ab-081d7a85109d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:00.273607 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-413c0d2e-7ec7-4ba0-89ab-081d7a85109d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:00.274030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-413c0d2e-7ec7-4ba0-89ab-081d7a85109d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:00.397532 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-413c0d2e-7ec7-4ba0-89ab-081d7a85109d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:00.405734 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-413c0d2e-7ec7-4ba0-89ab-081d7a85109d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.145333 Oct 11 07:01:00.406297 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1239/2494] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:00 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:00.587641 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-29db0ceb-dfca-41f7-87bd-a64de3f9353e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:00.588219 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-29db0ceb-dfca-41f7-87bd-a64de3f9353e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:00.594624 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-29db0ceb-dfca-41f7-87bd-a64de3f9353e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:00.595102 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-29db0ceb-dfca-41f7-87bd-a64de3f9353e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:00.595574 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-29db0ceb-dfca-41f7-87bd-a64de3f9353e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:00.596263 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-29db0ceb-dfca-41f7-87bd-a64de3f9353e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:00.596723 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-29db0ceb-dfca-41f7-87bd-a64de3f9353e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:00.597140 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-29db0ceb-dfca-41f7-87bd-a64de3f9353e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:00.723900 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-29db0ceb-dfca-41f7-87bd-a64de3f9353e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:00.732595 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-29db0ceb-dfca-41f7-87bd-a64de3f9353e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.148778 Oct 11 07:01:00.733321 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1256/2495] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:00 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:01.102888 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b18b37d1-2cd3-4e65-8231-f4068c4e19b9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:01.103529 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b18b37d1-2cd3-4e65-8231-f4068c4e19b9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:01.109448 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b18b37d1-2cd3-4e65-8231-f4068c4e19b9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:01.109923 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b18b37d1-2cd3-4e65-8231-f4068c4e19b9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:01.110353 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b18b37d1-2cd3-4e65-8231-f4068c4e19b9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:01.111037 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b18b37d1-2cd3-4e65-8231-f4068c4e19b9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:01.111508 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b18b37d1-2cd3-4e65-8231-f4068c4e19b9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:01.111927 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b18b37d1-2cd3-4e65-8231-f4068c4e19b9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:01.241306 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b18b37d1-2cd3-4e65-8231-f4068c4e19b9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:01.249886 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b18b37d1-2cd3-4e65-8231-f4068c4e19b9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:01.251312 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b18b37d1-2cd3-4e65-8231-f4068c4e19b9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:01.252483 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b18b37d1-2cd3-4e65-8231-f4068c4e19b9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.153511 Oct 11 07:01:01.253031 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1240/2496] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:01 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:01:01.430310 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5983ec21-07af-4b67-b304-6727b1a2a819 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:01.430913 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5983ec21-07af-4b67-b304-6727b1a2a819 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:01.436853 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5983ec21-07af-4b67-b304-6727b1a2a819 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:01.437327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5983ec21-07af-4b67-b304-6727b1a2a819 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:01.437749 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5983ec21-07af-4b67-b304-6727b1a2a819 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:01.438421 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5983ec21-07af-4b67-b304-6727b1a2a819 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:01.438866 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5983ec21-07af-4b67-b304-6727b1a2a819 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:01.439274 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5983ec21-07af-4b67-b304-6727b1a2a819 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:01.570390 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5983ec21-07af-4b67-b304-6727b1a2a819 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:01.578612 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5983ec21-07af-4b67-b304-6727b1a2a819 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.152636 Oct 11 07:01:01.579177 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1257/2497] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:01 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:01.754789 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bcb80c7b-3c35-4d0e-9fd2-039f24484835 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:01.755519 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bcb80c7b-3c35-4d0e-9fd2-039f24484835 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:01.762440 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bcb80c7b-3c35-4d0e-9fd2-039f24484835 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:01.762919 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bcb80c7b-3c35-4d0e-9fd2-039f24484835 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:01.763648 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bcb80c7b-3c35-4d0e-9fd2-039f24484835 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:01.764334 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bcb80c7b-3c35-4d0e-9fd2-039f24484835 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:01.764820 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bcb80c7b-3c35-4d0e-9fd2-039f24484835 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:01.765238 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bcb80c7b-3c35-4d0e-9fd2-039f24484835 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:01.890772 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-bcb80c7b-3c35-4d0e-9fd2-039f24484835 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:01.898828 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bcb80c7b-3c35-4d0e-9fd2-039f24484835 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.147897 Oct 11 07:01:01.899397 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1241/2498] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:01 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:02.278627 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-957dfce9-d5d6-442e-ab0d-ece62acdd2ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:02.279285 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-957dfce9-d5d6-442e-ab0d-ece62acdd2ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:02.285676 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-957dfce9-d5d6-442e-ab0d-ece62acdd2ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:02.286147 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-957dfce9-d5d6-442e-ab0d-ece62acdd2ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:02.286575 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-957dfce9-d5d6-442e-ab0d-ece62acdd2ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:02.287252 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-957dfce9-d5d6-442e-ab0d-ece62acdd2ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:02.287740 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-957dfce9-d5d6-442e-ab0d-ece62acdd2ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:02.288779 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-957dfce9-d5d6-442e-ab0d-ece62acdd2ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:02.414326 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-957dfce9-d5d6-442e-ab0d-ece62acdd2ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:02.422835 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-957dfce9-d5d6-442e-ab0d-ece62acdd2ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:02.424298 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-957dfce9-d5d6-442e-ab0d-ece62acdd2ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:02.425453 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-957dfce9-d5d6-442e-ab0d-ece62acdd2ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.150762 Oct 11 07:01:02.426005 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1258/2499] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:02 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:02.601771 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1b880630-48cc-47d4-ad75-3f25d330a93c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:02.602372 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1b880630-48cc-47d4-ad75-3f25d330a93c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:02.608406 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1b880630-48cc-47d4-ad75-3f25d330a93c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:02.608879 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1b880630-48cc-47d4-ad75-3f25d330a93c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:02.609306 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1b880630-48cc-47d4-ad75-3f25d330a93c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:02.609976 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1b880630-48cc-47d4-ad75-3f25d330a93c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:02.610421 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1b880630-48cc-47d4-ad75-3f25d330a93c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:02.610834 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1b880630-48cc-47d4-ad75-3f25d330a93c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:02.739614 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1b880630-48cc-47d4-ad75-3f25d330a93c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:02.747736 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1b880630-48cc-47d4-ad75-3f25d330a93c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.149709 Oct 11 07:01:02.748296 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1242/2500] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:02 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:02.922100 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6a87bef8-803f-4e46-87d3-3b82a395f6ba tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:02.922714 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6a87bef8-803f-4e46-87d3-3b82a395f6ba tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:02.929279 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a87bef8-803f-4e46-87d3-3b82a395f6ba tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:02.929759 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a87bef8-803f-4e46-87d3-3b82a395f6ba tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:02.930198 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a87bef8-803f-4e46-87d3-3b82a395f6ba tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:02.930884 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a87bef8-803f-4e46-87d3-3b82a395f6ba tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:02.931337 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a87bef8-803f-4e46-87d3-3b82a395f6ba tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:02.931786 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6a87bef8-803f-4e46-87d3-3b82a395f6ba tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:03.058911 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6a87bef8-803f-4e46-87d3-3b82a395f6ba tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:03.067013 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6a87bef8-803f-4e46-87d3-3b82a395f6ba tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.148762 Oct 11 07:01:03.067610 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1259/2501] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:02 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:03.450668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-eafc65b2-df93-4898-9424-324af39d4e69 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:03.451321 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-eafc65b2-df93-4898-9424-324af39d4e69 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:03.457738 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eafc65b2-df93-4898-9424-324af39d4e69 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:03.458215 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eafc65b2-df93-4898-9424-324af39d4e69 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:03.458650 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eafc65b2-df93-4898-9424-324af39d4e69 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:03.459337 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eafc65b2-df93-4898-9424-324af39d4e69 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:03.459817 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eafc65b2-df93-4898-9424-324af39d4e69 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:03.460241 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eafc65b2-df93-4898-9424-324af39d4e69 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:03.584587 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-eafc65b2-df93-4898-9424-324af39d4e69 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:03.593243 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-eafc65b2-df93-4898-9424-324af39d4e69 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:03.594696 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-eafc65b2-df93-4898-9424-324af39d4e69 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:03.595886 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-eafc65b2-df93-4898-9424-324af39d4e69 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.149197 Oct 11 07:01:03.596437 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1243/2502] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:03 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:03.772120 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-dc2b6e67-0b66-454a-a1fa-4afb0e10baf9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:03.773193 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-dc2b6e67-0b66-454a-a1fa-4afb0e10baf9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:03.780029 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc2b6e67-0b66-454a-a1fa-4afb0e10baf9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:03.780474 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc2b6e67-0b66-454a-a1fa-4afb0e10baf9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:03.780912 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc2b6e67-0b66-454a-a1fa-4afb0e10baf9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:03.781476 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc2b6e67-0b66-454a-a1fa-4afb0e10baf9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:03.781916 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc2b6e67-0b66-454a-a1fa-4afb0e10baf9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:03.782329 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dc2b6e67-0b66-454a-a1fa-4afb0e10baf9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:03.909412 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-dc2b6e67-0b66-454a-a1fa-4afb0e10baf9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:03.918050 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-dc2b6e67-0b66-454a-a1fa-4afb0e10baf9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.149801 Oct 11 07:01:03.918602 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1260/2503] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:03 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:04.090892 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6852765b-f8fd-45ca-874f-3ccbfd55e311 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:04.091488 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6852765b-f8fd-45ca-874f-3ccbfd55e311 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:04.097397 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6852765b-f8fd-45ca-874f-3ccbfd55e311 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:04.097875 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6852765b-f8fd-45ca-874f-3ccbfd55e311 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:04.098313 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6852765b-f8fd-45ca-874f-3ccbfd55e311 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:04.099032 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6852765b-f8fd-45ca-874f-3ccbfd55e311 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:04.099514 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6852765b-f8fd-45ca-874f-3ccbfd55e311 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:04.099943 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6852765b-f8fd-45ca-874f-3ccbfd55e311 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:04.117308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:01:04.229817 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6852765b-f8fd-45ca-874f-3ccbfd55e311 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:04.237901 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6852765b-f8fd-45ca-874f-3ccbfd55e311 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150925 Oct 11 07:01:04.238451 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1244/2504] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:04 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:04.621649 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cd6bfe97-26ad-46e0-970b-8cb1c987f347 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:04.622250 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cd6bfe97-26ad-46e0-970b-8cb1c987f347 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:04.628301 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cd6bfe97-26ad-46e0-970b-8cb1c987f347 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:04.628767 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cd6bfe97-26ad-46e0-970b-8cb1c987f347 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:04.629190 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cd6bfe97-26ad-46e0-970b-8cb1c987f347 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:04.629861 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cd6bfe97-26ad-46e0-970b-8cb1c987f347 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:04.630298 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cd6bfe97-26ad-46e0-970b-8cb1c987f347 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:04.630712 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cd6bfe97-26ad-46e0-970b-8cb1c987f347 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:04.756135 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cd6bfe97-26ad-46e0-970b-8cb1c987f347 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:04.765454 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cd6bfe97-26ad-46e0-970b-8cb1c987f347 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:04.766878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cd6bfe97-26ad-46e0-970b-8cb1c987f347 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:04.768124 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cd6bfe97-26ad-46e0-970b-8cb1c987f347 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.150340 Oct 11 07:01:04.768730 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1261/2505] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:04 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:04.941445 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2fc36f58-ee54-4e0e-b570-4f43b25b74b3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:04.941978 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2fc36f58-ee54-4e0e-b570-4f43b25b74b3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:04.948359 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2fc36f58-ee54-4e0e-b570-4f43b25b74b3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:04.948824 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2fc36f58-ee54-4e0e-b570-4f43b25b74b3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:04.949246 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2fc36f58-ee54-4e0e-b570-4f43b25b74b3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:04.949921 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2fc36f58-ee54-4e0e-b570-4f43b25b74b3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:04.950363 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2fc36f58-ee54-4e0e-b570-4f43b25b74b3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:04.950775 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2fc36f58-ee54-4e0e-b570-4f43b25b74b3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:05.075222 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2fc36f58-ee54-4e0e-b570-4f43b25b74b3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:05.083247 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2fc36f58-ee54-4e0e-b570-4f43b25b74b3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.145758 Oct 11 07:01:05.083865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1245/2506] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:04 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:05.261268 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-28f6f64c-af22-43e5-a7e5-127a45ec0c00 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:05.261827 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-28f6f64c-af22-43e5-a7e5-127a45ec0c00 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:05.268433 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28f6f64c-af22-43e5-a7e5-127a45ec0c00 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:05.268906 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28f6f64c-af22-43e5-a7e5-127a45ec0c00 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:05.269365 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28f6f64c-af22-43e5-a7e5-127a45ec0c00 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:05.270052 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28f6f64c-af22-43e5-a7e5-127a45ec0c00 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:05.270500 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28f6f64c-af22-43e5-a7e5-127a45ec0c00 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:05.270918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28f6f64c-af22-43e5-a7e5-127a45ec0c00 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:05.397715 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-28f6f64c-af22-43e5-a7e5-127a45ec0c00 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:05.405985 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-28f6f64c-af22-43e5-a7e5-127a45ec0c00 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.149102 Oct 11 07:01:05.406555 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1262/2507] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:05 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:05.793457 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-aec9e040-a60f-420f-be67-efbef8e737fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:05.794160 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-aec9e040-a60f-420f-be67-efbef8e737fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:05.800202 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aec9e040-a60f-420f-be67-efbef8e737fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:05.800690 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aec9e040-a60f-420f-be67-efbef8e737fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:05.801126 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aec9e040-a60f-420f-be67-efbef8e737fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:05.801822 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aec9e040-a60f-420f-be67-efbef8e737fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:05.802272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aec9e040-a60f-420f-be67-efbef8e737fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:05.802696 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aec9e040-a60f-420f-be67-efbef8e737fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:05.945503 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-aec9e040-a60f-420f-be67-efbef8e737fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:05.945733 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-aec9e040-a60f-420f-be67-efbef8e737fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:05.947090 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-aec9e040-a60f-420f-be67-efbef8e737fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:05.948414 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-aec9e040-a60f-420f-be67-efbef8e737fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.158943 Oct 11 07:01:05.948963 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1246/2508] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:05 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:06.106126 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bbe15ba6-1df5-4d52-a416-a7c00e955d0f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:06.106741 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bbe15ba6-1df5-4d52-a416-a7c00e955d0f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:06.112710 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bbe15ba6-1df5-4d52-a416-a7c00e955d0f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:06.113187 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bbe15ba6-1df5-4d52-a416-a7c00e955d0f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:06.113620 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bbe15ba6-1df5-4d52-a416-a7c00e955d0f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:06.114309 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bbe15ba6-1df5-4d52-a416-a7c00e955d0f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:06.114821 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bbe15ba6-1df5-4d52-a416-a7c00e955d0f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:06.115246 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bbe15ba6-1df5-4d52-a416-a7c00e955d0f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:06.333048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bbe15ba6-1df5-4d52-a416-a7c00e955d0f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:06.341400 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bbe15ba6-1df5-4d52-a416-a7c00e955d0f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.239124 Oct 11 07:01:06.341958 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1263/2509] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:06 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:06.429693 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1770a347-4192-47a3-933f-d4530b08105e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:06.430307 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1770a347-4192-47a3-933f-d4530b08105e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:06.436729 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1770a347-4192-47a3-933f-d4530b08105e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:06.437207 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1770a347-4192-47a3-933f-d4530b08105e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:06.437639 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1770a347-4192-47a3-933f-d4530b08105e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:06.438325 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1770a347-4192-47a3-933f-d4530b08105e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:06.438806 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1770a347-4192-47a3-933f-d4530b08105e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:06.439224 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1770a347-4192-47a3-933f-d4530b08105e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:06.568928 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1770a347-4192-47a3-933f-d4530b08105e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:06.577083 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1770a347-4192-47a3-933f-d4530b08105e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.152059 Oct 11 07:01:06.577640 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1247/2510] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:06 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:06.977244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a082c1bd-5569-4790-89ae-74b8507ec49d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:06.977850 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a082c1bd-5569-4790-89ae-74b8507ec49d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:06.983669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a082c1bd-5569-4790-89ae-74b8507ec49d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:06.984269 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a082c1bd-5569-4790-89ae-74b8507ec49d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:06.984714 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a082c1bd-5569-4790-89ae-74b8507ec49d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:06.985410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a082c1bd-5569-4790-89ae-74b8507ec49d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:06.985845 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a082c1bd-5569-4790-89ae-74b8507ec49d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:06.986263 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a082c1bd-5569-4790-89ae-74b8507ec49d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:07.114968 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a082c1bd-5569-4790-89ae-74b8507ec49d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:07.118553 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:01:07.124120 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a082c1bd-5569-4790-89ae-74b8507ec49d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:07.125540 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a082c1bd-5569-4790-89ae-74b8507ec49d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:07.126686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a082c1bd-5569-4790-89ae-74b8507ec49d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.153816 Oct 11 07:01:07.127231 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1264/2511] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:06 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:07.364804 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6f1f00cb-b0d0-4f8b-8202-0a15cacbc737 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:07.365408 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6f1f00cb-b0d0-4f8b-8202-0a15cacbc737 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:07.371311 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6f1f00cb-b0d0-4f8b-8202-0a15cacbc737 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:07.371805 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6f1f00cb-b0d0-4f8b-8202-0a15cacbc737 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:07.372226 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6f1f00cb-b0d0-4f8b-8202-0a15cacbc737 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:07.372901 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6f1f00cb-b0d0-4f8b-8202-0a15cacbc737 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:07.373371 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6f1f00cb-b0d0-4f8b-8202-0a15cacbc737 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:07.373782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6f1f00cb-b0d0-4f8b-8202-0a15cacbc737 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:07.500885 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6f1f00cb-b0d0-4f8b-8202-0a15cacbc737 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:07.509784 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6f1f00cb-b0d0-4f8b-8202-0a15cacbc737 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.148736 Oct 11 07:01:07.510342 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1248/2512] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:07 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:07.599929 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-77691682-cd26-420e-8085-7cfba309f1fa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:07.600539 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-77691682-cd26-420e-8085-7cfba309f1fa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:07.607060 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77691682-cd26-420e-8085-7cfba309f1fa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:07.607565 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77691682-cd26-420e-8085-7cfba309f1fa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:07.607998 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77691682-cd26-420e-8085-7cfba309f1fa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:07.608686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77691682-cd26-420e-8085-7cfba309f1fa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:07.609132 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77691682-cd26-420e-8085-7cfba309f1fa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:07.609555 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77691682-cd26-420e-8085-7cfba309f1fa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:07.735719 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-77691682-cd26-420e-8085-7cfba309f1fa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:07.744296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-77691682-cd26-420e-8085-7cfba309f1fa tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.148507 Oct 11 07:01:07.744857 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1265/2513] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:07 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:08.152491 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ffa5ec5e-b796-4509-8756-3437e47aa601 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:08.153088 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ffa5ec5e-b796-4509-8756-3437e47aa601 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:08.158910 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ffa5ec5e-b796-4509-8756-3437e47aa601 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:08.159438 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ffa5ec5e-b796-4509-8756-3437e47aa601 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:08.159866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ffa5ec5e-b796-4509-8756-3437e47aa601 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:08.160539 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ffa5ec5e-b796-4509-8756-3437e47aa601 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:08.160982 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ffa5ec5e-b796-4509-8756-3437e47aa601 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:08.161398 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ffa5ec5e-b796-4509-8756-3437e47aa601 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:08.290858 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ffa5ec5e-b796-4509-8756-3437e47aa601 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:08.299285 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ffa5ec5e-b796-4509-8756-3437e47aa601 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:08.300752 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ffa5ec5e-b796-4509-8756-3437e47aa601 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:08.301892 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ffa5ec5e-b796-4509-8756-3437e47aa601 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.153296 Oct 11 07:01:08.302432 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1249/2514] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:08 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:08.533384 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ba73b3e7-1959-4a85-8746-881e76ad7a22 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:08.533988 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ba73b3e7-1959-4a85-8746-881e76ad7a22 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:08.535887 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=78 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:01:08.542238 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ba73b3e7-1959-4a85-8746-881e76ad7a22 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:08.542664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ba73b3e7-1959-4a85-8746-881e76ad7a22 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:08.543101 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ba73b3e7-1959-4a85-8746-881e76ad7a22 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:08.543888 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ba73b3e7-1959-4a85-8746-881e76ad7a22 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:08.544344 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ba73b3e7-1959-4a85-8746-881e76ad7a22 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:08.544798 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ba73b3e7-1959-4a85-8746-881e76ad7a22 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:08.670744 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ba73b3e7-1959-4a85-8746-881e76ad7a22 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:08.678843 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ba73b3e7-1959-4a85-8746-881e76ad7a22 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.149384 Oct 11 07:01:08.679434 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1266/2515] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:08 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:08.767897 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8b8a889e-40fb-4a68-be86-ed283a2e908f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:08.768511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8b8a889e-40fb-4a68-be86-ed283a2e908f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:08.775404 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8b8a889e-40fb-4a68-be86-ed283a2e908f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:08.775907 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8b8a889e-40fb-4a68-be86-ed283a2e908f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:08.776341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8b8a889e-40fb-4a68-be86-ed283a2e908f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:08.777031 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8b8a889e-40fb-4a68-be86-ed283a2e908f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:08.777487 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8b8a889e-40fb-4a68-be86-ed283a2e908f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:08.777907 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8b8a889e-40fb-4a68-be86-ed283a2e908f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:08.904559 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8b8a889e-40fb-4a68-be86-ed283a2e908f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:08.912894 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8b8a889e-40fb-4a68-be86-ed283a2e908f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.148771 Oct 11 07:01:08.913512 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1250/2516] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:08 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:09.327350 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-523a75e8-3749-4c2e-8143-22bad93231c9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:09.327975 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-523a75e8-3749-4c2e-8143-22bad93231c9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:09.333944 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-523a75e8-3749-4c2e-8143-22bad93231c9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:09.334419 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-523a75e8-3749-4c2e-8143-22bad93231c9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:09.334875 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-523a75e8-3749-4c2e-8143-22bad93231c9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:09.335595 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-523a75e8-3749-4c2e-8143-22bad93231c9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:09.336045 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-523a75e8-3749-4c2e-8143-22bad93231c9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:09.336471 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-523a75e8-3749-4c2e-8143-22bad93231c9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:09.460441 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-523a75e8-3749-4c2e-8143-22bad93231c9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:09.468866 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-523a75e8-3749-4c2e-8143-22bad93231c9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:09.470295 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-523a75e8-3749-4c2e-8143-22bad93231c9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:09.471448 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-523a75e8-3749-4c2e-8143-22bad93231c9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.147975 Oct 11 07:01:09.472064 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1267/2517] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:09 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:09.702618 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f115f620-2685-49b1-a564-acab3869f731 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:09.703143 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f115f620-2685-49b1-a564-acab3869f731 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:09.709108 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f115f620-2685-49b1-a564-acab3869f731 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:09.709580 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f115f620-2685-49b1-a564-acab3869f731 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:09.710504 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f115f620-2685-49b1-a564-acab3869f731 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:09.711180 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f115f620-2685-49b1-a564-acab3869f731 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:09.711649 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f115f620-2685-49b1-a564-acab3869f731 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:09.712065 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f115f620-2685-49b1-a564-acab3869f731 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:09.836286 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f115f620-2685-49b1-a564-acab3869f731 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:09.844370 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f115f620-2685-49b1-a564-acab3869f731 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.145652 Oct 11 07:01:09.844925 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1251/2518] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:09 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:09.935783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-47879439-a53b-426a-99ee-a2341797c134 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:09.936394 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-47879439-a53b-426a-99ee-a2341797c134 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:09.942973 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-47879439-a53b-426a-99ee-a2341797c134 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:09.943475 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-47879439-a53b-426a-99ee-a2341797c134 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:09.943911 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-47879439-a53b-426a-99ee-a2341797c134 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:09.944598 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-47879439-a53b-426a-99ee-a2341797c134 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:09.945049 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-47879439-a53b-426a-99ee-a2341797c134 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:09.945472 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-47879439-a53b-426a-99ee-a2341797c134 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:10.070048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-47879439-a53b-426a-99ee-a2341797c134 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:10.078081 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-47879439-a53b-426a-99ee-a2341797c134 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.146071 Oct 11 07:01:10.078635 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1268/2519] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:09 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:10.497394 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e73ec527-85a5-444f-93dd-3daaab23cb67 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:10.497995 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e73ec527-85a5-444f-93dd-3daaab23cb67 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:10.503946 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e73ec527-85a5-444f-93dd-3daaab23cb67 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:10.504416 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e73ec527-85a5-444f-93dd-3daaab23cb67 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:10.504844 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e73ec527-85a5-444f-93dd-3daaab23cb67 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:10.505519 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e73ec527-85a5-444f-93dd-3daaab23cb67 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:10.505996 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e73ec527-85a5-444f-93dd-3daaab23cb67 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:10.506407 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e73ec527-85a5-444f-93dd-3daaab23cb67 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:10.635169 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e73ec527-85a5-444f-93dd-3daaab23cb67 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:10.644017 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e73ec527-85a5-444f-93dd-3daaab23cb67 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:10.645447 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e73ec527-85a5-444f-93dd-3daaab23cb67 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:10.646594 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e73ec527-85a5-444f-93dd-3daaab23cb67 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.153184 Oct 11 07:01:10.647152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1252/2520] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:10 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:10.869102 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-dba0a8ec-a15a-46dc-811d-cab7c8689c8d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:10.869722 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-dba0a8ec-a15a-46dc-811d-cab7c8689c8d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:10.875753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dba0a8ec-a15a-46dc-811d-cab7c8689c8d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:10.876225 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dba0a8ec-a15a-46dc-811d-cab7c8689c8d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:10.876646 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dba0a8ec-a15a-46dc-811d-cab7c8689c8d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:10.877324 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dba0a8ec-a15a-46dc-811d-cab7c8689c8d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:10.877763 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dba0a8ec-a15a-46dc-811d-cab7c8689c8d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:10.878181 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dba0a8ec-a15a-46dc-811d-cab7c8689c8d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:11.007562 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-dba0a8ec-a15a-46dc-811d-cab7c8689c8d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:11.015934 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-dba0a8ec-a15a-46dc-811d-cab7c8689c8d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.151339 Oct 11 07:01:11.016484 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1269/2521] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:10 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:11.102383 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5f065726-ac50-47dd-ab64-37a92744f9a8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:11.102987 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5f065726-ac50-47dd-ab64-37a92744f9a8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:11.109591 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f065726-ac50-47dd-ab64-37a92744f9a8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:11.110074 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f065726-ac50-47dd-ab64-37a92744f9a8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:11.110538 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f065726-ac50-47dd-ab64-37a92744f9a8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:11.111234 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f065726-ac50-47dd-ab64-37a92744f9a8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:11.111721 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f065726-ac50-47dd-ab64-37a92744f9a8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:11.112141 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5f065726-ac50-47dd-ab64-37a92744f9a8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:11.240057 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5f065726-ac50-47dd-ab64-37a92744f9a8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:11.248204 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5f065726-ac50-47dd-ab64-37a92744f9a8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150121 Oct 11 07:01:11.248761 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1253/2522] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:11 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:11.671006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-94b8b7f2-df25-4b67-a933-6bcc65865de5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:11.671562 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-94b8b7f2-df25-4b67-a933-6bcc65865de5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:11.677464 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-94b8b7f2-df25-4b67-a933-6bcc65865de5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:11.677934 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-94b8b7f2-df25-4b67-a933-6bcc65865de5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:11.678362 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-94b8b7f2-df25-4b67-a933-6bcc65865de5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:11.679040 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-94b8b7f2-df25-4b67-a933-6bcc65865de5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:11.679510 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-94b8b7f2-df25-4b67-a933-6bcc65865de5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:11.679929 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-94b8b7f2-df25-4b67-a933-6bcc65865de5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:11.803115 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-94b8b7f2-df25-4b67-a933-6bcc65865de5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:11.811697 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-94b8b7f2-df25-4b67-a933-6bcc65865de5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:11.813121 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-94b8b7f2-df25-4b67-a933-6bcc65865de5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:11.814263 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-94b8b7f2-df25-4b67-a933-6bcc65865de5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.147221 Oct 11 07:01:11.814819 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1270/2523] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:11 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:12.039436 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3fa7df7c-d13a-4a77-afb9-5e9a3c08ecde tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:12.039984 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3fa7df7c-d13a-4a77-afb9-5e9a3c08ecde tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:12.045967 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3fa7df7c-d13a-4a77-afb9-5e9a3c08ecde tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:12.046446 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3fa7df7c-d13a-4a77-afb9-5e9a3c08ecde tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:12.046876 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3fa7df7c-d13a-4a77-afb9-5e9a3c08ecde tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:12.047600 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3fa7df7c-d13a-4a77-afb9-5e9a3c08ecde tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:12.048058 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3fa7df7c-d13a-4a77-afb9-5e9a3c08ecde tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:12.048479 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3fa7df7c-d13a-4a77-afb9-5e9a3c08ecde tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:12.181526 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3fa7df7c-d13a-4a77-afb9-5e9a3c08ecde tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:12.189634 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3fa7df7c-d13a-4a77-afb9-5e9a3c08ecde tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.154329 Oct 11 07:01:12.190190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1254/2524] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:12 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:12.270894 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d557b25d-089d-4b55-860c-45b195b2324f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:12.271537 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d557b25d-089d-4b55-860c-45b195b2324f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:12.277885 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d557b25d-089d-4b55-860c-45b195b2324f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:12.278474 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d557b25d-089d-4b55-860c-45b195b2324f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:12.278978 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d557b25d-089d-4b55-860c-45b195b2324f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:12.279702 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d557b25d-089d-4b55-860c-45b195b2324f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:12.280148 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d557b25d-089d-4b55-860c-45b195b2324f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:12.280567 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d557b25d-089d-4b55-860c-45b195b2324f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:12.407994 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d557b25d-089d-4b55-860c-45b195b2324f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:12.416869 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d557b25d-089d-4b55-860c-45b195b2324f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.149646 Oct 11 07:01:12.417436 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1271/2525] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:12 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:12.840045 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b557d100-d832-4f93-884d-d7d943c66103 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:12.840578 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b557d100-d832-4f93-884d-d7d943c66103 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:12.846682 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b557d100-d832-4f93-884d-d7d943c66103 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:12.847158 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b557d100-d832-4f93-884d-d7d943c66103 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:12.847627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b557d100-d832-4f93-884d-d7d943c66103 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:12.848315 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b557d100-d832-4f93-884d-d7d943c66103 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:12.848764 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b557d100-d832-4f93-884d-d7d943c66103 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:12.849186 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b557d100-d832-4f93-884d-d7d943c66103 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:12.977056 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b557d100-d832-4f93-884d-d7d943c66103 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:12.985586 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b557d100-d832-4f93-884d-d7d943c66103 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:12.987160 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b557d100-d832-4f93-884d-d7d943c66103 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:12.988344 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b557d100-d832-4f93-884d-d7d943c66103 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152468 Oct 11 07:01:12.988890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1255/2526] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:12 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:13.213234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-210fc724-7ae2-4d00-a913-c503b281946f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:13.213859 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-210fc724-7ae2-4d00-a913-c503b281946f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:13.219743 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-210fc724-7ae2-4d00-a913-c503b281946f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:13.220215 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-210fc724-7ae2-4d00-a913-c503b281946f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:13.220641 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-210fc724-7ae2-4d00-a913-c503b281946f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:13.221312 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-210fc724-7ae2-4d00-a913-c503b281946f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:13.221754 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-210fc724-7ae2-4d00-a913-c503b281946f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:13.222192 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-210fc724-7ae2-4d00-a913-c503b281946f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:13.346591 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-210fc724-7ae2-4d00-a913-c503b281946f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:13.355337 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-210fc724-7ae2-4d00-a913-c503b281946f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.145861 Oct 11 07:01:13.355898 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1272/2527] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:13 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:13.440362 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c1719575-7e53-42d6-8ffa-39c47e06868e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:13.440977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c1719575-7e53-42d6-8ffa-39c47e06868e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:13.447329 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1719575-7e53-42d6-8ffa-39c47e06868e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:13.447833 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1719575-7e53-42d6-8ffa-39c47e06868e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:13.448265 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1719575-7e53-42d6-8ffa-39c47e06868e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:13.448947 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1719575-7e53-42d6-8ffa-39c47e06868e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:13.449396 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1719575-7e53-42d6-8ffa-39c47e06868e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:13.449815 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1719575-7e53-42d6-8ffa-39c47e06868e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:13.578351 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c1719575-7e53-42d6-8ffa-39c47e06868e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:13.587041 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c1719575-7e53-42d6-8ffa-39c47e06868e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150428 Oct 11 07:01:13.587626 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1256/2528] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:13 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:01:14.014356 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fa76fc0f-6342-4803-bbff-84d47166e814 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:14.014883 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fa76fc0f-6342-4803-bbff-84d47166e814 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:14.020880 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa76fc0f-6342-4803-bbff-84d47166e814 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:14.021352 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa76fc0f-6342-4803-bbff-84d47166e814 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:14.021781 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa76fc0f-6342-4803-bbff-84d47166e814 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:14.022488 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa76fc0f-6342-4803-bbff-84d47166e814 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:14.022932 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa76fc0f-6342-4803-bbff-84d47166e814 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:14.023351 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa76fc0f-6342-4803-bbff-84d47166e814 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:14.149075 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fa76fc0f-6342-4803-bbff-84d47166e814 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:14.157485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fa76fc0f-6342-4803-bbff-84d47166e814 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:14.159036 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fa76fc0f-6342-4803-bbff-84d47166e814 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:14.160222 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fa76fc0f-6342-4803-bbff-84d47166e814 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.150138 Oct 11 07:01:14.160771 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1273/2529] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:14 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:14.379347 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-65ff2a2d-9b78-4220-b3b3-1637d024c589 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:14.380092 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-65ff2a2d-9b78-4220-b3b3-1637d024c589 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:14.386516 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65ff2a2d-9b78-4220-b3b3-1637d024c589 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:14.386990 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65ff2a2d-9b78-4220-b3b3-1637d024c589 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:14.387437 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65ff2a2d-9b78-4220-b3b3-1637d024c589 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:14.388373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65ff2a2d-9b78-4220-b3b3-1637d024c589 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:14.388815 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65ff2a2d-9b78-4220-b3b3-1637d024c589 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:14.389231 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65ff2a2d-9b78-4220-b3b3-1637d024c589 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:14.513452 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-65ff2a2d-9b78-4220-b3b3-1637d024c589 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:14.521529 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-65ff2a2d-9b78-4220-b3b3-1637d024c589 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.146022 Oct 11 07:01:14.522116 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1257/2530] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:14 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:14.609683 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-33bcb699-769d-4ec6-be83-a3cfaf7014e0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:14.610251 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-33bcb699-769d-4ec6-be83-a3cfaf7014e0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:14.617148 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-33bcb699-769d-4ec6-be83-a3cfaf7014e0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:14.617617 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-33bcb699-769d-4ec6-be83-a3cfaf7014e0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:14.618045 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-33bcb699-769d-4ec6-be83-a3cfaf7014e0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:14.618726 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-33bcb699-769d-4ec6-be83-a3cfaf7014e0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:14.619169 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-33bcb699-769d-4ec6-be83-a3cfaf7014e0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:14.619614 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-33bcb699-769d-4ec6-be83-a3cfaf7014e0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:14.743404 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-33bcb699-769d-4ec6-be83-a3cfaf7014e0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:14.751518 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-33bcb699-769d-4ec6-be83-a3cfaf7014e0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.145624 Oct 11 07:01:14.752064 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1274/2531] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:14 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:15.185694 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-898b5030-e879-4ab6-a004-4cd1cd981f58 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:15.186293 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-898b5030-e879-4ab6-a004-4cd1cd981f58 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:15.192211 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-898b5030-e879-4ab6-a004-4cd1cd981f58 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:15.192681 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-898b5030-e879-4ab6-a004-4cd1cd981f58 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:15.193108 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-898b5030-e879-4ab6-a004-4cd1cd981f58 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:15.193782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-898b5030-e879-4ab6-a004-4cd1cd981f58 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:15.194222 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-898b5030-e879-4ab6-a004-4cd1cd981f58 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:15.194635 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-898b5030-e879-4ab6-a004-4cd1cd981f58 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:15.321392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-898b5030-e879-4ab6-a004-4cd1cd981f58 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:15.330074 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-898b5030-e879-4ab6-a004-4cd1cd981f58 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:15.331516 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-898b5030-e879-4ab6-a004-4cd1cd981f58 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:15.332680 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-898b5030-e879-4ab6-a004-4cd1cd981f58 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.150904 Oct 11 07:01:15.333229 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1258/2532] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:15 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:15.544431 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-39a65a2c-40ae-401e-90fc-1a9ae776dc8d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:15.545036 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-39a65a2c-40ae-401e-90fc-1a9ae776dc8d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:15.550921 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-39a65a2c-40ae-401e-90fc-1a9ae776dc8d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:15.551395 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-39a65a2c-40ae-401e-90fc-1a9ae776dc8d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:15.551851 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-39a65a2c-40ae-401e-90fc-1a9ae776dc8d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:15.552531 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-39a65a2c-40ae-401e-90fc-1a9ae776dc8d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:15.552977 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-39a65a2c-40ae-401e-90fc-1a9ae776dc8d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:15.553427 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-39a65a2c-40ae-401e-90fc-1a9ae776dc8d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:15.678838 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-39a65a2c-40ae-401e-90fc-1a9ae776dc8d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:15.687098 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-39a65a2c-40ae-401e-90fc-1a9ae776dc8d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.146475 Oct 11 07:01:15.687678 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1275/2533] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:15 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:15.775397 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-eceee1a4-39dd-4c63-9f71-fabebf7b40be tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:15.775994 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-eceee1a4-39dd-4c63-9f71-fabebf7b40be tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:15.782353 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eceee1a4-39dd-4c63-9f71-fabebf7b40be tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:15.782818 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eceee1a4-39dd-4c63-9f71-fabebf7b40be tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:15.783237 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eceee1a4-39dd-4c63-9f71-fabebf7b40be tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:15.783939 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eceee1a4-39dd-4c63-9f71-fabebf7b40be tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:15.784378 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eceee1a4-39dd-4c63-9f71-fabebf7b40be tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:15.784789 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eceee1a4-39dd-4c63-9f71-fabebf7b40be tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:15.914828 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-eceee1a4-39dd-4c63-9f71-fabebf7b40be tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:15.922998 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-eceee1a4-39dd-4c63-9f71-fabebf7b40be tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.151627 Oct 11 07:01:15.923580 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1259/2534] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:15 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:16.358186 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-84d1b5f4-fa72-4c0f-a6cc-6964d855ee04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:16.358783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-84d1b5f4-fa72-4c0f-a6cc-6964d855ee04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:16.364643 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-84d1b5f4-fa72-4c0f-a6cc-6964d855ee04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:16.365113 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-84d1b5f4-fa72-4c0f-a6cc-6964d855ee04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:16.365545 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-84d1b5f4-fa72-4c0f-a6cc-6964d855ee04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:16.366771 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-84d1b5f4-fa72-4c0f-a6cc-6964d855ee04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:16.367214 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-84d1b5f4-fa72-4c0f-a6cc-6964d855ee04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:16.367658 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-84d1b5f4-fa72-4c0f-a6cc-6964d855ee04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:16.710418 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9ac7a2ee-aac2-4d6b-a7f3-8e7272be8f30 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:16.711056 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9ac7a2ee-aac2-4d6b-a7f3-8e7272be8f30 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:16.716990 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9ac7a2ee-aac2-4d6b-a7f3-8e7272be8f30 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:16.717469 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9ac7a2ee-aac2-4d6b-a7f3-8e7272be8f30 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:16.717919 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9ac7a2ee-aac2-4d6b-a7f3-8e7272be8f30 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:16.718587 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9ac7a2ee-aac2-4d6b-a7f3-8e7272be8f30 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:16.719036 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9ac7a2ee-aac2-4d6b-a7f3-8e7272be8f30 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:16.719477 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9ac7a2ee-aac2-4d6b-a7f3-8e7272be8f30 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:16.745446 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-84d1b5f4-fa72-4c0f-a6cc-6964d855ee04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:16.754339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-84d1b5f4-fa72-4c0f-a6cc-6964d855ee04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:16.755790 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-84d1b5f4-fa72-4c0f-a6cc-6964d855ee04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:16.756975 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-84d1b5f4-fa72-4c0f-a6cc-6964d855ee04 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.402679 Oct 11 07:01:16.757559 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1276/2535] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:16 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:16.845459 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9ac7a2ee-aac2-4d6b-a7f3-8e7272be8f30 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:16.853602 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9ac7a2ee-aac2-4d6b-a7f3-8e7272be8f30 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.147419 Oct 11 07:01:16.854162 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1260/2536] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:16 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:01:16.946343 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ef94e842-65b0-4522-aef9-ebd97cd16b0c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:16.946985 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ef94e842-65b0-4522-aef9-ebd97cd16b0c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:16.952788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef94e842-65b0-4522-aef9-ebd97cd16b0c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:16.953256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef94e842-65b0-4522-aef9-ebd97cd16b0c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:16.953681 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef94e842-65b0-4522-aef9-ebd97cd16b0c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:16.954353 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef94e842-65b0-4522-aef9-ebd97cd16b0c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:16.954817 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef94e842-65b0-4522-aef9-ebd97cd16b0c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:16.955228 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef94e842-65b0-4522-aef9-ebd97cd16b0c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:17.085942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ef94e842-65b0-4522-aef9-ebd97cd16b0c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:17.094115 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ef94e842-65b0-4522-aef9-ebd97cd16b0c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.152045 Oct 11 07:01:17.094670 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1277/2537] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:16 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:17.782186 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-94bf961d-2907-461b-8c0d-d0f2255f8fd0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:17.782791 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-94bf961d-2907-461b-8c0d-d0f2255f8fd0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:17.788765 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-94bf961d-2907-461b-8c0d-d0f2255f8fd0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:17.789238 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-94bf961d-2907-461b-8c0d-d0f2255f8fd0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:17.789671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-94bf961d-2907-461b-8c0d-d0f2255f8fd0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:17.790356 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-94bf961d-2907-461b-8c0d-d0f2255f8fd0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:17.790804 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-94bf961d-2907-461b-8c0d-d0f2255f8fd0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:17.791221 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-94bf961d-2907-461b-8c0d-d0f2255f8fd0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:17.795131 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:01:17.876700 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-59aace27-8085-49a7-936d-9f26d6e68cd6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:17.877401 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-59aace27-8085-49a7-936d-9f26d6e68cd6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:17.884497 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-59aace27-8085-49a7-936d-9f26d6e68cd6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:17.884980 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-59aace27-8085-49a7-936d-9f26d6e68cd6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:17.885413 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-59aace27-8085-49a7-936d-9f26d6e68cd6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:17.886133 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-59aace27-8085-49a7-936d-9f26d6e68cd6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:17.886568 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-59aace27-8085-49a7-936d-9f26d6e68cd6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:17.886992 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-59aace27-8085-49a7-936d-9f26d6e68cd6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:17.920885 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-94bf961d-2907-461b-8c0d-d0f2255f8fd0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:17.930767 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-94bf961d-2907-461b-8c0d-d0f2255f8fd0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:17.932314 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-94bf961d-2907-461b-8c0d-d0f2255f8fd0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:17.933496 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-94bf961d-2907-461b-8c0d-d0f2255f8fd0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.155351 Oct 11 07:01:17.943708 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1261/2538] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:17 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:18.017504 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-59aace27-8085-49a7-936d-9f26d6e68cd6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:18.025736 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-59aace27-8085-49a7-936d-9f26d6e68cd6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.152876 Oct 11 07:01:18.026295 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1278/2539] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:17 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:01:18.117485 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-dcd4cd0e-df4a-44e1-aee7-bfa0d1075c21 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:18.118109 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-dcd4cd0e-df4a-44e1-aee7-bfa0d1075c21 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:18.124184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dcd4cd0e-df4a-44e1-aee7-bfa0d1075c21 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:18.124685 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dcd4cd0e-df4a-44e1-aee7-bfa0d1075c21 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:18.125115 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dcd4cd0e-df4a-44e1-aee7-bfa0d1075c21 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:18.125802 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dcd4cd0e-df4a-44e1-aee7-bfa0d1075c21 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:18.126250 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dcd4cd0e-df4a-44e1-aee7-bfa0d1075c21 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:18.126671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dcd4cd0e-df4a-44e1-aee7-bfa0d1075c21 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:18.251344 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-dcd4cd0e-df4a-44e1-aee7-bfa0d1075c21 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:18.260056 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-dcd4cd0e-df4a-44e1-aee7-bfa0d1075c21 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.147042 Oct 11 07:01:18.260617 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1262/2540] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:18 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:18.959881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d860d9ef-3964-40a1-8a4f-8834ef72596b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:18.960496 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d860d9ef-3964-40a1-8a4f-8834ef72596b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:18.966872 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d860d9ef-3964-40a1-8a4f-8834ef72596b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:18.967350 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d860d9ef-3964-40a1-8a4f-8834ef72596b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:18.967814 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d860d9ef-3964-40a1-8a4f-8834ef72596b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:18.968504 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d860d9ef-3964-40a1-8a4f-8834ef72596b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:18.968952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d860d9ef-3964-40a1-8a4f-8834ef72596b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:18.969372 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d860d9ef-3964-40a1-8a4f-8834ef72596b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:19.049078 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-464d9082-cf5b-4d7c-b136-5855419d5cab tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:19.049679 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-464d9082-cf5b-4d7c-b136-5855419d5cab tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:19.056097 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-464d9082-cf5b-4d7c-b136-5855419d5cab tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:19.056570 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-464d9082-cf5b-4d7c-b136-5855419d5cab tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:19.056995 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-464d9082-cf5b-4d7c-b136-5855419d5cab tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:19.057682 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-464d9082-cf5b-4d7c-b136-5855419d5cab tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:19.058128 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-464d9082-cf5b-4d7c-b136-5855419d5cab tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:19.058543 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-464d9082-cf5b-4d7c-b136-5855419d5cab tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:19.096738 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d860d9ef-3964-40a1-8a4f-8834ef72596b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:19.105436 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d860d9ef-3964-40a1-8a4f-8834ef72596b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:19.106859 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d860d9ef-3964-40a1-8a4f-8834ef72596b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:19.108307 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d860d9ef-3964-40a1-8a4f-8834ef72596b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152876 Oct 11 07:01:19.108859 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1279/2541] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:18 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:19.185433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-464d9082-cf5b-4d7c-b136-5855419d5cab tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:19.193487 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-464d9082-cf5b-4d7c-b136-5855419d5cab tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.148377 Oct 11 07:01:19.194036 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1263/2542] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:19 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:01:19.283228 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4370c334-3b42-4556-b2c1-397d114f3b6e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:19.283789 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4370c334-3b42-4556-b2c1-397d114f3b6e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:19.290155 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4370c334-3b42-4556-b2c1-397d114f3b6e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:19.290624 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4370c334-3b42-4556-b2c1-397d114f3b6e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:19.291050 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4370c334-3b42-4556-b2c1-397d114f3b6e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:19.291875 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4370c334-3b42-4556-b2c1-397d114f3b6e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:19.292305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4370c334-3b42-4556-b2c1-397d114f3b6e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:19.292724 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4370c334-3b42-4556-b2c1-397d114f3b6e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:19.423626 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4370c334-3b42-4556-b2c1-397d114f3b6e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:19.432139 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4370c334-3b42-4556-b2c1-397d114f3b6e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.152762 Oct 11 07:01:19.432703 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1280/2543] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:19 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:20.133477 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a42c8e04-6276-4d4a-bfae-3f36b7378efc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:20.134085 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a42c8e04-6276-4d4a-bfae-3f36b7378efc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:20.140905 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a42c8e04-6276-4d4a-bfae-3f36b7378efc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:20.141383 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a42c8e04-6276-4d4a-bfae-3f36b7378efc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:20.141818 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a42c8e04-6276-4d4a-bfae-3f36b7378efc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:20.142507 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a42c8e04-6276-4d4a-bfae-3f36b7378efc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:20.142955 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a42c8e04-6276-4d4a-bfae-3f36b7378efc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:20.143373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a42c8e04-6276-4d4a-bfae-3f36b7378efc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:20.217168 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f13a5e93-53de-4100-b2a5-acf61a9d8d86 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:20.217977 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f13a5e93-53de-4100-b2a5-acf61a9d8d86 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:20.224819 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f13a5e93-53de-4100-b2a5-acf61a9d8d86 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:20.225869 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f13a5e93-53de-4100-b2a5-acf61a9d8d86 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:20.226297 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f13a5e93-53de-4100-b2a5-acf61a9d8d86 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:20.226987 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f13a5e93-53de-4100-b2a5-acf61a9d8d86 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:20.227437 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f13a5e93-53de-4100-b2a5-acf61a9d8d86 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:20.227864 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f13a5e93-53de-4100-b2a5-acf61a9d8d86 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:20.245582 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:01:20.274981 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a42c8e04-6276-4d4a-bfae-3f36b7378efc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:20.283585 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a42c8e04-6276-4d4a-bfae-3f36b7378efc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:20.285013 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a42c8e04-6276-4d4a-bfae-3f36b7378efc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:20.286170 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a42c8e04-6276-4d4a-bfae-3f36b7378efc tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.156605 Oct 11 07:01:20.286736 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1264/2544] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:20 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:20.353543 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f13a5e93-53de-4100-b2a5-acf61a9d8d86 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:20.361633 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f13a5e93-53de-4100-b2a5-acf61a9d8d86 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.148529 Oct 11 07:01:20.362192 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1281/2545] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:20 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:01:20.454664 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1efbe9e2-7220-45f7-80e7-5e9c7a98142a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:20.455275 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1efbe9e2-7220-45f7-80e7-5e9c7a98142a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:20.461778 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1efbe9e2-7220-45f7-80e7-5e9c7a98142a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:20.462252 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1efbe9e2-7220-45f7-80e7-5e9c7a98142a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:20.462682 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1efbe9e2-7220-45f7-80e7-5e9c7a98142a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:20.463365 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1efbe9e2-7220-45f7-80e7-5e9c7a98142a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:20.463838 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1efbe9e2-7220-45f7-80e7-5e9c7a98142a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:20.464258 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1efbe9e2-7220-45f7-80e7-5e9c7a98142a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:20.591512 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1efbe9e2-7220-45f7-80e7-5e9c7a98142a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:20.599536 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1efbe9e2-7220-45f7-80e7-5e9c7a98142a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.148652 Oct 11 07:01:20.600090 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1265/2546] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:20 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:21.311804 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-aa6beb1e-314e-4d4c-b9ff-026865c61f62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:21.313032 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-aa6beb1e-314e-4d4c-b9ff-026865c61f62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:21.320626 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aa6beb1e-314e-4d4c-b9ff-026865c61f62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:21.321100 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aa6beb1e-314e-4d4c-b9ff-026865c61f62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:21.321525 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aa6beb1e-314e-4d4c-b9ff-026865c61f62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:21.322206 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aa6beb1e-314e-4d4c-b9ff-026865c61f62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:21.322644 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aa6beb1e-314e-4d4c-b9ff-026865c61f62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:21.323058 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aa6beb1e-314e-4d4c-b9ff-026865c61f62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:21.385302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8f663ab1-f449-4ad2-85cc-510715af64ba tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:21.386078 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8f663ab1-f449-4ad2-85cc-510715af64ba tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:21.389075 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=78 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:01:21.394517 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f663ab1-f449-4ad2-85cc-510715af64ba tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:21.394994 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f663ab1-f449-4ad2-85cc-510715af64ba tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:21.395444 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f663ab1-f449-4ad2-85cc-510715af64ba tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:21.396134 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f663ab1-f449-4ad2-85cc-510715af64ba tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:21.396579 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f663ab1-f449-4ad2-85cc-510715af64ba tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:21.397599 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8f663ab1-f449-4ad2-85cc-510715af64ba tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:21.453108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-aa6beb1e-314e-4d4c-b9ff-026865c61f62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:21.462399 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-aa6beb1e-314e-4d4c-b9ff-026865c61f62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:21.463870 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-aa6beb1e-314e-4d4c-b9ff-026865c61f62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:21.465024 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-aa6beb1e-314e-4d4c-b9ff-026865c61f62 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.157311 Oct 11 07:01:21.465673 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1282/2547] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:21 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:01:21.531245 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8f663ab1-f449-4ad2-85cc-510715af64ba tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:21.539562 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8f663ab1-f449-4ad2-85cc-510715af64ba tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.158681 Oct 11 07:01:21.540122 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1266/2548] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:21 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:01:21.621929 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-50c91553-e7b5-44b0-a2d0-56ce794868d5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:21.622572 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-50c91553-e7b5-44b0-a2d0-56ce794868d5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:21.628850 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-50c91553-e7b5-44b0-a2d0-56ce794868d5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:21.629333 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-50c91553-e7b5-44b0-a2d0-56ce794868d5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:21.629758 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-50c91553-e7b5-44b0-a2d0-56ce794868d5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:21.630592 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-50c91553-e7b5-44b0-a2d0-56ce794868d5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:21.631553 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-50c91553-e7b5-44b0-a2d0-56ce794868d5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:21.631970 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-50c91553-e7b5-44b0-a2d0-56ce794868d5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:21.760568 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-50c91553-e7b5-44b0-a2d0-56ce794868d5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:21.769053 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-50c91553-e7b5-44b0-a2d0-56ce794868d5 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150909 Oct 11 07:01:21.769616 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1283/2549] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:21 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:22.490162 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1e890a1a-f701-4f6a-9656-59e7402f64b5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:22.490765 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1e890a1a-f701-4f6a-9656-59e7402f64b5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:22.497111 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1e890a1a-f701-4f6a-9656-59e7402f64b5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:22.497582 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1e890a1a-f701-4f6a-9656-59e7402f64b5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:22.498011 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1e890a1a-f701-4f6a-9656-59e7402f64b5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:22.498688 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1e890a1a-f701-4f6a-9656-59e7402f64b5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:22.499127 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1e890a1a-f701-4f6a-9656-59e7402f64b5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:22.499570 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1e890a1a-f701-4f6a-9656-59e7402f64b5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:22.562153 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-04c74618-b285-4dca-89f8-d1688063e266 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:22.562863 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-04c74618-b285-4dca-89f8-d1688063e266 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:22.569334 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04c74618-b285-4dca-89f8-d1688063e266 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:22.569813 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04c74618-b285-4dca-89f8-d1688063e266 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:22.570241 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04c74618-b285-4dca-89f8-d1688063e266 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:22.570922 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04c74618-b285-4dca-89f8-d1688063e266 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:22.571367 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04c74618-b285-4dca-89f8-d1688063e266 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:22.571813 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04c74618-b285-4dca-89f8-d1688063e266 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:22.627034 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1e890a1a-f701-4f6a-9656-59e7402f64b5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:22.635880 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1e890a1a-f701-4f6a-9656-59e7402f64b5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:22.637312 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1e890a1a-f701-4f6a-9656-59e7402f64b5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:22.638765 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1e890a1a-f701-4f6a-9656-59e7402f64b5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152495 Oct 11 07:01:22.639330 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1267/2550] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:22 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:01:22.702177 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-04c74618-b285-4dca-89f8-d1688063e266 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:22.710776 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-04c74618-b285-4dca-89f8-d1688063e266 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.152573 Oct 11 07:01:22.711324 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1284/2551] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:22 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:01:22.792591 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c2334548-b67d-4aec-9fe3-08877331f7b0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:22.793208 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c2334548-b67d-4aec-9fe3-08877331f7b0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:22.799186 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c2334548-b67d-4aec-9fe3-08877331f7b0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:22.799696 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c2334548-b67d-4aec-9fe3-08877331f7b0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:22.800136 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c2334548-b67d-4aec-9fe3-08877331f7b0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:22.800823 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c2334548-b67d-4aec-9fe3-08877331f7b0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:22.801274 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c2334548-b67d-4aec-9fe3-08877331f7b0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:22.801696 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c2334548-b67d-4aec-9fe3-08877331f7b0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:22.930098 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c2334548-b67d-4aec-9fe3-08877331f7b0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:22.938191 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c2334548-b67d-4aec-9fe3-08877331f7b0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.149458 Oct 11 07:01:22.938744 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1268/2552] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:22 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:23.665451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7e511529-2e1b-43ba-b404-3f763748136d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:23.666045 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7e511529-2e1b-43ba-b404-3f763748136d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:23.672877 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e511529-2e1b-43ba-b404-3f763748136d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:23.673348 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e511529-2e1b-43ba-b404-3f763748136d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:23.673950 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e511529-2e1b-43ba-b404-3f763748136d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:23.674707 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e511529-2e1b-43ba-b404-3f763748136d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:23.675293 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e511529-2e1b-43ba-b404-3f763748136d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:23.675780 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e511529-2e1b-43ba-b404-3f763748136d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:23.735052 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2a1e2619-2d96-4511-bb19-42774d5a908e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:23.735696 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2a1e2619-2d96-4511-bb19-42774d5a908e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:23.742633 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2a1e2619-2d96-4511-bb19-42774d5a908e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:23.743118 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2a1e2619-2d96-4511-bb19-42774d5a908e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:23.743604 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2a1e2619-2d96-4511-bb19-42774d5a908e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:23.744418 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2a1e2619-2d96-4511-bb19-42774d5a908e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:23.744911 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2a1e2619-2d96-4511-bb19-42774d5a908e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:23.745336 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2a1e2619-2d96-4511-bb19-42774d5a908e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:23.812539 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7e511529-2e1b-43ba-b404-3f763748136d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:23.821796 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7e511529-2e1b-43ba-b404-3f763748136d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:23.823209 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7e511529-2e1b-43ba-b404-3f763748136d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:23.824388 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7e511529-2e1b-43ba-b404-3f763748136d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.163257 Oct 11 07:01:23.828966 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1285/2553] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:23 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:23.877067 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2a1e2619-2d96-4511-bb19-42774d5a908e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:23.885310 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2a1e2619-2d96-4511-bb19-42774d5a908e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.155009 Oct 11 07:01:23.886049 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1269/2554] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:23 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:23.961977 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0f8adbc6-8c99-48a6-be21-1fccb14d3c50 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:23.962603 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0f8adbc6-8c99-48a6-be21-1fccb14d3c50 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:23.968517 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0f8adbc6-8c99-48a6-be21-1fccb14d3c50 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:23.968981 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0f8adbc6-8c99-48a6-be21-1fccb14d3c50 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:23.969404 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0f8adbc6-8c99-48a6-be21-1fccb14d3c50 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:23.970075 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0f8adbc6-8c99-48a6-be21-1fccb14d3c50 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:23.970514 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0f8adbc6-8c99-48a6-be21-1fccb14d3c50 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:23.970924 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0f8adbc6-8c99-48a6-be21-1fccb14d3c50 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:24.098167 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0f8adbc6-8c99-48a6-be21-1fccb14d3c50 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:24.106882 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0f8adbc6-8c99-48a6-be21-1fccb14d3c50 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.149229 Oct 11 07:01:24.107463 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1286/2555] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:23 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:24.849646 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-27bbd2c8-35f5-41d5-871a-a91f1f9719b4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:24.850259 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-27bbd2c8-35f5-41d5-871a-a91f1f9719b4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:24.856699 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-27bbd2c8-35f5-41d5-871a-a91f1f9719b4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:24.857177 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-27bbd2c8-35f5-41d5-871a-a91f1f9719b4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:24.857618 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-27bbd2c8-35f5-41d5-871a-a91f1f9719b4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:24.858305 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-27bbd2c8-35f5-41d5-871a-a91f1f9719b4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:24.858761 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-27bbd2c8-35f5-41d5-871a-a91f1f9719b4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:24.859182 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-27bbd2c8-35f5-41d5-871a-a91f1f9719b4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:24.909874 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-659fdbcf-d885-4312-8612-24ea594d32c3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:24.910485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-659fdbcf-d885-4312-8612-24ea594d32c3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:24.917000 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-659fdbcf-d885-4312-8612-24ea594d32c3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:24.917474 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-659fdbcf-d885-4312-8612-24ea594d32c3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:24.917902 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-659fdbcf-d885-4312-8612-24ea594d32c3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:24.918591 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-659fdbcf-d885-4312-8612-24ea594d32c3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:24.919034 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-659fdbcf-d885-4312-8612-24ea594d32c3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:24.919470 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-659fdbcf-d885-4312-8612-24ea594d32c3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:24.991806 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-27bbd2c8-35f5-41d5-871a-a91f1f9719b4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:25.000343 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-27bbd2c8-35f5-41d5-871a-a91f1f9719b4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:25.001786 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-27bbd2c8-35f5-41d5-871a-a91f1f9719b4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:25.002947 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-27bbd2c8-35f5-41d5-871a-a91f1f9719b4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.157164 Oct 11 07:01:25.003552 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1270/2556] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:24 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:25.054679 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-659fdbcf-d885-4312-8612-24ea594d32c3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:25.063191 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-659fdbcf-d885-4312-8612-24ea594d32c3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.157166 Oct 11 07:01:25.063777 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1287/2557] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:24 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:01:25.131880 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d63e488f-03c2-419e-92a5-2e533c5b908b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:25.132820 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d63e488f-03c2-419e-92a5-2e533c5b908b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:25.142345 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d63e488f-03c2-419e-92a5-2e533c5b908b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:25.142826 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d63e488f-03c2-419e-92a5-2e533c5b908b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:25.144224 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d63e488f-03c2-419e-92a5-2e533c5b908b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:25.144915 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d63e488f-03c2-419e-92a5-2e533c5b908b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:25.145950 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d63e488f-03c2-419e-92a5-2e533c5b908b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:25.146569 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d63e488f-03c2-419e-92a5-2e533c5b908b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:25.278705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d63e488f-03c2-419e-92a5-2e533c5b908b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:25.286938 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d63e488f-03c2-419e-92a5-2e533c5b908b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.161210 Oct 11 07:01:25.288150 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1271/2558] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:25 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:26.029153 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8069c823-63c2-4b51-8aa3-65524314874f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:26.029904 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8069c823-63c2-4b51-8aa3-65524314874f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:26.036340 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8069c823-63c2-4b51-8aa3-65524314874f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:26.036894 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8069c823-63c2-4b51-8aa3-65524314874f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:26.037414 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8069c823-63c2-4b51-8aa3-65524314874f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:26.038101 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8069c823-63c2-4b51-8aa3-65524314874f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:26.038550 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8069c823-63c2-4b51-8aa3-65524314874f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:26.038972 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8069c823-63c2-4b51-8aa3-65524314874f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:26.088475 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5fa0aa60-face-4955-ac0c-ddf5e7fcfa0e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:26.089091 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5fa0aa60-face-4955-ac0c-ddf5e7fcfa0e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:26.095471 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5fa0aa60-face-4955-ac0c-ddf5e7fcfa0e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:26.095949 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5fa0aa60-face-4955-ac0c-ddf5e7fcfa0e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:26.096376 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5fa0aa60-face-4955-ac0c-ddf5e7fcfa0e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:26.097058 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5fa0aa60-face-4955-ac0c-ddf5e7fcfa0e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:26.097555 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5fa0aa60-face-4955-ac0c-ddf5e7fcfa0e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:26.097915 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5fa0aa60-face-4955-ac0c-ddf5e7fcfa0e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:26.170142 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8069c823-63c2-4b51-8aa3-65524314874f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:26.179662 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8069c823-63c2-4b51-8aa3-65524314874f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:26.181124 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8069c823-63c2-4b51-8aa3-65524314874f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:26.182281 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8069c823-63c2-4b51-8aa3-65524314874f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.156964 Oct 11 07:01:26.182844 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1288/2559] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:26 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:26.228202 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5fa0aa60-face-4955-ac0c-ddf5e7fcfa0e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:26.236353 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5fa0aa60-face-4955-ac0c-ddf5e7fcfa0e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.152630 Oct 11 07:01:26.236911 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1272/2560] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:26 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:01:26.310227 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-65a3e578-b809-4345-920a-117a8f005edf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:26.310841 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-65a3e578-b809-4345-920a-117a8f005edf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:26.317204 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-65a3e578-b809-4345-920a-117a8f005edf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:26.317758 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-65a3e578-b809-4345-920a-117a8f005edf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:26.318260 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-65a3e578-b809-4345-920a-117a8f005edf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:26.319070 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-65a3e578-b809-4345-920a-117a8f005edf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:26.319626 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-65a3e578-b809-4345-920a-117a8f005edf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:26.320112 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-65a3e578-b809-4345-920a-117a8f005edf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:26.448458 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-65a3e578-b809-4345-920a-117a8f005edf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:26.457174 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-65a3e578-b809-4345-920a-117a8f005edf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150711 Oct 11 07:01:26.457785 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1289/2561] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:26 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:27.207694 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6a372cb2-f82d-47b3-acb6-baa569a677bb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:27.208238 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6a372cb2-f82d-47b3-acb6-baa569a677bb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:27.214607 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6a372cb2-f82d-47b3-acb6-baa569a677bb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:27.215081 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6a372cb2-f82d-47b3-acb6-baa569a677bb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:27.215541 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6a372cb2-f82d-47b3-acb6-baa569a677bb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:27.216228 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6a372cb2-f82d-47b3-acb6-baa569a677bb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:27.216678 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6a372cb2-f82d-47b3-acb6-baa569a677bb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:27.217094 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6a372cb2-f82d-47b3-acb6-baa569a677bb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:27.259097 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b57bb3fe-aa16-4b0a-9561-7a1cf18b125e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:27.259727 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b57bb3fe-aa16-4b0a-9561-7a1cf18b125e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:27.266351 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b57bb3fe-aa16-4b0a-9561-7a1cf18b125e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:27.266819 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b57bb3fe-aa16-4b0a-9561-7a1cf18b125e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:27.267244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b57bb3fe-aa16-4b0a-9561-7a1cf18b125e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:27.267963 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b57bb3fe-aa16-4b0a-9561-7a1cf18b125e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:27.268402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b57bb3fe-aa16-4b0a-9561-7a1cf18b125e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:27.268809 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b57bb3fe-aa16-4b0a-9561-7a1cf18b125e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:27.351154 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6a372cb2-f82d-47b3-acb6-baa569a677bb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:27.359868 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6a372cb2-f82d-47b3-acb6-baa569a677bb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:27.361305 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6a372cb2-f82d-47b3-acb6-baa569a677bb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:27.362466 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6a372cb2-f82d-47b3-acb6-baa569a677bb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.158817 Oct 11 07:01:27.363012 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1273/2562] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:27 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:27.398977 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b57bb3fe-aa16-4b0a-9561-7a1cf18b125e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:27.407129 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b57bb3fe-aa16-4b0a-9561-7a1cf18b125e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.152405 Oct 11 07:01:27.407723 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1290/2563] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:27 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:01:27.481324 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cf28d4a7-dd49-46b2-bdbb-d4014d7024cf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:27.481873 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cf28d4a7-dd49-46b2-bdbb-d4014d7024cf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:27.487771 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf28d4a7-dd49-46b2-bdbb-d4014d7024cf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:27.488250 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf28d4a7-dd49-46b2-bdbb-d4014d7024cf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:27.488685 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf28d4a7-dd49-46b2-bdbb-d4014d7024cf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:27.489371 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf28d4a7-dd49-46b2-bdbb-d4014d7024cf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:27.489827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf28d4a7-dd49-46b2-bdbb-d4014d7024cf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:27.490929 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf28d4a7-dd49-46b2-bdbb-d4014d7024cf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:27.614097 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cf28d4a7-dd49-46b2-bdbb-d4014d7024cf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:27.622903 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cf28d4a7-dd49-46b2-bdbb-d4014d7024cf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.145451 Oct 11 07:01:27.623481 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1274/2564] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:27 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:28.389512 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-180224cf-5c94-433e-81dd-5aa0e5ed1501 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:28.390242 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-180224cf-5c94-433e-81dd-5aa0e5ed1501 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:28.397020 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-180224cf-5c94-433e-81dd-5aa0e5ed1501 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:28.397493 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-180224cf-5c94-433e-81dd-5aa0e5ed1501 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:28.397972 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-180224cf-5c94-433e-81dd-5aa0e5ed1501 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:28.398659 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-180224cf-5c94-433e-81dd-5aa0e5ed1501 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:28.399105 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-180224cf-5c94-433e-81dd-5aa0e5ed1501 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:28.399551 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-180224cf-5c94-433e-81dd-5aa0e5ed1501 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:28.430631 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a15317c8-dd6d-4a78-9208-88e2642f2810 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:28.431237 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a15317c8-dd6d-4a78-9208-88e2642f2810 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:28.437681 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a15317c8-dd6d-4a78-9208-88e2642f2810 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:28.438157 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a15317c8-dd6d-4a78-9208-88e2642f2810 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:28.438586 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a15317c8-dd6d-4a78-9208-88e2642f2810 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:28.439279 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a15317c8-dd6d-4a78-9208-88e2642f2810 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:28.439760 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a15317c8-dd6d-4a78-9208-88e2642f2810 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:28.440181 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a15317c8-dd6d-4a78-9208-88e2642f2810 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:28.527925 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-180224cf-5c94-433e-81dd-5aa0e5ed1501 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:28.536685 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-180224cf-5c94-433e-81dd-5aa0e5ed1501 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:28.538726 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-180224cf-5c94-433e-81dd-5aa0e5ed1501 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:28.539940 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-180224cf-5c94-433e-81dd-5aa0e5ed1501 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.154947 Oct 11 07:01:28.540489 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1291/2565] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:28 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:28.573686 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a15317c8-dd6d-4a78-9208-88e2642f2810 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:28.581824 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a15317c8-dd6d-4a78-9208-88e2642f2810 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.155625 Oct 11 07:01:28.582378 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1275/2566] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:28 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:01:28.645792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6e078cb8-d31c-4953-ba0e-60f048a98ca7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:28.646840 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6e078cb8-d31c-4953-ba0e-60f048a98ca7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:28.652665 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6e078cb8-d31c-4953-ba0e-60f048a98ca7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:28.653138 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6e078cb8-d31c-4953-ba0e-60f048a98ca7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:28.653563 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6e078cb8-d31c-4953-ba0e-60f048a98ca7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:28.654242 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6e078cb8-d31c-4953-ba0e-60f048a98ca7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:28.654682 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6e078cb8-d31c-4953-ba0e-60f048a98ca7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:28.655099 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6e078cb8-d31c-4953-ba0e-60f048a98ca7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:28.788794 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6e078cb8-d31c-4953-ba0e-60f048a98ca7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:28.797044 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6e078cb8-d31c-4953-ba0e-60f048a98ca7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.155060 Oct 11 07:01:28.797598 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1292/2567] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:28 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:29.565251 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-514e9504-f30d-4ba1-a325-415fbac9bfdf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:29.565859 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-514e9504-f30d-4ba1-a325-415fbac9bfdf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:29.572264 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-514e9504-f30d-4ba1-a325-415fbac9bfdf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:29.572742 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-514e9504-f30d-4ba1-a325-415fbac9bfdf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:29.573174 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-514e9504-f30d-4ba1-a325-415fbac9bfdf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:29.573878 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-514e9504-f30d-4ba1-a325-415fbac9bfdf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:29.574307 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-514e9504-f30d-4ba1-a325-415fbac9bfdf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:29.574726 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-514e9504-f30d-4ba1-a325-415fbac9bfdf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:29.605935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-239db3c6-7ba8-4d82-be20-6ec486d55d6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:29.606538 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-239db3c6-7ba8-4d82-be20-6ec486d55d6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:29.612936 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-239db3c6-7ba8-4d82-be20-6ec486d55d6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:29.613405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-239db3c6-7ba8-4d82-be20-6ec486d55d6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:29.613830 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-239db3c6-7ba8-4d82-be20-6ec486d55d6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:29.614510 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-239db3c6-7ba8-4d82-be20-6ec486d55d6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:29.615139 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-239db3c6-7ba8-4d82-be20-6ec486d55d6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:29.615581 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-239db3c6-7ba8-4d82-be20-6ec486d55d6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:29.709711 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-514e9504-f30d-4ba1-a325-415fbac9bfdf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:29.719425 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-514e9504-f30d-4ba1-a325-415fbac9bfdf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:29.720953 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-514e9504-f30d-4ba1-a325-415fbac9bfdf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:29.722187 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-514e9504-f30d-4ba1-a325-415fbac9bfdf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.160991 Oct 11 07:01:29.722798 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1276/2568] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:29 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:29.744748 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-239db3c6-7ba8-4d82-be20-6ec486d55d6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:29.753087 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-239db3c6-7ba8-4d82-be20-6ec486d55d6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.150916 Oct 11 07:01:29.753650 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1293/2569] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:29 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:01:29.819787 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-20671236-7b50-4f15-b9c6-276cbc2850a0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:29.820398 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-20671236-7b50-4f15-b9c6-276cbc2850a0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:29.826255 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20671236-7b50-4f15-b9c6-276cbc2850a0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:29.826734 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20671236-7b50-4f15-b9c6-276cbc2850a0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:29.827169 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20671236-7b50-4f15-b9c6-276cbc2850a0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:29.827885 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20671236-7b50-4f15-b9c6-276cbc2850a0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:29.828334 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20671236-7b50-4f15-b9c6-276cbc2850a0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:29.828754 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20671236-7b50-4f15-b9c6-276cbc2850a0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:29.954234 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-20671236-7b50-4f15-b9c6-276cbc2850a0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:29.957600 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:01:29.963959 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-20671236-7b50-4f15-b9c6-276cbc2850a0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.148037 Oct 11 07:01:29.964517 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1277/2570] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:29 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:30.749828 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1fb2815f-71ec-47bf-b11f-e66e0932b541 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:30.750426 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1fb2815f-71ec-47bf-b11f-e66e0932b541 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:30.756803 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1fb2815f-71ec-47bf-b11f-e66e0932b541 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:30.757267 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1fb2815f-71ec-47bf-b11f-e66e0932b541 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:30.757686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1fb2815f-71ec-47bf-b11f-e66e0932b541 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:30.758390 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1fb2815f-71ec-47bf-b11f-e66e0932b541 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:30.758826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1fb2815f-71ec-47bf-b11f-e66e0932b541 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:30.759236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1fb2815f-71ec-47bf-b11f-e66e0932b541 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:30.776740 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d5cd4c09-dcbe-4d4f-a9dd-f51d41efd9f1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:30.777353 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d5cd4c09-dcbe-4d4f-a9dd-f51d41efd9f1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:30.784191 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d5cd4c09-dcbe-4d4f-a9dd-f51d41efd9f1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:30.784664 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d5cd4c09-dcbe-4d4f-a9dd-f51d41efd9f1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:30.785092 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d5cd4c09-dcbe-4d4f-a9dd-f51d41efd9f1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:30.785777 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d5cd4c09-dcbe-4d4f-a9dd-f51d41efd9f1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:30.786225 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d5cd4c09-dcbe-4d4f-a9dd-f51d41efd9f1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:30.786642 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d5cd4c09-dcbe-4d4f-a9dd-f51d41efd9f1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:30.886267 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1fb2815f-71ec-47bf-b11f-e66e0932b541 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:30.895132 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1fb2815f-71ec-47bf-b11f-e66e0932b541 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:30.896585 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1fb2815f-71ec-47bf-b11f-e66e0932b541 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:30.898269 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1fb2815f-71ec-47bf-b11f-e66e0932b541 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.151838 Oct 11 07:01:30.898825 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1294/2571] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:30 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:30.918334 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d5cd4c09-dcbe-4d4f-a9dd-f51d41efd9f1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:30.926487 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d5cd4c09-dcbe-4d4f-a9dd-f51d41efd9f1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.154106 Oct 11 07:01:30.927034 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1278/2572] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:30 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:01:30.986759 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-34b7c274-c229-41f3-9dad-b6e7eb6738ee tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:30.987368 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-34b7c274-c229-41f3-9dad-b6e7eb6738ee tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:30.993221 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-34b7c274-c229-41f3-9dad-b6e7eb6738ee tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:30.993688 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-34b7c274-c229-41f3-9dad-b6e7eb6738ee tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:30.994112 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-34b7c274-c229-41f3-9dad-b6e7eb6738ee tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:30.994785 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-34b7c274-c229-41f3-9dad-b6e7eb6738ee tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:30.995223 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-34b7c274-c229-41f3-9dad-b6e7eb6738ee tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:30.995663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-34b7c274-c229-41f3-9dad-b6e7eb6738ee tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:31.125533 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-34b7c274-c229-41f3-9dad-b6e7eb6738ee tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:31.134221 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-34b7c274-c229-41f3-9dad-b6e7eb6738ee tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.151214 Oct 11 07:01:31.134788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1295/2573] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:30 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:31.925510 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-fc16dec4-bd49-4a13-a2f5-e047e3e93447 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:31.926129 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-fc16dec4-bd49-4a13-a2f5-e047e3e93447 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:31.934175 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc16dec4-bd49-4a13-a2f5-e047e3e93447 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:31.934852 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc16dec4-bd49-4a13-a2f5-e047e3e93447 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:31.935292 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc16dec4-bd49-4a13-a2f5-e047e3e93447 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:31.936004 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc16dec4-bd49-4a13-a2f5-e047e3e93447 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:31.936453 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc16dec4-bd49-4a13-a2f5-e047e3e93447 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:31.937139 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc16dec4-bd49-4a13-a2f5-e047e3e93447 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:31.950353 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-afea2119-3484-4dad-b9d7-1694f1334a1e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:31.951051 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-afea2119-3484-4dad-b9d7-1694f1334a1e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:31.957594 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-afea2119-3484-4dad-b9d7-1694f1334a1e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:31.958069 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-afea2119-3484-4dad-b9d7-1694f1334a1e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:31.958499 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-afea2119-3484-4dad-b9d7-1694f1334a1e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:31.959183 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-afea2119-3484-4dad-b9d7-1694f1334a1e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:31.959650 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-afea2119-3484-4dad-b9d7-1694f1334a1e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:31.960595 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-afea2119-3484-4dad-b9d7-1694f1334a1e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:32.066451 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-fc16dec4-bd49-4a13-a2f5-e047e3e93447 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:32.074996 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-fc16dec4-bd49-4a13-a2f5-e047e3e93447 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:32.076459 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-fc16dec4-bd49-4a13-a2f5-e047e3e93447 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:32.077633 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-fc16dec4-bd49-4a13-a2f5-e047e3e93447 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.157042 Oct 11 07:01:32.078192 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1279/2574] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:31 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:32.093256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-afea2119-3484-4dad-b9d7-1694f1334a1e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:32.102314 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-afea2119-3484-4dad-b9d7-1694f1334a1e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.156219 Oct 11 07:01:32.102862 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1296/2575] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:31 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:01:32.158027 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1e852b75-be97-4702-9266-74b4ca63c39d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:32.158641 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1e852b75-be97-4702-9266-74b4ca63c39d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:32.165139 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1e852b75-be97-4702-9266-74b4ca63c39d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:32.165610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1e852b75-be97-4702-9266-74b4ca63c39d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:32.166039 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1e852b75-be97-4702-9266-74b4ca63c39d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:32.166721 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1e852b75-be97-4702-9266-74b4ca63c39d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:32.167170 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1e852b75-be97-4702-9266-74b4ca63c39d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:32.167626 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1e852b75-be97-4702-9266-74b4ca63c39d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:32.297348 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1e852b75-be97-4702-9266-74b4ca63c39d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:32.305463 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1e852b75-be97-4702-9266-74b4ca63c39d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.151320 Oct 11 07:01:32.306011 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1280/2576] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:32 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:33.106735 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-111aeffb-fb83-4771-9bfc-2404c0784dcf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:33.107334 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-111aeffb-fb83-4771-9bfc-2404c0784dcf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:33.113841 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-111aeffb-fb83-4771-9bfc-2404c0784dcf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:33.114316 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-111aeffb-fb83-4771-9bfc-2404c0784dcf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:33.114743 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-111aeffb-fb83-4771-9bfc-2404c0784dcf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:33.115745 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-111aeffb-fb83-4771-9bfc-2404c0784dcf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:33.116260 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-111aeffb-fb83-4771-9bfc-2404c0784dcf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:33.117191 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-111aeffb-fb83-4771-9bfc-2404c0784dcf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:33.126352 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cf642ca7-0775-46f6-96f1-5edcf1f221c1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:33.126955 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cf642ca7-0775-46f6-96f1-5edcf1f221c1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:33.133329 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf642ca7-0775-46f6-96f1-5edcf1f221c1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:33.133798 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf642ca7-0775-46f6-96f1-5edcf1f221c1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:33.134233 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf642ca7-0775-46f6-96f1-5edcf1f221c1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:33.134915 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf642ca7-0775-46f6-96f1-5edcf1f221c1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:33.135357 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf642ca7-0775-46f6-96f1-5edcf1f221c1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:33.135804 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cf642ca7-0775-46f6-96f1-5edcf1f221c1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:33.251130 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-111aeffb-fb83-4771-9bfc-2404c0784dcf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:33.260940 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-111aeffb-fb83-4771-9bfc-2404c0784dcf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:33.262504 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-111aeffb-fb83-4771-9bfc-2404c0784dcf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:33.263978 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-111aeffb-fb83-4771-9bfc-2404c0784dcf tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.161162 Oct 11 07:01:33.269716 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cf642ca7-0775-46f6-96f1-5edcf1f221c1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:33.270226 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1297/2577] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:33 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:01:33.275929 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cf642ca7-0775-46f6-96f1-5edcf1f221c1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.153410 Oct 11 07:01:33.285922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1281/2578] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:33 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:01:33.328746 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-11f371f9-1522-4450-89c4-72b6d833afa7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:33.329350 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-11f371f9-1522-4450-89c4-72b6d833afa7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:33.335713 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-11f371f9-1522-4450-89c4-72b6d833afa7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:33.336185 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-11f371f9-1522-4450-89c4-72b6d833afa7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:33.336615 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-11f371f9-1522-4450-89c4-72b6d833afa7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:33.337286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-11f371f9-1522-4450-89c4-72b6d833afa7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:33.337727 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-11f371f9-1522-4450-89c4-72b6d833afa7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:33.338144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-11f371f9-1522-4450-89c4-72b6d833afa7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:33.342001 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:01:33.469633 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-11f371f9-1522-4450-89c4-72b6d833afa7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:33.478262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-11f371f9-1522-4450-89c4-72b6d833afa7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.153259 Oct 11 07:01:33.478815 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1298/2579] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:33 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:34.289806 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ad5f0b24-41eb-4288-a189-1bf34480d548 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:34.290417 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ad5f0b24-41eb-4288-a189-1bf34480d548 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:34.296948 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ad5f0b24-41eb-4288-a189-1bf34480d548 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:34.297433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ad5f0b24-41eb-4288-a189-1bf34480d548 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:34.298061 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ad5f0b24-41eb-4288-a189-1bf34480d548 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:34.299250 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2ed65be2-d1c6-4fae-aa63-8950d30dd1ca tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:34.299716 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ad5f0b24-41eb-4288-a189-1bf34480d548 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:34.299927 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ad5f0b24-41eb-4288-a189-1bf34480d548 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:34.300019 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2ed65be2-d1c6-4fae-aa63-8950d30dd1ca tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:34.300276 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ad5f0b24-41eb-4288-a189-1bf34480d548 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:34.307168 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ed65be2-d1c6-4fae-aa63-8950d30dd1ca tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:34.307670 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ed65be2-d1c6-4fae-aa63-8950d30dd1ca tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:34.308099 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ed65be2-d1c6-4fae-aa63-8950d30dd1ca tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:34.308792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ed65be2-d1c6-4fae-aa63-8950d30dd1ca tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:34.309234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ed65be2-d1c6-4fae-aa63-8950d30dd1ca tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:34.309680 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ed65be2-d1c6-4fae-aa63-8950d30dd1ca tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:34.432922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ad5f0b24-41eb-4288-a189-1bf34480d548 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:34.440821 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2ed65be2-d1c6-4fae-aa63-8950d30dd1ca tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:34.442043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ad5f0b24-41eb-4288-a189-1bf34480d548 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:34.443501 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ad5f0b24-41eb-4288-a189-1bf34480d548 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:34.445312 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ad5f0b24-41eb-4288-a189-1bf34480d548 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.158863 Oct 11 07:01:34.445795 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1282/2580] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:34 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:01:34.452200 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2ed65be2-d1c6-4fae-aa63-8950d30dd1ca tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.156597 Oct 11 07:01:34.452891 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1299/2581] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:34 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:01:34.501086 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-64c4315f-3dcd-4b07-9e56-f75ffac6b41a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:34.501698 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-64c4315f-3dcd-4b07-9e56-f75ffac6b41a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:34.507599 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-64c4315f-3dcd-4b07-9e56-f75ffac6b41a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:34.508080 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-64c4315f-3dcd-4b07-9e56-f75ffac6b41a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:34.508511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-64c4315f-3dcd-4b07-9e56-f75ffac6b41a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:34.509196 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-64c4315f-3dcd-4b07-9e56-f75ffac6b41a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:34.509643 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-64c4315f-3dcd-4b07-9e56-f75ffac6b41a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:34.510065 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-64c4315f-3dcd-4b07-9e56-f75ffac6b41a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:34.637345 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-64c4315f-3dcd-4b07-9e56-f75ffac6b41a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:34.645777 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-64c4315f-3dcd-4b07-9e56-f75ffac6b41a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.148482 Oct 11 07:01:34.646360 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1283/2582] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:34 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:35.470264 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2a5a36f8-5f74-4838-8c4a-30ebecbadc92 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:35.470870 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2a5a36f8-5f74-4838-8c4a-30ebecbadc92 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:35.475090 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c84a51c7-1a06-43a3-a1b1-7c1f4e32af5e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:35.475841 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c84a51c7-1a06-43a3-a1b1-7c1f4e32af5e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:35.477374 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2a5a36f8-5f74-4838-8c4a-30ebecbadc92 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:35.477889 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2a5a36f8-5f74-4838-8c4a-30ebecbadc92 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:35.478323 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2a5a36f8-5f74-4838-8c4a-30ebecbadc92 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:35.479024 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2a5a36f8-5f74-4838-8c4a-30ebecbadc92 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:35.479511 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2a5a36f8-5f74-4838-8c4a-30ebecbadc92 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:35.479935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2a5a36f8-5f74-4838-8c4a-30ebecbadc92 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:35.482287 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c84a51c7-1a06-43a3-a1b1-7c1f4e32af5e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:35.482758 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c84a51c7-1a06-43a3-a1b1-7c1f4e32af5e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:35.483189 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c84a51c7-1a06-43a3-a1b1-7c1f4e32af5e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:35.483900 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c84a51c7-1a06-43a3-a1b1-7c1f4e32af5e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:35.484351 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c84a51c7-1a06-43a3-a1b1-7c1f4e32af5e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:35.484770 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c84a51c7-1a06-43a3-a1b1-7c1f4e32af5e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:35.612188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2a5a36f8-5f74-4838-8c4a-30ebecbadc92 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:35.621580 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2a5a36f8-5f74-4838-8c4a-30ebecbadc92 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:35.622866 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2a5a36f8-5f74-4838-8c4a-30ebecbadc92 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:35.623930 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c84a51c7-1a06-43a3-a1b1-7c1f4e32af5e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:35.624070 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2a5a36f8-5f74-4838-8c4a-30ebecbadc92 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.157665 Oct 11 07:01:35.624599 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1300/2583] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:35 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:35.632821 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c84a51c7-1a06-43a3-a1b1-7c1f4e32af5e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.161508 Oct 11 07:01:35.633511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1284/2584] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:35 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:01:35.668018 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-05f62fe5-ef0f-4c27-972e-c88dafe0c85f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:35.668629 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-05f62fe5-ef0f-4c27-972e-c88dafe0c85f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:35.674497 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05f62fe5-ef0f-4c27-972e-c88dafe0c85f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:35.674970 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05f62fe5-ef0f-4c27-972e-c88dafe0c85f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:35.675399 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05f62fe5-ef0f-4c27-972e-c88dafe0c85f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:35.676103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05f62fe5-ef0f-4c27-972e-c88dafe0c85f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:35.676547 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05f62fe5-ef0f-4c27-972e-c88dafe0c85f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:35.676965 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05f62fe5-ef0f-4c27-972e-c88dafe0c85f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:35.802239 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-05f62fe5-ef0f-4c27-972e-c88dafe0c85f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:35.811169 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-05f62fe5-ef0f-4c27-972e-c88dafe0c85f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.146845 Oct 11 07:01:35.811770 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1301/2585] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:35 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:36.650395 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7778019f-feda-4c1c-bbed-5b39285695e9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:36.651080 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7778019f-feda-4c1c-bbed-5b39285695e9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:36.655939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1f82bd07-570b-4b83-aa09-7f687ff8da79 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:36.656598 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1f82bd07-570b-4b83-aa09-7f687ff8da79 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:36.657559 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7778019f-feda-4c1c-bbed-5b39285695e9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:36.657968 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7778019f-feda-4c1c-bbed-5b39285695e9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:36.658392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7778019f-feda-4c1c-bbed-5b39285695e9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:36.659074 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7778019f-feda-4c1c-bbed-5b39285695e9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:36.659539 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7778019f-feda-4c1c-bbed-5b39285695e9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:36.659954 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7778019f-feda-4c1c-bbed-5b39285695e9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:36.663647 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1f82bd07-570b-4b83-aa09-7f687ff8da79 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:36.664126 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1f82bd07-570b-4b83-aa09-7f687ff8da79 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:36.664557 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1f82bd07-570b-4b83-aa09-7f687ff8da79 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:36.665244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1f82bd07-570b-4b83-aa09-7f687ff8da79 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:36.665690 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1f82bd07-570b-4b83-aa09-7f687ff8da79 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:36.666110 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1f82bd07-570b-4b83-aa09-7f687ff8da79 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:36.791641 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7778019f-feda-4c1c-bbed-5b39285695e9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:36.797578 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1f82bd07-570b-4b83-aa09-7f687ff8da79 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:36.800473 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7778019f-feda-4c1c-bbed-5b39285695e9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:36.801971 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7778019f-feda-4c1c-bbed-5b39285695e9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:36.803197 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7778019f-feda-4c1c-bbed-5b39285695e9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.157123 Oct 11 07:01:36.803859 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1285/2586] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:36 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:36.805862 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1f82bd07-570b-4b83-aa09-7f687ff8da79 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.153680 Oct 11 07:01:36.806414 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1302/2587] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:36 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:01:36.834079 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5a3fa205-0821-4328-8222-13627e5f75e1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:36.835260 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5a3fa205-0821-4328-8222-13627e5f75e1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:36.841092 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a3fa205-0821-4328-8222-13627e5f75e1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:36.841564 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a3fa205-0821-4328-8222-13627e5f75e1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:36.841988 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a3fa205-0821-4328-8222-13627e5f75e1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:36.842661 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a3fa205-0821-4328-8222-13627e5f75e1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:36.843106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a3fa205-0821-4328-8222-13627e5f75e1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:36.843552 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5a3fa205-0821-4328-8222-13627e5f75e1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:36.969049 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5a3fa205-0821-4328-8222-13627e5f75e1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:36.977237 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5a3fa205-0821-4328-8222-13627e5f75e1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.146795 Oct 11 07:01:36.977795 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1286/2588] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:36 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:01:37.828753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0445ca44-4da7-4d2a-ae8e-55473bdb6513 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:37.829342 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0445ca44-4da7-4d2a-ae8e-55473bdb6513 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:37.829473 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-07aa9a8a-3f8c-4b34-8516-4b986fb21419 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:37.830143 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-07aa9a8a-3f8c-4b34-8516-4b986fb21419 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:37.836416 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0445ca44-4da7-4d2a-ae8e-55473bdb6513 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:37.836887 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0445ca44-4da7-4d2a-ae8e-55473bdb6513 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:37.837202 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-07aa9a8a-3f8c-4b34-8516-4b986fb21419 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:37.837335 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0445ca44-4da7-4d2a-ae8e-55473bdb6513 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:37.837672 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-07aa9a8a-3f8c-4b34-8516-4b986fb21419 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:37.837986 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0445ca44-4da7-4d2a-ae8e-55473bdb6513 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:37.838185 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-07aa9a8a-3f8c-4b34-8516-4b986fb21419 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:37.838431 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0445ca44-4da7-4d2a-ae8e-55473bdb6513 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:37.838763 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-07aa9a8a-3f8c-4b34-8516-4b986fb21419 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:37.838871 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0445ca44-4da7-4d2a-ae8e-55473bdb6513 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:37.839329 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-07aa9a8a-3f8c-4b34-8516-4b986fb21419 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:37.839770 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-07aa9a8a-3f8c-4b34-8516-4b986fb21419 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:37.969743 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0445ca44-4da7-4d2a-ae8e-55473bdb6513 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:37.969951 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-07aa9a8a-3f8c-4b34-8516-4b986fb21419 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:37.978170 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-07aa9a8a-3f8c-4b34-8516-4b986fb21419 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.152571 Oct 11 07:01:37.978452 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0445ca44-4da7-4d2a-ae8e-55473bdb6513 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:37.978729 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1287/2589] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:37 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:01:37.979970 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0445ca44-4da7-4d2a-ae8e-55473bdb6513 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:37.981184 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0445ca44-4da7-4d2a-ae8e-55473bdb6513 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.156343 Oct 11 07:01:37.981743 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1303/2590] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:37 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:37.999991 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ae23c595-49a8-4be0-9327-fc274c21c75e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:38.000820 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ae23c595-49a8-4be0-9327-fc274c21c75e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:38.007468 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ae23c595-49a8-4be0-9327-fc274c21c75e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:38.008012 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ae23c595-49a8-4be0-9327-fc274c21c75e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:38.008488 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ae23c595-49a8-4be0-9327-fc274c21c75e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:38.009180 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ae23c595-49a8-4be0-9327-fc274c21c75e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:38.009629 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ae23c595-49a8-4be0-9327-fc274c21c75e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:38.010161 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ae23c595-49a8-4be0-9327-fc274c21c75e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:38.140129 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ae23c595-49a8-4be0-9327-fc274c21c75e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:38.148244 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ae23c595-49a8-4be0-9327-fc274c21c75e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.152036 Oct 11 07:01:38.148812 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1288/2591] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:37 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:39.003516 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3f4a92c6-70b0-4f0b-a095-2eb670624a7d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:39.004073 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3f4a92c6-70b0-4f0b-a095-2eb670624a7d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:39.005855 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3f399ab0-d8d2-4847-92d1-b7116978f40e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:39.006379 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=76 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:01:39.006508 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3f399ab0-d8d2-4847-92d1-b7116978f40e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:39.011632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3f4a92c6-70b0-4f0b-a095-2eb670624a7d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:39.012102 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3f4a92c6-70b0-4f0b-a095-2eb670624a7d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:39.012530 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3f4a92c6-70b0-4f0b-a095-2eb670624a7d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:39.013426 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3f399ab0-d8d2-4847-92d1-b7116978f40e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:39.013564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3f4a92c6-70b0-4f0b-a095-2eb670624a7d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:39.013893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3f399ab0-d8d2-4847-92d1-b7116978f40e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:39.014003 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3f4a92c6-70b0-4f0b-a095-2eb670624a7d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:39.014315 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3f399ab0-d8d2-4847-92d1-b7116978f40e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:39.014431 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3f4a92c6-70b0-4f0b-a095-2eb670624a7d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:39.015029 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3f399ab0-d8d2-4847-92d1-b7116978f40e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:39.015500 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3f399ab0-d8d2-4847-92d1-b7116978f40e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:39.015921 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3f399ab0-d8d2-4847-92d1-b7116978f40e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:39.145212 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3f399ab0-d8d2-4847-92d1-b7116978f40e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:39.147473 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3f4a92c6-70b0-4f0b-a095-2eb670624a7d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:39.154058 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3f399ab0-d8d2-4847-92d1-b7116978f40e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:39.155509 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3f399ab0-d8d2-4847-92d1-b7116978f40e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:39.155642 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3f4a92c6-70b0-4f0b-a095-2eb670624a7d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.156025 Oct 11 07:01:39.156082 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1304/2592] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:38 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:39.156665 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3f399ab0-d8d2-4847-92d1-b7116978f40e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.154580 Oct 11 07:01:39.157295 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1289/2593] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:39 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:01:39.170628 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-dfc2bedb-7ca4-4e4d-a6b5-560b9cd7984c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:39.171242 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-dfc2bedb-7ca4-4e4d-a6b5-560b9cd7984c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:39.177078 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dfc2bedb-7ca4-4e4d-a6b5-560b9cd7984c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:39.177552 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dfc2bedb-7ca4-4e4d-a6b5-560b9cd7984c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:39.177986 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dfc2bedb-7ca4-4e4d-a6b5-560b9cd7984c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:39.179253 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dfc2bedb-7ca4-4e4d-a6b5-560b9cd7984c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:39.179744 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dfc2bedb-7ca4-4e4d-a6b5-560b9cd7984c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:39.180169 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dfc2bedb-7ca4-4e4d-a6b5-560b9cd7984c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:39.304696 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-dfc2bedb-7ca4-4e4d-a6b5-560b9cd7984c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:39.313103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-dfc2bedb-7ca4-4e4d-a6b5-560b9cd7984c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.146972 Oct 11 07:01:39.313663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1305/2594] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:39 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:40.180468 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7d8e34d4-6413-487f-9574-e9f6f4fe8814 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:40.181066 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7d8e34d4-6413-487f-9574-e9f6f4fe8814 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:40.182326 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0ca1b8c4-5894-4b4c-8c93-7341a1694176 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:40.182935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0ca1b8c4-5894-4b4c-8c93-7341a1694176 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:40.187588 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7d8e34d4-6413-487f-9574-e9f6f4fe8814 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:40.188070 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7d8e34d4-6413-487f-9574-e9f6f4fe8814 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:40.188505 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7d8e34d4-6413-487f-9574-e9f6f4fe8814 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:40.189200 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7d8e34d4-6413-487f-9574-e9f6f4fe8814 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:40.189331 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0ca1b8c4-5894-4b4c-8c93-7341a1694176 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:40.189654 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7d8e34d4-6413-487f-9574-e9f6f4fe8814 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:40.189821 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0ca1b8c4-5894-4b4c-8c93-7341a1694176 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:40.190077 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7d8e34d4-6413-487f-9574-e9f6f4fe8814 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:40.190190 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0ca1b8c4-5894-4b4c-8c93-7341a1694176 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:40.190803 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0ca1b8c4-5894-4b4c-8c93-7341a1694176 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:40.191250 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0ca1b8c4-5894-4b4c-8c93-7341a1694176 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:40.191695 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0ca1b8c4-5894-4b4c-8c93-7341a1694176 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:40.319883 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7d8e34d4-6413-487f-9574-e9f6f4fe8814 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:40.320087 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0ca1b8c4-5894-4b4c-8c93-7341a1694176 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:40.328384 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7d8e34d4-6413-487f-9574-e9f6f4fe8814 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.152542 Oct 11 07:01:40.328569 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0ca1b8c4-5894-4b4c-8c93-7341a1694176 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:40.328950 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1290/2595] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:40 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:40.330061 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0ca1b8c4-5894-4b4c-8c93-7341a1694176 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:40.331220 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0ca1b8c4-5894-4b4c-8c93-7341a1694176 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.153221 Oct 11 07:01:40.340763 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1306/2596] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:40 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:01:40.340977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-99ff5d0c-aba7-4d55-9682-468f92314d77 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:40.340977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-99ff5d0c-aba7-4d55-9682-468f92314d77 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:40.342109 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99ff5d0c-aba7-4d55-9682-468f92314d77 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:40.342743 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99ff5d0c-aba7-4d55-9682-468f92314d77 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:40.343170 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99ff5d0c-aba7-4d55-9682-468f92314d77 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:40.343898 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99ff5d0c-aba7-4d55-9682-468f92314d77 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:40.344339 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99ff5d0c-aba7-4d55-9682-468f92314d77 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:40.344750 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99ff5d0c-aba7-4d55-9682-468f92314d77 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:40.469896 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-99ff5d0c-aba7-4d55-9682-468f92314d77 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:40.478529 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-99ff5d0c-aba7-4d55-9682-468f92314d77 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.146869 Oct 11 07:01:40.479091 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1291/2597] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:40 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:01:41.352247 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c61e04d6-214c-42bd-b40c-7d01eb2e8a91 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:41.352966 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c61e04d6-214c-42bd-b40c-7d01eb2e8a91 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:41.356991 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e92c7305-5b8f-49a3-a503-18ceb7b0aa3d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:41.357610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e92c7305-5b8f-49a3-a503-18ceb7b0aa3d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:41.359338 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c61e04d6-214c-42bd-b40c-7d01eb2e8a91 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:41.359839 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c61e04d6-214c-42bd-b40c-7d01eb2e8a91 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:41.360258 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c61e04d6-214c-42bd-b40c-7d01eb2e8a91 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:41.360938 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c61e04d6-214c-42bd-b40c-7d01eb2e8a91 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:41.361375 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c61e04d6-214c-42bd-b40c-7d01eb2e8a91 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:41.361784 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c61e04d6-214c-42bd-b40c-7d01eb2e8a91 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:41.364095 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e92c7305-5b8f-49a3-a503-18ceb7b0aa3d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:41.364575 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e92c7305-5b8f-49a3-a503-18ceb7b0aa3d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:41.365013 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e92c7305-5b8f-49a3-a503-18ceb7b0aa3d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:41.365743 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e92c7305-5b8f-49a3-a503-18ceb7b0aa3d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:41.366755 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e92c7305-5b8f-49a3-a503-18ceb7b0aa3d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:41.367178 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e92c7305-5b8f-49a3-a503-18ceb7b0aa3d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:41.494852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c61e04d6-214c-42bd-b40c-7d01eb2e8a91 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:41.498420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e92c7305-5b8f-49a3-a503-18ceb7b0aa3d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:41.503240 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c61e04d6-214c-42bd-b40c-7d01eb2e8a91 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.155993 Oct 11 07:01:41.503824 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1307/2598] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:41 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:41.507397 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e92c7305-5b8f-49a3-a503-18ceb7b0aa3d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:41.508143 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7c4ad0bc-69fa-4795-a655-83062fe5d315 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:41.508738 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7c4ad0bc-69fa-4795-a655-83062fe5d315 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:41.508874 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e92c7305-5b8f-49a3-a503-18ceb7b0aa3d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:41.509996 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e92c7305-5b8f-49a3-a503-18ceb7b0aa3d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.156865 Oct 11 07:01:41.510532 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1292/2599] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:41 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:01:41.514837 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7c4ad0bc-69fa-4795-a655-83062fe5d315 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:41.515438 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7c4ad0bc-69fa-4795-a655-83062fe5d315 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:41.515873 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7c4ad0bc-69fa-4795-a655-83062fe5d315 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:41.516603 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7c4ad0bc-69fa-4795-a655-83062fe5d315 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:41.517047 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7c4ad0bc-69fa-4795-a655-83062fe5d315 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:41.517463 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7c4ad0bc-69fa-4795-a655-83062fe5d315 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:41.641574 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7c4ad0bc-69fa-4795-a655-83062fe5d315 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:41.650251 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7c4ad0bc-69fa-4795-a655-83062fe5d315 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.145511 Oct 11 07:01:41.650811 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1308/2600] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:41 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:42.527103 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-266e29e1-cc8a-4cbe-af04-55438682adf8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:42.527738 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-266e29e1-cc8a-4cbe-af04-55438682adf8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:42.534180 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-266e29e1-cc8a-4cbe-af04-55438682adf8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:42.534651 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-266e29e1-cc8a-4cbe-af04-55438682adf8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:42.535076 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-266e29e1-cc8a-4cbe-af04-55438682adf8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:42.535275 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9f730497-4e46-400b-a998-7de8fe42d4b1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:42.535781 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-266e29e1-cc8a-4cbe-af04-55438682adf8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:42.535898 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9f730497-4e46-400b-a998-7de8fe42d4b1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:42.536305 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-266e29e1-cc8a-4cbe-af04-55438682adf8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:42.536724 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-266e29e1-cc8a-4cbe-af04-55438682adf8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:42.542324 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9f730497-4e46-400b-a998-7de8fe42d4b1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:42.542791 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9f730497-4e46-400b-a998-7de8fe42d4b1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:42.543220 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9f730497-4e46-400b-a998-7de8fe42d4b1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:42.543927 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9f730497-4e46-400b-a998-7de8fe42d4b1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:42.544371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9f730497-4e46-400b-a998-7de8fe42d4b1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:42.544904 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9f730497-4e46-400b-a998-7de8fe42d4b1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:42.667612 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-266e29e1-cc8a-4cbe-af04-55438682adf8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:42.675936 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-266e29e1-cc8a-4cbe-af04-55438682adf8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.152655 Oct 11 07:01:42.676510 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1293/2601] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:42 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:42.680655 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9f730497-4e46-400b-a998-7de8fe42d4b1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:42.681558 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b361d89b-8c58-49bc-9cd1-7181140b984e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:42.682161 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b361d89b-8c58-49bc-9cd1-7181140b984e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:42.689062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b361d89b-8c58-49bc-9cd1-7181140b984e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:42.689376 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9f730497-4e46-400b-a998-7de8fe42d4b1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:42.689584 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b361d89b-8c58-49bc-9cd1-7181140b984e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:42.689966 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b361d89b-8c58-49bc-9cd1-7181140b984e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:42.690655 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b361d89b-8c58-49bc-9cd1-7181140b984e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:42.690837 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9f730497-4e46-400b-a998-7de8fe42d4b1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:42.691123 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b361d89b-8c58-49bc-9cd1-7181140b984e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:42.691559 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b361d89b-8c58-49bc-9cd1-7181140b984e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:42.691981 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9f730497-4e46-400b-a998-7de8fe42d4b1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.160622 Oct 11 07:01:42.694422 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1309/2602] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:42 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:01:42.711343 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:01:42.823051 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b361d89b-8c58-49bc-9cd1-7181140b984e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:42.831197 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b361d89b-8c58-49bc-9cd1-7181140b984e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.153761 Oct 11 07:01:42.831794 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1294/2603] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:42 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:43.699094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-06f617d2-55a2-4a61-bf2a-6fbc7234e5e7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:43.699700 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-06f617d2-55a2-4a61-bf2a-6fbc7234e5e7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:43.705919 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-06f617d2-55a2-4a61-bf2a-6fbc7234e5e7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:43.706395 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-06f617d2-55a2-4a61-bf2a-6fbc7234e5e7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:43.706829 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-06f617d2-55a2-4a61-bf2a-6fbc7234e5e7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:43.707552 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-06f617d2-55a2-4a61-bf2a-6fbc7234e5e7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:43.707996 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-06f617d2-55a2-4a61-bf2a-6fbc7234e5e7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:43.708416 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-06f617d2-55a2-4a61-bf2a-6fbc7234e5e7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:43.717557 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-192940b6-603c-4952-b092-775f5d2baf2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:43.718164 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-192940b6-603c-4952-b092-775f5d2baf2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:43.724540 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-192940b6-603c-4952-b092-775f5d2baf2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:43.725504 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-192940b6-603c-4952-b092-775f5d2baf2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:43.725935 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-192940b6-603c-4952-b092-775f5d2baf2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:43.726622 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-192940b6-603c-4952-b092-775f5d2baf2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:43.727064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-192940b6-603c-4952-b092-775f5d2baf2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:43.727508 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-192940b6-603c-4952-b092-775f5d2baf2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:43.845836 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-06f617d2-55a2-4a61-bf2a-6fbc7234e5e7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:43.854591 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-06f617d2-55a2-4a61-bf2a-6fbc7234e5e7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.159390 Oct 11 07:01:43.855152 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1310/2604] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:43 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:43.859788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6f507d36-5a79-42f3-9ad2-2d73d0e64901 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:43.860600 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6f507d36-5a79-42f3-9ad2-2d73d0e64901 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:43.862723 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-192940b6-603c-4952-b092-775f5d2baf2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:43.866383 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f507d36-5a79-42f3-9ad2-2d73d0e64901 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:43.866848 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f507d36-5a79-42f3-9ad2-2d73d0e64901 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:43.867508 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f507d36-5a79-42f3-9ad2-2d73d0e64901 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:43.868188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f507d36-5a79-42f3-9ad2-2d73d0e64901 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:43.868809 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f507d36-5a79-42f3-9ad2-2d73d0e64901 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:43.869398 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f507d36-5a79-42f3-9ad2-2d73d0e64901 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:43.877404 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-192940b6-603c-4952-b092-775f5d2baf2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:43.878981 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-192940b6-603c-4952-b092-775f5d2baf2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:43.880278 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-192940b6-603c-4952-b092-775f5d2baf2b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.166755 Oct 11 07:01:43.881073 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1295/2605] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:43 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:01:43.996908 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6f507d36-5a79-42f3-9ad2-2d73d0e64901 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:44.004996 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6f507d36-5a79-42f3-9ad2-2d73d0e64901 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.148606 Oct 11 07:01:44.005532 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1311/2606] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:43 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:44.878774 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-69d329a1-235e-4969-a0bb-f18dd5509347 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:44.879385 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-69d329a1-235e-4969-a0bb-f18dd5509347 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:44.886399 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-69d329a1-235e-4969-a0bb-f18dd5509347 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:44.886875 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-69d329a1-235e-4969-a0bb-f18dd5509347 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:44.887305 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-69d329a1-235e-4969-a0bb-f18dd5509347 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:44.888273 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-69d329a1-235e-4969-a0bb-f18dd5509347 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:44.888716 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-69d329a1-235e-4969-a0bb-f18dd5509347 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:44.889133 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-69d329a1-235e-4969-a0bb-f18dd5509347 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:44.906168 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bdcaae5b-ccd0-47f7-9ee5-9ada6573fc9d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:44.906924 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bdcaae5b-ccd0-47f7-9ee5-9ada6573fc9d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:44.913597 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bdcaae5b-ccd0-47f7-9ee5-9ada6573fc9d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:44.914081 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bdcaae5b-ccd0-47f7-9ee5-9ada6573fc9d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:44.914618 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bdcaae5b-ccd0-47f7-9ee5-9ada6573fc9d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:44.915303 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bdcaae5b-ccd0-47f7-9ee5-9ada6573fc9d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:44.915787 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bdcaae5b-ccd0-47f7-9ee5-9ada6573fc9d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:44.916212 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bdcaae5b-ccd0-47f7-9ee5-9ada6573fc9d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:45.020861 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-69d329a1-235e-4969-a0bb-f18dd5509347 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:45.029040 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-69d329a1-235e-4969-a0bb-f18dd5509347 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.154142 Oct 11 07:01:45.029606 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1296/2607] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:44 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:45.033982 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c7809d40-8f1d-4485-92ed-572b25072f53 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:45.034598 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c7809d40-8f1d-4485-92ed-572b25072f53 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:45.041033 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c7809d40-8f1d-4485-92ed-572b25072f53 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:45.041570 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c7809d40-8f1d-4485-92ed-572b25072f53 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:45.041998 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c7809d40-8f1d-4485-92ed-572b25072f53 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:45.042683 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c7809d40-8f1d-4485-92ed-572b25072f53 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:45.043125 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c7809d40-8f1d-4485-92ed-572b25072f53 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:45.043757 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c7809d40-8f1d-4485-92ed-572b25072f53 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:45.049525 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bdcaae5b-ccd0-47f7-9ee5-9ada6573fc9d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:45.058534 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bdcaae5b-ccd0-47f7-9ee5-9ada6573fc9d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:45.059996 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bdcaae5b-ccd0-47f7-9ee5-9ada6573fc9d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:45.061146 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bdcaae5b-ccd0-47f7-9ee5-9ada6573fc9d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.158916 Oct 11 07:01:45.061701 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1312/2608] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:44 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:45.175684 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c7809d40-8f1d-4485-92ed-572b25072f53 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:45.184640 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c7809d40-8f1d-4485-92ed-572b25072f53 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.154109 Oct 11 07:01:45.185199 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1297/2609] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:45 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:46.053562 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a74117a5-7fb3-43b7-b09d-7315f003efd0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:46.054176 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a74117a5-7fb3-43b7-b09d-7315f003efd0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:46.060528 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a74117a5-7fb3-43b7-b09d-7315f003efd0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:46.060996 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a74117a5-7fb3-43b7-b09d-7315f003efd0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:46.061420 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a74117a5-7fb3-43b7-b09d-7315f003efd0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:46.062100 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a74117a5-7fb3-43b7-b09d-7315f003efd0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:46.062541 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a74117a5-7fb3-43b7-b09d-7315f003efd0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:46.062957 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a74117a5-7fb3-43b7-b09d-7315f003efd0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:46.086084 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-72511aad-fdfb-4e5c-8991-23e03d517044 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:46.086834 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-72511aad-fdfb-4e5c-8991-23e03d517044 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:46.093251 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-72511aad-fdfb-4e5c-8991-23e03d517044 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:46.093722 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-72511aad-fdfb-4e5c-8991-23e03d517044 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:46.094148 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-72511aad-fdfb-4e5c-8991-23e03d517044 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:46.094834 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-72511aad-fdfb-4e5c-8991-23e03d517044 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:46.095274 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-72511aad-fdfb-4e5c-8991-23e03d517044 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:46.095712 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-72511aad-fdfb-4e5c-8991-23e03d517044 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:46.197310 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a74117a5-7fb3-43b7-b09d-7315f003efd0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:46.205716 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a74117a5-7fb3-43b7-b09d-7315f003efd0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.156443 Oct 11 07:01:46.211693 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1313/2610] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:46 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:46.211693 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-59a5c4a1-1192-4de1-9da3-526f999f23a2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:46.211693 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-59a5c4a1-1192-4de1-9da3-526f999f23a2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:46.216964 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-59a5c4a1-1192-4de1-9da3-526f999f23a2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:46.217428 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-59a5c4a1-1192-4de1-9da3-526f999f23a2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:46.217846 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-59a5c4a1-1192-4de1-9da3-526f999f23a2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:46.218517 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-59a5c4a1-1192-4de1-9da3-526f999f23a2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:46.218954 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-59a5c4a1-1192-4de1-9da3-526f999f23a2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:46.219363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-59a5c4a1-1192-4de1-9da3-526f999f23a2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:46.226509 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-72511aad-fdfb-4e5c-8991-23e03d517044 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:46.234954 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-72511aad-fdfb-4e5c-8991-23e03d517044 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:46.236392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-72511aad-fdfb-4e5c-8991-23e03d517044 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:46.237543 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-72511aad-fdfb-4e5c-8991-23e03d517044 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.155349 Oct 11 07:01:46.238084 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1298/2611] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:46 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:01:46.347589 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-59a5c4a1-1192-4de1-9da3-526f999f23a2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:46.351101 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:01:46.356545 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-59a5c4a1-1192-4de1-9da3-526f999f23a2 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.149355 Oct 11 07:01:46.357096 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1314/2612] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:46 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:47.228954 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9a42a473-06ce-48c5-91a1-b777e5c171a1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:47.229579 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9a42a473-06ce-48c5-91a1-b777e5c171a1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:47.236431 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9a42a473-06ce-48c5-91a1-b777e5c171a1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:47.237636 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9a42a473-06ce-48c5-91a1-b777e5c171a1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:47.238072 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9a42a473-06ce-48c5-91a1-b777e5c171a1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:47.238767 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9a42a473-06ce-48c5-91a1-b777e5c171a1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:47.239223 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9a42a473-06ce-48c5-91a1-b777e5c171a1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:47.239672 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9a42a473-06ce-48c5-91a1-b777e5c171a1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:47.265237 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-58735c65-1f06-44b5-a3ba-b32cb7a22fd1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:47.265875 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-58735c65-1f06-44b5-a3ba-b32cb7a22fd1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:47.272888 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-58735c65-1f06-44b5-a3ba-b32cb7a22fd1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:47.273366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-58735c65-1f06-44b5-a3ba-b32cb7a22fd1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:47.273798 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-58735c65-1f06-44b5-a3ba-b32cb7a22fd1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:47.274488 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-58735c65-1f06-44b5-a3ba-b32cb7a22fd1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:47.274936 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-58735c65-1f06-44b5-a3ba-b32cb7a22fd1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:47.275355 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-58735c65-1f06-44b5-a3ba-b32cb7a22fd1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:47.369084 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9a42a473-06ce-48c5-91a1-b777e5c171a1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:47.377640 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9a42a473-06ce-48c5-91a1-b777e5c171a1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.152445 Oct 11 07:01:47.378202 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1299/2613] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:47 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:47.383157 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e5f169e1-3261-40ae-8882-34ab4f74dfc0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:47.383787 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e5f169e1-3261-40ae-8882-34ab4f74dfc0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:47.389581 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e5f169e1-3261-40ae-8882-34ab4f74dfc0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:47.390053 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e5f169e1-3261-40ae-8882-34ab4f74dfc0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:47.390477 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e5f169e1-3261-40ae-8882-34ab4f74dfc0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:47.391157 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e5f169e1-3261-40ae-8882-34ab4f74dfc0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:47.391630 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e5f169e1-3261-40ae-8882-34ab4f74dfc0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:47.392052 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e5f169e1-3261-40ae-8882-34ab4f74dfc0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:47.404182 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-58735c65-1f06-44b5-a3ba-b32cb7a22fd1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:47.414675 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-58735c65-1f06-44b5-a3ba-b32cb7a22fd1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:47.416223 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-58735c65-1f06-44b5-a3ba-b32cb7a22fd1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:47.417396 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-58735c65-1f06-44b5-a3ba-b32cb7a22fd1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.156562 Oct 11 07:01:47.418565 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1315/2614] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:47 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:01:47.527807 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e5f169e1-3261-40ae-8882-34ab4f74dfc0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:47.536025 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e5f169e1-3261-40ae-8882-34ab4f74dfc0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.156897 Oct 11 07:01:47.536582 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1300/2615] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:47 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:48.402412 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b4f46c69-cc53-4d3d-a88c-fb85faf166a5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:48.403023 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b4f46c69-cc53-4d3d-a88c-fb85faf166a5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:48.409523 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b4f46c69-cc53-4d3d-a88c-fb85faf166a5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:48.409999 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b4f46c69-cc53-4d3d-a88c-fb85faf166a5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:48.410430 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b4f46c69-cc53-4d3d-a88c-fb85faf166a5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:48.411120 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b4f46c69-cc53-4d3d-a88c-fb85faf166a5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:48.411597 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b4f46c69-cc53-4d3d-a88c-fb85faf166a5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:48.412020 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b4f46c69-cc53-4d3d-a88c-fb85faf166a5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:48.444258 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f8ff7e5b-f0c3-4cb0-aebe-8441fdeb8ae6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:48.444975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f8ff7e5b-f0c3-4cb0-aebe-8441fdeb8ae6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:48.451242 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f8ff7e5b-f0c3-4cb0-aebe-8441fdeb8ae6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:48.451772 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f8ff7e5b-f0c3-4cb0-aebe-8441fdeb8ae6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:48.452210 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f8ff7e5b-f0c3-4cb0-aebe-8441fdeb8ae6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:48.452920 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f8ff7e5b-f0c3-4cb0-aebe-8441fdeb8ae6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:48.453372 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f8ff7e5b-f0c3-4cb0-aebe-8441fdeb8ae6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:48.453797 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f8ff7e5b-f0c3-4cb0-aebe-8441fdeb8ae6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:48.583935 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f8ff7e5b-f0c3-4cb0-aebe-8441fdeb8ae6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:48.593134 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f8ff7e5b-f0c3-4cb0-aebe-8441fdeb8ae6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:48.594575 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f8ff7e5b-f0c3-4cb0-aebe-8441fdeb8ae6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:48.595761 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f8ff7e5b-f0c3-4cb0-aebe-8441fdeb8ae6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.155373 Oct 11 07:01:48.600848 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1301/2616] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:48 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:01:48.601180 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-18616c43-55dc-4b8d-8b5a-3c9797a7c67b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:48.601787 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-18616c43-55dc-4b8d-8b5a-3c9797a7c67b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:48.607329 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-18616c43-55dc-4b8d-8b5a-3c9797a7c67b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:48.607851 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-18616c43-55dc-4b8d-8b5a-3c9797a7c67b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:48.608288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-18616c43-55dc-4b8d-8b5a-3c9797a7c67b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:48.608986 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-18616c43-55dc-4b8d-8b5a-3c9797a7c67b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:48.609507 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-18616c43-55dc-4b8d-8b5a-3c9797a7c67b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:48.609930 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-18616c43-55dc-4b8d-8b5a-3c9797a7c67b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:48.742955 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-18616c43-55dc-4b8d-8b5a-3c9797a7c67b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:48.751179 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-18616c43-55dc-4b8d-8b5a-3c9797a7c67b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.153898 Oct 11 07:01:48.751976 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1302/2617] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:48 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:48.759982 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b4f46c69-cc53-4d3d-a88c-fb85faf166a5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:48.768399 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b4f46c69-cc53-4d3d-a88c-fb85faf166a5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.369812 Oct 11 07:01:48.768953 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1316/2618] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:48 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:49.621897 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-eb6ae363-1985-4ee0-aaac-154463a83cc7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:49.622500 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-eb6ae363-1985-4ee0-aaac-154463a83cc7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:49.628992 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eb6ae363-1985-4ee0-aaac-154463a83cc7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:49.629468 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eb6ae363-1985-4ee0-aaac-154463a83cc7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:49.629897 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eb6ae363-1985-4ee0-aaac-154463a83cc7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:49.630574 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eb6ae363-1985-4ee0-aaac-154463a83cc7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:49.631543 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eb6ae363-1985-4ee0-aaac-154463a83cc7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:49.631961 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eb6ae363-1985-4ee0-aaac-154463a83cc7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:49.758756 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-eb6ae363-1985-4ee0-aaac-154463a83cc7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:49.767580 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-eb6ae363-1985-4ee0-aaac-154463a83cc7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:49.769024 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-eb6ae363-1985-4ee0-aaac-154463a83cc7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:49.770183 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-eb6ae363-1985-4ee0-aaac-154463a83cc7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152216 Oct 11 07:01:49.770731 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1303/2619] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:49 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:49.774536 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a8b88dba-f341-472d-97ee-38c227c98e61 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:49.775169 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a8b88dba-f341-472d-97ee-38c227c98e61 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:49.781242 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a8b88dba-f341-472d-97ee-38c227c98e61 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:49.781705 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a8b88dba-f341-472d-97ee-38c227c98e61 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:49.782124 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a8b88dba-f341-472d-97ee-38c227c98e61 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:49.782808 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a8b88dba-f341-472d-97ee-38c227c98e61 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:49.783232 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a8b88dba-f341-472d-97ee-38c227c98e61 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:49.783669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a8b88dba-f341-472d-97ee-38c227c98e61 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:49.791396 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5736c3da-8531-4933-984e-3550f4ecfa02 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:49.792104 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5736c3da-8531-4933-984e-3550f4ecfa02 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:49.797947 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5736c3da-8531-4933-984e-3550f4ecfa02 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:49.798433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5736c3da-8531-4933-984e-3550f4ecfa02 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:49.798869 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5736c3da-8531-4933-984e-3550f4ecfa02 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:49.799659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5736c3da-8531-4933-984e-3550f4ecfa02 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:49.800131 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5736c3da-8531-4933-984e-3550f4ecfa02 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:49.800562 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5736c3da-8531-4933-984e-3550f4ecfa02 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:49.912268 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a8b88dba-f341-472d-97ee-38c227c98e61 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:49.920422 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a8b88dba-f341-472d-97ee-38c227c98e61 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150255 Oct 11 07:01:49.920988 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1317/2620] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:49 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:01:49.931865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5736c3da-8531-4933-984e-3550f4ecfa02 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:49.940080 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5736c3da-8531-4933-984e-3550f4ecfa02 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.152479 Oct 11 07:01:49.940630 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1304/2621] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:49 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:01:50.795863 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bb52b4f8-a043-4f6e-a7dd-0721e6ce6743 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:50.796465 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bb52b4f8-a043-4f6e-a7dd-0721e6ce6743 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:50.802728 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bb52b4f8-a043-4f6e-a7dd-0721e6ce6743 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:50.803204 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bb52b4f8-a043-4f6e-a7dd-0721e6ce6743 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:50.803664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bb52b4f8-a043-4f6e-a7dd-0721e6ce6743 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:50.804357 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bb52b4f8-a043-4f6e-a7dd-0721e6ce6743 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:50.804799 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bb52b4f8-a043-4f6e-a7dd-0721e6ce6743 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:50.805217 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bb52b4f8-a043-4f6e-a7dd-0721e6ce6743 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:50.929837 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bb52b4f8-a043-4f6e-a7dd-0721e6ce6743 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:50.938255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bb52b4f8-a043-4f6e-a7dd-0721e6ce6743 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:50.939715 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bb52b4f8-a043-4f6e-a7dd-0721e6ce6743 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:50.940868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bb52b4f8-a043-4f6e-a7dd-0721e6ce6743 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.148949 Oct 11 07:01:50.941406 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1318/2622] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:50 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:50.944145 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b4d0dbae-eca7-40b1-af12-f3a5988ffe71 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:50.945393 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b4d0dbae-eca7-40b1-af12-f3a5988ffe71 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:50.951919 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b4d0dbae-eca7-40b1-af12-f3a5988ffe71 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:50.952405 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b4d0dbae-eca7-40b1-af12-f3a5988ffe71 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:50.952843 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b4d0dbae-eca7-40b1-af12-f3a5988ffe71 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:50.953534 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b4d0dbae-eca7-40b1-af12-f3a5988ffe71 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:50.953987 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b4d0dbae-eca7-40b1-af12-f3a5988ffe71 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:50.954408 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b4d0dbae-eca7-40b1-af12-f3a5988ffe71 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:50.963623 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-774fb2cf-a936-490f-87be-7767c9f42d1c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:50.964361 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-774fb2cf-a936-490f-87be-7767c9f42d1c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:50.970204 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-774fb2cf-a936-490f-87be-7767c9f42d1c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:50.970755 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-774fb2cf-a936-490f-87be-7767c9f42d1c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:50.971250 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-774fb2cf-a936-490f-87be-7767c9f42d1c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:50.972033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-774fb2cf-a936-490f-87be-7767c9f42d1c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:50.972477 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-774fb2cf-a936-490f-87be-7767c9f42d1c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:50.972898 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-774fb2cf-a936-490f-87be-7767c9f42d1c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:51.086134 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b4d0dbae-eca7-40b1-af12-f3a5988ffe71 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:51.094297 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b4d0dbae-eca7-40b1-af12-f3a5988ffe71 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.153960 Oct 11 07:01:51.094866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1305/2623] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:50 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:01:51.103733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-774fb2cf-a936-490f-87be-7767c9f42d1c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:51.112874 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-774fb2cf-a936-490f-87be-7767c9f42d1c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.153679 Oct 11 07:01:51.113509 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1319/2624] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:50 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:01:51.966765 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b22e5ef3-ae43-4d6a-aaed-9a2f49809757 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:51.967394 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b22e5ef3-ae43-4d6a-aaed-9a2f49809757 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:51.969791 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=80 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:01:51.974985 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b22e5ef3-ae43-4d6a-aaed-9a2f49809757 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:51.975991 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b22e5ef3-ae43-4d6a-aaed-9a2f49809757 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:51.976430 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b22e5ef3-ae43-4d6a-aaed-9a2f49809757 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:51.977102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b22e5ef3-ae43-4d6a-aaed-9a2f49809757 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:51.977543 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b22e5ef3-ae43-4d6a-aaed-9a2f49809757 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:51.977956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b22e5ef3-ae43-4d6a-aaed-9a2f49809757 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:52.105546 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b22e5ef3-ae43-4d6a-aaed-9a2f49809757 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:52.114891 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b22e5ef3-ae43-4d6a-aaed-9a2f49809757 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:52.116357 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b22e5ef3-ae43-4d6a-aaed-9a2f49809757 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:52.117595 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b22e5ef3-ae43-4d6a-aaed-9a2f49809757 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.154689 Oct 11 07:01:52.117941 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3e9a3bb2-1512-4599-a276-58a5b1ef4b9c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:52.118439 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1306/2625] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:51 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:52.118601 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3e9a3bb2-1512-4599-a276-58a5b1ef4b9c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:52.125141 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e9a3bb2-1512-4599-a276-58a5b1ef4b9c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:52.125608 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e9a3bb2-1512-4599-a276-58a5b1ef4b9c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:52.126033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e9a3bb2-1512-4599-a276-58a5b1ef4b9c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:52.126709 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e9a3bb2-1512-4599-a276-58a5b1ef4b9c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:52.127150 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e9a3bb2-1512-4599-a276-58a5b1ef4b9c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:52.127596 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e9a3bb2-1512-4599-a276-58a5b1ef4b9c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:52.136144 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-fbed349e-8a84-4266-b247-734ef2bab892 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:52.136853 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-fbed349e-8a84-4266-b247-734ef2bab892 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:52.143216 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fbed349e-8a84-4266-b247-734ef2bab892 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:52.143810 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fbed349e-8a84-4266-b247-734ef2bab892 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:52.144354 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fbed349e-8a84-4266-b247-734ef2bab892 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:52.145051 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fbed349e-8a84-4266-b247-734ef2bab892 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:52.145502 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fbed349e-8a84-4266-b247-734ef2bab892 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:52.145923 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fbed349e-8a84-4266-b247-734ef2bab892 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:52.258709 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3e9a3bb2-1512-4599-a276-58a5b1ef4b9c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:52.268236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3e9a3bb2-1512-4599-a276-58a5b1ef4b9c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.154674 Oct 11 07:01:52.268811 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1320/2626] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:52 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:01:52.277125 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-fbed349e-8a84-4266-b247-734ef2bab892 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:52.285329 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-fbed349e-8a84-4266-b247-734ef2bab892 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.153114 Oct 11 07:01:52.285885 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1307/2627] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:52 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:01:53.274950 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8e55cb0f-ba5a-4cd6-87dc-9c50ab433355 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:53.275587 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8e55cb0f-ba5a-4cd6-87dc-9c50ab433355 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:53.282767 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8e55cb0f-ba5a-4cd6-87dc-9c50ab433355 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:53.283243 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8e55cb0f-ba5a-4cd6-87dc-9c50ab433355 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:53.283698 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8e55cb0f-ba5a-4cd6-87dc-9c50ab433355 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:53.284382 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8e55cb0f-ba5a-4cd6-87dc-9c50ab433355 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:53.284828 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8e55cb0f-ba5a-4cd6-87dc-9c50ab433355 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:53.285245 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8e55cb0f-ba5a-4cd6-87dc-9c50ab433355 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:53.292544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9bc28cb6-5a8e-4b12-a905-93f4e443a99c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:53.293226 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9bc28cb6-5a8e-4b12-a905-93f4e443a99c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:53.299621 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9bc28cb6-5a8e-4b12-a905-93f4e443a99c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:53.300174 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9bc28cb6-5a8e-4b12-a905-93f4e443a99c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:53.300668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9bc28cb6-5a8e-4b12-a905-93f4e443a99c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:53.301411 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9bc28cb6-5a8e-4b12-a905-93f4e443a99c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:53.301924 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9bc28cb6-5a8e-4b12-a905-93f4e443a99c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:53.302426 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9bc28cb6-5a8e-4b12-a905-93f4e443a99c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:53.416700 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8e55cb0f-ba5a-4cd6-87dc-9c50ab433355 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:53.425569 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8e55cb0f-ba5a-4cd6-87dc-9c50ab433355 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:53.427056 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8e55cb0f-ba5a-4cd6-87dc-9c50ab433355 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:53.428267 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8e55cb0f-ba5a-4cd6-87dc-9c50ab433355 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.288539 Oct 11 07:01:53.429485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1321/2628] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:53 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:53.433925 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8ca9a992-885f-46bd-b526-045dff81a146 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:53.434529 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8ca9a992-885f-46bd-b526-045dff81a146 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:53.439384 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9bc28cb6-5a8e-4b12-a905-93f4e443a99c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:53.440289 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ca9a992-885f-46bd-b526-045dff81a146 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:53.440761 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ca9a992-885f-46bd-b526-045dff81a146 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:53.441383 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ca9a992-885f-46bd-b526-045dff81a146 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:53.442295 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ca9a992-885f-46bd-b526-045dff81a146 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:53.442747 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ca9a992-885f-46bd-b526-045dff81a146 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:53.443347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ca9a992-885f-46bd-b526-045dff81a146 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:53.448344 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9bc28cb6-5a8e-4b12-a905-93f4e443a99c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.160010 Oct 11 07:01:53.448911 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1308/2629] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:53 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:01:53.690018 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8ca9a992-885f-46bd-b526-045dff81a146 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:53.699169 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8ca9a992-885f-46bd-b526-045dff81a146 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.268681 Oct 11 07:01:53.699823 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1322/2630] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:53 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:54.453900 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-141012f8-949a-4c3b-b1d4-77c2c88b39c1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:54.454496 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-141012f8-949a-4c3b-b1d4-77c2c88b39c1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:54.460953 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-141012f8-949a-4c3b-b1d4-77c2c88b39c1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:54.461424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-141012f8-949a-4c3b-b1d4-77c2c88b39c1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:54.461848 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-141012f8-949a-4c3b-b1d4-77c2c88b39c1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:54.462525 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-141012f8-949a-4c3b-b1d4-77c2c88b39c1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:54.462968 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-141012f8-949a-4c3b-b1d4-77c2c88b39c1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:54.463382 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-141012f8-949a-4c3b-b1d4-77c2c88b39c1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:54.470956 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-329337d2-b334-4e6f-869b-aa0c37c36100 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:54.471634 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-329337d2-b334-4e6f-869b-aa0c37c36100 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:54.477983 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-329337d2-b334-4e6f-869b-aa0c37c36100 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:54.478454 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-329337d2-b334-4e6f-869b-aa0c37c36100 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:54.478881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-329337d2-b334-4e6f-869b-aa0c37c36100 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:54.479601 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-329337d2-b334-4e6f-869b-aa0c37c36100 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:54.480048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-329337d2-b334-4e6f-869b-aa0c37c36100 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:54.480469 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-329337d2-b334-4e6f-869b-aa0c37c36100 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:54.597823 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-141012f8-949a-4c3b-b1d4-77c2c88b39c1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:54.606525 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-141012f8-949a-4c3b-b1d4-77c2c88b39c1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:54.607984 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-141012f8-949a-4c3b-b1d4-77c2c88b39c1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:54.609144 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-141012f8-949a-4c3b-b1d4-77c2c88b39c1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.159117 Oct 11 07:01:54.612158 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-329337d2-b334-4e6f-869b-aa0c37c36100 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:54.620126 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1309/2631] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:54 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:54.621348 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-329337d2-b334-4e6f-869b-aa0c37c36100 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.154257 Oct 11 07:01:54.624901 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1323/2632] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:54 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:01:54.722893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a39f3c83-30d3-4dde-b366-42ddbaecfef5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:54.723512 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a39f3c83-30d3-4dde-b366-42ddbaecfef5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:54.729820 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a39f3c83-30d3-4dde-b366-42ddbaecfef5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:54.730296 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a39f3c83-30d3-4dde-b366-42ddbaecfef5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:54.730716 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a39f3c83-30d3-4dde-b366-42ddbaecfef5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:54.731392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a39f3c83-30d3-4dde-b366-42ddbaecfef5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:54.731856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a39f3c83-30d3-4dde-b366-42ddbaecfef5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:54.732446 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a39f3c83-30d3-4dde-b366-42ddbaecfef5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:54.857474 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a39f3c83-30d3-4dde-b366-42ddbaecfef5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:54.865491 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a39f3c83-30d3-4dde-b366-42ddbaecfef5 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.146393 Oct 11 07:01:54.866640 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1310/2633] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:54 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:55.644791 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-49ae2417-6f49-4e45-a0c7-5526ccddaca5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:55.645319 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4eb58703-177f-4248-ac8c-c108b448ead6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:55.645699 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4eb58703-177f-4248-ac8c-c108b448ead6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:55.646552 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-49ae2417-6f49-4e45-a0c7-5526ccddaca5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:55.652934 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4eb58703-177f-4248-ac8c-c108b448ead6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:55.653414 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4eb58703-177f-4248-ac8c-c108b448ead6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:55.653836 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4eb58703-177f-4248-ac8c-c108b448ead6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:55.653965 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49ae2417-6f49-4e45-a0c7-5526ccddaca5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:55.654450 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49ae2417-6f49-4e45-a0c7-5526ccddaca5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:55.654576 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4eb58703-177f-4248-ac8c-c108b448ead6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:55.654881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49ae2417-6f49-4e45-a0c7-5526ccddaca5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:55.655010 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4eb58703-177f-4248-ac8c-c108b448ead6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:55.655361 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4eb58703-177f-4248-ac8c-c108b448ead6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:55.655595 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49ae2417-6f49-4e45-a0c7-5526ccddaca5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:55.656055 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49ae2417-6f49-4e45-a0c7-5526ccddaca5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:55.656471 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49ae2417-6f49-4e45-a0c7-5526ccddaca5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:55.659478 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:01:55.791790 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4eb58703-177f-4248-ac8c-c108b448ead6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:55.795481 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-49ae2417-6f49-4e45-a0c7-5526ccddaca5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:55.800095 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4eb58703-177f-4248-ac8c-c108b448ead6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.159141 Oct 11 07:01:55.800664 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1311/2634] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:55 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:55.804900 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-49ae2417-6f49-4e45-a0c7-5526ccddaca5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:55.806316 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-49ae2417-6f49-4e45-a0c7-5526ccddaca5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:55.807588 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-49ae2417-6f49-4e45-a0c7-5526ccddaca5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.166605 Oct 11 07:01:55.808130 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1324/2635] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:55 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:55.889293 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-506e449b-614a-4f05-b291-540cc354a730 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:55.889936 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-506e449b-614a-4f05-b291-540cc354a730 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:55.895906 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-506e449b-614a-4f05-b291-540cc354a730 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:55.896388 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-506e449b-614a-4f05-b291-540cc354a730 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:55.896826 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-506e449b-614a-4f05-b291-540cc354a730 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:55.897582 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-506e449b-614a-4f05-b291-540cc354a730 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:55.898036 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-506e449b-614a-4f05-b291-540cc354a730 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:55.898463 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-506e449b-614a-4f05-b291-540cc354a730 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:56.027956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-506e449b-614a-4f05-b291-540cc354a730 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:56.036130 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-506e449b-614a-4f05-b291-540cc354a730 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.150836 Oct 11 07:01:56.036678 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1312/2636] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:55 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:56.823194 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-90f63bc6-7fc1-48a4-a054-798971d941cb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:56.823830 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-90f63bc6-7fc1-48a4-a054-798971d941cb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:56.830184 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-90f63bc6-7fc1-48a4-a054-798971d941cb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:56.830651 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-90f63bc6-7fc1-48a4-a054-798971d941cb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:56.831075 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-90f63bc6-7fc1-48a4-a054-798971d941cb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:56.831775 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-90f63bc6-7fc1-48a4-a054-798971d941cb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:56.832214 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-90f63bc6-7fc1-48a4-a054-798971d941cb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:56.832628 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-90f63bc6-7fc1-48a4-a054-798971d941cb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:56.833887 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5c59ee45-3027-418f-b739-c0d2248d2911 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:56.834537 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5c59ee45-3027-418f-b739-c0d2248d2911 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:56.841759 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5c59ee45-3027-418f-b739-c0d2248d2911 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:56.842260 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5c59ee45-3027-418f-b739-c0d2248d2911 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:56.842692 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5c59ee45-3027-418f-b739-c0d2248d2911 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:56.843384 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5c59ee45-3027-418f-b739-c0d2248d2911 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:56.843880 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5c59ee45-3027-418f-b739-c0d2248d2911 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:56.844304 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5c59ee45-3027-418f-b739-c0d2248d2911 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:56.962696 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-90f63bc6-7fc1-48a4-a054-798971d941cb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:56.970946 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-90f63bc6-7fc1-48a4-a054-798971d941cb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.151442 Oct 11 07:01:56.971536 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1325/2637] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:56 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:56.971843 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5c59ee45-3027-418f-b739-c0d2248d2911 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:56.980892 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5c59ee45-3027-418f-b739-c0d2248d2911 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:56.982390 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5c59ee45-3027-418f-b739-c0d2248d2911 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:56.983563 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5c59ee45-3027-418f-b739-c0d2248d2911 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.153577 Oct 11 07:01:56.984106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1313/2638] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:56 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:57.059250 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c88fe243-d9dd-4397-8baf-9ac7fdae5c8b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:57.059898 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c88fe243-d9dd-4397-8baf-9ac7fdae5c8b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:57.065703 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c88fe243-d9dd-4397-8baf-9ac7fdae5c8b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:57.066179 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c88fe243-d9dd-4397-8baf-9ac7fdae5c8b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:57.066610 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c88fe243-d9dd-4397-8baf-9ac7fdae5c8b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:57.067296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c88fe243-d9dd-4397-8baf-9ac7fdae5c8b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:57.067778 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c88fe243-d9dd-4397-8baf-9ac7fdae5c8b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:57.068202 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c88fe243-d9dd-4397-8baf-9ac7fdae5c8b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:57.196438 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c88fe243-d9dd-4397-8baf-9ac7fdae5c8b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:57.204567 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c88fe243-d9dd-4397-8baf-9ac7fdae5c8b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.149039 Oct 11 07:01:57.205136 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1326/2639] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:57 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:57.994641 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e625a3b2-468d-4e33-83c5-809303f8235f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:57.995257 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e625a3b2-468d-4e33-83c5-809303f8235f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:58.001665 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e625a3b2-468d-4e33-83c5-809303f8235f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:58.003680 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e625a3b2-468d-4e33-83c5-809303f8235f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:58.003680 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e625a3b2-468d-4e33-83c5-809303f8235f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:58.003680 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e625a3b2-468d-4e33-83c5-809303f8235f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:58.004031 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e625a3b2-468d-4e33-83c5-809303f8235f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:58.004256 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e625a3b2-468d-4e33-83c5-809303f8235f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:58.009197 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-afa07010-7c4f-440c-9c36-1de74c39f030 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:58.009765 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-afa07010-7c4f-440c-9c36-1de74c39f030 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:58.016238 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-afa07010-7c4f-440c-9c36-1de74c39f030 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:58.016713 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-afa07010-7c4f-440c-9c36-1de74c39f030 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:58.017193 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-afa07010-7c4f-440c-9c36-1de74c39f030 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:58.017860 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-afa07010-7c4f-440c-9c36-1de74c39f030 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:58.018308 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-afa07010-7c4f-440c-9c36-1de74c39f030 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:58.018726 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-afa07010-7c4f-440c-9c36-1de74c39f030 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:58.138351 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e625a3b2-468d-4e33-83c5-809303f8235f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:58.145367 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-afa07010-7c4f-440c-9c36-1de74c39f030 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:58.146732 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e625a3b2-468d-4e33-83c5-809303f8235f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.156359 Oct 11 07:01:58.147871 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1314/2640] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:57 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:58.154487 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-afa07010-7c4f-440c-9c36-1de74c39f030 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:58.155977 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-afa07010-7c4f-440c-9c36-1de74c39f030 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:58.157136 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-afa07010-7c4f-440c-9c36-1de74c39f030 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152127 Oct 11 07:01:58.157677 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1327/2641] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:58 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:01:58.229155 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-78d3a210-4eb4-4eaa-98a9-6b06be2cc254 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:58.229785 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-78d3a210-4eb4-4eaa-98a9-6b06be2cc254 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:58.235689 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78d3a210-4eb4-4eaa-98a9-6b06be2cc254 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:58.236166 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78d3a210-4eb4-4eaa-98a9-6b06be2cc254 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:58.236597 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78d3a210-4eb4-4eaa-98a9-6b06be2cc254 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:58.237280 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78d3a210-4eb4-4eaa-98a9-6b06be2cc254 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:58.237729 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78d3a210-4eb4-4eaa-98a9-6b06be2cc254 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:58.238148 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78d3a210-4eb4-4eaa-98a9-6b06be2cc254 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:58.362216 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-78d3a210-4eb4-4eaa-98a9-6b06be2cc254 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:58.370270 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-78d3a210-4eb4-4eaa-98a9-6b06be2cc254 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.145591 Oct 11 07:01:58.370930 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1315/2642] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:58 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:59.169923 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-450ed5ef-e18b-4a7f-b5a3-d03d344bc11e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:59.170523 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-450ed5ef-e18b-4a7f-b5a3-d03d344bc11e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:59.176875 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-450ed5ef-e18b-4a7f-b5a3-d03d344bc11e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:59.177339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-450ed5ef-e18b-4a7f-b5a3-d03d344bc11e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:59.177761 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-450ed5ef-e18b-4a7f-b5a3-d03d344bc11e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:59.178432 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-450ed5ef-e18b-4a7f-b5a3-d03d344bc11e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:59.178873 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-450ed5ef-e18b-4a7f-b5a3-d03d344bc11e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:59.179287 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-450ed5ef-e18b-4a7f-b5a3-d03d344bc11e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:59.182568 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c2c44d82-d0e0-4044-8939-194fabc48cd0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:59.183178 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c2c44d82-d0e0-4044-8939-194fabc48cd0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:59.189583 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c2c44d82-d0e0-4044-8939-194fabc48cd0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:59.190057 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c2c44d82-d0e0-4044-8939-194fabc48cd0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:59.190523 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c2c44d82-d0e0-4044-8939-194fabc48cd0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:59.191214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c2c44d82-d0e0-4044-8939-194fabc48cd0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:59.191689 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c2c44d82-d0e0-4044-8939-194fabc48cd0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:59.192112 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c2c44d82-d0e0-4044-8939-194fabc48cd0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:59.318834 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-450ed5ef-e18b-4a7f-b5a3-d03d344bc11e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:59.329208 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-450ed5ef-e18b-4a7f-b5a3-d03d344bc11e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.163032 Oct 11 07:01:59.329767 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1328/2643] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:59 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:01:59.330359 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c2c44d82-d0e0-4044-8939-194fabc48cd0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:59.339745 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c2c44d82-d0e0-4044-8939-194fabc48cd0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:59.341180 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c2c44d82-d0e0-4044-8939-194fabc48cd0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:59.342327 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c2c44d82-d0e0-4044-8939-194fabc48cd0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.163725 Oct 11 07:01:59.343207 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1316/2644] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:01:59 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:01:59.393869 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-88fd7749-85d9-4584-b47b-81c02928549d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:01:59.394473 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-88fd7749-85d9-4584-b47b-81c02928549d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:01:59.400817 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-88fd7749-85d9-4584-b47b-81c02928549d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:59.401294 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-88fd7749-85d9-4584-b47b-81c02928549d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:59.401843 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-88fd7749-85d9-4584-b47b-81c02928549d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:59.402535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-88fd7749-85d9-4584-b47b-81c02928549d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:01:59.402975 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-88fd7749-85d9-4584-b47b-81c02928549d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:01:59.403608 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-88fd7749-85d9-4584-b47b-81c02928549d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:01:59.534480 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-88fd7749-85d9-4584-b47b-81c02928549d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:01:59.542437 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-88fd7749-85d9-4584-b47b-81c02928549d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.152802 Oct 11 07:01:59.542991 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1329/2645] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:01:59 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:00.353562 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-35dc2916-64df-432c-b1be-1b34e7efeecd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:00.354168 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-35dc2916-64df-432c-b1be-1b34e7efeecd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:00.360617 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-35dc2916-64df-432c-b1be-1b34e7efeecd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:00.361120 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-35dc2916-64df-432c-b1be-1b34e7efeecd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:00.361548 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-35dc2916-64df-432c-b1be-1b34e7efeecd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:00.362231 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-35dc2916-64df-432c-b1be-1b34e7efeecd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:00.362679 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-35dc2916-64df-432c-b1be-1b34e7efeecd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:00.363097 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-35dc2916-64df-432c-b1be-1b34e7efeecd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:00.367717 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8df0a772-8ea7-4b15-8181-925fb9329914 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:00.368320 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8df0a772-8ea7-4b15-8181-925fb9329914 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:00.374621 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8df0a772-8ea7-4b15-8181-925fb9329914 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:00.375030 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8df0a772-8ea7-4b15-8181-925fb9329914 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:00.375481 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8df0a772-8ea7-4b15-8181-925fb9329914 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:00.376160 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8df0a772-8ea7-4b15-8181-925fb9329914 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:00.376601 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8df0a772-8ea7-4b15-8181-925fb9329914 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:00.377013 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8df0a772-8ea7-4b15-8181-925fb9329914 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:00.491390 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-35dc2916-64df-432c-b1be-1b34e7efeecd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:00.499498 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-35dc2916-64df-432c-b1be-1b34e7efeecd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.149805 Oct 11 07:02:00.500055 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1317/2646] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:00 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:00.504811 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8df0a772-8ea7-4b15-8181-925fb9329914 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:00.514113 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8df0a772-8ea7-4b15-8181-925fb9329914 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:00.515722 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8df0a772-8ea7-4b15-8181-925fb9329914 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:00.516950 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8df0a772-8ea7-4b15-8181-925fb9329914 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.153539 Oct 11 07:02:00.517496 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1330/2647] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:00 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:02:00.565797 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8e217783-d78d-4f9f-8134-ddf2a37846eb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:00.566398 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8e217783-d78d-4f9f-8134-ddf2a37846eb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:00.572789 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e217783-d78d-4f9f-8134-ddf2a37846eb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:00.573262 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e217783-d78d-4f9f-8134-ddf2a37846eb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:00.573682 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e217783-d78d-4f9f-8134-ddf2a37846eb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:00.574358 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e217783-d78d-4f9f-8134-ddf2a37846eb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:00.574801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e217783-d78d-4f9f-8134-ddf2a37846eb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:00.575218 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e217783-d78d-4f9f-8134-ddf2a37846eb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:00.701091 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8e217783-d78d-4f9f-8134-ddf2a37846eb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:00.709172 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8e217783-d78d-4f9f-8134-ddf2a37846eb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.147120 Oct 11 07:02:00.710342 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1318/2648] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:00 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:01.523567 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a9aac1d5-613c-4bd1-b7e4-a895996cc1a7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:01.524178 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a9aac1d5-613c-4bd1-b7e4-a895996cc1a7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:01.530607 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9aac1d5-613c-4bd1-b7e4-a895996cc1a7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:01.531081 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9aac1d5-613c-4bd1-b7e4-a895996cc1a7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:01.531548 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9aac1d5-613c-4bd1-b7e4-a895996cc1a7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:01.532217 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9aac1d5-613c-4bd1-b7e4-a895996cc1a7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:01.532660 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9aac1d5-613c-4bd1-b7e4-a895996cc1a7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:01.533079 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9aac1d5-613c-4bd1-b7e4-a895996cc1a7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:01.541498 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-26737f65-d435-4d21-a56d-2ba3e30c1200 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:01.542144 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-26737f65-d435-4d21-a56d-2ba3e30c1200 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:01.548495 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26737f65-d435-4d21-a56d-2ba3e30c1200 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:01.548976 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26737f65-d435-4d21-a56d-2ba3e30c1200 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:01.549415 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26737f65-d435-4d21-a56d-2ba3e30c1200 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:01.550204 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26737f65-d435-4d21-a56d-2ba3e30c1200 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:01.550564 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26737f65-d435-4d21-a56d-2ba3e30c1200 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:01.550991 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26737f65-d435-4d21-a56d-2ba3e30c1200 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:01.551278 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:02:01.665635 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a9aac1d5-613c-4bd1-b7e4-a895996cc1a7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:01.673798 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a9aac1d5-613c-4bd1-b7e4-a895996cc1a7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.154178 Oct 11 07:02:01.674366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1331/2649] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:01 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:01.685554 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-26737f65-d435-4d21-a56d-2ba3e30c1200 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:01.694072 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-26737f65-d435-4d21-a56d-2ba3e30c1200 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:01.695538 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-26737f65-d435-4d21-a56d-2ba3e30c1200 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:01.696725 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-26737f65-d435-4d21-a56d-2ba3e30c1200 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.159569 Oct 11 07:02:01.697277 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1319/2650] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:01 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:02:01.732762 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8b596326-7219-45fb-90f6-1bd1932946e3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:01.733370 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8b596326-7219-45fb-90f6-1bd1932946e3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:01.739228 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8b596326-7219-45fb-90f6-1bd1932946e3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:01.739734 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8b596326-7219-45fb-90f6-1bd1932946e3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:01.740169 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8b596326-7219-45fb-90f6-1bd1932946e3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:01.741500 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8b596326-7219-45fb-90f6-1bd1932946e3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:01.741955 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8b596326-7219-45fb-90f6-1bd1932946e3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:01.742378 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8b596326-7219-45fb-90f6-1bd1932946e3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:01.869657 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8b596326-7219-45fb-90f6-1bd1932946e3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:01.877765 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8b596326-7219-45fb-90f6-1bd1932946e3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.148755 Oct 11 07:02:01.878329 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1332/2651] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:01 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:02.697261 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ed646f5e-e1dd-44fe-8b2e-5e6ab93dc0b8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:02.697894 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ed646f5e-e1dd-44fe-8b2e-5e6ab93dc0b8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:02.704444 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ed646f5e-e1dd-44fe-8b2e-5e6ab93dc0b8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:02.704913 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ed646f5e-e1dd-44fe-8b2e-5e6ab93dc0b8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:02.705342 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ed646f5e-e1dd-44fe-8b2e-5e6ab93dc0b8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:02.706014 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ed646f5e-e1dd-44fe-8b2e-5e6ab93dc0b8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:02.706459 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ed646f5e-e1dd-44fe-8b2e-5e6ab93dc0b8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:02.706872 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ed646f5e-e1dd-44fe-8b2e-5e6ab93dc0b8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:02.721695 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ae92511f-364c-4311-97be-3f3d7e8f1e45 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:02.722303 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ae92511f-364c-4311-97be-3f3d7e8f1e45 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:02.729186 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ae92511f-364c-4311-97be-3f3d7e8f1e45 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:02.729662 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ae92511f-364c-4311-97be-3f3d7e8f1e45 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:02.730101 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ae92511f-364c-4311-97be-3f3d7e8f1e45 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:02.730791 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ae92511f-364c-4311-97be-3f3d7e8f1e45 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:02.731238 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ae92511f-364c-4311-97be-3f3d7e8f1e45 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:02.731684 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ae92511f-364c-4311-97be-3f3d7e8f1e45 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:02.838777 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ed646f5e-e1dd-44fe-8b2e-5e6ab93dc0b8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:02.848008 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ed646f5e-e1dd-44fe-8b2e-5e6ab93dc0b8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.154447 Oct 11 07:02:02.848580 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1320/2652] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:02 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:02.865059 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ae92511f-364c-4311-97be-3f3d7e8f1e45 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:02.873521 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ae92511f-364c-4311-97be-3f3d7e8f1e45 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:02.874966 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ae92511f-364c-4311-97be-3f3d7e8f1e45 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:02.876131 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ae92511f-364c-4311-97be-3f3d7e8f1e45 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.158281 Oct 11 07:02:02.876677 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1333/2653] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:02 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:02:02.901821 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-14fb931c-d834-403c-9b36-63818dcf56da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:02.902458 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-14fb931c-d834-403c-9b36-63818dcf56da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:02.908479 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14fb931c-d834-403c-9b36-63818dcf56da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:02.908955 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14fb931c-d834-403c-9b36-63818dcf56da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:02.909390 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14fb931c-d834-403c-9b36-63818dcf56da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:02.910074 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14fb931c-d834-403c-9b36-63818dcf56da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:02.910523 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14fb931c-d834-403c-9b36-63818dcf56da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:02.910941 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-14fb931c-d834-403c-9b36-63818dcf56da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:03.264589 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-14fb931c-d834-403c-9b36-63818dcf56da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:03.273405 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-14fb931c-d834-403c-9b36-63818dcf56da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.375396 Oct 11 07:02:03.273971 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1321/2654] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:02 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:03.872851 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c7d9a7dc-ccfc-4837-85ca-9803388ea163 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:03.873459 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c7d9a7dc-ccfc-4837-85ca-9803388ea163 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:03.879917 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c7d9a7dc-ccfc-4837-85ca-9803388ea163 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:03.880388 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c7d9a7dc-ccfc-4837-85ca-9803388ea163 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:03.880810 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c7d9a7dc-ccfc-4837-85ca-9803388ea163 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:03.881483 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c7d9a7dc-ccfc-4837-85ca-9803388ea163 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:03.881922 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c7d9a7dc-ccfc-4837-85ca-9803388ea163 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:03.882332 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c7d9a7dc-ccfc-4837-85ca-9803388ea163 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:03.901540 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e76b3a72-7fa6-4e47-bf7e-c8131cad31fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:03.902155 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e76b3a72-7fa6-4e47-bf7e-c8131cad31fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:03.908564 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e76b3a72-7fa6-4e47-bf7e-c8131cad31fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:03.909050 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e76b3a72-7fa6-4e47-bf7e-c8131cad31fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:03.909487 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e76b3a72-7fa6-4e47-bf7e-c8131cad31fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:03.910181 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e76b3a72-7fa6-4e47-bf7e-c8131cad31fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:03.910638 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e76b3a72-7fa6-4e47-bf7e-c8131cad31fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:03.911065 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e76b3a72-7fa6-4e47-bf7e-c8131cad31fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:04.009457 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c7d9a7dc-ccfc-4837-85ca-9803388ea163 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:04.018011 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c7d9a7dc-ccfc-4837-85ca-9803388ea163 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.149043 Oct 11 07:02:04.018571 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1334/2655] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:03 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:04.038835 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e76b3a72-7fa6-4e47-bf7e-c8131cad31fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:04.047395 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e76b3a72-7fa6-4e47-bf7e-c8131cad31fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:04.048858 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e76b3a72-7fa6-4e47-bf7e-c8131cad31fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:04.050039 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e76b3a72-7fa6-4e47-bf7e-c8131cad31fe tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152338 Oct 11 07:02:04.050586 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1322/2656] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:03 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:02:04.296655 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2fdfbf9b-ce46-4549-8ae8-cc716194995d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:04.297279 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2fdfbf9b-ce46-4549-8ae8-cc716194995d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:04.303070 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2fdfbf9b-ce46-4549-8ae8-cc716194995d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:04.303574 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2fdfbf9b-ce46-4549-8ae8-cc716194995d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:04.303998 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2fdfbf9b-ce46-4549-8ae8-cc716194995d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:04.304666 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2fdfbf9b-ce46-4549-8ae8-cc716194995d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:04.305111 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2fdfbf9b-ce46-4549-8ae8-cc716194995d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:04.305520 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2fdfbf9b-ce46-4549-8ae8-cc716194995d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:04.432180 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2fdfbf9b-ce46-4549-8ae8-cc716194995d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:04.440757 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2fdfbf9b-ce46-4549-8ae8-cc716194995d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.147981 Oct 11 07:02:04.441358 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1335/2657] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:04 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:05.040598 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-026efd8e-edf1-43e4-8c71-1a13e67f1dcb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:05.041216 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-026efd8e-edf1-43e4-8c71-1a13e67f1dcb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:05.047701 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-026efd8e-edf1-43e4-8c71-1a13e67f1dcb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:05.048180 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-026efd8e-edf1-43e4-8c71-1a13e67f1dcb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:05.048613 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-026efd8e-edf1-43e4-8c71-1a13e67f1dcb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:05.049303 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-026efd8e-edf1-43e4-8c71-1a13e67f1dcb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:05.049749 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-026efd8e-edf1-43e4-8c71-1a13e67f1dcb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:05.050176 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-026efd8e-edf1-43e4-8c71-1a13e67f1dcb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:05.075898 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1bca236d-4ca4-4c8b-990d-ab6ff40471f3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:05.076500 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1bca236d-4ca4-4c8b-990d-ab6ff40471f3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:05.082782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1bca236d-4ca4-4c8b-990d-ab6ff40471f3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:05.083249 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1bca236d-4ca4-4c8b-990d-ab6ff40471f3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:05.083736 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1bca236d-4ca4-4c8b-990d-ab6ff40471f3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:05.084399 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1bca236d-4ca4-4c8b-990d-ab6ff40471f3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:05.084837 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1bca236d-4ca4-4c8b-990d-ab6ff40471f3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:05.085246 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1bca236d-4ca4-4c8b-990d-ab6ff40471f3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:05.187624 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-026efd8e-edf1-43e4-8c71-1a13e67f1dcb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:05.196063 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-026efd8e-edf1-43e4-8c71-1a13e67f1dcb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.159235 Oct 11 07:02:05.197742 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1323/2658] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:05 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:05.218311 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1bca236d-4ca4-4c8b-990d-ab6ff40471f3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:05.227275 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1bca236d-4ca4-4c8b-990d-ab6ff40471f3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:05.228744 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1bca236d-4ca4-4c8b-990d-ab6ff40471f3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:05.229903 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1bca236d-4ca4-4c8b-990d-ab6ff40471f3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.157883 Oct 11 07:02:05.230449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1336/2659] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:05 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:02:05.464308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0bcdbe10-f8d9-4cd3-9147-3af669f509ad tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:05.464910 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0bcdbe10-f8d9-4cd3-9147-3af669f509ad tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:05.471106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0bcdbe10-f8d9-4cd3-9147-3af669f509ad tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:05.471688 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0bcdbe10-f8d9-4cd3-9147-3af669f509ad tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:05.472115 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0bcdbe10-f8d9-4cd3-9147-3af669f509ad tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:05.472797 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0bcdbe10-f8d9-4cd3-9147-3af669f509ad tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:05.473238 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0bcdbe10-f8d9-4cd3-9147-3af669f509ad tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:05.473651 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0bcdbe10-f8d9-4cd3-9147-3af669f509ad tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:05.597910 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0bcdbe10-f8d9-4cd3-9147-3af669f509ad tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:05.606597 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0bcdbe10-f8d9-4cd3-9147-3af669f509ad tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.146054 Oct 11 07:02:05.607154 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1324/2660] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:05 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:06.219197 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8c7d16a6-0805-42b5-9e10-aa6efd091bcd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:06.219842 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8c7d16a6-0805-42b5-9e10-aa6efd091bcd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:06.226067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c7d16a6-0805-42b5-9e10-aa6efd091bcd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:06.226544 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c7d16a6-0805-42b5-9e10-aa6efd091bcd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:06.226973 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c7d16a6-0805-42b5-9e10-aa6efd091bcd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:06.227682 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c7d16a6-0805-42b5-9e10-aa6efd091bcd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:06.228130 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c7d16a6-0805-42b5-9e10-aa6efd091bcd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:06.228564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8c7d16a6-0805-42b5-9e10-aa6efd091bcd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:06.257311 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-dfceae08-9178-4904-9a8f-c42f292e5e43 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:06.257925 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-dfceae08-9178-4904-9a8f-c42f292e5e43 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:06.265420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dfceae08-9178-4904-9a8f-c42f292e5e43 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:06.265922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dfceae08-9178-4904-9a8f-c42f292e5e43 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:06.266349 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dfceae08-9178-4904-9a8f-c42f292e5e43 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:06.267041 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dfceae08-9178-4904-9a8f-c42f292e5e43 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:06.268048 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dfceae08-9178-4904-9a8f-c42f292e5e43 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:06.268048 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dfceae08-9178-4904-9a8f-c42f292e5e43 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:06.357414 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8c7d16a6-0805-42b5-9e10-aa6efd091bcd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:06.366141 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8c7d16a6-0805-42b5-9e10-aa6efd091bcd tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150193 Oct 11 07:02:06.366711 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1337/2661] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:06 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:06.397502 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-dfceae08-9178-4904-9a8f-c42f292e5e43 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:06.406087 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-dfceae08-9178-4904-9a8f-c42f292e5e43 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:06.407890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-dfceae08-9178-4904-9a8f-c42f292e5e43 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:06.409076 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-dfceae08-9178-4904-9a8f-c42f292e5e43 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.157161 Oct 11 07:02:06.409624 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1325/2662] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:06 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:02:06.629024 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-83a3016b-bc0a-4d46-8157-982b20f34517 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:06.629632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-83a3016b-bc0a-4d46-8157-982b20f34517 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:06.636439 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-83a3016b-bc0a-4d46-8157-982b20f34517 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:06.636910 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-83a3016b-bc0a-4d46-8157-982b20f34517 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:06.637339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-83a3016b-bc0a-4d46-8157-982b20f34517 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:06.638274 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-83a3016b-bc0a-4d46-8157-982b20f34517 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:06.638714 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-83a3016b-bc0a-4d46-8157-982b20f34517 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:06.639130 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-83a3016b-bc0a-4d46-8157-982b20f34517 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:06.768137 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-83a3016b-bc0a-4d46-8157-982b20f34517 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:06.776209 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-83a3016b-bc0a-4d46-8157-982b20f34517 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.150992 Oct 11 07:02:06.776760 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1338/2663] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:06 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:02:07.389799 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-849fcc9a-adeb-4479-a5ec-b3c7889512df tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:07.390404 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-849fcc9a-adeb-4479-a5ec-b3c7889512df tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:07.396826 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-849fcc9a-adeb-4479-a5ec-b3c7889512df tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:07.397296 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-849fcc9a-adeb-4479-a5ec-b3c7889512df tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:07.398226 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-849fcc9a-adeb-4479-a5ec-b3c7889512df tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:07.398908 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-849fcc9a-adeb-4479-a5ec-b3c7889512df tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:07.399347 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-849fcc9a-adeb-4479-a5ec-b3c7889512df tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:07.399787 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-849fcc9a-adeb-4479-a5ec-b3c7889512df tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:07.434807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0a65f37c-a868-4540-a29b-3d075b739a7c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:07.435327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0a65f37c-a868-4540-a29b-3d075b739a7c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:07.442424 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0a65f37c-a868-4540-a29b-3d075b739a7c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:07.442552 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0a65f37c-a868-4540-a29b-3d075b739a7c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:07.442953 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0a65f37c-a868-4540-a29b-3d075b739a7c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:07.443688 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0a65f37c-a868-4540-a29b-3d075b739a7c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:07.444140 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0a65f37c-a868-4540-a29b-3d075b739a7c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:07.445301 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0a65f37c-a868-4540-a29b-3d075b739a7c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:07.541542 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-849fcc9a-adeb-4479-a5ec-b3c7889512df tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:07.544590 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-849fcc9a-adeb-4479-a5ec-b3c7889512df tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.158783 Oct 11 07:02:07.545383 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1326/2664] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:07 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:07.580191 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0a65f37c-a868-4540-a29b-3d075b739a7c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:07.589367 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0a65f37c-a868-4540-a29b-3d075b739a7c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:07.590793 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0a65f37c-a868-4540-a29b-3d075b739a7c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:07.591972 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0a65f37c-a868-4540-a29b-3d075b739a7c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.161824 Oct 11 07:02:07.592513 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1339/2665] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:07 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:02:07.800475 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-99ca06d9-90ed-46a8-910b-083ccc34346d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:07.800981 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-99ca06d9-90ed-46a8-910b-083ccc34346d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:07.807634 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99ca06d9-90ed-46a8-910b-083ccc34346d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:07.808113 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99ca06d9-90ed-46a8-910b-083ccc34346d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:07.808544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99ca06d9-90ed-46a8-910b-083ccc34346d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:07.809233 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99ca06d9-90ed-46a8-910b-083ccc34346d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:07.809679 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99ca06d9-90ed-46a8-910b-083ccc34346d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:07.810099 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99ca06d9-90ed-46a8-910b-083ccc34346d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:07.940465 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-99ca06d9-90ed-46a8-910b-083ccc34346d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:07.944060 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:02:07.950545 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-99ca06d9-90ed-46a8-910b-083ccc34346d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.153953 Oct 11 07:02:07.951198 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1327/2666] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:07 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:08.567277 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f31a90d1-eada-4d0f-9b8a-9aa31cb036a6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:08.567928 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f31a90d1-eada-4d0f-9b8a-9aa31cb036a6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:08.574239 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f31a90d1-eada-4d0f-9b8a-9aa31cb036a6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:08.574754 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f31a90d1-eada-4d0f-9b8a-9aa31cb036a6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:08.575303 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f31a90d1-eada-4d0f-9b8a-9aa31cb036a6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:08.575846 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f31a90d1-eada-4d0f-9b8a-9aa31cb036a6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:08.576296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f31a90d1-eada-4d0f-9b8a-9aa31cb036a6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:08.576717 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f31a90d1-eada-4d0f-9b8a-9aa31cb036a6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:08.616888 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a7f2f04a-0549-4ee2-b7d7-727a8565468c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:08.617452 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a7f2f04a-0549-4ee2-b7d7-727a8565468c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:08.623846 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a7f2f04a-0549-4ee2-b7d7-727a8565468c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:08.624328 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a7f2f04a-0549-4ee2-b7d7-727a8565468c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:08.624759 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a7f2f04a-0549-4ee2-b7d7-727a8565468c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:08.625451 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a7f2f04a-0549-4ee2-b7d7-727a8565468c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:08.625897 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a7f2f04a-0549-4ee2-b7d7-727a8565468c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:08.626319 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a7f2f04a-0549-4ee2-b7d7-727a8565468c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:08.707434 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f31a90d1-eada-4d0f-9b8a-9aa31cb036a6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:08.717597 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f31a90d1-eada-4d0f-9b8a-9aa31cb036a6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.153958 Oct 11 07:02:08.718269 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1340/2667] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:08 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:08.758438 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a7f2f04a-0549-4ee2-b7d7-727a8565468c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:08.767276 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a7f2f04a-0549-4ee2-b7d7-727a8565468c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:08.768828 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a7f2f04a-0549-4ee2-b7d7-727a8565468c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:08.769966 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a7f2f04a-0549-4ee2-b7d7-727a8565468c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.157101 Oct 11 07:02:08.770511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1328/2668] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:08 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:02:08.974101 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-199c8a00-625e-416f-8983-8ce7825eacfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:08.974626 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-199c8a00-625e-416f-8983-8ce7825eacfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:08.980511 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-199c8a00-625e-416f-8983-8ce7825eacfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:08.980979 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-199c8a00-625e-416f-8983-8ce7825eacfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:08.981401 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-199c8a00-625e-416f-8983-8ce7825eacfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:08.982077 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-199c8a00-625e-416f-8983-8ce7825eacfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:08.982576 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-199c8a00-625e-416f-8983-8ce7825eacfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:08.983018 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-199c8a00-625e-416f-8983-8ce7825eacfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:09.108063 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-199c8a00-625e-416f-8983-8ce7825eacfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:09.116093 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-199c8a00-625e-416f-8983-8ce7825eacfd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.145930 Oct 11 07:02:09.116640 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1341/2669] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:08 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:09.741906 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-074b266b-09e7-4975-8e41-84d240394529 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:09.742509 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-074b266b-09e7-4975-8e41-84d240394529 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:09.748873 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-074b266b-09e7-4975-8e41-84d240394529 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:09.749377 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-074b266b-09e7-4975-8e41-84d240394529 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:09.749807 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-074b266b-09e7-4975-8e41-84d240394529 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:09.750482 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-074b266b-09e7-4975-8e41-84d240394529 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:09.750922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-074b266b-09e7-4975-8e41-84d240394529 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:09.751335 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-074b266b-09e7-4975-8e41-84d240394529 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:09.797143 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-dd94812a-a159-4860-83d4-e09ee5b72b5d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:09.797721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-dd94812a-a159-4860-83d4-e09ee5b72b5d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:09.799980 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=76 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:02:09.805189 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dd94812a-a159-4860-83d4-e09ee5b72b5d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:09.805685 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dd94812a-a159-4860-83d4-e09ee5b72b5d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:09.806105 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dd94812a-a159-4860-83d4-e09ee5b72b5d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:09.806790 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dd94812a-a159-4860-83d4-e09ee5b72b5d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:09.807236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dd94812a-a159-4860-83d4-e09ee5b72b5d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:09.807791 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dd94812a-a159-4860-83d4-e09ee5b72b5d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:09.880454 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-074b266b-09e7-4975-8e41-84d240394529 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:09.889914 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-074b266b-09e7-4975-8e41-84d240394529 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.151808 Oct 11 07:02:09.890484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1329/2670] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:09 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:09.935114 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-dd94812a-a159-4860-83d4-e09ee5b72b5d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:09.943901 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-dd94812a-a159-4860-83d4-e09ee5b72b5d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:09.945916 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-dd94812a-a159-4860-83d4-e09ee5b72b5d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:09.947104 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-dd94812a-a159-4860-83d4-e09ee5b72b5d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.153876 Oct 11 07:02:09.947690 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1342/2671] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:09 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:02:10.140098 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7c1bb7e2-e4a6-43d3-915e-ab072032008b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:10.140710 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7c1bb7e2-e4a6-43d3-915e-ab072032008b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:10.146618 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7c1bb7e2-e4a6-43d3-915e-ab072032008b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:10.147094 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7c1bb7e2-e4a6-43d3-915e-ab072032008b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:10.147569 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7c1bb7e2-e4a6-43d3-915e-ab072032008b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:10.148254 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7c1bb7e2-e4a6-43d3-915e-ab072032008b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:10.148702 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7c1bb7e2-e4a6-43d3-915e-ab072032008b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:10.149123 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7c1bb7e2-e4a6-43d3-915e-ab072032008b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:10.274842 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7c1bb7e2-e4a6-43d3-915e-ab072032008b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:10.282934 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7c1bb7e2-e4a6-43d3-915e-ab072032008b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.146930 Oct 11 07:02:10.283511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1330/2672] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:10 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:10.913570 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6ac3eab4-8678-461e-bce0-34daa3931e5c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:10.914118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6ac3eab4-8678-461e-bce0-34daa3931e5c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:10.921276 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6ac3eab4-8678-461e-bce0-34daa3931e5c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:10.921753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6ac3eab4-8678-461e-bce0-34daa3931e5c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:10.922181 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6ac3eab4-8678-461e-bce0-34daa3931e5c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:10.922868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6ac3eab4-8678-461e-bce0-34daa3931e5c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:10.923314 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6ac3eab4-8678-461e-bce0-34daa3931e5c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:10.923765 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6ac3eab4-8678-461e-bce0-34daa3931e5c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:10.973060 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-13480767-e8d4-40cf-b21d-f0abccd58e0a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:10.973673 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-13480767-e8d4-40cf-b21d-f0abccd58e0a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:10.980801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13480767-e8d4-40cf-b21d-f0abccd58e0a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:10.981276 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13480767-e8d4-40cf-b21d-f0abccd58e0a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:10.981708 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13480767-e8d4-40cf-b21d-f0abccd58e0a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:10.982393 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13480767-e8d4-40cf-b21d-f0abccd58e0a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:10.982841 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13480767-e8d4-40cf-b21d-f0abccd58e0a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:10.983282 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13480767-e8d4-40cf-b21d-f0abccd58e0a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:11.054756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6ac3eab4-8678-461e-bce0-34daa3931e5c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:11.062985 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6ac3eab4-8678-461e-bce0-34daa3931e5c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.153303 Oct 11 07:02:11.063570 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1343/2673] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:10 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:11.113103 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-13480767-e8d4-40cf-b21d-f0abccd58e0a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:11.121567 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-13480767-e8d4-40cf-b21d-f0abccd58e0a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:11.123003 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-13480767-e8d4-40cf-b21d-f0abccd58e0a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:11.124182 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-13480767-e8d4-40cf-b21d-f0abccd58e0a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.155010 Oct 11 07:02:11.124735 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1331/2674] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:10 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:02:11.306204 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d5e313d5-fc5e-4168-b8e6-2d3e7671d7ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:11.306726 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d5e313d5-fc5e-4168-b8e6-2d3e7671d7ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:11.312580 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d5e313d5-fc5e-4168-b8e6-2d3e7671d7ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:11.313048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d5e313d5-fc5e-4168-b8e6-2d3e7671d7ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:11.313472 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d5e313d5-fc5e-4168-b8e6-2d3e7671d7ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:11.314140 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d5e313d5-fc5e-4168-b8e6-2d3e7671d7ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:11.314577 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d5e313d5-fc5e-4168-b8e6-2d3e7671d7ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:11.314991 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d5e313d5-fc5e-4168-b8e6-2d3e7671d7ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:11.439828 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d5e313d5-fc5e-4168-b8e6-2d3e7671d7ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:11.448415 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d5e313d5-fc5e-4168-b8e6-2d3e7671d7ac tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.146223 Oct 11 07:02:11.448960 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1344/2675] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:11 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:12.085947 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f06c3e1e-913c-433d-8910-bcea7944f7c4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:12.086484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f06c3e1e-913c-433d-8910-bcea7944f7c4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:12.092855 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f06c3e1e-913c-433d-8910-bcea7944f7c4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:12.093329 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f06c3e1e-913c-433d-8910-bcea7944f7c4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:12.093758 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f06c3e1e-913c-433d-8910-bcea7944f7c4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:12.094441 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f06c3e1e-913c-433d-8910-bcea7944f7c4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:12.094890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f06c3e1e-913c-433d-8910-bcea7944f7c4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:12.095311 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f06c3e1e-913c-433d-8910-bcea7944f7c4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:12.149765 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3caf0135-a134-4f3b-a2ba-d4972bfa37c5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:12.150365 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3caf0135-a134-4f3b-a2ba-d4972bfa37c5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:12.156702 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3caf0135-a134-4f3b-a2ba-d4972bfa37c5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:12.157170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3caf0135-a134-4f3b-a2ba-d4972bfa37c5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:12.157590 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3caf0135-a134-4f3b-a2ba-d4972bfa37c5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:12.158276 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3caf0135-a134-4f3b-a2ba-d4972bfa37c5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:12.158714 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3caf0135-a134-4f3b-a2ba-d4972bfa37c5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:12.159126 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3caf0135-a134-4f3b-a2ba-d4972bfa37c5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:12.222543 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f06c3e1e-913c-433d-8910-bcea7944f7c4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:12.231935 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f06c3e1e-913c-433d-8910-bcea7944f7c4 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.149473 Oct 11 07:02:12.232495 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1332/2676] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:12 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:12.291822 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3caf0135-a134-4f3b-a2ba-d4972bfa37c5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:12.300339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3caf0135-a134-4f3b-a2ba-d4972bfa37c5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:12.301759 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3caf0135-a134-4f3b-a2ba-d4972bfa37c5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:12.302905 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3caf0135-a134-4f3b-a2ba-d4972bfa37c5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.157079 Oct 11 07:02:12.303470 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1345/2677] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:12 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:02:12.472428 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-17c383a1-a8b3-482c-9826-b3e73c5a168e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:12.473043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-17c383a1-a8b3-482c-9826-b3e73c5a168e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:12.479644 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17c383a1-a8b3-482c-9826-b3e73c5a168e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:12.480124 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17c383a1-a8b3-482c-9826-b3e73c5a168e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:12.480558 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17c383a1-a8b3-482c-9826-b3e73c5a168e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:12.481276 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17c383a1-a8b3-482c-9826-b3e73c5a168e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:12.481727 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17c383a1-a8b3-482c-9826-b3e73c5a168e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:12.482150 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17c383a1-a8b3-482c-9826-b3e73c5a168e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:12.610273 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-17c383a1-a8b3-482c-9826-b3e73c5a168e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:12.619107 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-17c383a1-a8b3-482c-9826-b3e73c5a168e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.150573 Oct 11 07:02:12.619692 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1333/2678] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:12 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:13.255164 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5a3133d9-23f2-43ed-866b-abbbeb653385 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:13.255833 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5a3133d9-23f2-43ed-866b-abbbeb653385 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:13.263038 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5a3133d9-23f2-43ed-866b-abbbeb653385 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:13.263555 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5a3133d9-23f2-43ed-866b-abbbeb653385 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:13.263983 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5a3133d9-23f2-43ed-866b-abbbeb653385 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:13.264667 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5a3133d9-23f2-43ed-866b-abbbeb653385 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:13.265108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5a3133d9-23f2-43ed-866b-abbbeb653385 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:13.265526 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5a3133d9-23f2-43ed-866b-abbbeb653385 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:13.328249 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e6e1c270-a24b-437b-808b-451aa9e16e35 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:13.328967 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e6e1c270-a24b-437b-808b-451aa9e16e35 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:13.335556 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e6e1c270-a24b-437b-808b-451aa9e16e35 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:13.336038 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e6e1c270-a24b-437b-808b-451aa9e16e35 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:13.336491 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e6e1c270-a24b-437b-808b-451aa9e16e35 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:13.337176 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e6e1c270-a24b-437b-808b-451aa9e16e35 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:13.337624 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e6e1c270-a24b-437b-808b-451aa9e16e35 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:13.338046 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e6e1c270-a24b-437b-808b-451aa9e16e35 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:13.393956 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5a3133d9-23f2-43ed-866b-abbbeb653385 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:13.402455 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5a3133d9-23f2-43ed-866b-abbbeb653385 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.151351 Oct 11 07:02:13.403228 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1346/2679] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:13 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:13.468779 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e6e1c270-a24b-437b-808b-451aa9e16e35 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:13.477914 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e6e1c270-a24b-437b-808b-451aa9e16e35 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:13.479355 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e6e1c270-a24b-437b-808b-451aa9e16e35 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:13.480536 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e6e1c270-a24b-437b-808b-451aa9e16e35 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.156245 Oct 11 07:02:13.481084 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1334/2680] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:13 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:02:13.642139 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9100086f-df13-407a-ba40-435a3dfb242f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:13.642737 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9100086f-df13-407a-ba40-435a3dfb242f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:13.648496 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9100086f-df13-407a-ba40-435a3dfb242f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:13.648964 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9100086f-df13-407a-ba40-435a3dfb242f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:13.649390 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9100086f-df13-407a-ba40-435a3dfb242f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:13.650063 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9100086f-df13-407a-ba40-435a3dfb242f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:13.650501 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9100086f-df13-407a-ba40-435a3dfb242f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:13.650915 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9100086f-df13-407a-ba40-435a3dfb242f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:13.930017 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9100086f-df13-407a-ba40-435a3dfb242f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:13.938726 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9100086f-df13-407a-ba40-435a3dfb242f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.300389 Oct 11 07:02:13.939275 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1347/2681] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:13 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:14.426106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-71f6afac-1979-4cf3-b95c-8b5535d8aaa6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:14.426725 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-71f6afac-1979-4cf3-b95c-8b5535d8aaa6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:14.433845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-71f6afac-1979-4cf3-b95c-8b5535d8aaa6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:14.434325 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-71f6afac-1979-4cf3-b95c-8b5535d8aaa6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:14.434762 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-71f6afac-1979-4cf3-b95c-8b5535d8aaa6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:14.435483 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-71f6afac-1979-4cf3-b95c-8b5535d8aaa6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:14.435940 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-71f6afac-1979-4cf3-b95c-8b5535d8aaa6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:14.436364 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-71f6afac-1979-4cf3-b95c-8b5535d8aaa6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:14.506195 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b4c87c57-18ea-4634-9d58-299b784e9859 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:14.506834 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b4c87c57-18ea-4634-9d58-299b784e9859 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:14.513396 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b4c87c57-18ea-4634-9d58-299b784e9859 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:14.513905 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b4c87c57-18ea-4634-9d58-299b784e9859 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:14.514373 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b4c87c57-18ea-4634-9d58-299b784e9859 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:14.515105 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b4c87c57-18ea-4634-9d58-299b784e9859 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:14.515592 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b4c87c57-18ea-4634-9d58-299b784e9859 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:14.516018 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b4c87c57-18ea-4634-9d58-299b784e9859 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:14.519922 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:02:14.568321 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-71f6afac-1979-4cf3-b95c-8b5535d8aaa6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:14.576589 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-71f6afac-1979-4cf3-b95c-8b5535d8aaa6 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.154396 Oct 11 07:02:14.577156 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1335/2682] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:14 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:14.642700 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b4c87c57-18ea-4634-9d58-299b784e9859 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:14.651770 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b4c87c57-18ea-4634-9d58-299b784e9859 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:14.653199 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b4c87c57-18ea-4634-9d58-299b784e9859 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:14.654346 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b4c87c57-18ea-4634-9d58-299b784e9859 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152020 Oct 11 07:02:14.654887 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1348/2683] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:14 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:02:14.962949 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-83661eba-e5fa-4a44-94f5-b87ed6dca170 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:14.963497 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-83661eba-e5fa-4a44-94f5-b87ed6dca170 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:14.969360 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-83661eba-e5fa-4a44-94f5-b87ed6dca170 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:14.969840 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-83661eba-e5fa-4a44-94f5-b87ed6dca170 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:14.970283 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-83661eba-e5fa-4a44-94f5-b87ed6dca170 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:14.970974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-83661eba-e5fa-4a44-94f5-b87ed6dca170 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:14.971447 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-83661eba-e5fa-4a44-94f5-b87ed6dca170 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:14.971875 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-83661eba-e5fa-4a44-94f5-b87ed6dca170 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:15.097033 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-83661eba-e5fa-4a44-94f5-b87ed6dca170 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:15.105156 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-83661eba-e5fa-4a44-94f5-b87ed6dca170 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.146708 Oct 11 07:02:15.105722 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1336/2684] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:14 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:15.600046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fa6febf6-11b0-4880-aa71-ccd7646d2fa3 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:15.600659 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fa6febf6-11b0-4880-aa71-ccd7646d2fa3 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:15.607652 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa6febf6-11b0-4880-aa71-ccd7646d2fa3 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:15.608132 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa6febf6-11b0-4880-aa71-ccd7646d2fa3 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:15.608569 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa6febf6-11b0-4880-aa71-ccd7646d2fa3 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:15.609257 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa6febf6-11b0-4880-aa71-ccd7646d2fa3 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:15.609745 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa6febf6-11b0-4880-aa71-ccd7646d2fa3 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:15.610168 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa6febf6-11b0-4880-aa71-ccd7646d2fa3 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:15.679927 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e8dbd74e-542d-4392-8a91-d009666c8d92 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:15.681059 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e8dbd74e-542d-4392-8a91-d009666c8d92 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:15.687389 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e8dbd74e-542d-4392-8a91-d009666c8d92 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:15.687896 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e8dbd74e-542d-4392-8a91-d009666c8d92 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:15.688329 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e8dbd74e-542d-4392-8a91-d009666c8d92 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:15.689024 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e8dbd74e-542d-4392-8a91-d009666c8d92 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:15.689475 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e8dbd74e-542d-4392-8a91-d009666c8d92 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:15.689896 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e8dbd74e-542d-4392-8a91-d009666c8d92 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:15.738218 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fa6febf6-11b0-4880-aa71-ccd7646d2fa3 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:15.747950 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fa6febf6-11b0-4880-aa71-ccd7646d2fa3 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.151648 Oct 11 07:02:15.748518 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1349/2685] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:15 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:15.822787 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e8dbd74e-542d-4392-8a91-d009666c8d92 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:15.831377 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e8dbd74e-542d-4392-8a91-d009666c8d92 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:15.832856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e8dbd74e-542d-4392-8a91-d009666c8d92 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:15.834013 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e8dbd74e-542d-4392-8a91-d009666c8d92 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.158075 Oct 11 07:02:15.834568 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1337/2686] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:15 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:02:16.128408 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7033b32b-4f1f-4a73-8bdc-76b80339faf7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:16.129018 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7033b32b-4f1f-4a73-8bdc-76b80339faf7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:16.134815 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7033b32b-4f1f-4a73-8bdc-76b80339faf7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:16.135289 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7033b32b-4f1f-4a73-8bdc-76b80339faf7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:16.135760 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7033b32b-4f1f-4a73-8bdc-76b80339faf7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:16.136439 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7033b32b-4f1f-4a73-8bdc-76b80339faf7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:16.136885 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7033b32b-4f1f-4a73-8bdc-76b80339faf7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:16.137565 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7033b32b-4f1f-4a73-8bdc-76b80339faf7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:16.264657 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7033b32b-4f1f-4a73-8bdc-76b80339faf7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:16.272861 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7033b32b-4f1f-4a73-8bdc-76b80339faf7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.148287 Oct 11 07:02:16.273418 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1350/2687] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:16 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:02:16.771127 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-60d534dd-626f-41fe-b845-dd61166a2dbf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:16.771778 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-60d534dd-626f-41fe-b845-dd61166a2dbf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:16.778668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-60d534dd-626f-41fe-b845-dd61166a2dbf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:16.779136 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-60d534dd-626f-41fe-b845-dd61166a2dbf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:16.779595 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-60d534dd-626f-41fe-b845-dd61166a2dbf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:16.780275 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-60d534dd-626f-41fe-b845-dd61166a2dbf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:16.780714 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-60d534dd-626f-41fe-b845-dd61166a2dbf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:16.781128 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-60d534dd-626f-41fe-b845-dd61166a2dbf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:16.859110 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3ea13e37-4c8f-485c-8a8d-4cba7fc6a5d5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:16.859749 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3ea13e37-4c8f-485c-8a8d-4cba7fc6a5d5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:16.866104 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3ea13e37-4c8f-485c-8a8d-4cba7fc6a5d5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:16.866589 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3ea13e37-4c8f-485c-8a8d-4cba7fc6a5d5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:16.867024 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3ea13e37-4c8f-485c-8a8d-4cba7fc6a5d5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:16.867815 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3ea13e37-4c8f-485c-8a8d-4cba7fc6a5d5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:16.868262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3ea13e37-4c8f-485c-8a8d-4cba7fc6a5d5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:16.868681 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3ea13e37-4c8f-485c-8a8d-4cba7fc6a5d5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:16.955739 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-60d534dd-626f-41fe-b845-dd61166a2dbf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:16.964491 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-60d534dd-626f-41fe-b845-dd61166a2dbf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.197163 Oct 11 07:02:16.965052 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1338/2688] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:16 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:16.996867 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3ea13e37-4c8f-485c-8a8d-4cba7fc6a5d5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:17.005640 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3ea13e37-4c8f-485c-8a8d-4cba7fc6a5d5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:17.007065 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3ea13e37-4c8f-485c-8a8d-4cba7fc6a5d5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:17.008290 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3ea13e37-4c8f-485c-8a8d-4cba7fc6a5d5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.153069 Oct 11 07:02:17.008839 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1351/2689] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:16 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:02:17.297857 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c1c3aa7d-9a29-4b59-8a82-676e6cded59b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:17.298386 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c1c3aa7d-9a29-4b59-8a82-676e6cded59b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:17.304344 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1c3aa7d-9a29-4b59-8a82-676e6cded59b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:17.304823 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1c3aa7d-9a29-4b59-8a82-676e6cded59b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:17.305253 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1c3aa7d-9a29-4b59-8a82-676e6cded59b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:17.305938 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1c3aa7d-9a29-4b59-8a82-676e6cded59b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:17.306385 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1c3aa7d-9a29-4b59-8a82-676e6cded59b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:17.306802 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1c3aa7d-9a29-4b59-8a82-676e6cded59b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:17.431830 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c1c3aa7d-9a29-4b59-8a82-676e6cded59b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:17.440987 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c1c3aa7d-9a29-4b59-8a82-676e6cded59b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.147057 Oct 11 07:02:17.441577 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1339/2690] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:17 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:17.988590 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-caa263e2-04da-405e-8242-0e7fb6b9bd14 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:17.989206 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-caa263e2-04da-405e-8242-0e7fb6b9bd14 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:17.996470 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-caa263e2-04da-405e-8242-0e7fb6b9bd14 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:17.996959 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-caa263e2-04da-405e-8242-0e7fb6b9bd14 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:17.997394 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-caa263e2-04da-405e-8242-0e7fb6b9bd14 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:17.998094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-caa263e2-04da-405e-8242-0e7fb6b9bd14 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:17.998577 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-caa263e2-04da-405e-8242-0e7fb6b9bd14 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:17.998999 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-caa263e2-04da-405e-8242-0e7fb6b9bd14 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:18.034014 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e58a1b33-4d0a-4005-8311-aeb4ddfc0e96 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:18.035257 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e58a1b33-4d0a-4005-8311-aeb4ddfc0e96 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:18.042188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e58a1b33-4d0a-4005-8311-aeb4ddfc0e96 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:18.042684 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e58a1b33-4d0a-4005-8311-aeb4ddfc0e96 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:18.043117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e58a1b33-4d0a-4005-8311-aeb4ddfc0e96 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:18.043858 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e58a1b33-4d0a-4005-8311-aeb4ddfc0e96 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:18.044309 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e58a1b33-4d0a-4005-8311-aeb4ddfc0e96 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:18.044930 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e58a1b33-4d0a-4005-8311-aeb4ddfc0e96 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:18.141345 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-caa263e2-04da-405e-8242-0e7fb6b9bd14 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:18.149693 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-caa263e2-04da-405e-8242-0e7fb6b9bd14 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.165031 Oct 11 07:02:18.150257 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1352/2691] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:17 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:18.184303 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e58a1b33-4d0a-4005-8311-aeb4ddfc0e96 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:18.192763 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e58a1b33-4d0a-4005-8311-aeb4ddfc0e96 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:18.194198 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e58a1b33-4d0a-4005-8311-aeb4ddfc0e96 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:18.195344 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e58a1b33-4d0a-4005-8311-aeb4ddfc0e96 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.165145 Oct 11 07:02:18.195950 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1340/2692] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:18 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:02:18.465862 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-827968f1-5c17-4da6-b162-c7d979f31c5a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:18.466473 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-827968f1-5c17-4da6-b162-c7d979f31c5a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:18.472321 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-827968f1-5c17-4da6-b162-c7d979f31c5a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:18.472801 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-827968f1-5c17-4da6-b162-c7d979f31c5a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:18.473236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-827968f1-5c17-4da6-b162-c7d979f31c5a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:18.473923 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-827968f1-5c17-4da6-b162-c7d979f31c5a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:18.474381 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-827968f1-5c17-4da6-b162-c7d979f31c5a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:18.474804 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-827968f1-5c17-4da6-b162-c7d979f31c5a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:18.602572 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-827968f1-5c17-4da6-b162-c7d979f31c5a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:18.610637 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-827968f1-5c17-4da6-b162-c7d979f31c5a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.149104 Oct 11 07:02:18.611182 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1353/2693] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:18 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:19.172975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5694f8d2-3966-4a82-aeae-d97d711abca3 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:19.173587 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5694f8d2-3966-4a82-aeae-d97d711abca3 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:19.180538 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5694f8d2-3966-4a82-aeae-d97d711abca3 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:19.181013 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5694f8d2-3966-4a82-aeae-d97d711abca3 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:19.181445 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5694f8d2-3966-4a82-aeae-d97d711abca3 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:19.182125 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5694f8d2-3966-4a82-aeae-d97d711abca3 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:19.182573 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5694f8d2-3966-4a82-aeae-d97d711abca3 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:19.182991 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5694f8d2-3966-4a82-aeae-d97d711abca3 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:19.220615 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-28249c3c-086d-47f9-a11b-1b3d390fb5ca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:19.221216 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-28249c3c-086d-47f9-a11b-1b3d390fb5ca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:19.227654 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28249c3c-086d-47f9-a11b-1b3d390fb5ca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:19.228139 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28249c3c-086d-47f9-a11b-1b3d390fb5ca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:19.228576 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28249c3c-086d-47f9-a11b-1b3d390fb5ca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:19.229271 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28249c3c-086d-47f9-a11b-1b3d390fb5ca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:19.229720 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28249c3c-086d-47f9-a11b-1b3d390fb5ca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:19.230144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-28249c3c-086d-47f9-a11b-1b3d390fb5ca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:19.310638 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5694f8d2-3966-4a82-aeae-d97d711abca3 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:19.318889 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5694f8d2-3966-4a82-aeae-d97d711abca3 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.149675 Oct 11 07:02:19.319470 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1341/2694] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:19 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:19.357983 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-28249c3c-086d-47f9-a11b-1b3d390fb5ca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:19.366825 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-28249c3c-086d-47f9-a11b-1b3d390fb5ca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:19.368843 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-28249c3c-086d-47f9-a11b-1b3d390fb5ca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:19.369981 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-28249c3c-086d-47f9-a11b-1b3d390fb5ca tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.153218 Oct 11 07:02:19.370517 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1354/2695] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:19 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:02:19.633898 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d8896863-67ff-4e69-a111-c88e558eb12a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:19.634504 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d8896863-67ff-4e69-a111-c88e558eb12a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:19.640727 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8896863-67ff-4e69-a111-c88e558eb12a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:19.641202 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8896863-67ff-4e69-a111-c88e558eb12a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:19.641633 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8896863-67ff-4e69-a111-c88e558eb12a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:19.642315 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8896863-67ff-4e69-a111-c88e558eb12a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:19.642767 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8896863-67ff-4e69-a111-c88e558eb12a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:19.643186 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8896863-67ff-4e69-a111-c88e558eb12a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:19.773361 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d8896863-67ff-4e69-a111-c88e558eb12a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:19.782062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d8896863-67ff-4e69-a111-c88e558eb12a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.152020 Oct 11 07:02:19.782624 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1342/2696] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:19 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:20.342910 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-01fee059-76c9-4deb-83df-a74befe3296b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:20.343550 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-01fee059-76c9-4deb-83df-a74befe3296b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:20.349949 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-01fee059-76c9-4deb-83df-a74befe3296b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:20.350429 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-01fee059-76c9-4deb-83df-a74befe3296b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:20.350865 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-01fee059-76c9-4deb-83df-a74befe3296b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:20.351595 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-01fee059-76c9-4deb-83df-a74befe3296b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:20.352086 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-01fee059-76c9-4deb-83df-a74befe3296b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:20.352512 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-01fee059-76c9-4deb-83df-a74befe3296b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:20.395729 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0b901230-ae7c-440c-96be-91694738dc24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:20.396301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0b901230-ae7c-440c-96be-91694738dc24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:20.403341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b901230-ae7c-440c-96be-91694738dc24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:20.403853 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b901230-ae7c-440c-96be-91694738dc24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:20.404280 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b901230-ae7c-440c-96be-91694738dc24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:20.404972 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b901230-ae7c-440c-96be-91694738dc24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:20.405416 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b901230-ae7c-440c-96be-91694738dc24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:20.405828 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b901230-ae7c-440c-96be-91694738dc24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:20.482491 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-01fee059-76c9-4deb-83df-a74befe3296b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:20.490804 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-01fee059-76c9-4deb-83df-a74befe3296b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.151685 Oct 11 07:02:20.491357 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1355/2697] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:20 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:20.536506 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0b901230-ae7c-440c-96be-91694738dc24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:20.545110 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0b901230-ae7c-440c-96be-91694738dc24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:20.546551 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0b901230-ae7c-440c-96be-91694738dc24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:20.547734 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0b901230-ae7c-440c-96be-91694738dc24 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.155931 Oct 11 07:02:20.548293 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1343/2698] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:20 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:02:20.806625 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2a34c151-b6a8-4929-b11d-e2ca552443f6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:20.807145 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2a34c151-b6a8-4929-b11d-e2ca552443f6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:20.812953 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2a34c151-b6a8-4929-b11d-e2ca552443f6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:20.813423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2a34c151-b6a8-4929-b11d-e2ca552443f6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:20.813848 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2a34c151-b6a8-4929-b11d-e2ca552443f6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:20.814531 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2a34c151-b6a8-4929-b11d-e2ca552443f6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:20.814970 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2a34c151-b6a8-4929-b11d-e2ca552443f6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:20.815381 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2a34c151-b6a8-4929-b11d-e2ca552443f6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:20.940536 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2a34c151-b6a8-4929-b11d-e2ca552443f6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:20.948741 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2a34c151-b6a8-4929-b11d-e2ca552443f6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.146565 Oct 11 07:02:20.949306 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1356/2699] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:20 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:21.514636 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f950e217-240f-4f21-9bd6-e750b16ad138 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:21.515250 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f950e217-240f-4f21-9bd6-e750b16ad138 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:21.521707 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f950e217-240f-4f21-9bd6-e750b16ad138 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:21.522178 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f950e217-240f-4f21-9bd6-e750b16ad138 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:21.522607 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f950e217-240f-4f21-9bd6-e750b16ad138 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:21.523287 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f950e217-240f-4f21-9bd6-e750b16ad138 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:21.523768 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f950e217-240f-4f21-9bd6-e750b16ad138 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:21.524189 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f950e217-240f-4f21-9bd6-e750b16ad138 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:21.543378 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:02:21.573490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cb544ebb-aeb3-4163-ba67-51fd923c8006 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:21.574092 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cb544ebb-aeb3-4163-ba67-51fd923c8006 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:21.580172 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb544ebb-aeb3-4163-ba67-51fd923c8006 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:21.580649 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb544ebb-aeb3-4163-ba67-51fd923c8006 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:21.581083 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb544ebb-aeb3-4163-ba67-51fd923c8006 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:21.581764 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb544ebb-aeb3-4163-ba67-51fd923c8006 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:21.582209 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb544ebb-aeb3-4163-ba67-51fd923c8006 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:21.582628 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb544ebb-aeb3-4163-ba67-51fd923c8006 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:21.654218 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f950e217-240f-4f21-9bd6-e750b16ad138 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:21.662395 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f950e217-240f-4f21-9bd6-e750b16ad138 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.151828 Oct 11 07:02:21.662965 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1344/2700] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:21 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:21.711494 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cb544ebb-aeb3-4163-ba67-51fd923c8006 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:21.719961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cb544ebb-aeb3-4163-ba67-51fd923c8006 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:21.721392 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cb544ebb-aeb3-4163-ba67-51fd923c8006 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:21.722548 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cb544ebb-aeb3-4163-ba67-51fd923c8006 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.153498 Oct 11 07:02:21.723093 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1357/2701] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:21 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:02:21.972026 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d8b68d39-830f-4939-bb67-2e369b329b7d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:21.972555 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d8b68d39-830f-4939-bb67-2e369b329b7d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:21.978976 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8b68d39-830f-4939-bb67-2e369b329b7d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:21.979462 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8b68d39-830f-4939-bb67-2e369b329b7d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:21.979919 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8b68d39-830f-4939-bb67-2e369b329b7d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:21.980601 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8b68d39-830f-4939-bb67-2e369b329b7d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:21.981045 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8b68d39-830f-4939-bb67-2e369b329b7d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:21.981454 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8b68d39-830f-4939-bb67-2e369b329b7d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:22.111649 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d8b68d39-830f-4939-bb67-2e369b329b7d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:22.119932 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d8b68d39-830f-4939-bb67-2e369b329b7d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.151716 Oct 11 07:02:22.120485 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1345/2702] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:21 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:22.686043 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-124a0da8-ef6c-46c1-b348-00316850107a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:22.687285 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-124a0da8-ef6c-46c1-b348-00316850107a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:22.693832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-124a0da8-ef6c-46c1-b348-00316850107a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:22.694303 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-124a0da8-ef6c-46c1-b348-00316850107a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:22.694736 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-124a0da8-ef6c-46c1-b348-00316850107a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:22.695937 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-124a0da8-ef6c-46c1-b348-00316850107a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:22.696388 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-124a0da8-ef6c-46c1-b348-00316850107a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:22.696808 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-124a0da8-ef6c-46c1-b348-00316850107a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:22.748596 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-dd5a5641-96ad-4b0b-8db6-c8370bc72b77 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:22.749232 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-dd5a5641-96ad-4b0b-8db6-c8370bc72b77 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:22.751666 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=80 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:02:22.756865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dd5a5641-96ad-4b0b-8db6-c8370bc72b77 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:22.757372 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dd5a5641-96ad-4b0b-8db6-c8370bc72b77 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:22.757799 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dd5a5641-96ad-4b0b-8db6-c8370bc72b77 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:22.759178 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dd5a5641-96ad-4b0b-8db6-c8370bc72b77 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:22.759649 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dd5a5641-96ad-4b0b-8db6-c8370bc72b77 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:22.760067 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dd5a5641-96ad-4b0b-8db6-c8370bc72b77 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:22.825696 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-124a0da8-ef6c-46c1-b348-00316850107a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:22.834056 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-124a0da8-ef6c-46c1-b348-00316850107a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.151828 Oct 11 07:02:22.834618 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1358/2703] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:22 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:22.887759 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-dd5a5641-96ad-4b0b-8db6-c8370bc72b77 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:22.896327 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-dd5a5641-96ad-4b0b-8db6-c8370bc72b77 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:22.897770 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-dd5a5641-96ad-4b0b-8db6-c8370bc72b77 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:22.898937 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-dd5a5641-96ad-4b0b-8db6-c8370bc72b77 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.154254 Oct 11 07:02:22.899507 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1346/2704] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:22 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:02:23.142735 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-93470af7-098b-423f-b4e8-074bb23acadd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:23.143344 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-93470af7-098b-423f-b4e8-074bb23acadd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:23.149177 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-93470af7-098b-423f-b4e8-074bb23acadd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:23.149646 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-93470af7-098b-423f-b4e8-074bb23acadd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:23.150068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-93470af7-098b-423f-b4e8-074bb23acadd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:23.150775 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-93470af7-098b-423f-b4e8-074bb23acadd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:23.151212 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-93470af7-098b-423f-b4e8-074bb23acadd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:23.151653 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-93470af7-098b-423f-b4e8-074bb23acadd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:23.280336 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-93470af7-098b-423f-b4e8-074bb23acadd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:23.288405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-93470af7-098b-423f-b4e8-074bb23acadd tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.149454 Oct 11 07:02:23.288959 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1359/2705] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:23 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:23.857138 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a60468d3-b806-4539-a904-73cc943a2629 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:23.857837 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a60468d3-b806-4539-a904-73cc943a2629 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:23.864389 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a60468d3-b806-4539-a904-73cc943a2629 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:23.864867 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a60468d3-b806-4539-a904-73cc943a2629 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:23.865296 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a60468d3-b806-4539-a904-73cc943a2629 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:23.866008 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a60468d3-b806-4539-a904-73cc943a2629 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:23.866459 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a60468d3-b806-4539-a904-73cc943a2629 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:23.866881 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a60468d3-b806-4539-a904-73cc943a2629 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:23.924124 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e23fc60d-6a18-4bc9-af63-6534eaa8095a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:23.924721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e23fc60d-6a18-4bc9-af63-6534eaa8095a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:23.931194 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e23fc60d-6a18-4bc9-af63-6534eaa8095a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:23.931700 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e23fc60d-6a18-4bc9-af63-6534eaa8095a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:23.932133 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e23fc60d-6a18-4bc9-af63-6534eaa8095a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:23.932825 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e23fc60d-6a18-4bc9-af63-6534eaa8095a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:23.933271 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e23fc60d-6a18-4bc9-af63-6534eaa8095a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:23.933691 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e23fc60d-6a18-4bc9-af63-6534eaa8095a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:23.998287 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a60468d3-b806-4539-a904-73cc943a2629 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:24.006523 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a60468d3-b806-4539-a904-73cc943a2629 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.153331 Oct 11 07:02:24.007108 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1347/2706] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:23 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:24.062144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e23fc60d-6a18-4bc9-af63-6534eaa8095a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:24.070590 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e23fc60d-6a18-4bc9-af63-6534eaa8095a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:24.072592 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e23fc60d-6a18-4bc9-af63-6534eaa8095a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:24.073744 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e23fc60d-6a18-4bc9-af63-6534eaa8095a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.153581 Oct 11 07:02:24.074292 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1360/2707] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:23 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:02:24.314494 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-53196e3f-c234-4129-bd64-9ad7dcfdf236 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:24.315029 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-53196e3f-c234-4129-bd64-9ad7dcfdf236 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:24.321066 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-53196e3f-c234-4129-bd64-9ad7dcfdf236 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:24.321539 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-53196e3f-c234-4129-bd64-9ad7dcfdf236 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:24.322529 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-53196e3f-c234-4129-bd64-9ad7dcfdf236 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:24.323211 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-53196e3f-c234-4129-bd64-9ad7dcfdf236 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:24.323684 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-53196e3f-c234-4129-bd64-9ad7dcfdf236 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:24.324105 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-53196e3f-c234-4129-bd64-9ad7dcfdf236 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:24.451670 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-53196e3f-c234-4129-bd64-9ad7dcfdf236 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:24.459817 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-53196e3f-c234-4129-bd64-9ad7dcfdf236 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.149173 Oct 11 07:02:24.460359 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1348/2708] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:24 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:02:25.030541 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-220dc15b-b49a-4814-b5a3-2610d01a07fe tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:25.031125 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-220dc15b-b49a-4814-b5a3-2610d01a07fe tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:25.037447 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-220dc15b-b49a-4814-b5a3-2610d01a07fe tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:25.037916 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-220dc15b-b49a-4814-b5a3-2610d01a07fe tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:25.038341 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-220dc15b-b49a-4814-b5a3-2610d01a07fe tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:25.039013 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-220dc15b-b49a-4814-b5a3-2610d01a07fe tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:25.039485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-220dc15b-b49a-4814-b5a3-2610d01a07fe tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:25.039904 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-220dc15b-b49a-4814-b5a3-2610d01a07fe tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:25.098938 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a527e0f1-976e-4d16-b2e2-269f9b670c34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:25.099662 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a527e0f1-976e-4d16-b2e2-269f9b670c34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:25.106769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a527e0f1-976e-4d16-b2e2-269f9b670c34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:25.107328 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a527e0f1-976e-4d16-b2e2-269f9b670c34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:25.107862 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a527e0f1-976e-4d16-b2e2-269f9b670c34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:25.108628 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a527e0f1-976e-4d16-b2e2-269f9b670c34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:25.109153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a527e0f1-976e-4d16-b2e2-269f9b670c34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:25.109654 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a527e0f1-976e-4d16-b2e2-269f9b670c34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:25.165034 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-220dc15b-b49a-4814-b5a3-2610d01a07fe tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:25.173810 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-220dc15b-b49a-4814-b5a3-2610d01a07fe tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.147092 Oct 11 07:02:25.174366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1361/2709] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:25 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:25.235975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a527e0f1-976e-4d16-b2e2-269f9b670c34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:25.244451 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a527e0f1-976e-4d16-b2e2-269f9b670c34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:25.245900 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a527e0f1-976e-4d16-b2e2-269f9b670c34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:25.247066 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a527e0f1-976e-4d16-b2e2-269f9b670c34 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.151990 Oct 11 07:02:25.247730 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1349/2710] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:25 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:02:25.482489 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-22eff0e1-5f21-47c8-af7d-09fc5229e92a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:25.483096 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-22eff0e1-5f21-47c8-af7d-09fc5229e92a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:25.488957 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-22eff0e1-5f21-47c8-af7d-09fc5229e92a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:25.489434 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-22eff0e1-5f21-47c8-af7d-09fc5229e92a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:25.489865 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-22eff0e1-5f21-47c8-af7d-09fc5229e92a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:25.490549 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-22eff0e1-5f21-47c8-af7d-09fc5229e92a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:25.490995 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-22eff0e1-5f21-47c8-af7d-09fc5229e92a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:25.491432 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-22eff0e1-5f21-47c8-af7d-09fc5229e92a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:25.618016 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-22eff0e1-5f21-47c8-af7d-09fc5229e92a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:25.626061 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-22eff0e1-5f21-47c8-af7d-09fc5229e92a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.147968 Oct 11 07:02:25.626620 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1362/2711] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:25 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:26.196688 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d75f0382-e7a7-4464-97c4-72470cd15782 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:26.197300 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d75f0382-e7a7-4464-97c4-72470cd15782 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:26.203861 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d75f0382-e7a7-4464-97c4-72470cd15782 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:26.204286 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d75f0382-e7a7-4464-97c4-72470cd15782 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:26.204720 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d75f0382-e7a7-4464-97c4-72470cd15782 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:26.205412 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d75f0382-e7a7-4464-97c4-72470cd15782 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:26.205893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d75f0382-e7a7-4464-97c4-72470cd15782 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:26.206325 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d75f0382-e7a7-4464-97c4-72470cd15782 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:26.272594 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5ae660d7-1399-412e-90f7-9cb47ca51da3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:26.273244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5ae660d7-1399-412e-90f7-9cb47ca51da3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:26.279584 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ae660d7-1399-412e-90f7-9cb47ca51da3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:26.280058 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ae660d7-1399-412e-90f7-9cb47ca51da3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:26.280487 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ae660d7-1399-412e-90f7-9cb47ca51da3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:26.281165 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ae660d7-1399-412e-90f7-9cb47ca51da3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:26.281608 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ae660d7-1399-412e-90f7-9cb47ca51da3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:26.282020 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5ae660d7-1399-412e-90f7-9cb47ca51da3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:26.338856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d75f0382-e7a7-4464-97c4-72470cd15782 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:26.347079 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d75f0382-e7a7-4464-97c4-72470cd15782 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.154228 Oct 11 07:02:26.347663 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1350/2712] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:26 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:26.410259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5ae660d7-1399-412e-90f7-9cb47ca51da3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:26.419355 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5ae660d7-1399-412e-90f7-9cb47ca51da3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:26.420838 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5ae660d7-1399-412e-90f7-9cb47ca51da3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:26.421992 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5ae660d7-1399-412e-90f7-9cb47ca51da3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.153294 Oct 11 07:02:26.422534 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1363/2713] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:26 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:02:26.651239 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-433eb875-cbeb-4c0c-9094-adf7a1a4236c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:26.651863 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-433eb875-cbeb-4c0c-9094-adf7a1a4236c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:26.657764 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-433eb875-cbeb-4c0c-9094-adf7a1a4236c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:26.658233 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-433eb875-cbeb-4c0c-9094-adf7a1a4236c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:26.658662 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-433eb875-cbeb-4c0c-9094-adf7a1a4236c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:26.659337 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-433eb875-cbeb-4c0c-9094-adf7a1a4236c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:26.659807 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-433eb875-cbeb-4c0c-9094-adf7a1a4236c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:26.660225 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-433eb875-cbeb-4c0c-9094-adf7a1a4236c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:26.786595 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-433eb875-cbeb-4c0c-9094-adf7a1a4236c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:26.795407 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-433eb875-cbeb-4c0c-9094-adf7a1a4236c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.148416 Oct 11 07:02:26.795988 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1351/2714] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:26 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:27.371171 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-896a71fd-27fe-4aa9-a595-ba635772c867 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:27.371874 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-896a71fd-27fe-4aa9-a595-ba635772c867 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:27.378092 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-896a71fd-27fe-4aa9-a595-ba635772c867 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:27.378558 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-896a71fd-27fe-4aa9-a595-ba635772c867 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:27.378979 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-896a71fd-27fe-4aa9-a595-ba635772c867 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:27.379676 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-896a71fd-27fe-4aa9-a595-ba635772c867 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:27.380116 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-896a71fd-27fe-4aa9-a595-ba635772c867 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:27.380529 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-896a71fd-27fe-4aa9-a595-ba635772c867 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:27.452196 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0bfb98cc-6652-4db2-b1e3-b1c1badeec8b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:27.452803 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0bfb98cc-6652-4db2-b1e3-b1c1badeec8b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:27.459051 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0bfb98cc-6652-4db2-b1e3-b1c1badeec8b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:27.459551 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0bfb98cc-6652-4db2-b1e3-b1c1badeec8b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:27.459983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0bfb98cc-6652-4db2-b1e3-b1c1badeec8b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:27.460669 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0bfb98cc-6652-4db2-b1e3-b1c1badeec8b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:27.461113 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0bfb98cc-6652-4db2-b1e3-b1c1badeec8b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:27.461527 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0bfb98cc-6652-4db2-b1e3-b1c1badeec8b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:27.512986 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-896a71fd-27fe-4aa9-a595-ba635772c867 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:27.517248 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:02:27.522587 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-896a71fd-27fe-4aa9-a595-ba635772c867 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.155719 Oct 11 07:02:27.523158 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1364/2715] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:27 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:27.595622 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0bfb98cc-6652-4db2-b1e3-b1c1badeec8b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:27.604739 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0bfb98cc-6652-4db2-b1e3-b1c1badeec8b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:27.606181 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0bfb98cc-6652-4db2-b1e3-b1c1badeec8b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:27.607347 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0bfb98cc-6652-4db2-b1e3-b1c1badeec8b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.163291 Oct 11 07:02:27.607940 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1352/2716] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:27 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:02:27.818332 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-18f1de4d-09b3-4af6-94e3-7749a7790a7f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:27.818860 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-18f1de4d-09b3-4af6-94e3-7749a7790a7f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:27.824725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18f1de4d-09b3-4af6-94e3-7749a7790a7f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:27.825203 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18f1de4d-09b3-4af6-94e3-7749a7790a7f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:27.825637 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18f1de4d-09b3-4af6-94e3-7749a7790a7f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:27.826321 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18f1de4d-09b3-4af6-94e3-7749a7790a7f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:27.826768 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18f1de4d-09b3-4af6-94e3-7749a7790a7f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:27.827187 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18f1de4d-09b3-4af6-94e3-7749a7790a7f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:27.952593 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-18f1de4d-09b3-4af6-94e3-7749a7790a7f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:27.960683 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-18f1de4d-09b3-4af6-94e3-7749a7790a7f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.146577 Oct 11 07:02:27.961230 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1365/2717] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:27 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:28.546323 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-da887d5c-a8ea-4ca4-ab09-8e4cae62819a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:28.546937 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-da887d5c-a8ea-4ca4-ab09-8e4cae62819a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:28.553336 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-da887d5c-a8ea-4ca4-ab09-8e4cae62819a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:28.553815 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-da887d5c-a8ea-4ca4-ab09-8e4cae62819a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:28.554253 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-da887d5c-a8ea-4ca4-ab09-8e4cae62819a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:28.554993 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-da887d5c-a8ea-4ca4-ab09-8e4cae62819a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:28.555509 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-da887d5c-a8ea-4ca4-ab09-8e4cae62819a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:28.556015 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-da887d5c-a8ea-4ca4-ab09-8e4cae62819a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:28.633936 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2a7fcdc1-f330-4eb3-adb9-8d54331c210c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:28.635561 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2a7fcdc1-f330-4eb3-adb9-8d54331c210c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:28.641755 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2a7fcdc1-f330-4eb3-adb9-8d54331c210c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:28.642231 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2a7fcdc1-f330-4eb3-adb9-8d54331c210c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:28.642659 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2a7fcdc1-f330-4eb3-adb9-8d54331c210c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:28.643354 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2a7fcdc1-f330-4eb3-adb9-8d54331c210c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:28.644029 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2a7fcdc1-f330-4eb3-adb9-8d54331c210c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:28.644460 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2a7fcdc1-f330-4eb3-adb9-8d54331c210c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:28.689687 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-da887d5c-a8ea-4ca4-ab09-8e4cae62819a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:28.698353 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-da887d5c-a8ea-4ca4-ab09-8e4cae62819a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.155905 Oct 11 07:02:28.698914 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1353/2718] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:28 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:28.772016 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2a7fcdc1-f330-4eb3-adb9-8d54331c210c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:28.780510 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2a7fcdc1-f330-4eb3-adb9-8d54331c210c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:28.781935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2a7fcdc1-f330-4eb3-adb9-8d54331c210c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:28.783089 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2a7fcdc1-f330-4eb3-adb9-8d54331c210c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.153367 Oct 11 07:02:28.783683 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1366/2719] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:28 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:02:28.984340 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2b1a01d0-cfa1-4926-ac33-895b63201977 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:28.985068 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2b1a01d0-cfa1-4926-ac33-895b63201977 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:28.991006 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2b1a01d0-cfa1-4926-ac33-895b63201977 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:28.991506 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2b1a01d0-cfa1-4926-ac33-895b63201977 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:28.991932 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2b1a01d0-cfa1-4926-ac33-895b63201977 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:28.992611 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2b1a01d0-cfa1-4926-ac33-895b63201977 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:28.993055 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2b1a01d0-cfa1-4926-ac33-895b63201977 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:28.993970 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2b1a01d0-cfa1-4926-ac33-895b63201977 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:29.119634 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2b1a01d0-cfa1-4926-ac33-895b63201977 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:29.127733 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2b1a01d0-cfa1-4926-ac33-895b63201977 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.147351 Oct 11 07:02:29.128292 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1354/2720] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:28 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:29.720977 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a9d85e43-659c-4f62-9b55-41921cd9502c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:29.721664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a9d85e43-659c-4f62-9b55-41921cd9502c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:29.728578 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9d85e43-659c-4f62-9b55-41921cd9502c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:29.733065 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9d85e43-659c-4f62-9b55-41921cd9502c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:29.733065 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9d85e43-659c-4f62-9b55-41921cd9502c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:29.733065 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9d85e43-659c-4f62-9b55-41921cd9502c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:29.733065 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9d85e43-659c-4f62-9b55-41921cd9502c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:29.733467 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9d85e43-659c-4f62-9b55-41921cd9502c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:29.808427 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-114c86a8-84a9-474c-ac60-512ef001e8db tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:29.809016 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-114c86a8-84a9-474c-ac60-512ef001e8db tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:29.815190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-114c86a8-84a9-474c-ac60-512ef001e8db tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:29.815696 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-114c86a8-84a9-474c-ac60-512ef001e8db tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:29.816128 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-114c86a8-84a9-474c-ac60-512ef001e8db tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:29.816819 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-114c86a8-84a9-474c-ac60-512ef001e8db tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:29.817267 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-114c86a8-84a9-474c-ac60-512ef001e8db tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:29.817686 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-114c86a8-84a9-474c-ac60-512ef001e8db tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:29.860212 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a9d85e43-659c-4f62-9b55-41921cd9502c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:29.868357 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a9d85e43-659c-4f62-9b55-41921cd9502c tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.151174 Oct 11 07:02:29.868924 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1367/2721] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:29 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:29.948675 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-114c86a8-84a9-474c-ac60-512ef001e8db tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:29.957197 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-114c86a8-84a9-474c-ac60-512ef001e8db tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:29.958624 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-114c86a8-84a9-474c-ac60-512ef001e8db tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:29.959804 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-114c86a8-84a9-474c-ac60-512ef001e8db tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.155238 Oct 11 07:02:29.960358 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1355/2722] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:29 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:02:30.150820 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-52ae2190-a7ae-45bf-a2ba-d3148803390f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:30.151443 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-52ae2190-a7ae-45bf-a2ba-d3148803390f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:30.157349 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-52ae2190-a7ae-45bf-a2ba-d3148803390f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:30.157815 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-52ae2190-a7ae-45bf-a2ba-d3148803390f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:30.158238 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-52ae2190-a7ae-45bf-a2ba-d3148803390f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:30.158911 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-52ae2190-a7ae-45bf-a2ba-d3148803390f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:30.159354 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-52ae2190-a7ae-45bf-a2ba-d3148803390f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:30.159795 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-52ae2190-a7ae-45bf-a2ba-d3148803390f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:30.284191 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-52ae2190-a7ae-45bf-a2ba-d3148803390f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:30.292211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-52ae2190-a7ae-45bf-a2ba-d3148803390f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.145743 Oct 11 07:02:30.292745 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1368/2723] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:30 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:02:30.891230 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d1d36fd0-e755-480a-8991-edf96589b72a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:30.891870 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d1d36fd0-e755-480a-8991-edf96589b72a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:30.898280 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d1d36fd0-e755-480a-8991-edf96589b72a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:30.898761 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d1d36fd0-e755-480a-8991-edf96589b72a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:30.899196 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d1d36fd0-e755-480a-8991-edf96589b72a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:30.899914 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d1d36fd0-e755-480a-8991-edf96589b72a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:30.900364 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d1d36fd0-e755-480a-8991-edf96589b72a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:30.900785 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d1d36fd0-e755-480a-8991-edf96589b72a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:30.985565 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c1a50adf-e463-40a4-abc0-d245aaf71487 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:30.986495 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c1a50adf-e463-40a4-abc0-d245aaf71487 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:30.993151 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c1a50adf-e463-40a4-abc0-d245aaf71487 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:30.993688 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c1a50adf-e463-40a4-abc0-d245aaf71487 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:30.994113 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c1a50adf-e463-40a4-abc0-d245aaf71487 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:30.994797 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c1a50adf-e463-40a4-abc0-d245aaf71487 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:30.995239 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c1a50adf-e463-40a4-abc0-d245aaf71487 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:30.995692 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c1a50adf-e463-40a4-abc0-d245aaf71487 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:31.026861 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d1d36fd0-e755-480a-8991-edf96589b72a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:31.035109 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d1d36fd0-e755-480a-8991-edf96589b72a tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.147909 Oct 11 07:02:31.035710 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1356/2724] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:30 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:31.124555 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c1a50adf-e463-40a4-abc0-d245aaf71487 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:31.132968 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c1a50adf-e463-40a4-abc0-d245aaf71487 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:31.134387 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c1a50adf-e463-40a4-abc0-d245aaf71487 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:31.135674 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c1a50adf-e463-40a4-abc0-d245aaf71487 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.153827 Oct 11 07:02:31.136217 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1369/2725] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:30 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:02:31.316019 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-766ea2e7-55e6-46ff-a616-15660d22576a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:31.316549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-766ea2e7-55e6-46ff-a616-15660d22576a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:31.323016 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-766ea2e7-55e6-46ff-a616-15660d22576a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:31.323518 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-766ea2e7-55e6-46ff-a616-15660d22576a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:31.323953 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-766ea2e7-55e6-46ff-a616-15660d22576a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:31.324638 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-766ea2e7-55e6-46ff-a616-15660d22576a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:31.325086 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-766ea2e7-55e6-46ff-a616-15660d22576a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:31.325506 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-766ea2e7-55e6-46ff-a616-15660d22576a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:31.456666 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-766ea2e7-55e6-46ff-a616-15660d22576a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:31.465451 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-766ea2e7-55e6-46ff-a616-15660d22576a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.153361 Oct 11 07:02:31.466007 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1357/2726] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:31 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:32.058464 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8f74fdee-1d3b-40d2-a1a9-d30b7534bff1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:32.059000 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8f74fdee-1d3b-40d2-a1a9-d30b7534bff1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:32.065352 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f74fdee-1d3b-40d2-a1a9-d30b7534bff1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:32.065819 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f74fdee-1d3b-40d2-a1a9-d30b7534bff1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:32.066244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f74fdee-1d3b-40d2-a1a9-d30b7534bff1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:32.066925 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f74fdee-1d3b-40d2-a1a9-d30b7534bff1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:32.067368 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f74fdee-1d3b-40d2-a1a9-d30b7534bff1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:32.067819 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f74fdee-1d3b-40d2-a1a9-d30b7534bff1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:32.161342 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d167ec5c-634e-40a4-a8a4-09ee314fcb4b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:32.161950 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d167ec5c-634e-40a4-a8a4-09ee314fcb4b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:32.168885 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d167ec5c-634e-40a4-a8a4-09ee314fcb4b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:32.169365 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d167ec5c-634e-40a4-a8a4-09ee314fcb4b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:32.169792 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d167ec5c-634e-40a4-a8a4-09ee314fcb4b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:32.170482 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d167ec5c-634e-40a4-a8a4-09ee314fcb4b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:32.170925 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d167ec5c-634e-40a4-a8a4-09ee314fcb4b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:32.171344 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d167ec5c-634e-40a4-a8a4-09ee314fcb4b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:32.195113 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8f74fdee-1d3b-40d2-a1a9-d30b7534bff1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:32.203609 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8f74fdee-1d3b-40d2-a1a9-d30b7534bff1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.149399 Oct 11 07:02:32.204178 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1370/2727] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:32 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:32.297262 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d167ec5c-634e-40a4-a8a4-09ee314fcb4b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:32.306428 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d167ec5c-634e-40a4-a8a4-09ee314fcb4b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:32.307900 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d167ec5c-634e-40a4-a8a4-09ee314fcb4b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:32.309108 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d167ec5c-634e-40a4-a8a4-09ee314fcb4b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.151607 Oct 11 07:02:32.309604 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1358/2728] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:32 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:02:32.488429 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-55c0cd38-9806-4596-9f87-8d2226bf4470 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:32.489034 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-55c0cd38-9806-4596-9f87-8d2226bf4470 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:32.494833 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-55c0cd38-9806-4596-9f87-8d2226bf4470 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:32.495301 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-55c0cd38-9806-4596-9f87-8d2226bf4470 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:32.495772 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-55c0cd38-9806-4596-9f87-8d2226bf4470 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:32.496471 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-55c0cd38-9806-4596-9f87-8d2226bf4470 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:32.496914 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-55c0cd38-9806-4596-9f87-8d2226bf4470 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:32.497330 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-55c0cd38-9806-4596-9f87-8d2226bf4470 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:32.624178 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-55c0cd38-9806-4596-9f87-8d2226bf4470 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:32.632322 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-55c0cd38-9806-4596-9f87-8d2226bf4470 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.147704 Oct 11 07:02:32.632875 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1371/2729] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:32 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:33.226152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3cd822ef-2261-45b7-b72e-24fce68bed34 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:33.226768 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3cd822ef-2261-45b7-b72e-24fce68bed34 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:33.233312 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3cd822ef-2261-45b7-b72e-24fce68bed34 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:33.233796 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3cd822ef-2261-45b7-b72e-24fce68bed34 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:33.234232 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3cd822ef-2261-45b7-b72e-24fce68bed34 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:33.234926 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3cd822ef-2261-45b7-b72e-24fce68bed34 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:33.235384 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3cd822ef-2261-45b7-b72e-24fce68bed34 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:33.235833 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3cd822ef-2261-45b7-b72e-24fce68bed34 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:33.334236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9d204456-e4e9-4e13-9f3b-cc6011720ed9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:33.335488 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9d204456-e4e9-4e13-9f3b-cc6011720ed9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:33.341816 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9d204456-e4e9-4e13-9f3b-cc6011720ed9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:33.342288 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9d204456-e4e9-4e13-9f3b-cc6011720ed9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:33.342713 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9d204456-e4e9-4e13-9f3b-cc6011720ed9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:33.343392 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9d204456-e4e9-4e13-9f3b-cc6011720ed9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:33.343858 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9d204456-e4e9-4e13-9f3b-cc6011720ed9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:33.344271 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9d204456-e4e9-4e13-9f3b-cc6011720ed9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:33.365961 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3cd822ef-2261-45b7-b72e-24fce68bed34 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:33.374853 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3cd822ef-2261-45b7-b72e-24fce68bed34 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.152556 Oct 11 07:02:33.375440 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1359/2730] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:33 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:33.469686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9d204456-e4e9-4e13-9f3b-cc6011720ed9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:33.478271 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9d204456-e4e9-4e13-9f3b-cc6011720ed9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:33.479662 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9d204456-e4e9-4e13-9f3b-cc6011720ed9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:33.480803 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9d204456-e4e9-4e13-9f3b-cc6011720ed9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.150543 Oct 11 07:02:33.481350 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1372/2731] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:33 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:02:33.655610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a492d3a6-08df-41df-aa4e-f20056087fcf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:33.656218 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a492d3a6-08df-41df-aa4e-f20056087fcf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:33.662093 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a492d3a6-08df-41df-aa4e-f20056087fcf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:33.662568 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a492d3a6-08df-41df-aa4e-f20056087fcf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:33.663006 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a492d3a6-08df-41df-aa4e-f20056087fcf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:33.663720 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a492d3a6-08df-41df-aa4e-f20056087fcf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:33.664173 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a492d3a6-08df-41df-aa4e-f20056087fcf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:33.664589 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a492d3a6-08df-41df-aa4e-f20056087fcf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:33.789710 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a492d3a6-08df-41df-aa4e-f20056087fcf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:33.798400 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a492d3a6-08df-41df-aa4e-f20056087fcf tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.146622 Oct 11 07:02:33.798960 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1360/2732] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:33 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:34.398392 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b9e36990-490f-4c06-bac9-c5cfa586106b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:34.398984 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b9e36990-490f-4c06-bac9-c5cfa586106b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:34.406149 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b9e36990-490f-4c06-bac9-c5cfa586106b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:34.406620 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b9e36990-490f-4c06-bac9-c5cfa586106b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:34.407070 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b9e36990-490f-4c06-bac9-c5cfa586106b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:34.407745 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b9e36990-490f-4c06-bac9-c5cfa586106b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:34.408184 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b9e36990-490f-4c06-bac9-c5cfa586106b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:34.408616 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b9e36990-490f-4c06-bac9-c5cfa586106b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:34.506752 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8a739c27-d787-4d9f-a02c-d5ba3d5e5195 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:34.507357 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8a739c27-d787-4d9f-a02c-d5ba3d5e5195 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:34.514627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8a739c27-d787-4d9f-a02c-d5ba3d5e5195 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:34.515107 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8a739c27-d787-4d9f-a02c-d5ba3d5e5195 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:34.515565 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8a739c27-d787-4d9f-a02c-d5ba3d5e5195 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:34.516260 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8a739c27-d787-4d9f-a02c-d5ba3d5e5195 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:34.516706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8a739c27-d787-4d9f-a02c-d5ba3d5e5195 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:34.517126 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8a739c27-d787-4d9f-a02c-d5ba3d5e5195 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:34.521131 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:02:34.534218 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b9e36990-490f-4c06-bac9-c5cfa586106b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:34.542333 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b9e36990-490f-4c06-bac9-c5cfa586106b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.147826 Oct 11 07:02:34.542883 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1373/2733] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:34 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:34.644018 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8a739c27-d787-4d9f-a02c-d5ba3d5e5195 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:34.653180 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8a739c27-d787-4d9f-a02c-d5ba3d5e5195 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:34.654533 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8a739c27-d787-4d9f-a02c-d5ba3d5e5195 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:34.655711 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8a739c27-d787-4d9f-a02c-d5ba3d5e5195 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152762 Oct 11 07:02:34.656254 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1361/2734] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:34 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:02:34.822476 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-925c8026-bb03-4bca-ac6a-25ecbe91ee12 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:34.823121 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-925c8026-bb03-4bca-ac6a-25ecbe91ee12 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:34.828975 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-925c8026-bb03-4bca-ac6a-25ecbe91ee12 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:34.829454 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-925c8026-bb03-4bca-ac6a-25ecbe91ee12 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:34.829915 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-925c8026-bb03-4bca-ac6a-25ecbe91ee12 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:34.830599 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-925c8026-bb03-4bca-ac6a-25ecbe91ee12 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:34.831044 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-925c8026-bb03-4bca-ac6a-25ecbe91ee12 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:34.831488 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-925c8026-bb03-4bca-ac6a-25ecbe91ee12 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:34.962385 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-925c8026-bb03-4bca-ac6a-25ecbe91ee12 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:34.970619 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-925c8026-bb03-4bca-ac6a-25ecbe91ee12 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.152503 Oct 11 07:02:34.971322 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1374/2735] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:34 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:35.565210 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0cd3416f-dc5d-48f2-8faf-9b085f227db7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:35.565811 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0cd3416f-dc5d-48f2-8faf-9b085f227db7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:35.572230 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0cd3416f-dc5d-48f2-8faf-9b085f227db7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:35.572700 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0cd3416f-dc5d-48f2-8faf-9b085f227db7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:35.573124 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0cd3416f-dc5d-48f2-8faf-9b085f227db7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:35.573802 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0cd3416f-dc5d-48f2-8faf-9b085f227db7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:35.574240 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0cd3416f-dc5d-48f2-8faf-9b085f227db7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:35.574653 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0cd3416f-dc5d-48f2-8faf-9b085f227db7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:35.680753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8b88c81d-9765-412a-83f3-8e24513f81ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:35.681284 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8b88c81d-9765-412a-83f3-8e24513f81ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:35.687686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8b88c81d-9765-412a-83f3-8e24513f81ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:35.688164 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8b88c81d-9765-412a-83f3-8e24513f81ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:35.688598 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8b88c81d-9765-412a-83f3-8e24513f81ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:35.689285 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8b88c81d-9765-412a-83f3-8e24513f81ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:35.689734 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8b88c81d-9765-412a-83f3-8e24513f81ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:35.690157 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8b88c81d-9765-412a-83f3-8e24513f81ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:35.704268 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0cd3416f-dc5d-48f2-8faf-9b085f227db7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:35.712979 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0cd3416f-dc5d-48f2-8faf-9b085f227db7 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.151619 Oct 11 07:02:35.713637 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1362/2736] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:35 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:35.818138 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8b88c81d-9765-412a-83f3-8e24513f81ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:35.827128 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8b88c81d-9765-412a-83f3-8e24513f81ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:35.828640 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8b88c81d-9765-412a-83f3-8e24513f81ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:35.829791 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8b88c81d-9765-412a-83f3-8e24513f81ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152961 Oct 11 07:02:35.830340 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1375/2737] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:35 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:02:35.993835 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3531a0a4-8dd5-40ea-88fd-e8626e35308c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:35.994453 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3531a0a4-8dd5-40ea-88fd-e8626e35308c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:36.000298 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3531a0a4-8dd5-40ea-88fd-e8626e35308c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:36.000782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3531a0a4-8dd5-40ea-88fd-e8626e35308c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:36.001211 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3531a0a4-8dd5-40ea-88fd-e8626e35308c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:36.001935 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3531a0a4-8dd5-40ea-88fd-e8626e35308c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:36.002385 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3531a0a4-8dd5-40ea-88fd-e8626e35308c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:36.002811 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3531a0a4-8dd5-40ea-88fd-e8626e35308c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:36.129294 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3531a0a4-8dd5-40ea-88fd-e8626e35308c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:36.138118 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3531a0a4-8dd5-40ea-88fd-e8626e35308c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.148113 Oct 11 07:02:36.138669 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1363/2738] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:35 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:36.736777 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2bf55077-429a-41b3-81d7-978c47316f10 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:36.737321 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2bf55077-429a-41b3-81d7-978c47316f10 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:36.744241 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2bf55077-429a-41b3-81d7-978c47316f10 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:36.744706 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2bf55077-429a-41b3-81d7-978c47316f10 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:36.745131 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2bf55077-429a-41b3-81d7-978c47316f10 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:36.745803 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2bf55077-429a-41b3-81d7-978c47316f10 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:36.746244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2bf55077-429a-41b3-81d7-978c47316f10 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:36.746659 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2bf55077-429a-41b3-81d7-978c47316f10 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:36.855542 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8287fd93-73c5-4c7f-a750-295be1a728b9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:36.856146 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8287fd93-73c5-4c7f-a750-295be1a728b9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:36.862440 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8287fd93-73c5-4c7f-a750-295be1a728b9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:36.862915 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8287fd93-73c5-4c7f-a750-295be1a728b9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:36.863340 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8287fd93-73c5-4c7f-a750-295be1a728b9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:36.864189 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8287fd93-73c5-4c7f-a750-295be1a728b9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:36.864629 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8287fd93-73c5-4c7f-a750-295be1a728b9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:36.865042 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8287fd93-73c5-4c7f-a750-295be1a728b9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:36.874781 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2bf55077-429a-41b3-81d7-978c47316f10 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:36.882963 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2bf55077-429a-41b3-81d7-978c47316f10 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150079 Oct 11 07:02:36.883530 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1376/2739] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:36 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:36.995700 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8287fd93-73c5-4c7f-a750-295be1a728b9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:37.004204 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8287fd93-73c5-4c7f-a750-295be1a728b9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:37.005628 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8287fd93-73c5-4c7f-a750-295be1a728b9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:37.006790 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8287fd93-73c5-4c7f-a750-295be1a728b9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.155641 Oct 11 07:02:37.007336 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1364/2740] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:36 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:02:37.161487 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b82fe411-3eb0-4871-b952-c2f9275c0620 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:37.162086 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b82fe411-3eb0-4871-b952-c2f9275c0620 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:37.168505 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b82fe411-3eb0-4871-b952-c2f9275c0620 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:37.168967 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b82fe411-3eb0-4871-b952-c2f9275c0620 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:37.169393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b82fe411-3eb0-4871-b952-c2f9275c0620 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:37.170071 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b82fe411-3eb0-4871-b952-c2f9275c0620 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:37.170510 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b82fe411-3eb0-4871-b952-c2f9275c0620 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:37.170957 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b82fe411-3eb0-4871-b952-c2f9275c0620 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:37.300975 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b82fe411-3eb0-4871-b952-c2f9275c0620 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:37.309151 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b82fe411-3eb0-4871-b952-c2f9275c0620 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.151403 Oct 11 07:02:37.309705 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1377/2741] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:37 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:37.905977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b25aae97-6049-4c46-895a-edec641dbaa8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:37.906583 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b25aae97-6049-4c46-895a-edec641dbaa8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:37.912996 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b25aae97-6049-4c46-895a-edec641dbaa8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:37.913464 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b25aae97-6049-4c46-895a-edec641dbaa8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:37.913889 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b25aae97-6049-4c46-895a-edec641dbaa8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:37.914582 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b25aae97-6049-4c46-895a-edec641dbaa8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:37.915007 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b25aae97-6049-4c46-895a-edec641dbaa8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:37.915425 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b25aae97-6049-4c46-895a-edec641dbaa8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:38.032815 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4f827901-f81f-4ebe-b9ff-429759600ab2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:38.033444 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4f827901-f81f-4ebe-b9ff-429759600ab2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:38.039843 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f827901-f81f-4ebe-b9ff-429759600ab2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:38.040322 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f827901-f81f-4ebe-b9ff-429759600ab2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:38.040750 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f827901-f81f-4ebe-b9ff-429759600ab2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:38.041438 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f827901-f81f-4ebe-b9ff-429759600ab2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:38.041886 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f827901-f81f-4ebe-b9ff-429759600ab2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:38.042303 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f827901-f81f-4ebe-b9ff-429759600ab2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:38.045590 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b25aae97-6049-4c46-895a-edec641dbaa8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:38.053841 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b25aae97-6049-4c46-895a-edec641dbaa8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.151651 Oct 11 07:02:38.054396 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1365/2742] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:37 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:38.170260 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4f827901-f81f-4ebe-b9ff-429759600ab2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:38.179019 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4f827901-f81f-4ebe-b9ff-429759600ab2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:38.180472 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4f827901-f81f-4ebe-b9ff-429759600ab2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:38.182284 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4f827901-f81f-4ebe-b9ff-429759600ab2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.153392 Oct 11 07:02:38.182821 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1378/2743] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:38 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:02:38.332559 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1bac21d7-02a6-4383-b7a4-55ce934c890e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:38.333189 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1bac21d7-02a6-4383-b7a4-55ce934c890e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:38.339231 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1bac21d7-02a6-4383-b7a4-55ce934c890e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:38.339729 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1bac21d7-02a6-4383-b7a4-55ce934c890e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:38.340156 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1bac21d7-02a6-4383-b7a4-55ce934c890e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:38.340829 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1bac21d7-02a6-4383-b7a4-55ce934c890e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:38.341272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1bac21d7-02a6-4383-b7a4-55ce934c890e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:38.341682 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1bac21d7-02a6-4383-b7a4-55ce934c890e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:38.466073 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1bac21d7-02a6-4383-b7a4-55ce934c890e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:38.474155 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1bac21d7-02a6-4383-b7a4-55ce934c890e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.145435 Oct 11 07:02:38.474715 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1366/2744] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:38 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:39.077869 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ed099656-3e3a-4ed0-956f-2629897f7962 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:39.078479 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ed099656-3e3a-4ed0-956f-2629897f7962 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:39.084899 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ed099656-3e3a-4ed0-956f-2629897f7962 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:39.085374 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ed099656-3e3a-4ed0-956f-2629897f7962 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:39.085805 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ed099656-3e3a-4ed0-956f-2629897f7962 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:39.086489 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ed099656-3e3a-4ed0-956f-2629897f7962 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:39.087591 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ed099656-3e3a-4ed0-956f-2629897f7962 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:39.088013 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ed099656-3e3a-4ed0-956f-2629897f7962 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:39.208307 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8503584c-f899-46ed-bbee-a926ab552df6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:39.208964 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8503584c-f899-46ed-bbee-a926ab552df6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:39.217044 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8503584c-f899-46ed-bbee-a926ab552df6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:39.217533 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8503584c-f899-46ed-bbee-a926ab552df6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:39.217964 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8503584c-f899-46ed-bbee-a926ab552df6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:39.218670 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8503584c-f899-46ed-bbee-a926ab552df6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:39.219116 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8503584c-f899-46ed-bbee-a926ab552df6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:39.219794 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8503584c-f899-46ed-bbee-a926ab552df6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:39.220546 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ed099656-3e3a-4ed0-956f-2629897f7962 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:39.229897 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ed099656-3e3a-4ed0-956f-2629897f7962 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.155760 Oct 11 07:02:39.230805 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1379/2745] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:39 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:39.361044 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8503584c-f899-46ed-bbee-a926ab552df6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:39.369615 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8503584c-f899-46ed-bbee-a926ab552df6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:39.371054 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8503584c-f899-46ed-bbee-a926ab552df6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:39.372228 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8503584c-f899-46ed-bbee-a926ab552df6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.168716 Oct 11 07:02:39.372781 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1367/2746] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:39 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:02:39.498069 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-04b41530-8352-44df-806d-d02ed4df48da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:39.498678 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-04b41530-8352-44df-806d-d02ed4df48da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:39.504719 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04b41530-8352-44df-806d-d02ed4df48da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:39.505195 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04b41530-8352-44df-806d-d02ed4df48da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:39.505630 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04b41530-8352-44df-806d-d02ed4df48da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:39.506325 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04b41530-8352-44df-806d-d02ed4df48da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:39.506770 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04b41530-8352-44df-806d-d02ed4df48da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:39.507211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-04b41530-8352-44df-806d-d02ed4df48da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:39.631754 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-04b41530-8352-44df-806d-d02ed4df48da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:39.640610 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-04b41530-8352-44df-806d-d02ed4df48da tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.146412 Oct 11 07:02:39.641165 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1380/2747] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:39 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:40.265961 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bee917ad-0da4-46d2-aaf4-6c2d6cd9b8f1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:40.266565 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bee917ad-0da4-46d2-aaf4-6c2d6cd9b8f1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:40.273021 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bee917ad-0da4-46d2-aaf4-6c2d6cd9b8f1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:40.273498 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bee917ad-0da4-46d2-aaf4-6c2d6cd9b8f1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:40.273921 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bee917ad-0da4-46d2-aaf4-6c2d6cd9b8f1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:40.274612 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bee917ad-0da4-46d2-aaf4-6c2d6cd9b8f1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:40.275053 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bee917ad-0da4-46d2-aaf4-6c2d6cd9b8f1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:40.275491 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bee917ad-0da4-46d2-aaf4-6c2d6cd9b8f1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:40.398111 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3841c5e7-479e-40ca-ac43-7d88c2a9eab4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:40.398721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3841c5e7-479e-40ca-ac43-7d88c2a9eab4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:40.401166 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=78 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:02:40.403245 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-bee917ad-0da4-46d2-aaf4-6c2d6cd9b8f1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:40.406407 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3841c5e7-479e-40ca-ac43-7d88c2a9eab4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:40.406897 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3841c5e7-479e-40ca-ac43-7d88c2a9eab4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:40.407333 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3841c5e7-479e-40ca-ac43-7d88c2a9eab4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:40.408472 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3841c5e7-479e-40ca-ac43-7d88c2a9eab4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:40.408596 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3841c5e7-479e-40ca-ac43-7d88c2a9eab4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:40.409004 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3841c5e7-479e-40ca-ac43-7d88c2a9eab4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:40.412496 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bee917ad-0da4-46d2-aaf4-6c2d6cd9b8f1 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150543 Oct 11 07:02:40.419346 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1368/2748] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:40 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:40.427941 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:02:40.542440 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3841c5e7-479e-40ca-ac43-7d88c2a9eab4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:40.550911 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3841c5e7-479e-40ca-ac43-7d88c2a9eab4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:40.552411 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3841c5e7-479e-40ca-ac43-7d88c2a9eab4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:40.553564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3841c5e7-479e-40ca-ac43-7d88c2a9eab4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.159592 Oct 11 07:02:40.554117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1381/2749] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:40 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:02:40.665554 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-38996091-c903-4692-a203-03da84308356 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:40.666156 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-38996091-c903-4692-a203-03da84308356 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:40.672117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38996091-c903-4692-a203-03da84308356 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:40.672594 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38996091-c903-4692-a203-03da84308356 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:40.673048 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38996091-c903-4692-a203-03da84308356 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:40.673723 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38996091-c903-4692-a203-03da84308356 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:40.674167 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38996091-c903-4692-a203-03da84308356 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:40.674584 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38996091-c903-4692-a203-03da84308356 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:40.806200 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-38996091-c903-4692-a203-03da84308356 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:40.814542 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-38996091-c903-4692-a203-03da84308356 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.153211 Oct 11 07:02:40.815092 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1369/2750] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:40 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:41.436482 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-30e7f146-8db1-4c4d-8626-bc8d4127ff52 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:41.437095 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-30e7f146-8db1-4c4d-8626-bc8d4127ff52 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:41.443472 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-30e7f146-8db1-4c4d-8626-bc8d4127ff52 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:41.443954 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-30e7f146-8db1-4c4d-8626-bc8d4127ff52 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:41.444390 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-30e7f146-8db1-4c4d-8626-bc8d4127ff52 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:41.445076 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-30e7f146-8db1-4c4d-8626-bc8d4127ff52 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:41.445525 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-30e7f146-8db1-4c4d-8626-bc8d4127ff52 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:41.445949 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-30e7f146-8db1-4c4d-8626-bc8d4127ff52 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:41.572560 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-30e7f146-8db1-4c4d-8626-bc8d4127ff52 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:41.579226 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4081571a-7b29-4b23-809c-cc5c383f92eb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:41.579876 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4081571a-7b29-4b23-809c-cc5c383f92eb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:41.580828 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-30e7f146-8db1-4c4d-8626-bc8d4127ff52 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.148139 Oct 11 07:02:41.581563 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1382/2751] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:41 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:41.586276 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4081571a-7b29-4b23-809c-cc5c383f92eb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:41.586750 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4081571a-7b29-4b23-809c-cc5c383f92eb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:41.587182 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4081571a-7b29-4b23-809c-cc5c383f92eb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:41.588408 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4081571a-7b29-4b23-809c-cc5c383f92eb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:41.588863 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4081571a-7b29-4b23-809c-cc5c383f92eb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:41.589285 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4081571a-7b29-4b23-809c-cc5c383f92eb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:41.714629 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4081571a-7b29-4b23-809c-cc5c383f92eb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:41.723125 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4081571a-7b29-4b23-809c-cc5c383f92eb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:41.724596 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4081571a-7b29-4b23-809c-cc5c383f92eb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:41.725736 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4081571a-7b29-4b23-809c-cc5c383f92eb tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.150364 Oct 11 07:02:41.726280 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1370/2752] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:41 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:02:41.837693 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a40d9668-2a5c-47c7-9922-83b238f21c82 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:41.838823 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a40d9668-2a5c-47c7-9922-83b238f21c82 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:41.844713 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a40d9668-2a5c-47c7-9922-83b238f21c82 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:41.845184 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a40d9668-2a5c-47c7-9922-83b238f21c82 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:41.845611 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a40d9668-2a5c-47c7-9922-83b238f21c82 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:41.846293 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a40d9668-2a5c-47c7-9922-83b238f21c82 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:41.846733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a40d9668-2a5c-47c7-9922-83b238f21c82 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:41.847147 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a40d9668-2a5c-47c7-9922-83b238f21c82 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:41.973628 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a40d9668-2a5c-47c7-9922-83b238f21c82 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:41.981591 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a40d9668-2a5c-47c7-9922-83b238f21c82 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.147757 Oct 11 07:02:41.982143 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1383/2753] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:41 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:02:42.604383 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6d731d40-a35e-419f-a6cc-2f82629005ec tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:42.604987 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6d731d40-a35e-419f-a6cc-2f82629005ec tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:42.611314 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6d731d40-a35e-419f-a6cc-2f82629005ec tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:42.611829 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6d731d40-a35e-419f-a6cc-2f82629005ec tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:42.612256 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6d731d40-a35e-419f-a6cc-2f82629005ec tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:42.612934 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6d731d40-a35e-419f-a6cc-2f82629005ec tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:42.613376 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6d731d40-a35e-419f-a6cc-2f82629005ec tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:42.613790 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6d731d40-a35e-419f-a6cc-2f82629005ec tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:42.740299 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6d731d40-a35e-419f-a6cc-2f82629005ec tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:42.749040 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6d731d40-a35e-419f-a6cc-2f82629005ec tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.148881 Oct 11 07:02:42.749593 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1371/2754] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:42 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:42.751959 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-045c0aac-65ce-4ffe-accf-6f90bfa28a93 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:42.752644 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-045c0aac-65ce-4ffe-accf-6f90bfa28a93 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:42.759246 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-045c0aac-65ce-4ffe-accf-6f90bfa28a93 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:42.759823 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-045c0aac-65ce-4ffe-accf-6f90bfa28a93 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:42.760341 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-045c0aac-65ce-4ffe-accf-6f90bfa28a93 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:42.761101 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-045c0aac-65ce-4ffe-accf-6f90bfa28a93 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:42.761549 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-045c0aac-65ce-4ffe-accf-6f90bfa28a93 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:42.762237 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-045c0aac-65ce-4ffe-accf-6f90bfa28a93 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:42.887989 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-045c0aac-65ce-4ffe-accf-6f90bfa28a93 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:42.896551 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-045c0aac-65ce-4ffe-accf-6f90bfa28a93 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:42.897963 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-045c0aac-65ce-4ffe-accf-6f90bfa28a93 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:42.899102 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-045c0aac-65ce-4ffe-accf-6f90bfa28a93 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.151189 Oct 11 07:02:42.899676 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1384/2755] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:42 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:02:43.004715 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bc76f2a0-3a3a-42af-8102-877a7ddac57b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:43.005302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bc76f2a0-3a3a-42af-8102-877a7ddac57b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:43.011809 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bc76f2a0-3a3a-42af-8102-877a7ddac57b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:43.012536 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bc76f2a0-3a3a-42af-8102-877a7ddac57b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:43.012963 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bc76f2a0-3a3a-42af-8102-877a7ddac57b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:43.013641 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bc76f2a0-3a3a-42af-8102-877a7ddac57b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:43.014083 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bc76f2a0-3a3a-42af-8102-877a7ddac57b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:43.014503 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bc76f2a0-3a3a-42af-8102-877a7ddac57b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:43.139547 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-bc76f2a0-3a3a-42af-8102-877a7ddac57b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:43.147624 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bc76f2a0-3a3a-42af-8102-877a7ddac57b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.146733 Oct 11 07:02:43.148176 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1372/2756] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:42 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:43.772254 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e4a8255a-6488-4bb5-87e2-ab7c66443f4b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:43.772876 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e4a8255a-6488-4bb5-87e2-ab7c66443f4b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:43.779693 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e4a8255a-6488-4bb5-87e2-ab7c66443f4b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:43.780162 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e4a8255a-6488-4bb5-87e2-ab7c66443f4b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:43.780589 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e4a8255a-6488-4bb5-87e2-ab7c66443f4b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:43.781259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e4a8255a-6488-4bb5-87e2-ab7c66443f4b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:43.781695 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e4a8255a-6488-4bb5-87e2-ab7c66443f4b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:43.782107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e4a8255a-6488-4bb5-87e2-ab7c66443f4b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:43.905804 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e4a8255a-6488-4bb5-87e2-ab7c66443f4b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:43.913784 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e4a8255a-6488-4bb5-87e2-ab7c66443f4b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.145417 Oct 11 07:02:43.914336 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1385/2757] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:43 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:43.925027 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c7256744-7c97-464c-aa3d-0f211f4ba8b0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:43.925663 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c7256744-7c97-464c-aa3d-0f211f4ba8b0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:43.932814 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c7256744-7c97-464c-aa3d-0f211f4ba8b0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:43.933289 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c7256744-7c97-464c-aa3d-0f211f4ba8b0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:43.933714 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c7256744-7c97-464c-aa3d-0f211f4ba8b0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:43.934395 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c7256744-7c97-464c-aa3d-0f211f4ba8b0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:43.934837 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c7256744-7c97-464c-aa3d-0f211f4ba8b0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:43.935251 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c7256744-7c97-464c-aa3d-0f211f4ba8b0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:44.060722 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c7256744-7c97-464c-aa3d-0f211f4ba8b0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:44.069168 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c7256744-7c97-464c-aa3d-0f211f4ba8b0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:44.070612 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c7256744-7c97-464c-aa3d-0f211f4ba8b0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:44.071794 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c7256744-7c97-464c-aa3d-0f211f4ba8b0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.150598 Oct 11 07:02:44.072344 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1373/2758] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:43 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:02:44.170422 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-25ef6719-dc6a-4348-8bf3-4b88c6418b50 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:44.171029 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-25ef6719-dc6a-4348-8bf3-4b88c6418b50 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:44.176925 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25ef6719-dc6a-4348-8bf3-4b88c6418b50 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:44.177396 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25ef6719-dc6a-4348-8bf3-4b88c6418b50 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:44.177826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25ef6719-dc6a-4348-8bf3-4b88c6418b50 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:44.178534 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25ef6719-dc6a-4348-8bf3-4b88c6418b50 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:44.178978 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25ef6719-dc6a-4348-8bf3-4b88c6418b50 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:44.179440 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-25ef6719-dc6a-4348-8bf3-4b88c6418b50 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:44.307501 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-25ef6719-dc6a-4348-8bf3-4b88c6418b50 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:44.315627 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-25ef6719-dc6a-4348-8bf3-4b88c6418b50 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.149520 Oct 11 07:02:44.316184 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1386/2759] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:44 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:44.935472 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b50eb7a8-d853-4355-ba8e-349677092126 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:44.936080 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b50eb7a8-d853-4355-ba8e-349677092126 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:44.942628 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b50eb7a8-d853-4355-ba8e-349677092126 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:44.943125 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b50eb7a8-d853-4355-ba8e-349677092126 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:44.943584 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b50eb7a8-d853-4355-ba8e-349677092126 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:44.944272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b50eb7a8-d853-4355-ba8e-349677092126 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:44.944741 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b50eb7a8-d853-4355-ba8e-349677092126 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:44.945144 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b50eb7a8-d853-4355-ba8e-349677092126 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:45.074457 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b50eb7a8-d853-4355-ba8e-349677092126 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:45.082492 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b50eb7a8-d853-4355-ba8e-349677092126 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150848 Oct 11 07:02:45.083046 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1374/2760] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:44 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:45.097271 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9a8033d2-f05a-4602-a51c-d7016b862d31 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:45.097907 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9a8033d2-f05a-4602-a51c-d7016b862d31 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:45.104379 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9a8033d2-f05a-4602-a51c-d7016b862d31 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:45.104855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9a8033d2-f05a-4602-a51c-d7016b862d31 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:45.105284 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9a8033d2-f05a-4602-a51c-d7016b862d31 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:45.105969 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9a8033d2-f05a-4602-a51c-d7016b862d31 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:45.106415 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9a8033d2-f05a-4602-a51c-d7016b862d31 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:45.106840 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9a8033d2-f05a-4602-a51c-d7016b862d31 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:45.230938 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9a8033d2-f05a-4602-a51c-d7016b862d31 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:45.239281 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9a8033d2-f05a-4602-a51c-d7016b862d31 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:45.240713 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9a8033d2-f05a-4602-a51c-d7016b862d31 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:45.241852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9a8033d2-f05a-4602-a51c-d7016b862d31 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.148628 Oct 11 07:02:45.242393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1387/2761] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:45 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:02:45.344825 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6ab0405b-48d2-4306-a2bb-944aed6fa344 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:45.345419 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6ab0405b-48d2-4306-a2bb-944aed6fa344 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:45.351278 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ab0405b-48d2-4306-a2bb-944aed6fa344 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:45.351782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ab0405b-48d2-4306-a2bb-944aed6fa344 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:45.352206 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ab0405b-48d2-4306-a2bb-944aed6fa344 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:45.352881 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ab0405b-48d2-4306-a2bb-944aed6fa344 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:45.353324 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ab0405b-48d2-4306-a2bb-944aed6fa344 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:45.354017 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ab0405b-48d2-4306-a2bb-944aed6fa344 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:45.481431 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6ab0405b-48d2-4306-a2bb-944aed6fa344 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:45.489456 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6ab0405b-48d2-4306-a2bb-944aed6fa344 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.148597 Oct 11 07:02:45.490000 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1375/2762] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:45 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:46.107588 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-742982cd-0ad1-4676-b21d-97b6b0af9486 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:46.108199 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-742982cd-0ad1-4676-b21d-97b6b0af9486 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:46.114512 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-742982cd-0ad1-4676-b21d-97b6b0af9486 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:46.114984 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-742982cd-0ad1-4676-b21d-97b6b0af9486 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:46.115406 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-742982cd-0ad1-4676-b21d-97b6b0af9486 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:46.116102 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-742982cd-0ad1-4676-b21d-97b6b0af9486 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:46.116540 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-742982cd-0ad1-4676-b21d-97b6b0af9486 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:46.116956 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-742982cd-0ad1-4676-b21d-97b6b0af9486 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:46.243855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-742982cd-0ad1-4676-b21d-97b6b0af9486 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:46.251932 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-742982cd-0ad1-4676-b21d-97b6b0af9486 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.148903 Oct 11 07:02:46.252491 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1388/2763] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:46 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:46.268139 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3099b751-7a73-411e-a06f-a2671c5c6efd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:46.268778 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3099b751-7a73-411e-a06f-a2671c5c6efd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:46.275164 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3099b751-7a73-411e-a06f-a2671c5c6efd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:46.276183 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3099b751-7a73-411e-a06f-a2671c5c6efd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:46.276621 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3099b751-7a73-411e-a06f-a2671c5c6efd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:46.277300 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3099b751-7a73-411e-a06f-a2671c5c6efd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:46.277747 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3099b751-7a73-411e-a06f-a2671c5c6efd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:46.278167 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3099b751-7a73-411e-a06f-a2671c5c6efd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:46.408986 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3099b751-7a73-411e-a06f-a2671c5c6efd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:46.417780 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3099b751-7a73-411e-a06f-a2671c5c6efd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:46.419231 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3099b751-7a73-411e-a06f-a2671c5c6efd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:46.420421 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3099b751-7a73-411e-a06f-a2671c5c6efd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.156153 Oct 11 07:02:46.420979 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1376/2764] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:46 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:02:46.513937 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7287aea3-f8f0-4f08-bcf7-42402acf2deb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:46.514480 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7287aea3-f8f0-4f08-bcf7-42402acf2deb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:46.520309 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7287aea3-f8f0-4f08-bcf7-42402acf2deb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:46.520779 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7287aea3-f8f0-4f08-bcf7-42402acf2deb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:46.521204 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7287aea3-f8f0-4f08-bcf7-42402acf2deb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:46.521876 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7287aea3-f8f0-4f08-bcf7-42402acf2deb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:46.522315 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7287aea3-f8f0-4f08-bcf7-42402acf2deb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:46.522728 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7287aea3-f8f0-4f08-bcf7-42402acf2deb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:46.651149 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7287aea3-f8f0-4f08-bcf7-42402acf2deb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:46.659434 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7287aea3-f8f0-4f08-bcf7-42402acf2deb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.150094 Oct 11 07:02:46.660163 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1389/2765] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:46 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:47.273986 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-624f4e9a-7b82-449f-9889-46d9e89c4576 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:47.274596 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-624f4e9a-7b82-449f-9889-46d9e89c4576 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:47.283069 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-624f4e9a-7b82-449f-9889-46d9e89c4576 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:47.283574 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-624f4e9a-7b82-449f-9889-46d9e89c4576 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:47.284006 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-624f4e9a-7b82-449f-9889-46d9e89c4576 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:47.284683 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-624f4e9a-7b82-449f-9889-46d9e89c4576 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:47.285132 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-624f4e9a-7b82-449f-9889-46d9e89c4576 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:47.285543 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-624f4e9a-7b82-449f-9889-46d9e89c4576 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:47.415023 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-624f4e9a-7b82-449f-9889-46d9e89c4576 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:47.418969 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:02:47.424493 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-624f4e9a-7b82-449f-9889-46d9e89c4576 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.154335 Oct 11 07:02:47.425050 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1377/2766] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:47 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:47.446078 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-56874866-ee85-468c-acda-747b5283e031 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:47.446813 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-56874866-ee85-468c-acda-747b5283e031 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:47.453842 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-56874866-ee85-468c-acda-747b5283e031 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:47.454314 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-56874866-ee85-468c-acda-747b5283e031 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:47.455021 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-56874866-ee85-468c-acda-747b5283e031 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:47.455402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-56874866-ee85-468c-acda-747b5283e031 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:47.455969 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-56874866-ee85-468c-acda-747b5283e031 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:47.456384 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-56874866-ee85-468c-acda-747b5283e031 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:47.590941 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-56874866-ee85-468c-acda-747b5283e031 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:47.601786 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-56874866-ee85-468c-acda-747b5283e031 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:47.603271 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-56874866-ee85-468c-acda-747b5283e031 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:47.605121 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-56874866-ee85-468c-acda-747b5283e031 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.163096 Oct 11 07:02:47.605759 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1390/2767] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:47 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:02:47.682789 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-353c0205-9f15-4c9d-83d4-6415ebc1dd9d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:47.683512 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-353c0205-9f15-4c9d-83d4-6415ebc1dd9d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:47.690096 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-353c0205-9f15-4c9d-83d4-6415ebc1dd9d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:47.690604 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-353c0205-9f15-4c9d-83d4-6415ebc1dd9d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:47.691000 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-353c0205-9f15-4c9d-83d4-6415ebc1dd9d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:47.691764 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-353c0205-9f15-4c9d-83d4-6415ebc1dd9d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:47.692217 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-353c0205-9f15-4c9d-83d4-6415ebc1dd9d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:47.692874 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-353c0205-9f15-4c9d-83d4-6415ebc1dd9d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:47.828272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-353c0205-9f15-4c9d-83d4-6415ebc1dd9d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:47.836723 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-353c0205-9f15-4c9d-83d4-6415ebc1dd9d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.157824 Oct 11 07:02:47.837267 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1378/2768] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:47 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:48.448163 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c8dada1a-a9bc-456e-b567-121767d4ce8f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:48.448769 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c8dada1a-a9bc-456e-b567-121767d4ce8f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:48.455093 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c8dada1a-a9bc-456e-b567-121767d4ce8f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:48.455600 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c8dada1a-a9bc-456e-b567-121767d4ce8f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:48.456030 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c8dada1a-a9bc-456e-b567-121767d4ce8f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:48.456704 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c8dada1a-a9bc-456e-b567-121767d4ce8f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:48.457143 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c8dada1a-a9bc-456e-b567-121767d4ce8f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:48.457558 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c8dada1a-a9bc-456e-b567-121767d4ce8f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:48.632953 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0bd90245-bf1e-48d0-be41-8983f5030c3c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:48.633585 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0bd90245-bf1e-48d0-be41-8983f5030c3c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:48.640086 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0bd90245-bf1e-48d0-be41-8983f5030c3c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:48.640574 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0bd90245-bf1e-48d0-be41-8983f5030c3c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:48.641004 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0bd90245-bf1e-48d0-be41-8983f5030c3c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:48.641706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0bd90245-bf1e-48d0-be41-8983f5030c3c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:48.642153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0bd90245-bf1e-48d0-be41-8983f5030c3c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:48.642575 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0bd90245-bf1e-48d0-be41-8983f5030c3c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:48.788499 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0bd90245-bf1e-48d0-be41-8983f5030c3c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:48.798509 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0bd90245-bf1e-48d0-be41-8983f5030c3c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:48.800019 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0bd90245-bf1e-48d0-be41-8983f5030c3c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:48.801217 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0bd90245-bf1e-48d0-be41-8983f5030c3c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.172232 Oct 11 07:02:48.801765 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1379/2769] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:48 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:02:48.838491 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c8dada1a-a9bc-456e-b567-121767d4ce8f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:48.846713 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c8dada1a-a9bc-456e-b567-121767d4ce8f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.403100 Oct 11 07:02:48.847267 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1391/2770] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:48 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:48.861839 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-11189bf4-d02c-411e-8486-b5a0df05c441 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:48.862444 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-11189bf4-d02c-411e-8486-b5a0df05c441 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:48.868472 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-11189bf4-d02c-411e-8486-b5a0df05c441 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:48.869574 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-11189bf4-d02c-411e-8486-b5a0df05c441 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:48.870009 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-11189bf4-d02c-411e-8486-b5a0df05c441 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:48.870689 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-11189bf4-d02c-411e-8486-b5a0df05c441 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:48.871132 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-11189bf4-d02c-411e-8486-b5a0df05c441 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:48.871573 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-11189bf4-d02c-411e-8486-b5a0df05c441 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:48.997375 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-11189bf4-d02c-411e-8486-b5a0df05c441 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:49.005762 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-11189bf4-d02c-411e-8486-b5a0df05c441 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.147367 Oct 11 07:02:49.006312 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1380/2771] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:48 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:49.826510 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e1c74144-7ee2-4aa3-8ab5-fdd09b6329aa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:49.827116 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e1c74144-7ee2-4aa3-8ab5-fdd09b6329aa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:49.833435 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e1c74144-7ee2-4aa3-8ab5-fdd09b6329aa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:49.833911 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e1c74144-7ee2-4aa3-8ab5-fdd09b6329aa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:49.834332 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e1c74144-7ee2-4aa3-8ab5-fdd09b6329aa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:49.835015 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e1c74144-7ee2-4aa3-8ab5-fdd09b6329aa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:49.835482 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e1c74144-7ee2-4aa3-8ab5-fdd09b6329aa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:49.835905 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e1c74144-7ee2-4aa3-8ab5-fdd09b6329aa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:49.869924 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2a84a5b9-e08d-4178-b08e-6c38f2b302af tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:49.870532 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2a84a5b9-e08d-4178-b08e-6c38f2b302af tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:49.876982 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2a84a5b9-e08d-4178-b08e-6c38f2b302af tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:49.877460 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2a84a5b9-e08d-4178-b08e-6c38f2b302af tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:49.877889 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2a84a5b9-e08d-4178-b08e-6c38f2b302af tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:49.878585 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2a84a5b9-e08d-4178-b08e-6c38f2b302af tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:49.879033 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2a84a5b9-e08d-4178-b08e-6c38f2b302af tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:49.879474 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2a84a5b9-e08d-4178-b08e-6c38f2b302af tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:49.962684 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e1c74144-7ee2-4aa3-8ab5-fdd09b6329aa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:49.971736 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e1c74144-7ee2-4aa3-8ab5-fdd09b6329aa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:49.973448 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e1c74144-7ee2-4aa3-8ab5-fdd09b6329aa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:49.974645 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e1c74144-7ee2-4aa3-8ab5-fdd09b6329aa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152567 Oct 11 07:02:49.975566 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1392/2772] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:49 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:02:50.010943 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2a84a5b9-e08d-4178-b08e-6c38f2b302af tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:50.019410 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2a84a5b9-e08d-4178-b08e-6c38f2b302af tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.153811 Oct 11 07:02:50.019984 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1381/2773] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:49 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:02:50.028773 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-94ce6b16-8bba-4162-bcb2-20e82211f86d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:50.029406 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-94ce6b16-8bba-4162-bcb2-20e82211f86d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:50.035308 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-94ce6b16-8bba-4162-bcb2-20e82211f86d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:50.035820 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-94ce6b16-8bba-4162-bcb2-20e82211f86d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:50.036251 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-94ce6b16-8bba-4162-bcb2-20e82211f86d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:50.036937 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-94ce6b16-8bba-4162-bcb2-20e82211f86d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:50.037386 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-94ce6b16-8bba-4162-bcb2-20e82211f86d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:50.037807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-94ce6b16-8bba-4162-bcb2-20e82211f86d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:50.163919 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-94ce6b16-8bba-4162-bcb2-20e82211f86d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:50.172487 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-94ce6b16-8bba-4162-bcb2-20e82211f86d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.147539 Oct 11 07:02:50.173042 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1393/2774] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:50 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:50.999944 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-169dfd68-af57-4e44-874c-e36c159efe33 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:51.000544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-169dfd68-af57-4e44-874c-e36c159efe33 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:51.006874 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-169dfd68-af57-4e44-874c-e36c159efe33 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:51.007355 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-169dfd68-af57-4e44-874c-e36c159efe33 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:51.007800 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-169dfd68-af57-4e44-874c-e36c159efe33 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:51.008476 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-169dfd68-af57-4e44-874c-e36c159efe33 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:51.008926 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-169dfd68-af57-4e44-874c-e36c159efe33 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:51.009343 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-169dfd68-af57-4e44-874c-e36c159efe33 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:51.042792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-67918704-3962-4851-b015-945660263906 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:51.043322 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-67918704-3962-4851-b015-945660263906 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:51.049313 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67918704-3962-4851-b015-945660263906 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:51.049786 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67918704-3962-4851-b015-945660263906 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:51.050214 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67918704-3962-4851-b015-945660263906 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:51.050909 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67918704-3962-4851-b015-945660263906 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:51.051350 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67918704-3962-4851-b015-945660263906 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:51.051793 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67918704-3962-4851-b015-945660263906 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:51.136635 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-169dfd68-af57-4e44-874c-e36c159efe33 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:51.145736 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-169dfd68-af57-4e44-874c-e36c159efe33 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:51.147179 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-169dfd68-af57-4e44-874c-e36c159efe33 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:51.148356 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-169dfd68-af57-4e44-874c-e36c159efe33 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152300 Oct 11 07:02:51.148914 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1382/2775] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:50 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:02:51.179042 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-67918704-3962-4851-b015-945660263906 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:51.187078 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-67918704-3962-4851-b015-945660263906 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.148715 Oct 11 07:02:51.187671 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1394/2776] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:51 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:02:51.195915 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-645fe357-8ad9-49d7-a200-ce5d631babb3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:51.196607 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-645fe357-8ad9-49d7-a200-ce5d631babb3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:51.202511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-645fe357-8ad9-49d7-a200-ce5d631babb3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:51.202989 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-645fe357-8ad9-49d7-a200-ce5d631babb3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:51.203433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-645fe357-8ad9-49d7-a200-ce5d631babb3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:51.204125 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-645fe357-8ad9-49d7-a200-ce5d631babb3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:51.204574 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-645fe357-8ad9-49d7-a200-ce5d631babb3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:51.204994 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-645fe357-8ad9-49d7-a200-ce5d631babb3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:51.335494 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-645fe357-8ad9-49d7-a200-ce5d631babb3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:51.344069 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-645fe357-8ad9-49d7-a200-ce5d631babb3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.151884 Oct 11 07:02:51.344624 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1383/2777] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:51 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:52.174394 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-37ddfcf0-3757-4398-a11b-7f5c96124d0d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:52.174923 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-37ddfcf0-3757-4398-a11b-7f5c96124d0d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:52.181368 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-37ddfcf0-3757-4398-a11b-7f5c96124d0d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:52.182347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-37ddfcf0-3757-4398-a11b-7f5c96124d0d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:52.182782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-37ddfcf0-3757-4398-a11b-7f5c96124d0d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:52.183497 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-37ddfcf0-3757-4398-a11b-7f5c96124d0d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:52.183949 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-37ddfcf0-3757-4398-a11b-7f5c96124d0d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:52.184370 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-37ddfcf0-3757-4398-a11b-7f5c96124d0d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:52.209995 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-505a623a-c1fa-4f03-aa2d-1ead3f15c337 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:52.210634 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-505a623a-c1fa-4f03-aa2d-1ead3f15c337 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:52.217126 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-505a623a-c1fa-4f03-aa2d-1ead3f15c337 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:52.217605 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-505a623a-c1fa-4f03-aa2d-1ead3f15c337 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:52.218046 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-505a623a-c1fa-4f03-aa2d-1ead3f15c337 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:52.218739 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-505a623a-c1fa-4f03-aa2d-1ead3f15c337 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:52.219190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-505a623a-c1fa-4f03-aa2d-1ead3f15c337 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:52.219642 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-505a623a-c1fa-4f03-aa2d-1ead3f15c337 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:52.316272 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-37ddfcf0-3757-4398-a11b-7f5c96124d0d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:52.325011 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-37ddfcf0-3757-4398-a11b-7f5c96124d0d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:52.326522 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-37ddfcf0-3757-4398-a11b-7f5c96124d0d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:52.327740 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-37ddfcf0-3757-4398-a11b-7f5c96124d0d tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.157231 Oct 11 07:02:52.328430 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1395/2778] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:52 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:02:52.347732 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-505a623a-c1fa-4f03-aa2d-1ead3f15c337 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:52.356513 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-505a623a-c1fa-4f03-aa2d-1ead3f15c337 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150342 Oct 11 07:02:52.357064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1384/2779] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:52 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:02:52.366810 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-94b16766-9695-4753-ad83-07208e405144 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:52.367432 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-94b16766-9695-4753-ad83-07208e405144 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:52.373961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-94b16766-9695-4753-ad83-07208e405144 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:52.374471 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-94b16766-9695-4753-ad83-07208e405144 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:52.374902 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-94b16766-9695-4753-ad83-07208e405144 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:52.375648 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-94b16766-9695-4753-ad83-07208e405144 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:52.376094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-94b16766-9695-4753-ad83-07208e405144 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:52.376556 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-94b16766-9695-4753-ad83-07208e405144 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:52.502445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-94b16766-9695-4753-ad83-07208e405144 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:52.510788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-94b16766-9695-4753-ad83-07208e405144 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.147782 Oct 11 07:02:52.511394 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1396/2780] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:52 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:53.354254 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3bd48b5d-53fb-4fd1-904a-1b5201f6d227 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:53.354902 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3bd48b5d-53fb-4fd1-904a-1b5201f6d227 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:53.357286 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=78 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:02:53.362678 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3bd48b5d-53fb-4fd1-904a-1b5201f6d227 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:53.363159 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3bd48b5d-53fb-4fd1-904a-1b5201f6d227 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:53.363637 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3bd48b5d-53fb-4fd1-904a-1b5201f6d227 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:53.364336 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3bd48b5d-53fb-4fd1-904a-1b5201f6d227 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:53.364786 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3bd48b5d-53fb-4fd1-904a-1b5201f6d227 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:53.365215 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3bd48b5d-53fb-4fd1-904a-1b5201f6d227 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:53.379961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8d4988ab-c1d9-4f11-8ac5-12c98247be04 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:53.380639 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8d4988ab-c1d9-4f11-8ac5-12c98247be04 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:53.387199 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8d4988ab-c1d9-4f11-8ac5-12c98247be04 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:53.387726 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8d4988ab-c1d9-4f11-8ac5-12c98247be04 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:53.388151 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8d4988ab-c1d9-4f11-8ac5-12c98247be04 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:53.388827 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8d4988ab-c1d9-4f11-8ac5-12c98247be04 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:53.389269 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8d4988ab-c1d9-4f11-8ac5-12c98247be04 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:53.389682 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8d4988ab-c1d9-4f11-8ac5-12c98247be04 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:53.495647 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3bd48b5d-53fb-4fd1-904a-1b5201f6d227 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:53.504422 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3bd48b5d-53fb-4fd1-904a-1b5201f6d227 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:53.505859 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3bd48b5d-53fb-4fd1-904a-1b5201f6d227 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:53.507022 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3bd48b5d-53fb-4fd1-904a-1b5201f6d227 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.157257 Oct 11 07:02:53.507600 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1385/2781] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:53 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:02:53.516280 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8d4988ab-c1d9-4f11-8ac5-12c98247be04 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:53.524364 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8d4988ab-c1d9-4f11-8ac5-12c98247be04 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.148194 Oct 11 07:02:53.524980 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1397/2782] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:53 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:02:53.533723 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9eb8b5a6-fce1-4161-9e87-c25e52dd68b9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:53.534329 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9eb8b5a6-fce1-4161-9e87-c25e52dd68b9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:53.540180 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9eb8b5a6-fce1-4161-9e87-c25e52dd68b9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:53.540659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9eb8b5a6-fce1-4161-9e87-c25e52dd68b9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:53.541655 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9eb8b5a6-fce1-4161-9e87-c25e52dd68b9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:53.542338 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9eb8b5a6-fce1-4161-9e87-c25e52dd68b9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:53.542788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9eb8b5a6-fce1-4161-9e87-c25e52dd68b9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:53.543208 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9eb8b5a6-fce1-4161-9e87-c25e52dd68b9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:53.673834 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9eb8b5a6-fce1-4161-9e87-c25e52dd68b9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:53.681937 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9eb8b5a6-fce1-4161-9e87-c25e52dd68b9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.151907 Oct 11 07:02:53.682487 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1386/2783] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:53 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:54.532576 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-51e696d9-7eae-4542-90a7-53614c08c533 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:54.533181 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-51e696d9-7eae-4542-90a7-53614c08c533 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:54.539563 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-51e696d9-7eae-4542-90a7-53614c08c533 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:54.540039 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-51e696d9-7eae-4542-90a7-53614c08c533 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:54.540467 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-51e696d9-7eae-4542-90a7-53614c08c533 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:54.541653 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-51e696d9-7eae-4542-90a7-53614c08c533 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:54.542102 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-51e696d9-7eae-4542-90a7-53614c08c533 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:54.542616 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-51e696d9-7eae-4542-90a7-53614c08c533 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:54.546585 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:02:54.547759 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3772b72b-cccd-41d9-840d-ec47620f372e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:54.548420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3772b72b-cccd-41d9-840d-ec47620f372e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:54.554893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3772b72b-cccd-41d9-840d-ec47620f372e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:54.555371 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3772b72b-cccd-41d9-840d-ec47620f372e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:54.555831 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3772b72b-cccd-41d9-840d-ec47620f372e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:54.557205 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3772b72b-cccd-41d9-840d-ec47620f372e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:54.557654 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3772b72b-cccd-41d9-840d-ec47620f372e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:54.558070 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3772b72b-cccd-41d9-840d-ec47620f372e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:54.673723 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-51e696d9-7eae-4542-90a7-53614c08c533 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:54.682876 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-51e696d9-7eae-4542-90a7-53614c08c533 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:54.684174 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3772b72b-cccd-41d9-840d-ec47620f372e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:54.684341 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-51e696d9-7eae-4542-90a7-53614c08c533 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:54.685463 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-51e696d9-7eae-4542-90a7-53614c08c533 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.156827 Oct 11 07:02:54.686097 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1398/2784] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:54 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:02:54.692436 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3772b72b-cccd-41d9-840d-ec47620f372e tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.148692 Oct 11 07:02:54.692994 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1387/2785] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:54 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:54.704344 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a8f0d85e-e541-4114-abde-261b45c616d9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:54.704936 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a8f0d85e-e541-4114-abde-261b45c616d9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:54.710754 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a8f0d85e-e541-4114-abde-261b45c616d9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:54.711256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a8f0d85e-e541-4114-abde-261b45c616d9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:54.711716 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a8f0d85e-e541-4114-abde-261b45c616d9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:54.712388 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a8f0d85e-e541-4114-abde-261b45c616d9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:54.712825 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a8f0d85e-e541-4114-abde-261b45c616d9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:54.713235 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a8f0d85e-e541-4114-abde-261b45c616d9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:54.837306 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a8f0d85e-e541-4114-abde-261b45c616d9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:54.845337 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a8f0d85e-e541-4114-abde-261b45c616d9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.144567 Oct 11 07:02:54.845893 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1399/2786] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:54 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:02:55.710960 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7a4ce43f-c66e-4318-b12d-7b9cd1d07d9b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:55.711559 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7a4ce43f-c66e-4318-b12d-7b9cd1d07d9b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:55.715190 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9a9c1693-4063-4cf1-a815-8519bcbb601d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:55.715836 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9a9c1693-4063-4cf1-a815-8519bcbb601d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:55.718098 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7a4ce43f-c66e-4318-b12d-7b9cd1d07d9b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:55.718575 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7a4ce43f-c66e-4318-b12d-7b9cd1d07d9b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:55.719008 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7a4ce43f-c66e-4318-b12d-7b9cd1d07d9b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:55.719729 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7a4ce43f-c66e-4318-b12d-7b9cd1d07d9b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:55.720179 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7a4ce43f-c66e-4318-b12d-7b9cd1d07d9b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:55.720600 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7a4ce43f-c66e-4318-b12d-7b9cd1d07d9b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:55.722383 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9a9c1693-4063-4cf1-a815-8519bcbb601d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:55.722859 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9a9c1693-4063-4cf1-a815-8519bcbb601d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:55.723294 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9a9c1693-4063-4cf1-a815-8519bcbb601d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:55.724031 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9a9c1693-4063-4cf1-a815-8519bcbb601d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:55.724485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9a9c1693-4063-4cf1-a815-8519bcbb601d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:55.724909 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9a9c1693-4063-4cf1-a815-8519bcbb601d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:55.851622 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7a4ce43f-c66e-4318-b12d-7b9cd1d07d9b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:55.856126 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9a9c1693-4063-4cf1-a815-8519bcbb601d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:55.860407 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7a4ce43f-c66e-4318-b12d-7b9cd1d07d9b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:55.861841 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7a4ce43f-c66e-4318-b12d-7b9cd1d07d9b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:55.863001 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7a4ce43f-c66e-4318-b12d-7b9cd1d07d9b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.156047 Oct 11 07:02:55.863750 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1388/2787] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:55 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:02:55.866684 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9a9c1693-4063-4cf1-a815-8519bcbb601d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.155281 Oct 11 07:02:55.867365 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1400/2788] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:55 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:02:55.868245 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7fec3c98-873f-4845-b4bb-be66b9ae12b3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:55.869359 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7fec3c98-873f-4845-b4bb-be66b9ae12b3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:55.875256 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7fec3c98-873f-4845-b4bb-be66b9ae12b3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:55.875787 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7fec3c98-873f-4845-b4bb-be66b9ae12b3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:55.876220 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7fec3c98-873f-4845-b4bb-be66b9ae12b3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:55.876900 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7fec3c98-873f-4845-b4bb-be66b9ae12b3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:55.877353 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7fec3c98-873f-4845-b4bb-be66b9ae12b3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:55.877768 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7fec3c98-873f-4845-b4bb-be66b9ae12b3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:56.004471 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7fec3c98-873f-4845-b4bb-be66b9ae12b3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:56.013410 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7fec3c98-873f-4845-b4bb-be66b9ae12b3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.148567 Oct 11 07:02:56.013971 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1389/2789] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:55 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:56.889985 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-20c7b125-cd48-4440-9ab6-5bfc089391ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:56.890593 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-20c7b125-cd48-4440-9ab6-5bfc089391ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:56.891443 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ea03155b-1b25-4d27-85ce-3b7d3c5b0cad tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:56.892063 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ea03155b-1b25-4d27-85ce-3b7d3c5b0cad tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:56.897332 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20c7b125-cd48-4440-9ab6-5bfc089391ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:56.897855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20c7b125-cd48-4440-9ab6-5bfc089391ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:56.898280 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20c7b125-cd48-4440-9ab6-5bfc089391ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:56.898407 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ea03155b-1b25-4d27-85ce-3b7d3c5b0cad tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:56.898746 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ea03155b-1b25-4d27-85ce-3b7d3c5b0cad tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:56.898990 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20c7b125-cd48-4440-9ab6-5bfc089391ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:56.899177 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ea03155b-1b25-4d27-85ce-3b7d3c5b0cad tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:56.899445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20c7b125-cd48-4440-9ab6-5bfc089391ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:56.899869 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-20c7b125-cd48-4440-9ab6-5bfc089391ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:56.899986 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ea03155b-1b25-4d27-85ce-3b7d3c5b0cad tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:56.900908 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ea03155b-1b25-4d27-85ce-3b7d3c5b0cad tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:56.901324 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ea03155b-1b25-4d27-85ce-3b7d3c5b0cad tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:57.027084 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-20c7b125-cd48-4440-9ab6-5bfc089391ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:57.027293 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ea03155b-1b25-4d27-85ce-3b7d3c5b0cad tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:57.035797 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ea03155b-1b25-4d27-85ce-3b7d3c5b0cad tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.148050 Oct 11 07:02:57.035998 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-20c7b125-cd48-4440-9ab6-5bfc089391ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:57.036534 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1390/2790] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:56 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:02:57.040860 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-54eeae97-e394-4215-93d1-3ef5dc351b6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:57.041459 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-54eeae97-e394-4215-93d1-3ef5dc351b6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:57.046985 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-54eeae97-e394-4215-93d1-3ef5dc351b6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:57.047490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-54eeae97-e394-4215-93d1-3ef5dc351b6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:57.047925 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-54eeae97-e394-4215-93d1-3ef5dc351b6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:57.048610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-54eeae97-e394-4215-93d1-3ef5dc351b6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:57.049058 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-54eeae97-e394-4215-93d1-3ef5dc351b6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:57.049480 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-54eeae97-e394-4215-93d1-3ef5dc351b6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:57.051942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-20c7b125-cd48-4440-9ab6-5bfc089391ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:57.053127 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-20c7b125-cd48-4440-9ab6-5bfc089391ec tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.167301 Oct 11 07:02:57.053677 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1401/2791] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:56 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:02:57.177098 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-54eeae97-e394-4215-93d1-3ef5dc351b6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:57.186674 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-54eeae97-e394-4215-93d1-3ef5dc351b6f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.149341 Oct 11 07:02:57.187533 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1391/2792] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:57 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:58.058043 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-33b45528-711e-4f2f-aaeb-496d13c43585 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:58.058638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-33b45528-711e-4f2f-aaeb-496d13c43585 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:58.064993 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-33b45528-711e-4f2f-aaeb-496d13c43585 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:58.065491 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-33b45528-711e-4f2f-aaeb-496d13c43585 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:58.065913 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-33b45528-711e-4f2f-aaeb-496d13c43585 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:58.066586 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-33b45528-711e-4f2f-aaeb-496d13c43585 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:58.067029 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-33b45528-711e-4f2f-aaeb-496d13c43585 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:58.067464 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-33b45528-711e-4f2f-aaeb-496d13c43585 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:58.077781 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8a23c885-620f-484b-bc77-53d2392df9ac tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:58.078417 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8a23c885-620f-484b-bc77-53d2392df9ac tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:58.084846 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8a23c885-620f-484b-bc77-53d2392df9ac tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:58.085324 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8a23c885-620f-484b-bc77-53d2392df9ac tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:58.085754 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8a23c885-620f-484b-bc77-53d2392df9ac tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:58.086438 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8a23c885-620f-484b-bc77-53d2392df9ac tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:58.086902 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8a23c885-620f-484b-bc77-53d2392df9ac tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:58.087308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8a23c885-620f-484b-bc77-53d2392df9ac tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:58.200351 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-33b45528-711e-4f2f-aaeb-496d13c43585 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:58.209469 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-33b45528-711e-4f2f-aaeb-496d13c43585 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.155178 Oct 11 07:02:58.210330 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1402/2793] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:58 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:58.215671 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-677f3c8a-44ef-4a65-840d-b01c00338dcb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:58.216282 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-677f3c8a-44ef-4a65-840d-b01c00338dcb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:58.224513 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-677f3c8a-44ef-4a65-840d-b01c00338dcb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:58.227567 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8a23c885-620f-484b-bc77-53d2392df9ac tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:58.229583 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-677f3c8a-44ef-4a65-840d-b01c00338dcb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:58.230040 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-677f3c8a-44ef-4a65-840d-b01c00338dcb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:58.230782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-677f3c8a-44ef-4a65-840d-b01c00338dcb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:58.231522 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-677f3c8a-44ef-4a65-840d-b01c00338dcb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:58.231774 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-677f3c8a-44ef-4a65-840d-b01c00338dcb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:58.237886 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8a23c885-620f-484b-bc77-53d2392df9ac tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:58.239312 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8a23c885-620f-484b-bc77-53d2392df9ac tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:58.240510 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8a23c885-620f-484b-bc77-53d2392df9ac tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.166553 Oct 11 07:02:58.254951 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1392/2794] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:58 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:02:58.364487 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-677f3c8a-44ef-4a65-840d-b01c00338dcb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:58.372537 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-677f3c8a-44ef-4a65-840d-b01c00338dcb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.161263 Oct 11 07:02:58.373096 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1403/2795] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:58 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:59.233403 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cb51350d-a115-49ac-b43a-9cbc00d77110 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:59.234009 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cb51350d-a115-49ac-b43a-9cbc00d77110 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:59.240501 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb51350d-a115-49ac-b43a-9cbc00d77110 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:59.240979 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb51350d-a115-49ac-b43a-9cbc00d77110 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:59.241408 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb51350d-a115-49ac-b43a-9cbc00d77110 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:59.242089 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb51350d-a115-49ac-b43a-9cbc00d77110 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:59.242538 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb51350d-a115-49ac-b43a-9cbc00d77110 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:59.242957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb51350d-a115-49ac-b43a-9cbc00d77110 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:59.279328 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-47b30084-61e8-4f3b-8f98-1fb816d72644 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:59.280153 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-47b30084-61e8-4f3b-8f98-1fb816d72644 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:59.286756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-47b30084-61e8-4f3b-8f98-1fb816d72644 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:59.287233 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-47b30084-61e8-4f3b-8f98-1fb816d72644 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:59.287696 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-47b30084-61e8-4f3b-8f98-1fb816d72644 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:59.288694 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-47b30084-61e8-4f3b-8f98-1fb816d72644 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:59.288830 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-47b30084-61e8-4f3b-8f98-1fb816d72644 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:59.289246 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-47b30084-61e8-4f3b-8f98-1fb816d72644 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:59.381357 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cb51350d-a115-49ac-b43a-9cbc00d77110 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:59.391744 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cb51350d-a115-49ac-b43a-9cbc00d77110 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.161056 Oct 11 07:02:59.391744 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1393/2796] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:59 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:02:59.405215 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e7a88463-833a-4aed-a9bb-f04959db9482 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:02:59.406107 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e7a88463-833a-4aed-a9bb-f04959db9482 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:02:59.413107 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7a88463-833a-4aed-a9bb-f04959db9482 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:59.413593 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7a88463-833a-4aed-a9bb-f04959db9482 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:59.414025 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7a88463-833a-4aed-a9bb-f04959db9482 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:59.414724 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7a88463-833a-4aed-a9bb-f04959db9482 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:02:59.415174 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7a88463-833a-4aed-a9bb-f04959db9482 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:02:59.416209 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7a88463-833a-4aed-a9bb-f04959db9482 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:02:59.427612 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-47b30084-61e8-4f3b-8f98-1fb816d72644 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:59.436202 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:02:59.436357 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-47b30084-61e8-4f3b-8f98-1fb816d72644 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:59.437969 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-47b30084-61e8-4f3b-8f98-1fb816d72644 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:59.439131 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-47b30084-61e8-4f3b-8f98-1fb816d72644 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.163695 Oct 11 07:02:59.439710 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1404/2797] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:02:59 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:02:59.547027 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e7a88463-833a-4aed-a9bb-f04959db9482 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:02:59.555247 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e7a88463-833a-4aed-a9bb-f04959db9482 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.154353 Oct 11 07:02:59.555842 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1394/2798] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:02:59 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:00.414086 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7d011f8d-2053-456a-bbb4-e3c435caead8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:00.414903 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7d011f8d-2053-456a-bbb4-e3c435caead8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:00.421404 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d011f8d-2053-456a-bbb4-e3c435caead8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:00.421942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d011f8d-2053-456a-bbb4-e3c435caead8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:00.422445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d011f8d-2053-456a-bbb4-e3c435caead8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:00.423190 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d011f8d-2053-456a-bbb4-e3c435caead8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:00.423729 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d011f8d-2053-456a-bbb4-e3c435caead8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:00.424221 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7d011f8d-2053-456a-bbb4-e3c435caead8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:00.464289 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d9a1fe2c-50e5-4dd1-99b9-a370de7c65a5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:00.464934 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d9a1fe2c-50e5-4dd1-99b9-a370de7c65a5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:00.471640 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d9a1fe2c-50e5-4dd1-99b9-a370de7c65a5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:00.472186 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d9a1fe2c-50e5-4dd1-99b9-a370de7c65a5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:00.472622 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d9a1fe2c-50e5-4dd1-99b9-a370de7c65a5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:00.473316 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d9a1fe2c-50e5-4dd1-99b9-a370de7c65a5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:00.473765 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d9a1fe2c-50e5-4dd1-99b9-a370de7c65a5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:00.474180 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d9a1fe2c-50e5-4dd1-99b9-a370de7c65a5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:00.554664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7d011f8d-2053-456a-bbb4-e3c435caead8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:00.563615 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7d011f8d-2053-456a-bbb4-e3c435caead8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.153356 Oct 11 07:03:00.564188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1405/2799] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:00 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:00.578334 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-652f6f66-24a4-4aaf-8e7f-6901d1a9276e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:00.579037 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-652f6f66-24a4-4aaf-8e7f-6901d1a9276e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:00.584985 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-652f6f66-24a4-4aaf-8e7f-6901d1a9276e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:00.585465 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-652f6f66-24a4-4aaf-8e7f-6901d1a9276e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:00.585901 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-652f6f66-24a4-4aaf-8e7f-6901d1a9276e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:00.586594 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-652f6f66-24a4-4aaf-8e7f-6901d1a9276e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:00.587045 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-652f6f66-24a4-4aaf-8e7f-6901d1a9276e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:00.587619 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-652f6f66-24a4-4aaf-8e7f-6901d1a9276e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:00.605602 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d9a1fe2c-50e5-4dd1-99b9-a370de7c65a5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:00.614381 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d9a1fe2c-50e5-4dd1-99b9-a370de7c65a5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:00.615943 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d9a1fe2c-50e5-4dd1-99b9-a370de7c65a5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:00.617185 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d9a1fe2c-50e5-4dd1-99b9-a370de7c65a5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.156797 Oct 11 07:03:00.618247 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1395/2800] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:00 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:03:00.714191 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-652f6f66-24a4-4aaf-8e7f-6901d1a9276e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:00.722226 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-652f6f66-24a4-4aaf-8e7f-6901d1a9276e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.147528 Oct 11 07:03:00.722769 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1406/2801] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:00 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:01.588526 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9701d18e-7a62-44fe-9966-35910043af72 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:01.589170 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9701d18e-7a62-44fe-9966-35910043af72 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:01.595558 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9701d18e-7a62-44fe-9966-35910043af72 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:01.596032 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9701d18e-7a62-44fe-9966-35910043af72 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:01.596462 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9701d18e-7a62-44fe-9966-35910043af72 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:01.597144 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9701d18e-7a62-44fe-9966-35910043af72 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:01.597587 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9701d18e-7a62-44fe-9966-35910043af72 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:01.598007 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9701d18e-7a62-44fe-9966-35910043af72 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:01.643810 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a5b3d308-d98a-45ed-9f30-37284c3ca456 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:01.644360 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a5b3d308-d98a-45ed-9f30-37284c3ca456 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:01.651537 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a5b3d308-d98a-45ed-9f30-37284c3ca456 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:01.652010 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a5b3d308-d98a-45ed-9f30-37284c3ca456 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:01.652442 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a5b3d308-d98a-45ed-9f30-37284c3ca456 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:01.653125 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a5b3d308-d98a-45ed-9f30-37284c3ca456 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:01.653565 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a5b3d308-d98a-45ed-9f30-37284c3ca456 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:01.653980 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a5b3d308-d98a-45ed-9f30-37284c3ca456 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:01.724376 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9701d18e-7a62-44fe-9966-35910043af72 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:01.732558 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9701d18e-7a62-44fe-9966-35910043af72 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.148503 Oct 11 07:03:01.733122 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1396/2802] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:01 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:01.745876 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-18b591d4-3d3c-49c0-b124-5d9bbc3e4a84 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:01.746567 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-18b591d4-3d3c-49c0-b124-5d9bbc3e4a84 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:01.752570 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-18b591d4-3d3c-49c0-b124-5d9bbc3e4a84 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:01.753118 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-18b591d4-3d3c-49c0-b124-5d9bbc3e4a84 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:01.753616 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-18b591d4-3d3c-49c0-b124-5d9bbc3e4a84 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:01.754380 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-18b591d4-3d3c-49c0-b124-5d9bbc3e4a84 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:01.754894 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-18b591d4-3d3c-49c0-b124-5d9bbc3e4a84 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:01.755406 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-18b591d4-3d3c-49c0-b124-5d9bbc3e4a84 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:01.786006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a5b3d308-d98a-45ed-9f30-37284c3ca456 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:01.794735 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a5b3d308-d98a-45ed-9f30-37284c3ca456 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:01.796221 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a5b3d308-d98a-45ed-9f30-37284c3ca456 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:01.797403 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a5b3d308-d98a-45ed-9f30-37284c3ca456 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.157494 Oct 11 07:03:01.797957 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1407/2803] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:01 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:03:01.883210 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-18b591d4-3d3c-49c0-b124-5d9bbc3e4a84 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:01.892669 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-18b591d4-3d3c-49c0-b124-5d9bbc3e4a84 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.150926 Oct 11 07:03:01.893238 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1397/2804] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:01 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:03:02.757660 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b7647661-e8de-4489-9512-3afafa73ef47 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:02.758199 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b7647661-e8de-4489-9512-3afafa73ef47 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:02.764930 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b7647661-e8de-4489-9512-3afafa73ef47 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:02.765436 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b7647661-e8de-4489-9512-3afafa73ef47 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:02.765869 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b7647661-e8de-4489-9512-3afafa73ef47 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:02.766556 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b7647661-e8de-4489-9512-3afafa73ef47 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:02.767001 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b7647661-e8de-4489-9512-3afafa73ef47 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:02.767441 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b7647661-e8de-4489-9512-3afafa73ef47 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:02.824116 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-dcb437be-c6e3-4c84-b5c3-a022bec2e948 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:02.824820 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-dcb437be-c6e3-4c84-b5c3-a022bec2e948 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:02.831350 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dcb437be-c6e3-4c84-b5c3-a022bec2e948 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:02.831850 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dcb437be-c6e3-4c84-b5c3-a022bec2e948 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:02.832277 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dcb437be-c6e3-4c84-b5c3-a022bec2e948 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:02.833172 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dcb437be-c6e3-4c84-b5c3-a022bec2e948 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:02.833644 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dcb437be-c6e3-4c84-b5c3-a022bec2e948 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:02.834059 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dcb437be-c6e3-4c84-b5c3-a022bec2e948 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:02.895964 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b7647661-e8de-4489-9512-3afafa73ef47 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:02.904783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b7647661-e8de-4489-9512-3afafa73ef47 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.151092 Oct 11 07:03:02.905346 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1408/2805] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:02 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:02.915629 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c1980bfe-57d4-4f0b-9226-30cfdc05b343 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:02.916446 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c1980bfe-57d4-4f0b-9226-30cfdc05b343 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:02.922208 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c1980bfe-57d4-4f0b-9226-30cfdc05b343 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:02.922686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c1980bfe-57d4-4f0b-9226-30cfdc05b343 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:02.923114 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c1980bfe-57d4-4f0b-9226-30cfdc05b343 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:02.923833 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c1980bfe-57d4-4f0b-9226-30cfdc05b343 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:02.924277 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c1980bfe-57d4-4f0b-9226-30cfdc05b343 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:02.924695 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c1980bfe-57d4-4f0b-9226-30cfdc05b343 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:02.965384 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-dcb437be-c6e3-4c84-b5c3-a022bec2e948 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:02.973925 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-dcb437be-c6e3-4c84-b5c3-a022bec2e948 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:02.975345 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-dcb437be-c6e3-4c84-b5c3-a022bec2e948 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:02.976515 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-dcb437be-c6e3-4c84-b5c3-a022bec2e948 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.157144 Oct 11 07:03:02.977061 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1398/2806] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:02 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:03:03.049182 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c1980bfe-57d4-4f0b-9226-30cfdc05b343 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:03.057276 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c1980bfe-57d4-4f0b-9226-30cfdc05b343 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.145499 Oct 11 07:03:03.057828 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1409/2807] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:02 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:03:03.928035 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cb1412e8-4d9e-4e47-9205-ee469cf9d5eb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:03.928633 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cb1412e8-4d9e-4e47-9205-ee469cf9d5eb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:03.935088 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb1412e8-4d9e-4e47-9205-ee469cf9d5eb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:03.935666 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb1412e8-4d9e-4e47-9205-ee469cf9d5eb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:03.936099 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb1412e8-4d9e-4e47-9205-ee469cf9d5eb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:03.936781 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb1412e8-4d9e-4e47-9205-ee469cf9d5eb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:03.937226 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb1412e8-4d9e-4e47-9205-ee469cf9d5eb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:03.937646 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb1412e8-4d9e-4e47-9205-ee469cf9d5eb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:04.001601 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c21b6f54-f27c-4426-be13-65dceff3d660 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:04.002308 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c21b6f54-f27c-4426-be13-65dceff3d660 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:04.008661 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c21b6f54-f27c-4426-be13-65dceff3d660 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:04.009208 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c21b6f54-f27c-4426-be13-65dceff3d660 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:04.009704 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c21b6f54-f27c-4426-be13-65dceff3d660 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:04.010482 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c21b6f54-f27c-4426-be13-65dceff3d660 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:04.010939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c21b6f54-f27c-4426-be13-65dceff3d660 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:04.011344 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c21b6f54-f27c-4426-be13-65dceff3d660 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:04.064515 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cb1412e8-4d9e-4e47-9205-ee469cf9d5eb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:04.072832 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cb1412e8-4d9e-4e47-9205-ee469cf9d5eb tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.148647 Oct 11 07:03:04.074049 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1399/2808] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:03 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:04.081032 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-524142bd-cc79-4d5d-962f-690c3559c79d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:04.081625 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-524142bd-cc79-4d5d-962f-690c3559c79d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:04.087804 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-524142bd-cc79-4d5d-962f-690c3559c79d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:04.088281 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-524142bd-cc79-4d5d-962f-690c3559c79d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:04.088705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-524142bd-cc79-4d5d-962f-690c3559c79d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:04.089384 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-524142bd-cc79-4d5d-962f-690c3559c79d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:04.089830 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-524142bd-cc79-4d5d-962f-690c3559c79d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:04.090242 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-524142bd-cc79-4d5d-962f-690c3559c79d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:04.143321 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c21b6f54-f27c-4426-be13-65dceff3d660 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:04.152775 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c21b6f54-f27c-4426-be13-65dceff3d660 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:04.154229 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c21b6f54-f27c-4426-be13-65dceff3d660 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:04.155368 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c21b6f54-f27c-4426-be13-65dceff3d660 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.157669 Oct 11 07:03:04.155950 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1410/2809] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:03 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:03:04.218917 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-524142bd-cc79-4d5d-962f-690c3559c79d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:04.227018 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-524142bd-cc79-4d5d-962f-690c3559c79d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.149574 Oct 11 07:03:04.227659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1400/2810] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:04 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:03:05.096874 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-626e86d6-09af-4c60-9564-7e380f7b6588 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:05.097488 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-626e86d6-09af-4c60-9564-7e380f7b6588 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:05.104531 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-626e86d6-09af-4c60-9564-7e380f7b6588 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:05.105005 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-626e86d6-09af-4c60-9564-7e380f7b6588 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:05.105433 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-626e86d6-09af-4c60-9564-7e380f7b6588 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:05.106122 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-626e86d6-09af-4c60-9564-7e380f7b6588 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:05.106567 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-626e86d6-09af-4c60-9564-7e380f7b6588 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:05.106987 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-626e86d6-09af-4c60-9564-7e380f7b6588 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:05.180835 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f3d3624a-4088-42be-b06b-caedc04ea8de tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:05.182088 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f3d3624a-4088-42be-b06b-caedc04ea8de tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:05.188401 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3d3624a-4088-42be-b06b-caedc04ea8de tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:05.188875 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3d3624a-4088-42be-b06b-caedc04ea8de tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:05.189300 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3d3624a-4088-42be-b06b-caedc04ea8de tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:05.189983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3d3624a-4088-42be-b06b-caedc04ea8de tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:05.190426 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3d3624a-4088-42be-b06b-caedc04ea8de tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:05.190876 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3d3624a-4088-42be-b06b-caedc04ea8de tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:05.234687 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-626e86d6-09af-4c60-9564-7e380f7b6588 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:05.242939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-626e86d6-09af-4c60-9564-7e380f7b6588 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.149896 Oct 11 07:03:05.244069 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1411/2811] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:05 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:05.250273 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5eb129f0-b093-4fed-9213-529c67dde5d6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:05.250881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5eb129f0-b093-4fed-9213-529c67dde5d6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:05.256645 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5eb129f0-b093-4fed-9213-529c67dde5d6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:05.257130 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5eb129f0-b093-4fed-9213-529c67dde5d6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:05.257557 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5eb129f0-b093-4fed-9213-529c67dde5d6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:05.258728 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5eb129f0-b093-4fed-9213-529c67dde5d6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:05.259178 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5eb129f0-b093-4fed-9213-529c67dde5d6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:05.259643 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5eb129f0-b093-4fed-9213-529c67dde5d6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:05.320290 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f3d3624a-4088-42be-b06b-caedc04ea8de tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:05.329409 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f3d3624a-4088-42be-b06b-caedc04ea8de tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:05.330829 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f3d3624a-4088-42be-b06b-caedc04ea8de tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:05.332005 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f3d3624a-4088-42be-b06b-caedc04ea8de tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.155340 Oct 11 07:03:05.332556 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1401/2812] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:05 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:03:05.389396 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5eb129f0-b093-4fed-9213-529c67dde5d6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:05.397611 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5eb129f0-b093-4fed-9213-529c67dde5d6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.150832 Oct 11 07:03:05.398163 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1412/2813] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:05 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:06.266967 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7dbe6afd-64d6-4317-852b-40cd6f951a85 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:06.267639 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7dbe6afd-64d6-4317-852b-40cd6f951a85 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:06.274145 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7dbe6afd-64d6-4317-852b-40cd6f951a85 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:06.274645 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7dbe6afd-64d6-4317-852b-40cd6f951a85 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:06.275070 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7dbe6afd-64d6-4317-852b-40cd6f951a85 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:06.275772 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7dbe6afd-64d6-4317-852b-40cd6f951a85 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:06.276216 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7dbe6afd-64d6-4317-852b-40cd6f951a85 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:06.276661 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7dbe6afd-64d6-4317-852b-40cd6f951a85 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:06.357297 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-98b45fe7-c8c7-437c-9c75-076c184a659c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:06.357904 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-98b45fe7-c8c7-437c-9c75-076c184a659c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:06.364396 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-98b45fe7-c8c7-437c-9c75-076c184a659c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:06.364875 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-98b45fe7-c8c7-437c-9c75-076c184a659c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:06.365305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-98b45fe7-c8c7-437c-9c75-076c184a659c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:06.365995 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-98b45fe7-c8c7-437c-9c75-076c184a659c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:06.366441 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-98b45fe7-c8c7-437c-9c75-076c184a659c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:06.366863 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-98b45fe7-c8c7-437c-9c75-076c184a659c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:06.406135 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7dbe6afd-64d6-4317-852b-40cd6f951a85 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:06.414526 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7dbe6afd-64d6-4317-852b-40cd6f951a85 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.151280 Oct 11 07:03:06.415740 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1402/2814] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:06 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:06.420807 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6b07b0ca-848f-4f6a-a621-0bd98b229c39 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:06.421397 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6b07b0ca-848f-4f6a-a621-0bd98b229c39 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:06.427536 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6b07b0ca-848f-4f6a-a621-0bd98b229c39 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:06.428010 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6b07b0ca-848f-4f6a-a621-0bd98b229c39 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:06.428438 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6b07b0ca-848f-4f6a-a621-0bd98b229c39 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:06.429114 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6b07b0ca-848f-4f6a-a621-0bd98b229c39 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:06.429559 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6b07b0ca-848f-4f6a-a621-0bd98b229c39 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:06.429974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6b07b0ca-848f-4f6a-a621-0bd98b229c39 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:06.501329 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-98b45fe7-c8c7-437c-9c75-076c184a659c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:06.509934 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-98b45fe7-c8c7-437c-9c75-076c184a659c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:06.512269 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-98b45fe7-c8c7-437c-9c75-076c184a659c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:06.513420 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-98b45fe7-c8c7-437c-9c75-076c184a659c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.160003 Oct 11 07:03:06.513975 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1413/2815] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:06 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:03:06.559809 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6b07b0ca-848f-4f6a-a621-0bd98b229c39 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:06.567864 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6b07b0ca-848f-4f6a-a621-0bd98b229c39 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.150520 Oct 11 07:03:06.568412 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1403/2816] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:06 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:07.439133 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f045cb57-d098-4eed-9c1e-ffc900003eaf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:07.439774 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f045cb57-d098-4eed-9c1e-ffc900003eaf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:07.445675 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f045cb57-d098-4eed-9c1e-ffc900003eaf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:07.446150 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f045cb57-d098-4eed-9c1e-ffc900003eaf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:07.446578 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f045cb57-d098-4eed-9c1e-ffc900003eaf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:07.447276 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f045cb57-d098-4eed-9c1e-ffc900003eaf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:07.448006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f045cb57-d098-4eed-9c1e-ffc900003eaf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:07.448438 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f045cb57-d098-4eed-9c1e-ffc900003eaf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:07.537866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-576d4503-057e-40cd-93fe-20e652d4ab10 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:07.538470 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-576d4503-057e-40cd-93fe-20e652d4ab10 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:07.545366 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-576d4503-057e-40cd-93fe-20e652d4ab10 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:07.545842 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-576d4503-057e-40cd-93fe-20e652d4ab10 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:07.546273 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-576d4503-057e-40cd-93fe-20e652d4ab10 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:07.546960 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-576d4503-057e-40cd-93fe-20e652d4ab10 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:07.547408 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-576d4503-057e-40cd-93fe-20e652d4ab10 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:07.547850 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-576d4503-057e-40cd-93fe-20e652d4ab10 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:07.579336 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f045cb57-d098-4eed-9c1e-ffc900003eaf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:07.582862 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:03:07.588321 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f045cb57-d098-4eed-9c1e-ffc900003eaf tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.153574 Oct 11 07:03:07.588983 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1414/2817] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:07 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:07.593662 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-917bd230-8a51-48e0-b26b-a5297c00f6e7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:07.594382 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-917bd230-8a51-48e0-b26b-a5297c00f6e7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:07.600664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-917bd230-8a51-48e0-b26b-a5297c00f6e7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:07.601236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-917bd230-8a51-48e0-b26b-a5297c00f6e7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:07.601741 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-917bd230-8a51-48e0-b26b-a5297c00f6e7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:07.602494 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-917bd230-8a51-48e0-b26b-a5297c00f6e7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:07.603014 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-917bd230-8a51-48e0-b26b-a5297c00f6e7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:07.603539 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-917bd230-8a51-48e0-b26b-a5297c00f6e7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:07.677780 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-576d4503-057e-40cd-93fe-20e652d4ab10 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:07.686924 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-576d4503-057e-40cd-93fe-20e652d4ab10 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:07.688399 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-576d4503-057e-40cd-93fe-20e652d4ab10 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:07.689560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-576d4503-057e-40cd-93fe-20e652d4ab10 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.155489 Oct 11 07:03:07.690116 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1404/2818] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:07 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:03:07.733642 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-917bd230-8a51-48e0-b26b-a5297c00f6e7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:07.744507 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-917bd230-8a51-48e0-b26b-a5297c00f6e7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.154283 Oct 11 07:03:07.745337 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1415/2819] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:07 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:08.610803 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-87c9c138-38c2-47d1-92dd-5f76ce3c5d8f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:08.611456 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-87c9c138-38c2-47d1-92dd-5f76ce3c5d8f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:08.617812 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87c9c138-38c2-47d1-92dd-5f76ce3c5d8f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:08.618287 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87c9c138-38c2-47d1-92dd-5f76ce3c5d8f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:08.618718 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87c9c138-38c2-47d1-92dd-5f76ce3c5d8f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:08.619403 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87c9c138-38c2-47d1-92dd-5f76ce3c5d8f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:08.620377 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87c9c138-38c2-47d1-92dd-5f76ce3c5d8f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:08.620796 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87c9c138-38c2-47d1-92dd-5f76ce3c5d8f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:08.714075 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-961e953b-0101-455b-8b82-1c68e5d8b4aa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:08.714719 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-961e953b-0101-455b-8b82-1c68e5d8b4aa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:08.721073 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-961e953b-0101-455b-8b82-1c68e5d8b4aa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:08.721549 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-961e953b-0101-455b-8b82-1c68e5d8b4aa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:08.721986 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-961e953b-0101-455b-8b82-1c68e5d8b4aa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:08.722678 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-961e953b-0101-455b-8b82-1c68e5d8b4aa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:08.723124 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-961e953b-0101-455b-8b82-1c68e5d8b4aa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:08.723575 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-961e953b-0101-455b-8b82-1c68e5d8b4aa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:08.749693 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-87c9c138-38c2-47d1-92dd-5f76ce3c5d8f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:08.758136 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-87c9c138-38c2-47d1-92dd-5f76ce3c5d8f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.151145 Oct 11 07:03:08.758701 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1405/2820] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:08 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:08.768998 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c00f2808-6f96-4797-83c0-01db76834205 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:08.769697 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c00f2808-6f96-4797-83c0-01db76834205 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:08.775680 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c00f2808-6f96-4797-83c0-01db76834205 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:08.776157 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c00f2808-6f96-4797-83c0-01db76834205 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:08.776586 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c00f2808-6f96-4797-83c0-01db76834205 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:08.777278 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c00f2808-6f96-4797-83c0-01db76834205 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:08.777725 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c00f2808-6f96-4797-83c0-01db76834205 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:08.778148 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c00f2808-6f96-4797-83c0-01db76834205 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:08.877729 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-961e953b-0101-455b-8b82-1c68e5d8b4aa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:08.887201 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-961e953b-0101-455b-8b82-1c68e5d8b4aa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:08.888787 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-961e953b-0101-455b-8b82-1c68e5d8b4aa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:08.890321 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-961e953b-0101-455b-8b82-1c68e5d8b4aa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.179683 Oct 11 07:03:08.893445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1416/2821] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:08 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:03:08.914708 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c00f2808-6f96-4797-83c0-01db76834205 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:08.922960 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c00f2808-6f96-4797-83c0-01db76834205 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.157686 Oct 11 07:03:08.923529 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1406/2822] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:08 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:09.782737 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f4157ea8-cdb0-42fc-8fbb-6eb1f0831e6d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:09.783356 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f4157ea8-cdb0-42fc-8fbb-6eb1f0831e6d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:09.789799 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f4157ea8-cdb0-42fc-8fbb-6eb1f0831e6d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:09.790278 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f4157ea8-cdb0-42fc-8fbb-6eb1f0831e6d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:09.790712 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f4157ea8-cdb0-42fc-8fbb-6eb1f0831e6d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:09.791401 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f4157ea8-cdb0-42fc-8fbb-6eb1f0831e6d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:09.791874 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f4157ea8-cdb0-42fc-8fbb-6eb1f0831e6d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:09.792299 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f4157ea8-cdb0-42fc-8fbb-6eb1f0831e6d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:09.915374 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-64021401-2994-4aa0-be2f-2f41eb402726 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:09.916001 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-64021401-2994-4aa0-be2f-2f41eb402726 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:09.921321 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f4157ea8-cdb0-42fc-8fbb-6eb1f0831e6d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:09.931998 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f4157ea8-cdb0-42fc-8fbb-6eb1f0831e6d tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.153149 Oct 11 07:03:09.933072 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1417/2823] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:09 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:09.934390 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-64021401-2994-4aa0-be2f-2f41eb402726 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:09.934873 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-64021401-2994-4aa0-be2f-2f41eb402726 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:09.935301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-64021401-2994-4aa0-be2f-2f41eb402726 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:09.936027 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-64021401-2994-4aa0-be2f-2f41eb402726 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:09.936470 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-64021401-2994-4aa0-be2f-2f41eb402726 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:09.936887 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-64021401-2994-4aa0-be2f-2f41eb402726 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:09.945701 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e2b570b0-45cd-4bf9-be80-bb472c118b79 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:09.946328 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e2b570b0-45cd-4bf9-be80-bb472c118b79 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:09.954689 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e2b570b0-45cd-4bf9-be80-bb472c118b79 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:09.955173 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e2b570b0-45cd-4bf9-be80-bb472c118b79 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:09.955649 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e2b570b0-45cd-4bf9-be80-bb472c118b79 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:09.956349 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e2b570b0-45cd-4bf9-be80-bb472c118b79 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:09.956800 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e2b570b0-45cd-4bf9-be80-bb472c118b79 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:09.957223 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e2b570b0-45cd-4bf9-be80-bb472c118b79 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:10.074305 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-64021401-2994-4aa0-be2f-2f41eb402726 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:10.083103 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-64021401-2994-4aa0-be2f-2f41eb402726 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:10.084576 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-64021401-2994-4aa0-be2f-2f41eb402726 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:10.085767 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-64021401-2994-4aa0-be2f-2f41eb402726 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.174105 Oct 11 07:03:10.087002 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1407/2824] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:09 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:03:10.089344 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e2b570b0-45cd-4bf9-be80-bb472c118b79 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:10.097522 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e2b570b0-45cd-4bf9-be80-bb472c118b79 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.155418 Oct 11 07:03:10.098071 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1418/2825] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:09 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:10.956089 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6e7f6a16-9680-4f60-9e89-9170ce8c440f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:10.956801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6e7f6a16-9680-4f60-9e89-9170ce8c440f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:10.963311 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e7f6a16-9680-4f60-9e89-9170ce8c440f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:10.963828 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e7f6a16-9680-4f60-9e89-9170ce8c440f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:10.964263 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e7f6a16-9680-4f60-9e89-9170ce8c440f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:10.964952 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e7f6a16-9680-4f60-9e89-9170ce8c440f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:10.965405 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e7f6a16-9680-4f60-9e89-9170ce8c440f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:10.965831 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e7f6a16-9680-4f60-9e89-9170ce8c440f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:11.094794 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6e7f6a16-9680-4f60-9e89-9170ce8c440f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:11.102896 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6e7f6a16-9680-4f60-9e89-9170ce8c440f tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150634 Oct 11 07:03:11.103474 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1408/2826] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:10 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:11.112332 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d1714e49-0bea-450b-ba93-6f5ce625cbfa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:11.112930 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d1714e49-0bea-450b-ba93-6f5ce625cbfa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:11.115256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=76 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:03:11.121553 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d1714e49-0bea-450b-ba93-6f5ce625cbfa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:11.121750 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a2d73300-4fce-4d44-aecf-6ee88aef108a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:11.122028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d1714e49-0bea-450b-ba93-6f5ce625cbfa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:11.122156 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a2d73300-4fce-4d44-aecf-6ee88aef108a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:11.122457 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d1714e49-0bea-450b-ba93-6f5ce625cbfa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:11.123170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d1714e49-0bea-450b-ba93-6f5ce625cbfa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:11.123647 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d1714e49-0bea-450b-ba93-6f5ce625cbfa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:11.124063 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d1714e49-0bea-450b-ba93-6f5ce625cbfa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:11.128109 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2d73300-4fce-4d44-aecf-6ee88aef108a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:11.128583 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2d73300-4fce-4d44-aecf-6ee88aef108a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:11.129011 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2d73300-4fce-4d44-aecf-6ee88aef108a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:11.129700 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2d73300-4fce-4d44-aecf-6ee88aef108a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:11.130146 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2d73300-4fce-4d44-aecf-6ee88aef108a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:11.130569 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2d73300-4fce-4d44-aecf-6ee88aef108a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:11.252685 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d1714e49-0bea-450b-ba93-6f5ce625cbfa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:11.257170 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a2d73300-4fce-4d44-aecf-6ee88aef108a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:11.261742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d1714e49-0bea-450b-ba93-6f5ce625cbfa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:11.263189 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d1714e49-0bea-450b-ba93-6f5ce625cbfa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:11.264378 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d1714e49-0bea-450b-ba93-6f5ce625cbfa tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.155926 Oct 11 07:03:11.264930 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1419/2827] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:11 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:03:11.265807 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a2d73300-4fce-4d44-aecf-6ee88aef108a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.148648 Oct 11 07:03:11.266362 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1409/2828] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:11 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:03:12.126362 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8db8e74c-39ec-42b3-ada0-1008ed4ab271 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:12.126970 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8db8e74c-39ec-42b3-ada0-1008ed4ab271 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:12.133310 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8db8e74c-39ec-42b3-ada0-1008ed4ab271 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:12.133784 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8db8e74c-39ec-42b3-ada0-1008ed4ab271 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:12.134210 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8db8e74c-39ec-42b3-ada0-1008ed4ab271 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:12.134887 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8db8e74c-39ec-42b3-ada0-1008ed4ab271 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:12.135940 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8db8e74c-39ec-42b3-ada0-1008ed4ab271 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:12.136361 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8db8e74c-39ec-42b3-ada0-1008ed4ab271 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:12.269303 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8db8e74c-39ec-42b3-ada0-1008ed4ab271 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:12.277952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8db8e74c-39ec-42b3-ada0-1008ed4ab271 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.155271 Oct 11 07:03:12.278541 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1420/2829] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:12 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:12.290372 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3549f956-22bb-4bc2-bb99-9bf7f7574506 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:12.291027 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3549f956-22bb-4bc2-bb99-9bf7f7574506 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:12.299175 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-01e84a5f-37c2-443b-9a31-60eab596df70 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:12.299818 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-01e84a5f-37c2-443b-9a31-60eab596df70 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:12.306072 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3549f956-22bb-4bc2-bb99-9bf7f7574506 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:12.306474 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-01e84a5f-37c2-443b-9a31-60eab596df70 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:12.306863 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3549f956-22bb-4bc2-bb99-9bf7f7574506 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:12.307839 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-01e84a5f-37c2-443b-9a31-60eab596df70 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:12.307962 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3549f956-22bb-4bc2-bb99-9bf7f7574506 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:12.308393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-01e84a5f-37c2-443b-9a31-60eab596df70 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:12.308703 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3549f956-22bb-4bc2-bb99-9bf7f7574506 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:12.309174 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3549f956-22bb-4bc2-bb99-9bf7f7574506 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:12.309295 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-01e84a5f-37c2-443b-9a31-60eab596df70 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:12.309562 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3549f956-22bb-4bc2-bb99-9bf7f7574506 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:12.309829 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-01e84a5f-37c2-443b-9a31-60eab596df70 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:12.310450 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-01e84a5f-37c2-443b-9a31-60eab596df70 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:12.445644 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-01e84a5f-37c2-443b-9a31-60eab596df70 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:12.446302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3549f956-22bb-4bc2-bb99-9bf7f7574506 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:12.454511 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-01e84a5f-37c2-443b-9a31-60eab596df70 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.159138 Oct 11 07:03:12.455064 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1421/2830] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:12 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:12.455253 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3549f956-22bb-4bc2-bb99-9bf7f7574506 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:12.456720 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3549f956-22bb-4bc2-bb99-9bf7f7574506 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:12.457897 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3549f956-22bb-4bc2-bb99-9bf7f7574506 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.171551 Oct 11 07:03:12.458617 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1410/2831] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:12 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:03:13.302480 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6ca932a1-fe4d-467f-b62c-dc44e2de8c36 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:13.303009 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6ca932a1-fe4d-467f-b62c-dc44e2de8c36 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:13.309352 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6ca932a1-fe4d-467f-b62c-dc44e2de8c36 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:13.309819 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6ca932a1-fe4d-467f-b62c-dc44e2de8c36 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:13.310245 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6ca932a1-fe4d-467f-b62c-dc44e2de8c36 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:13.310922 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6ca932a1-fe4d-467f-b62c-dc44e2de8c36 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:13.311361 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6ca932a1-fe4d-467f-b62c-dc44e2de8c36 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:13.311808 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6ca932a1-fe4d-467f-b62c-dc44e2de8c36 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:13.437312 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6ca932a1-fe4d-467f-b62c-dc44e2de8c36 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:13.445649 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6ca932a1-fe4d-467f-b62c-dc44e2de8c36 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.147066 Oct 11 07:03:13.446207 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1422/2832] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:13 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:13.478074 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-be07925d-69ae-4b6e-b9fa-2dfb50d97bf8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:13.478739 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-be07925d-69ae-4b6e-b9fa-2dfb50d97bf8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:13.481667 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c60d6e5c-401e-47c4-a627-c6bc5584b07a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:13.482300 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c60d6e5c-401e-47c4-a627-c6bc5584b07a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:13.485268 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-be07925d-69ae-4b6e-b9fa-2dfb50d97bf8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:13.485748 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-be07925d-69ae-4b6e-b9fa-2dfb50d97bf8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:13.486181 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-be07925d-69ae-4b6e-b9fa-2dfb50d97bf8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:13.486881 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-be07925d-69ae-4b6e-b9fa-2dfb50d97bf8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:13.487334 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-be07925d-69ae-4b6e-b9fa-2dfb50d97bf8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:13.487785 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-be07925d-69ae-4b6e-b9fa-2dfb50d97bf8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:13.488026 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c60d6e5c-401e-47c4-a627-c6bc5584b07a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:13.488504 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c60d6e5c-401e-47c4-a627-c6bc5584b07a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:13.488935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c60d6e5c-401e-47c4-a627-c6bc5584b07a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:13.489614 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c60d6e5c-401e-47c4-a627-c6bc5584b07a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:13.490058 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c60d6e5c-401e-47c4-a627-c6bc5584b07a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:13.490476 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c60d6e5c-401e-47c4-a627-c6bc5584b07a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:13.491694 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:03:13.615796 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-be07925d-69ae-4b6e-b9fa-2dfb50d97bf8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:13.618583 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c60d6e5c-401e-47c4-a627-c6bc5584b07a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:13.624713 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-be07925d-69ae-4b6e-b9fa-2dfb50d97bf8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.150416 Oct 11 07:03:13.625319 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1411/2833] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:13 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:13.627946 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c60d6e5c-401e-47c4-a627-c6bc5584b07a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:13.629413 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c60d6e5c-401e-47c4-a627-c6bc5584b07a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:13.630662 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c60d6e5c-401e-47c4-a627-c6bc5584b07a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152726 Oct 11 07:03:13.631333 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1423/2834] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:13 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:03:14.136326 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6e98a636-e407-4d79-ab76-784338d16925 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:14.137084 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6e98a636-e407-4d79-ab76-784338d16925 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:14.142977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e98a636-e407-4d79-ab76-784338d16925 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:14.143491 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e98a636-e407-4d79-ab76-784338d16925 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:14.143933 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e98a636-e407-4d79-ab76-784338d16925 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:14.144630 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e98a636-e407-4d79-ab76-784338d16925 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:14.145087 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e98a636-e407-4d79-ab76-784338d16925 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:14.145509 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e98a636-e407-4d79-ab76-784338d16925 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:14.170120 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6e98a636-e407-4d79-ab76-784338d16925 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Going to try to terminate instance {{(pid=125267) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 07:03:14.247346 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6e98a636-e407-4d79-ab76-784338d16925 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 204 len: 0 microversion: 2.1 time: 0.114504 Oct 11 07:03:14.248181 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1412/2835] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Oct 11 07:03:14 2022] DELETE /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 07:03:14.256199 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-82a1e335-db39-4b8a-881f-b7b1925dac10 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:14.258826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-82a1e335-db39-4b8a-881f-b7b1925dac10 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:14.265541 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-82a1e335-db39-4b8a-881f-b7b1925dac10 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:14.266021 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-82a1e335-db39-4b8a-881f-b7b1925dac10 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:14.266489 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-82a1e335-db39-4b8a-881f-b7b1925dac10 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:14.267178 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-82a1e335-db39-4b8a-881f-b7b1925dac10 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:14.267665 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-82a1e335-db39-4b8a-881f-b7b1925dac10 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:14.268086 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-82a1e335-db39-4b8a-881f-b7b1925dac10 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:14.393949 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-82a1e335-db39-4b8a-881f-b7b1925dac10 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:14.401993 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-82a1e335-db39-4b8a-881f-b7b1925dac10 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1718 microversion: 2.1 time: 0.149696 Oct 11 07:03:14.402557 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1424/2836] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:14 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:14.469193 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-77db3a9b-1b27-46d8-9ba6-9d73b26b822b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:14.469889 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-77db3a9b-1b27-46d8-9ba6-9d73b26b822b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:14.475802 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-77db3a9b-1b27-46d8-9ba6-9d73b26b822b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:14.476278 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-77db3a9b-1b27-46d8-9ba6-9d73b26b822b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:14.476703 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-77db3a9b-1b27-46d8-9ba6-9d73b26b822b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:14.477396 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-77db3a9b-1b27-46d8-9ba6-9d73b26b822b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:14.477842 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-77db3a9b-1b27-46d8-9ba6-9d73b26b822b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:14.478263 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-77db3a9b-1b27-46d8-9ba6-9d73b26b822b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:14.607145 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-77db3a9b-1b27-46d8-9ba6-9d73b26b822b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:14.615259 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-77db3a9b-1b27-46d8-9ba6-9d73b26b822b tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.150220 Oct 11 07:03:14.615844 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1413/2837] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:14 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:14.648546 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1b8ada64-271c-42f5-9a6c-9d64b5da7a37 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:14.649151 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1b8ada64-271c-42f5-9a6c-9d64b5da7a37 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:14.655158 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b8ada64-271c-42f5-9a6c-9d64b5da7a37 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:14.655655 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b8ada64-271c-42f5-9a6c-9d64b5da7a37 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:14.656085 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b8ada64-271c-42f5-9a6c-9d64b5da7a37 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:14.656724 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e86ffcde-1275-458a-9efd-7b0d22faffa8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:14.656851 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b8ada64-271c-42f5-9a6c-9d64b5da7a37 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:14.657188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b8ada64-271c-42f5-9a6c-9d64b5da7a37 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:14.657331 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e86ffcde-1275-458a-9efd-7b0d22faffa8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:14.657601 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1b8ada64-271c-42f5-9a6c-9d64b5da7a37 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:14.663488 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e86ffcde-1275-458a-9efd-7b0d22faffa8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:14.663970 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e86ffcde-1275-458a-9efd-7b0d22faffa8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:14.664401 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e86ffcde-1275-458a-9efd-7b0d22faffa8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:14.665091 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e86ffcde-1275-458a-9efd-7b0d22faffa8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:14.665537 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e86ffcde-1275-458a-9efd-7b0d22faffa8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:14.665984 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e86ffcde-1275-458a-9efd-7b0d22faffa8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:14.788673 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1b8ada64-271c-42f5-9a6c-9d64b5da7a37 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:14.794453 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e86ffcde-1275-458a-9efd-7b0d22faffa8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:14.797371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1b8ada64-271c-42f5-9a6c-9d64b5da7a37 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.152540 Oct 11 07:03:14.797947 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1425/2838] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:14 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:14.803210 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e86ffcde-1275-458a-9efd-7b0d22faffa8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:14.804674 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e86ffcde-1275-458a-9efd-7b0d22faffa8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:14.805823 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e86ffcde-1275-458a-9efd-7b0d22faffa8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152982 Oct 11 07:03:14.806360 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1414/2839] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:14 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:03:15.424405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-35cd15e8-836a-403e-800f-d6b8f2c44682 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:15.425014 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-35cd15e8-836a-403e-800f-d6b8f2c44682 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:15.431465 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-35cd15e8-836a-403e-800f-d6b8f2c44682 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:15.432439 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-35cd15e8-836a-403e-800f-d6b8f2c44682 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:15.433101 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-35cd15e8-836a-403e-800f-d6b8f2c44682 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:15.434261 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-35cd15e8-836a-403e-800f-d6b8f2c44682 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:15.435003 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-35cd15e8-836a-403e-800f-d6b8f2c44682 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:15.435592 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-35cd15e8-836a-403e-800f-d6b8f2c44682 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:15.625755 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-35cd15e8-836a-403e-800f-d6b8f2c44682 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:15.636041 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-35cd15e8-836a-403e-800f-d6b8f2c44682 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1718 microversion: 2.1 time: 0.215293 Oct 11 07:03:15.638374 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-62e82589-11b0-492f-a6c9-0259fb5c6dd8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:15.639553 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-62e82589-11b0-492f-a6c9-0259fb5c6dd8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:15.646000 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62e82589-11b0-492f-a6c9-0259fb5c6dd8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:15.646480 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62e82589-11b0-492f-a6c9-0259fb5c6dd8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:15.646910 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62e82589-11b0-492f-a6c9-0259fb5c6dd8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:15.647838 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62e82589-11b0-492f-a6c9-0259fb5c6dd8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:15.648299 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62e82589-11b0-492f-a6c9-0259fb5c6dd8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:15.648709 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62e82589-11b0-492f-a6c9-0259fb5c6dd8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:15.651860 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1426/2840] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:15 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1718 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:15.784443 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-62e82589-11b0-492f-a6c9-0259fb5c6dd8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:15.794481 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-62e82589-11b0-492f-a6c9-0259fb5c6dd8 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.160222 Oct 11 07:03:15.795051 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1415/2841] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:15 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:15.821452 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d5187453-7418-456d-afed-a8f47cd03086 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:15.822063 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d5187453-7418-456d-afed-a8f47cd03086 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:15.829282 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d5187453-7418-456d-afed-a8f47cd03086 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:15.830016 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d5187453-7418-456d-afed-a8f47cd03086 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:15.830446 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d5187453-7418-456d-afed-a8f47cd03086 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:15.831318 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d5187453-7418-456d-afed-a8f47cd03086 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:15.831791 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d5187453-7418-456d-afed-a8f47cd03086 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:15.831910 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-99bce4e1-e79e-4419-84e5-94c031c4dc3a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:15.832210 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d5187453-7418-456d-afed-a8f47cd03086 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:15.832521 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-99bce4e1-e79e-4419-84e5-94c031c4dc3a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:15.838577 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99bce4e1-e79e-4419-84e5-94c031c4dc3a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:15.839052 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99bce4e1-e79e-4419-84e5-94c031c4dc3a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:15.839758 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99bce4e1-e79e-4419-84e5-94c031c4dc3a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:15.840627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99bce4e1-e79e-4419-84e5-94c031c4dc3a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:15.841071 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99bce4e1-e79e-4419-84e5-94c031c4dc3a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:15.841689 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-99bce4e1-e79e-4419-84e5-94c031c4dc3a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:15.984740 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-99bce4e1-e79e-4419-84e5-94c031c4dc3a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:15.998095 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-99bce4e1-e79e-4419-84e5-94c031c4dc3a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:15.999682 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-99bce4e1-e79e-4419-84e5-94c031c4dc3a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:16.001920 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-99bce4e1-e79e-4419-84e5-94c031c4dc3a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.174447 Oct 11 07:03:16.012889 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1416/2842] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:15 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:03:16.062215 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d5187453-7418-456d-afed-a8f47cd03086 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:16.074873 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d5187453-7418-456d-afed-a8f47cd03086 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.257236 Oct 11 07:03:16.075918 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1427/2843] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:15 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:16.095506 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-4d1b05db-2434-42de-aded-c5316d6b459e req-ce77b575-2a8d-44d6-ae3e-54eb74d94e2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c76b29e-08a3-4b53-9b36-82980a19493d", "name": "network-vif-deleted", "tag": "b4d1c36d-2115-4009-915e-804111b3a836"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:03:16.111313 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-4d1b05db-2434-42de-aded-c5316d6b459e req-ce77b575-2a8d-44d6-ae3e-54eb74d94e2c service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:16.112103 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-4d1b05db-2434-42de-aded-c5316d6b459e req-ce77b575-2a8d-44d6-ae3e-54eb74d94e2c service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:16.112700 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-4d1b05db-2434-42de-aded-c5316d6b459e req-ce77b575-2a8d-44d6-ae3e-54eb74d94e2c service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:16.126103 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-4d1b05db-2434-42de-aded-c5316d6b459e req-ce77b575-2a8d-44d6-ae3e-54eb74d94e2c service nova] Creating event network-vif-deleted:b4d1c36d-2115-4009-915e-804111b3a836 for instance 9c76b29e-08a3-4b53-9b36-82980a19493d on hv-cinder-85495 Oct 11 07:03:16.132566 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-4d1b05db-2434-42de-aded-c5316d6b459e req-ce77b575-2a8d-44d6-ae3e-54eb74d94e2c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117614 Oct 11 07:03:16.133394 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1417/2844] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:03:16.659378 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b267164c-758b-4b5d-8567-93929e985739 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:16.660010 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b267164c-758b-4b5d-8567-93929e985739 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:16.666751 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b267164c-758b-4b5d-8567-93929e985739 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:16.667229 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b267164c-758b-4b5d-8567-93929e985739 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:16.667686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b267164c-758b-4b5d-8567-93929e985739 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:16.668907 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b267164c-758b-4b5d-8567-93929e985739 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:16.669354 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b267164c-758b-4b5d-8567-93929e985739 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:16.669768 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b267164c-758b-4b5d-8567-93929e985739 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:16.731533 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b267164c-758b-4b5d-8567-93929e985739 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:16.740765 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b267164c-758b-4b5d-8567-93929e985739 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085133 Oct 11 07:03:16.741452 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1428/2845] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:16 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:16.818836 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0e42f1ab-9971-48f0-96bb-bddd804e1ea0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:16.819561 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0e42f1ab-9971-48f0-96bb-bddd804e1ea0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] [instance: 0240e39b-9517-4a93-9789-705cd357e01c] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:16.826336 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0e42f1ab-9971-48f0-96bb-bddd804e1ea0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:16.826818 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0e42f1ab-9971-48f0-96bb-bddd804e1ea0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:16.827251 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0e42f1ab-9971-48f0-96bb-bddd804e1ea0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:16.827975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0e42f1ab-9971-48f0-96bb-bddd804e1ea0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:16.828421 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0e42f1ab-9971-48f0-96bb-bddd804e1ea0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:16.829028 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0e42f1ab-9971-48f0-96bb-bddd804e1ea0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:16.959447 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0e42f1ab-9971-48f0-96bb-bddd804e1ea0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cccdf0e0e8214d11867cc9a47c997b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca42ed577ae40258f333875e0efbd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:16.968802 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0e42f1ab-9971-48f0-96bb-bddd804e1ea0 tempest-VolumesSnapshotTestJSON-1275682045 tempest-VolumesSnapshotTestJSON-1275682045-project] 10.222.0.39 "GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c" status: 200 len: 1560 microversion: 2.1 time: 0.154582 Oct 11 07:03:16.969355 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1418/2846] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:16 2022] GET /compute/v2.1/servers/0240e39b-9517-4a93-9789-705cd357e01c => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:17.029405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3b5d597c-2aee-40bd-8bc5-e6ac79d0e9ff tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:17.030283 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3b5d597c-2aee-40bd-8bc5-e6ac79d0e9ff tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:17.036843 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b5d597c-2aee-40bd-8bc5-e6ac79d0e9ff tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:17.037315 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b5d597c-2aee-40bd-8bc5-e6ac79d0e9ff tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:17.037743 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b5d597c-2aee-40bd-8bc5-e6ac79d0e9ff tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:17.038422 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b5d597c-2aee-40bd-8bc5-e6ac79d0e9ff tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:17.038865 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b5d597c-2aee-40bd-8bc5-e6ac79d0e9ff tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:17.039829 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3b5d597c-2aee-40bd-8bc5-e6ac79d0e9ff tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:17.102454 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-04f618bc-7138-4321-8b13-9f6100f50186 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:17.103070 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-04f618bc-7138-4321-8b13-9f6100f50186 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:17.109362 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-04f618bc-7138-4321-8b13-9f6100f50186 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:17.109734 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-04f618bc-7138-4321-8b13-9f6100f50186 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:17.110811 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-04f618bc-7138-4321-8b13-9f6100f50186 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:17.110952 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-04f618bc-7138-4321-8b13-9f6100f50186 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:17.111953 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-04f618bc-7138-4321-8b13-9f6100f50186 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:17.111953 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-04f618bc-7138-4321-8b13-9f6100f50186 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:17.179470 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3b5d597c-2aee-40bd-8bc5-e6ac79d0e9ff tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:17.187591 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3b5d597c-2aee-40bd-8bc5-e6ac79d0e9ff tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:17.189397 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3b5d597c-2aee-40bd-8bc5-e6ac79d0e9ff tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:17.190550 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3b5d597c-2aee-40bd-8bc5-e6ac79d0e9ff tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.165700 Oct 11 07:03:17.195785 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1429/2847] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:17 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:03:17.252897 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-04f618bc-7138-4321-8b13-9f6100f50186 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:17.261959 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-04f618bc-7138-4321-8b13-9f6100f50186 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.163170 Oct 11 07:03:17.262518 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1419/2848] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:17 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:03:17.764077 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3e6f746d-82d1-4bf3-885f-319b87e1e945 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:17.764622 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3e6f746d-82d1-4bf3-885f-319b87e1e945 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:17.771317 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e6f746d-82d1-4bf3-885f-319b87e1e945 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:17.771829 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e6f746d-82d1-4bf3-885f-319b87e1e945 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:17.772261 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e6f746d-82d1-4bf3-885f-319b87e1e945 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:17.772966 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e6f746d-82d1-4bf3-885f-319b87e1e945 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:17.773420 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e6f746d-82d1-4bf3-885f-319b87e1e945 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:17.773824 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e6f746d-82d1-4bf3-885f-319b87e1e945 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:17.835684 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3e6f746d-82d1-4bf3-885f-319b87e1e945 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:17.844521 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3e6f746d-82d1-4bf3-885f-319b87e1e945 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085305 Oct 11 07:03:17.845062 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1430/2849] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:17 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:18.216172 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cb914651-91ad-4094-aa49-58174fd79f51 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:18.216776 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cb914651-91ad-4094-aa49-58174fd79f51 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:18.222684 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb914651-91ad-4094-aa49-58174fd79f51 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:18.223156 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb914651-91ad-4094-aa49-58174fd79f51 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:18.223625 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb914651-91ad-4094-aa49-58174fd79f51 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:18.224302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb914651-91ad-4094-aa49-58174fd79f51 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:18.224747 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb914651-91ad-4094-aa49-58174fd79f51 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:18.225160 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb914651-91ad-4094-aa49-58174fd79f51 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:18.284732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-13397462-530b-40b7-8a80-e680349abcd9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:18.285333 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-13397462-530b-40b7-8a80-e680349abcd9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:18.291147 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-13397462-530b-40b7-8a80-e680349abcd9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:18.291701 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-13397462-530b-40b7-8a80-e680349abcd9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:18.292135 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-13397462-530b-40b7-8a80-e680349abcd9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:18.292811 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-13397462-530b-40b7-8a80-e680349abcd9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:18.293255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-13397462-530b-40b7-8a80-e680349abcd9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:18.293675 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-13397462-530b-40b7-8a80-e680349abcd9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:18.311647 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:03:18.351877 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cb914651-91ad-4094-aa49-58174fd79f51 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:18.361333 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cb914651-91ad-4094-aa49-58174fd79f51 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:18.362872 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cb914651-91ad-4094-aa49-58174fd79f51 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:18.364158 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cb914651-91ad-4094-aa49-58174fd79f51 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.151977 Oct 11 07:03:18.364813 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1420/2850] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:18 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:03:18.421268 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-13397462-530b-40b7-8a80-e680349abcd9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:18.429363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-13397462-530b-40b7-8a80-e680349abcd9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.148431 Oct 11 07:03:18.429921 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1431/2851] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:18 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:03:18.866498 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-050f95f5-28c4-4c1d-a5ec-d2c7fcd34fea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:18.867169 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-050f95f5-28c4-4c1d-a5ec-d2c7fcd34fea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:18.873740 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-050f95f5-28c4-4c1d-a5ec-d2c7fcd34fea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:18.874221 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-050f95f5-28c4-4c1d-a5ec-d2c7fcd34fea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:18.874661 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-050f95f5-28c4-4c1d-a5ec-d2c7fcd34fea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:18.875352 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-050f95f5-28c4-4c1d-a5ec-d2c7fcd34fea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:18.875840 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-050f95f5-28c4-4c1d-a5ec-d2c7fcd34fea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:18.876267 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-050f95f5-28c4-4c1d-a5ec-d2c7fcd34fea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:18.936869 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-050f95f5-28c4-4c1d-a5ec-d2c7fcd34fea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:18.945014 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-050f95f5-28c4-4c1d-a5ec-d2c7fcd34fea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082389 Oct 11 07:03:18.945571 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1421/2852] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:18 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:19.390121 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6452d8e5-3f2e-4800-a71e-94742459b9fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:19.390726 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6452d8e5-3f2e-4800-a71e-94742459b9fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:19.397135 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6452d8e5-3f2e-4800-a71e-94742459b9fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:19.397605 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6452d8e5-3f2e-4800-a71e-94742459b9fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:19.398032 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6452d8e5-3f2e-4800-a71e-94742459b9fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:19.398706 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6452d8e5-3f2e-4800-a71e-94742459b9fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:19.399155 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6452d8e5-3f2e-4800-a71e-94742459b9fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:19.399603 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6452d8e5-3f2e-4800-a71e-94742459b9fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:19.453225 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-697917c5-26b0-42c2-b7a7-8ae995e6648e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:19.453822 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-697917c5-26b0-42c2-b7a7-8ae995e6648e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:19.460288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-697917c5-26b0-42c2-b7a7-8ae995e6648e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:19.460772 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-697917c5-26b0-42c2-b7a7-8ae995e6648e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:19.461203 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-697917c5-26b0-42c2-b7a7-8ae995e6648e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:19.462213 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-697917c5-26b0-42c2-b7a7-8ae995e6648e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:19.462680 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-697917c5-26b0-42c2-b7a7-8ae995e6648e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:19.463709 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-697917c5-26b0-42c2-b7a7-8ae995e6648e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:19.534505 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6452d8e5-3f2e-4800-a71e-94742459b9fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:19.543171 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6452d8e5-3f2e-4800-a71e-94742459b9fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:19.544621 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6452d8e5-3f2e-4800-a71e-94742459b9fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:19.545901 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6452d8e5-3f2e-4800-a71e-94742459b9fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.159817 Oct 11 07:03:19.546294 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1432/2853] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:19 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:03:19.597021 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-697917c5-26b0-42c2-b7a7-8ae995e6648e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:19.605192 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-697917c5-26b0-42c2-b7a7-8ae995e6648e tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 200 len: 1725 microversion: 2.1 time: 0.156206 Oct 11 07:03:19.605753 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1422/2854] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:19 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:03:19.628771 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-64bd9cac-57b4-46cb-a358-29b0f9253fe9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '.version_select at 0x7f8e26cd5820>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:19.633219 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR oslo.messaging._drivers.impl_rabbit [None req-64bd9cac-57b4-46cb-a358-29b0f9253fe9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [8f1f77dc-5a3e-4e57-bede-40e1e3c93547] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 07:03:19.969639 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1fde9939-04e8-4694-a80d-81a4c6d9f3db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:19.969639 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1fde9939-04e8-4694-a80d-81a4c6d9f3db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:19.975305 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fde9939-04e8-4694-a80d-81a4c6d9f3db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:19.975835 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fde9939-04e8-4694-a80d-81a4c6d9f3db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:19.976257 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fde9939-04e8-4694-a80d-81a4c6d9f3db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:19.976940 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fde9939-04e8-4694-a80d-81a4c6d9f3db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:19.977391 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fde9939-04e8-4694-a80d-81a4c6d9f3db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:19.977811 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fde9939-04e8-4694-a80d-81a4c6d9f3db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:20.037805 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1fde9939-04e8-4694-a80d-81a4c6d9f3db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:20.045916 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1fde9939-04e8-4694-a80d-81a4c6d9f3db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081606 Oct 11 07:03:20.046466 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1423/2855] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:19 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:03:20.570870 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bb936104-a93a-43ef-9424-222d998dc5b3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:20.571553 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bb936104-a93a-43ef-9424-222d998dc5b3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:20.578712 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb936104-a93a-43ef-9424-222d998dc5b3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:20.579189 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb936104-a93a-43ef-9424-222d998dc5b3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:20.579660 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb936104-a93a-43ef-9424-222d998dc5b3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:20.580352 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb936104-a93a-43ef-9424-222d998dc5b3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:20.580798 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb936104-a93a-43ef-9424-222d998dc5b3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:20.581213 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bb936104-a93a-43ef-9424-222d998dc5b3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:20.640285 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO oslo.messaging._drivers.impl_rabbit [None req-64bd9cac-57b4-46cb-a358-29b0f9253fe9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [8f1f77dc-5a3e-4e57-bede-40e1e3c93547] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 47208. Oct 11 07:03:20.660969 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-64bd9cac-57b4-46cb-a358-29b0f9253fe9 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-981874670" status: 202 len: 0 microversion: 2.1 time: 1.035272 Oct 11 07:03:20.660969 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1433/2856] 10.222.0.39 () {58 vars in 1218 bytes} [Tue Oct 11 07:03:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-981874670 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 07:03:20.716767 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-bb936104-a93a-43ef-9424-222d998dc5b3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:20.725599 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-bb936104-a93a-43ef-9424-222d998dc5b3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:20.727125 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-bb936104-a93a-43ef-9424-222d998dc5b3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:20.728421 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bb936104-a93a-43ef-9424-222d998dc5b3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.161457 Oct 11 07:03:20.729057 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1424/2857] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:20 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:03:21.068429 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-da7c0a8c-5f63-4870-a0b2-ce0c9ab3f223 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:21.069040 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-da7c0a8c-5f63-4870-a0b2-ce0c9ab3f223 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:21.076999 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-da7c0a8c-5f63-4870-a0b2-ce0c9ab3f223 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:21.077483 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-da7c0a8c-5f63-4870-a0b2-ce0c9ab3f223 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:21.077914 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-da7c0a8c-5f63-4870-a0b2-ce0c9ab3f223 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:21.078614 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-da7c0a8c-5f63-4870-a0b2-ce0c9ab3f223 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:21.079063 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-da7c0a8c-5f63-4870-a0b2-ce0c9ab3f223 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:21.079510 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-da7c0a8c-5f63-4870-a0b2-ce0c9ab3f223 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:21.163654 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-da7c0a8c-5f63-4870-a0b2-ce0c9ab3f223 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:21.171765 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-da7c0a8c-5f63-4870-a0b2-ce0c9ab3f223 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.107374 Oct 11 07:03:21.172325 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1434/2858] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:21 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:21.542887 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-d4bb7ff9-d556-4c79-b834-43386d8366c4 req-1580a035-9086-4263-8205-c3236cb6f99e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2ce136a-30ab-4986-931e-5af38b37875e", "tag": "3280a926-f599-464d-a89c-2446cca4d1a4"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:03:21.553526 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-d4bb7ff9-d556-4c79-b834-43386d8366c4 req-1580a035-9086-4263-8205-c3236cb6f99e service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:21.554004 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-d4bb7ff9-d556-4c79-b834-43386d8366c4 req-1580a035-9086-4263-8205-c3236cb6f99e service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:21.554433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-d4bb7ff9-d556-4c79-b834-43386d8366c4 req-1580a035-9086-4263-8205-c3236cb6f99e service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:21.566265 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-d4bb7ff9-d556-4c79-b834-43386d8366c4 req-1580a035-9086-4263-8205-c3236cb6f99e service nova] Creating event network-changed:3280a926-f599-464d-a89c-2446cca4d1a4 for instance a2ce136a-30ab-4986-931e-5af38b37875e on hv-cinder-85495 Oct 11 07:03:21.571612 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-d4bb7ff9-d556-4c79-b834-43386d8366c4 req-1580a035-9086-4263-8205-c3236cb6f99e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033242 Oct 11 07:03:21.572856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1425/2859] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:03:21.767459 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f8995b6d-159d-4573-9c24-2ef9abb07097 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:21.767459 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f8995b6d-159d-4573-9c24-2ef9abb07097 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:21.768154 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-73d40983-3f28-4fea-a752-1df3146dcd7d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Action: 'create', calling method: .version_select at 0x7f8e2a542d30>, body: {"keypair": {"name": "tempest-keypair-448344022", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPo9rekF3pLhSJ7pz6BO+DA6BW+yYjExfZ0cfCm1reojIOP93PqrkVIJ3/RB+RfCViYrYfAkMkwz6f7jk0Wi0k2mQPYnt4HHKjGZjdsSw8xuplcxvkEEEUsOt3osWXimpg=="}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:03:21.781163 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-73d40983-3f28-4fea-a752-1df3146dcd7d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Getting quotas for project 5af47e2321de4d299ff3a7fb3d3d9e3c. Resources: {'key_pairs'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 07:03:21.783235 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f8995b6d-159d-4573-9c24-2ef9abb07097 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:21.783899 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f8995b6d-159d-4573-9c24-2ef9abb07097 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:21.784470 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f8995b6d-159d-4573-9c24-2ef9abb07097 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:21.785200 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f8995b6d-159d-4573-9c24-2ef9abb07097 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:21.785438 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-73d40983-3f28-4fea-a752-1df3146dcd7d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Getting quotas for user 2e63c3f83f3d41018e6330f26ed7b8a0 and project 5af47e2321de4d299ff3a7fb3d3d9e3c. Resources: {'key_pairs'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 07:03:21.785653 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f8995b6d-159d-4573-9c24-2ef9abb07097 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:21.786078 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f8995b6d-159d-4573-9c24-2ef9abb07097 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:21.799490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR oslo.messaging._drivers.impl_rabbit [None req-73d40983-3f28-4fea-a752-1df3146dcd7d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [9118c09c-d25a-4df3-9abf-bc5a09ce8823] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 07:03:21.994966 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f8995b6d-159d-4573-9c24-2ef9abb07097 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:22.004386 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f8995b6d-159d-4573-9c24-2ef9abb07097 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:22.005832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f8995b6d-159d-4573-9c24-2ef9abb07097 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:22.007025 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f8995b6d-159d-4573-9c24-2ef9abb07097 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.256293 Oct 11 07:03:22.007858 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1435/2860] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:21 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:03:22.194087 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6f1b74b6-0bd4-4728-aecb-e202d26e4ffc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:22.194694 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6f1b74b6-0bd4-4728-aecb-e202d26e4ffc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:22.202533 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f1b74b6-0bd4-4728-aecb-e202d26e4ffc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:22.203011 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f1b74b6-0bd4-4728-aecb-e202d26e4ffc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:22.203452 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f1b74b6-0bd4-4728-aecb-e202d26e4ffc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:22.205189 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f1b74b6-0bd4-4728-aecb-e202d26e4ffc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:22.205189 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f1b74b6-0bd4-4728-aecb-e202d26e4ffc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:22.205189 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6f1b74b6-0bd4-4728-aecb-e202d26e4ffc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:22.267594 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6f1b74b6-0bd4-4728-aecb-e202d26e4ffc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:22.275664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6f1b74b6-0bd4-4728-aecb-e202d26e4ffc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085299 Oct 11 07:03:22.276223 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1436/2861] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:22 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:03:22.807145 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [None req-73d40983-3f28-4fea-a752-1df3146dcd7d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [9118c09c-d25a-4df3-9abf-bc5a09ce8823] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 47224. Oct 11 07:03:22.821484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-73d40983-3f28-4fea-a752-1df3146dcd7d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.062924 Oct 11 07:03:22.822075 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1426/2862] 10.222.0.39 () {60 vars in 1159 bytes} [Tue Oct 11 07:03:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 07:03:23.033398 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e814e31e-4354-42b9-a7f7-7c21e52dbfa6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:23.034092 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e814e31e-4354-42b9-a7f7-7c21e52dbfa6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:23.040342 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e814e31e-4354-42b9-a7f7-7c21e52dbfa6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:23.040828 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e814e31e-4354-42b9-a7f7-7c21e52dbfa6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:23.041260 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e814e31e-4354-42b9-a7f7-7c21e52dbfa6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:23.041962 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e814e31e-4354-42b9-a7f7-7c21e52dbfa6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:23.042409 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e814e31e-4354-42b9-a7f7-7c21e52dbfa6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:23.042834 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e814e31e-4354-42b9-a7f7-7c21e52dbfa6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:23.298643 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4a0ca3a4-9632-4d37-ba03-d6682eb91fcb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:23.299690 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e814e31e-4354-42b9-a7f7-7c21e52dbfa6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:23.299868 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4a0ca3a4-9632-4d37-ba03-d6682eb91fcb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:23.303812 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:03:23.308321 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4a0ca3a4-9632-4d37-ba03-d6682eb91fcb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:23.308712 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e814e31e-4354-42b9-a7f7-7c21e52dbfa6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:23.308878 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4a0ca3a4-9632-4d37-ba03-d6682eb91fcb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:23.309669 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4a0ca3a4-9632-4d37-ba03-d6682eb91fcb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:23.310174 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e814e31e-4354-42b9-a7f7-7c21e52dbfa6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:23.310437 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4a0ca3a4-9632-4d37-ba03-d6682eb91fcb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:23.310891 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4a0ca3a4-9632-4d37-ba03-d6682eb91fcb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:23.311316 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4a0ca3a4-9632-4d37-ba03-d6682eb91fcb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:23.311550 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e814e31e-4354-42b9-a7f7-7c21e52dbfa6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.281909 Oct 11 07:03:23.312209 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1437/2863] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:23 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:03:23.380342 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4a0ca3a4-9632-4d37-ba03-d6682eb91fcb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:23.389785 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4a0ca3a4-9632-4d37-ba03-d6682eb91fcb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.095479 Oct 11 07:03:23.390667 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1427/2864] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:23 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:24.338318 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2645cb7c-8e53-4f82-bf71-ade9f6a68b50 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:24.338874 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2645cb7c-8e53-4f82-bf71-ade9f6a68b50 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:24.345522 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2645cb7c-8e53-4f82-bf71-ade9f6a68b50 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:24.345998 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2645cb7c-8e53-4f82-bf71-ade9f6a68b50 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:24.346427 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2645cb7c-8e53-4f82-bf71-ade9f6a68b50 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:24.347127 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2645cb7c-8e53-4f82-bf71-ade9f6a68b50 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:24.347595 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2645cb7c-8e53-4f82-bf71-ade9f6a68b50 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:24.348010 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2645cb7c-8e53-4f82-bf71-ade9f6a68b50 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:24.421670 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-dce2e51c-6c38-41a5-9a5d-40d31b46dfb8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:24.422291 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-dce2e51c-6c38-41a5-9a5d-40d31b46dfb8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:24.430616 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dce2e51c-6c38-41a5-9a5d-40d31b46dfb8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:24.431107 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dce2e51c-6c38-41a5-9a5d-40d31b46dfb8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:24.431601 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dce2e51c-6c38-41a5-9a5d-40d31b46dfb8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:24.432311 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dce2e51c-6c38-41a5-9a5d-40d31b46dfb8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:24.432765 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dce2e51c-6c38-41a5-9a5d-40d31b46dfb8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:24.433196 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dce2e51c-6c38-41a5-9a5d-40d31b46dfb8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:24.451885 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:03:24.487980 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2645cb7c-8e53-4f82-bf71-ade9f6a68b50 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:24.496606 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2645cb7c-8e53-4f82-bf71-ade9f6a68b50 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:24.498020 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2645cb7c-8e53-4f82-bf71-ade9f6a68b50 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:24.499175 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2645cb7c-8e53-4f82-bf71-ade9f6a68b50 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.165465 Oct 11 07:03:24.500067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1438/2865] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:24 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:03:24.524292 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-dce2e51c-6c38-41a5-9a5d-40d31b46dfb8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:24.533758 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-dce2e51c-6c38-41a5-9a5d-40d31b46dfb8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.124671 Oct 11 07:03:24.534691 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1428/2866] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:24 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:24.601694 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f69ac766-0030-45d6-8c48-b7009acab184 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1921761938", "imageRef": "2303551c-410e-4a2b-8eeb-dea686876901", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21c482a1-7bc7-4511-a714-740a34b4b762"}], "security_groups": [{"name": "tempest-securitygroup--912586126"}], "key_name": "tempest-keypair-448344022", "user_data": "}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:03:24.703397 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.network.neutron [None req-f69ac766-0030-45d6-8c48-b7009acab184 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] validate_networks() for [('21c482a1-7bc7-4511-a714-740a34b4b762', None, None, None, None, None)] {{(pid=125266) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 07:03:25.133770 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-f69ac766-0030-45d6-8c48-b7009acab184 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Flavor limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 07:03:25.134184 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-f69ac766-0030-45d6-8c48-b7009acab184 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Image limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 07:03:25.135254 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-f69ac766-0030-45d6-8c48-b7009acab184 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Flavor pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 07:03:25.135684 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-f69ac766-0030-45d6-8c48-b7009acab184 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Image pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 07:03:25.136086 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-f69ac766-0030-45d6-8c48-b7009acab184 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 07:03:25.144786 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f69ac766-0030-45d6-8c48-b7009acab184 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:25.145253 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f69ac766-0030-45d6-8c48-b7009acab184 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:25.145675 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f69ac766-0030-45d6-8c48-b7009acab184 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:25.146387 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f69ac766-0030-45d6-8c48-b7009acab184 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:25.146825 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f69ac766-0030-45d6-8c48-b7009acab184 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:25.147237 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f69ac766-0030-45d6-8c48-b7009acab184 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:25.163251 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-f69ac766-0030-45d6-8c48-b7009acab184 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Getting quotas for project 5af47e2321de4d299ff3a7fb3d3d9e3c. Resources: {'cores', 'ram', 'instances'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 07:03:25.167126 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-f69ac766-0030-45d6-8c48-b7009acab184 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Getting quotas for user 2e63c3f83f3d41018e6330f26ed7b8a0 and project 5af47e2321de4d299ff3a7fb3d3d9e3c. Resources: {'cores', 'ram', 'instances'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 07:03:25.178118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f69ac766-0030-45d6-8c48-b7009acab184 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Going to run 1 instances... {{(pid=125266) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 07:03:25.180429 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f69ac766-0030-45d6-8c48-b7009acab184 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: edea36de-eaed-4410-81f5-b9a3643849c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2303551c-410e-4a2b-8eeb-dea686876901',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 07:03:25.228835 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f69ac766-0030-45d6-8c48-b7009acab184 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.631359 Oct 11 07:03:25.229598 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1439/2867] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Oct 11 07:03:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 07:03:25.240761 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-847517ee-91c2-4ad8-8b5a-9cb7cff0d60b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:25.241372 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-847517ee-91c2-4ad8-8b5a-9cb7cff0d60b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: edea36de-eaed-4410-81f5-b9a3643849c2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:25.293329 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-847517ee-91c2-4ad8-8b5a-9cb7cff0d60b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:25.300091 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-847517ee-91c2-4ad8-8b5a-9cb7cff0d60b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2" status: 200 len: 1241 microversion: 2.1 time: 0.063128 Oct 11 07:03:25.300669 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1429/2868] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:25 2022] GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2 => generated 1241 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:25.525014 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-14ce5075-b356-41e0-9acb-887c4499716a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:25.525623 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-14ce5075-b356-41e0-9acb-887c4499716a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:25.532490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-14ce5075-b356-41e0-9acb-887c4499716a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:25.532973 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-14ce5075-b356-41e0-9acb-887c4499716a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:25.533402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-14ce5075-b356-41e0-9acb-887c4499716a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:25.534086 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-14ce5075-b356-41e0-9acb-887c4499716a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:25.534533 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-14ce5075-b356-41e0-9acb-887c4499716a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:25.534953 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-14ce5075-b356-41e0-9acb-887c4499716a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:25.557947 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d8368a55-4b5f-49e4-80d8-0a86203e236a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:25.558632 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d8368a55-4b5f-49e4-80d8-0a86203e236a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:25.565814 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8368a55-4b5f-49e4-80d8-0a86203e236a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:25.566308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8368a55-4b5f-49e4-80d8-0a86203e236a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:25.566749 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8368a55-4b5f-49e4-80d8-0a86203e236a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:25.567479 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8368a55-4b5f-49e4-80d8-0a86203e236a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:25.567940 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8368a55-4b5f-49e4-80d8-0a86203e236a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:25.568368 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d8368a55-4b5f-49e4-80d8-0a86203e236a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:25.628165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d8368a55-4b5f-49e4-80d8-0a86203e236a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:25.636586 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d8368a55-4b5f-49e4-80d8-0a86203e236a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082929 Oct 11 07:03:25.637149 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1430/2869] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:25 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:03:25.663671 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-14ce5075-b356-41e0-9acb-887c4499716a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:25.672628 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-14ce5075-b356-41e0-9acb-887c4499716a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:25.674039 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-14ce5075-b356-41e0-9acb-887c4499716a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:25.675177 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-14ce5075-b356-41e0-9acb-887c4499716a tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.154591 Oct 11 07:03:25.675758 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1440/2870] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:25 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:03:26.323691 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e79c7ac7-ed36-4980-831d-d5c0e3f82a73 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:26.324308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e79c7ac7-ed36-4980-831d-d5c0e3f82a73 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: edea36de-eaed-4410-81f5-b9a3643849c2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:26.379234 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e79c7ac7-ed36-4980-831d-d5c0e3f82a73 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:26.387120 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e79c7ac7-ed36-4980-831d-d5c0e3f82a73 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2" status: 200 len: 1241 microversion: 2.1 time: 0.067668 Oct 11 07:03:26.398470 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1431/2871] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:26 2022] GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:26.659523 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3056b74d-6ea1-4d06-9c18-4514992cd490 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:26.660133 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3056b74d-6ea1-4d06-9c18-4514992cd490 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:26.666505 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3056b74d-6ea1-4d06-9c18-4514992cd490 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:26.666981 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3056b74d-6ea1-4d06-9c18-4514992cd490 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:26.667428 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3056b74d-6ea1-4d06-9c18-4514992cd490 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:26.668111 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3056b74d-6ea1-4d06-9c18-4514992cd490 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:26.668558 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3056b74d-6ea1-4d06-9c18-4514992cd490 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:26.668987 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3056b74d-6ea1-4d06-9c18-4514992cd490 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:26.701954 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-19c1c15a-b645-44b8-bb37-f551e6b17ce0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:26.702655 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-19c1c15a-b645-44b8-bb37-f551e6b17ce0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:26.709248 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-19c1c15a-b645-44b8-bb37-f551e6b17ce0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:26.709793 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-19c1c15a-b645-44b8-bb37-f551e6b17ce0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:26.710235 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-19c1c15a-b645-44b8-bb37-f551e6b17ce0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:26.710935 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-19c1c15a-b645-44b8-bb37-f551e6b17ce0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:26.711385 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-19c1c15a-b645-44b8-bb37-f551e6b17ce0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:26.711828 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-19c1c15a-b645-44b8-bb37-f551e6b17ce0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:26.733221 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3056b74d-6ea1-4d06-9c18-4514992cd490 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:26.741573 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3056b74d-6ea1-4d06-9c18-4514992cd490 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085932 Oct 11 07:03:26.742139 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1441/2872] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:26 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:26.839087 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-19c1c15a-b645-44b8-bb37-f551e6b17ce0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:26.847647 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-19c1c15a-b645-44b8-bb37-f551e6b17ce0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:26.849083 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-19c1c15a-b645-44b8-bb37-f551e6b17ce0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:26.850228 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-19c1c15a-b645-44b8-bb37-f551e6b17ce0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152151 Oct 11 07:03:26.850779 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1432/2873] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:26 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:03:27.412319 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-64021ebf-c2bb-4d59-8bf9-6aef80f35a4d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:27.412928 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-64021ebf-c2bb-4d59-8bf9-6aef80f35a4d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: edea36de-eaed-4410-81f5-b9a3643849c2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:27.466751 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-64021ebf-c2bb-4d59-8bf9-6aef80f35a4d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:27.473933 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-64021ebf-c2bb-4d59-8bf9-6aef80f35a4d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2" status: 200 len: 1241 microversion: 2.1 time: 0.067554 Oct 11 07:03:27.474634 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1442/2874] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:27 2022] GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:27.765264 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-26f8fec0-b35b-4036-b74c-4e42eefb7f7b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:27.765886 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-26f8fec0-b35b-4036-b74c-4e42eefb7f7b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:27.772246 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26f8fec0-b35b-4036-b74c-4e42eefb7f7b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:27.772722 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26f8fec0-b35b-4036-b74c-4e42eefb7f7b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:27.773157 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26f8fec0-b35b-4036-b74c-4e42eefb7f7b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:27.773840 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26f8fec0-b35b-4036-b74c-4e42eefb7f7b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:27.774292 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26f8fec0-b35b-4036-b74c-4e42eefb7f7b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:27.774711 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26f8fec0-b35b-4036-b74c-4e42eefb7f7b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:27.834401 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-26f8fec0-b35b-4036-b74c-4e42eefb7f7b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:27.842998 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-26f8fec0-b35b-4036-b74c-4e42eefb7f7b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081862 Oct 11 07:03:27.843572 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1433/2875] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:27 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:27.874880 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f2df6975-86ce-4873-bf25-806b31eaab4e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:27.875521 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f2df6975-86ce-4873-bf25-806b31eaab4e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:27.881944 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f2df6975-86ce-4873-bf25-806b31eaab4e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:27.882425 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f2df6975-86ce-4873-bf25-806b31eaab4e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:27.882861 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f2df6975-86ce-4873-bf25-806b31eaab4e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:27.883584 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f2df6975-86ce-4873-bf25-806b31eaab4e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:27.884035 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f2df6975-86ce-4873-bf25-806b31eaab4e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:27.884502 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f2df6975-86ce-4873-bf25-806b31eaab4e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:28.013069 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f2df6975-86ce-4873-bf25-806b31eaab4e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:28.021671 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f2df6975-86ce-4873-bf25-806b31eaab4e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:28.023089 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f2df6975-86ce-4873-bf25-806b31eaab4e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:28.024288 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f2df6975-86ce-4873-bf25-806b31eaab4e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.153291 Oct 11 07:03:28.024845 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1443/2876] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:27 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:03:28.497669 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9263781f-4419-4713-a6e6-3216f25a92bb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:28.498287 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9263781f-4419-4713-a6e6-3216f25a92bb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: edea36de-eaed-4410-81f5-b9a3643849c2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:28.551473 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9263781f-4419-4713-a6e6-3216f25a92bb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:28.559683 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9263781f-4419-4713-a6e6-3216f25a92bb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2" status: 200 len: 1241 microversion: 2.1 time: 0.066414 Oct 11 07:03:28.560245 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1434/2877] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:28 2022] GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:28.865241 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-62391ef5-4d37-418b-a3ac-99e09fdc8b21 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:28.865844 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-62391ef5-4d37-418b-a3ac-99e09fdc8b21 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:28.871777 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62391ef5-4d37-418b-a3ac-99e09fdc8b21 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:28.872247 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62391ef5-4d37-418b-a3ac-99e09fdc8b21 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:28.872671 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62391ef5-4d37-418b-a3ac-99e09fdc8b21 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:28.873343 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62391ef5-4d37-418b-a3ac-99e09fdc8b21 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:28.873784 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62391ef5-4d37-418b-a3ac-99e09fdc8b21 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:28.874196 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62391ef5-4d37-418b-a3ac-99e09fdc8b21 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:28.934704 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-62391ef5-4d37-418b-a3ac-99e09fdc8b21 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:28.942758 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-62391ef5-4d37-418b-a3ac-99e09fdc8b21 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081326 Oct 11 07:03:28.943310 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1444/2878] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:28 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:29.050405 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e10c570c-aeb1-423d-adea-18f16497dee4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:29.051012 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e10c570c-aeb1-423d-adea-18f16497dee4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:29.057836 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e10c570c-aeb1-423d-adea-18f16497dee4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:29.058313 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e10c570c-aeb1-423d-adea-18f16497dee4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:29.058746 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e10c570c-aeb1-423d-adea-18f16497dee4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:29.059456 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e10c570c-aeb1-423d-adea-18f16497dee4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:29.059908 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e10c570c-aeb1-423d-adea-18f16497dee4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:29.060329 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e10c570c-aeb1-423d-adea-18f16497dee4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:29.187559 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e10c570c-aeb1-423d-adea-18f16497dee4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:29.196039 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e10c570c-aeb1-423d-adea-18f16497dee4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:29.197468 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e10c570c-aeb1-423d-adea-18f16497dee4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:29.198614 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e10c570c-aeb1-423d-adea-18f16497dee4 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152136 Oct 11 07:03:29.199166 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1435/2879] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:29 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:03:29.582190 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0dc2cf23-ba1a-4721-8356-76322aefabb4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:29.582800 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0dc2cf23-ba1a-4721-8356-76322aefabb4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: edea36de-eaed-4410-81f5-b9a3643849c2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:29.588803 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0dc2cf23-ba1a-4721-8356-76322aefabb4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:29.589283 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0dc2cf23-ba1a-4721-8356-76322aefabb4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:29.590010 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0dc2cf23-ba1a-4721-8356-76322aefabb4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:29.590697 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0dc2cf23-ba1a-4721-8356-76322aefabb4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:29.591144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0dc2cf23-ba1a-4721-8356-76322aefabb4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:29.591606 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0dc2cf23-ba1a-4721-8356-76322aefabb4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:29.654077 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0dc2cf23-ba1a-4721-8356-76322aefabb4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:29.661746 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0dc2cf23-ba1a-4721-8356-76322aefabb4 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2" status: 200 len: 1245 microversion: 2.1 time: 0.083391 Oct 11 07:03:29.662303 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1445/2880] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:29 2022] GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:29.965248 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-65c4ade8-83c5-4cde-96a9-a31fd2909c6e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:29.965857 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-65c4ade8-83c5-4cde-96a9-a31fd2909c6e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:29.972662 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65c4ade8-83c5-4cde-96a9-a31fd2909c6e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:29.973341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65c4ade8-83c5-4cde-96a9-a31fd2909c6e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:29.973881 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65c4ade8-83c5-4cde-96a9-a31fd2909c6e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:29.974786 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65c4ade8-83c5-4cde-96a9-a31fd2909c6e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:29.975302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65c4ade8-83c5-4cde-96a9-a31fd2909c6e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:29.975775 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65c4ade8-83c5-4cde-96a9-a31fd2909c6e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:30.040146 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-65c4ade8-83c5-4cde-96a9-a31fd2909c6e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:30.048946 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-65c4ade8-83c5-4cde-96a9-a31fd2909c6e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.087528 Oct 11 07:03:30.049532 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1436/2881] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:29 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:30.223586 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-554bdfe6-d993-4f87-8129-232fe323e78e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:30.224212 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-554bdfe6-d993-4f87-8129-232fe323e78e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:30.231114 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-554bdfe6-d993-4f87-8129-232fe323e78e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:30.231770 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-554bdfe6-d993-4f87-8129-232fe323e78e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:30.232200 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-554bdfe6-d993-4f87-8129-232fe323e78e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:30.232879 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-554bdfe6-d993-4f87-8129-232fe323e78e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:30.233323 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-554bdfe6-d993-4f87-8129-232fe323e78e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:30.233743 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-554bdfe6-d993-4f87-8129-232fe323e78e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:30.359219 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-554bdfe6-d993-4f87-8129-232fe323e78e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:30.367671 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-554bdfe6-d993-4f87-8129-232fe323e78e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:30.369096 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-554bdfe6-d993-4f87-8129-232fe323e78e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:30.370232 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-554bdfe6-d993-4f87-8129-232fe323e78e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.150459 Oct 11 07:03:30.370779 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1446/2882] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:30 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:03:30.684664 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-01f60b7a-da3a-49d3-a0a2-bf30b5d8f4e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:30.685276 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-01f60b7a-da3a-49d3-a0a2-bf30b5d8f4e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: edea36de-eaed-4410-81f5-b9a3643849c2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:30.691996 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-01f60b7a-da3a-49d3-a0a2-bf30b5d8f4e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:30.692474 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-01f60b7a-da3a-49d3-a0a2-bf30b5d8f4e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:30.692903 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-01f60b7a-da3a-49d3-a0a2-bf30b5d8f4e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:30.693591 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-01f60b7a-da3a-49d3-a0a2-bf30b5d8f4e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:30.694036 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-01f60b7a-da3a-49d3-a0a2-bf30b5d8f4e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:30.694485 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-01f60b7a-da3a-49d3-a0a2-bf30b5d8f4e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:30.755511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-01f60b7a-da3a-49d3-a0a2-bf30b5d8f4e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:30.763933 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-01f60b7a-da3a-49d3-a0a2-bf30b5d8f4e6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2" status: 200 len: 1299 microversion: 2.1 time: 0.083229 Oct 11 07:03:30.764491 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1437/2883] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:30 2022] GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2 => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:03:31.072860 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a89a2cfb-c102-43c3-b95f-69b0dbf1b6f6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:31.073482 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a89a2cfb-c102-43c3-b95f-69b0dbf1b6f6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:31.079769 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a89a2cfb-c102-43c3-b95f-69b0dbf1b6f6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:31.080260 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a89a2cfb-c102-43c3-b95f-69b0dbf1b6f6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:31.080694 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a89a2cfb-c102-43c3-b95f-69b0dbf1b6f6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:31.081394 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a89a2cfb-c102-43c3-b95f-69b0dbf1b6f6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:31.081848 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a89a2cfb-c102-43c3-b95f-69b0dbf1b6f6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:31.082274 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a89a2cfb-c102-43c3-b95f-69b0dbf1b6f6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:31.153258 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a89a2cfb-c102-43c3-b95f-69b0dbf1b6f6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:31.161499 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a89a2cfb-c102-43c3-b95f-69b0dbf1b6f6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.093261 Oct 11 07:03:31.161989 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1447/2884] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:31 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:31.396886 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-dab79248-91d0-47d1-9e49-f3997dd1bc69 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:31.398069 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-dab79248-91d0-47d1-9e49-f3997dd1bc69 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:31.405308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dab79248-91d0-47d1-9e49-f3997dd1bc69 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:31.406194 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dab79248-91d0-47d1-9e49-f3997dd1bc69 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:31.407331 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dab79248-91d0-47d1-9e49-f3997dd1bc69 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:31.409180 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dab79248-91d0-47d1-9e49-f3997dd1bc69 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:31.409986 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dab79248-91d0-47d1-9e49-f3997dd1bc69 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:31.410697 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dab79248-91d0-47d1-9e49-f3997dd1bc69 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:31.556951 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-dab79248-91d0-47d1-9e49-f3997dd1bc69 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:31.565883 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-dab79248-91d0-47d1-9e49-f3997dd1bc69 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:31.567502 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-dab79248-91d0-47d1-9e49-f3997dd1bc69 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:31.568686 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-dab79248-91d0-47d1-9e49-f3997dd1bc69 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.176503 Oct 11 07:03:31.569360 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1438/2885] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:31 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:03:31.787694 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-12f2d613-17c2-40ea-869a-55ce592de97c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:31.788334 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-12f2d613-17c2-40ea-869a-55ce592de97c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: edea36de-eaed-4410-81f5-b9a3643849c2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:31.795265 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-12f2d613-17c2-40ea-869a-55ce592de97c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:31.796802 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-12f2d613-17c2-40ea-869a-55ce592de97c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:31.797727 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-12f2d613-17c2-40ea-869a-55ce592de97c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:31.798621 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-12f2d613-17c2-40ea-869a-55ce592de97c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:31.799076 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-12f2d613-17c2-40ea-869a-55ce592de97c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:31.799520 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-12f2d613-17c2-40ea-869a-55ce592de97c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:32.009245 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-12f2d613-17c2-40ea-869a-55ce592de97c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:32.017778 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-12f2d613-17c2-40ea-869a-55ce592de97c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2" status: 200 len: 1366 microversion: 2.1 time: 0.234038 Oct 11 07:03:32.018335 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1448/2886] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:31 2022] GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:32.121183 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-9bbaedd1-c0da-48fe-8ab8-9fe5425eee3f req-af0800d7-713d-42be-ba37-1bff92692580 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edea36de-eaed-4410-81f5-b9a3643849c2", "tag": "23bd824c-911b-4ca8-a97f-28c788b0eca8"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:03:32.130817 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-9bbaedd1-c0da-48fe-8ab8-9fe5425eee3f req-af0800d7-713d-42be-ba37-1bff92692580 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:32.131284 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-9bbaedd1-c0da-48fe-8ab8-9fe5425eee3f req-af0800d7-713d-42be-ba37-1bff92692580 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:32.131766 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-9bbaedd1-c0da-48fe-8ab8-9fe5425eee3f req-af0800d7-713d-42be-ba37-1bff92692580 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:32.144284 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-9bbaedd1-c0da-48fe-8ab8-9fe5425eee3f req-af0800d7-713d-42be-ba37-1bff92692580 service nova] Creating event network-changed:23bd824c-911b-4ca8-a97f-28c788b0eca8 for instance edea36de-eaed-4410-81f5-b9a3643849c2 on hv-cinder-85495 Oct 11 07:03:32.149517 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-9bbaedd1-c0da-48fe-8ab8-9fe5425eee3f req-af0800d7-713d-42be-ba37-1bff92692580 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032575 Oct 11 07:03:32.150256 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1439/2887] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:03:32.184248 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ee63341c-2a2c-4785-8e0d-56795ed1c5a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:32.184853 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ee63341c-2a2c-4785-8e0d-56795ed1c5a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:32.190661 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ee63341c-2a2c-4785-8e0d-56795ed1c5a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:32.191137 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ee63341c-2a2c-4785-8e0d-56795ed1c5a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:32.191599 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ee63341c-2a2c-4785-8e0d-56795ed1c5a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:32.192287 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ee63341c-2a2c-4785-8e0d-56795ed1c5a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:32.192731 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ee63341c-2a2c-4785-8e0d-56795ed1c5a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:32.193150 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ee63341c-2a2c-4785-8e0d-56795ed1c5a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:32.283970 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ee63341c-2a2c-4785-8e0d-56795ed1c5a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:32.292970 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ee63341c-2a2c-4785-8e0d-56795ed1c5a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.113184 Oct 11 07:03:32.293541 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1449/2888] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:32 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:32.594938 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-47123ab4-6fa3-4cad-9325-f009dbaa6da0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:32.595691 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-47123ab4-6fa3-4cad-9325-f009dbaa6da0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:32.601804 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-47123ab4-6fa3-4cad-9325-f009dbaa6da0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:32.602284 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-47123ab4-6fa3-4cad-9325-f009dbaa6da0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:32.602714 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-47123ab4-6fa3-4cad-9325-f009dbaa6da0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:32.603979 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-47123ab4-6fa3-4cad-9325-f009dbaa6da0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:32.604424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-47123ab4-6fa3-4cad-9325-f009dbaa6da0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:32.604957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-47123ab4-6fa3-4cad-9325-f009dbaa6da0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:32.730550 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-47123ab4-6fa3-4cad-9325-f009dbaa6da0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:32.739195 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-47123ab4-6fa3-4cad-9325-f009dbaa6da0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:32.740666 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-47123ab4-6fa3-4cad-9325-f009dbaa6da0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:32.741811 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-47123ab4-6fa3-4cad-9325-f009dbaa6da0 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.151122 Oct 11 07:03:32.742359 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1440/2889] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:32 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:03:33.040655 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-43222ca7-7f41-4578-b27f-3b85695a6077 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:33.041342 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-43222ca7-7f41-4578-b27f-3b85695a6077 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: edea36de-eaed-4410-81f5-b9a3643849c2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:33.047768 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-43222ca7-7f41-4578-b27f-3b85695a6077 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:33.048262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-43222ca7-7f41-4578-b27f-3b85695a6077 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:33.048676 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-43222ca7-7f41-4578-b27f-3b85695a6077 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:33.049389 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-43222ca7-7f41-4578-b27f-3b85695a6077 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:33.049839 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-43222ca7-7f41-4578-b27f-3b85695a6077 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:33.050261 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-43222ca7-7f41-4578-b27f-3b85695a6077 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:33.173307 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-43222ca7-7f41-4578-b27f-3b85695a6077 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:33.176696 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:03:33.182122 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-43222ca7-7f41-4578-b27f-3b85695a6077 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2" status: 200 len: 1366 microversion: 2.1 time: 0.145304 Oct 11 07:03:33.182682 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1450/2890] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:33 2022] GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:33.316384 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cd53121a-b997-4ac0-a84e-468c1525f55e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:33.316913 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cd53121a-b997-4ac0-a84e-468c1525f55e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:33.323863 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cd53121a-b997-4ac0-a84e-468c1525f55e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:33.324343 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cd53121a-b997-4ac0-a84e-468c1525f55e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:33.324776 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cd53121a-b997-4ac0-a84e-468c1525f55e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:33.325463 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cd53121a-b997-4ac0-a84e-468c1525f55e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:33.325913 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cd53121a-b997-4ac0-a84e-468c1525f55e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:33.326331 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cd53121a-b997-4ac0-a84e-468c1525f55e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:33.385874 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cd53121a-b997-4ac0-a84e-468c1525f55e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:33.394142 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cd53121a-b997-4ac0-a84e-468c1525f55e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081694 Oct 11 07:03:33.394695 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1441/2891] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:33 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:33.767960 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ec38ed63-7954-4d17-b286-9f722eef2dd8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:33.768587 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ec38ed63-7954-4d17-b286-9f722eef2dd8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:33.774608 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec38ed63-7954-4d17-b286-9f722eef2dd8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:33.775096 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec38ed63-7954-4d17-b286-9f722eef2dd8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:33.775555 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec38ed63-7954-4d17-b286-9f722eef2dd8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:33.776254 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec38ed63-7954-4d17-b286-9f722eef2dd8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:33.776706 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec38ed63-7954-4d17-b286-9f722eef2dd8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:33.777133 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec38ed63-7954-4d17-b286-9f722eef2dd8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:33.988897 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ec38ed63-7954-4d17-b286-9f722eef2dd8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:33.997606 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ec38ed63-7954-4d17-b286-9f722eef2dd8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:33.999133 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ec38ed63-7954-4d17-b286-9f722eef2dd8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:34.000373 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ec38ed63-7954-4d17-b286-9f722eef2dd8 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.236718 Oct 11 07:03:34.000926 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1451/2892] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:33 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:03:34.204749 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0fcb9482-5c8d-4cc6-b326-4db5518cf071 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:34.205364 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0fcb9482-5c8d-4cc6-b326-4db5518cf071 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: edea36de-eaed-4410-81f5-b9a3643849c2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:34.211261 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0fcb9482-5c8d-4cc6-b326-4db5518cf071 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:34.211780 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0fcb9482-5c8d-4cc6-b326-4db5518cf071 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:34.212745 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0fcb9482-5c8d-4cc6-b326-4db5518cf071 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:34.213434 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0fcb9482-5c8d-4cc6-b326-4db5518cf071 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:34.213884 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0fcb9482-5c8d-4cc6-b326-4db5518cf071 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:34.214308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0fcb9482-5c8d-4cc6-b326-4db5518cf071 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:34.343926 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0fcb9482-5c8d-4cc6-b326-4db5518cf071 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:34.351597 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0fcb9482-5c8d-4cc6-b326-4db5518cf071 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2" status: 200 len: 1366 microversion: 2.1 time: 0.150651 Oct 11 07:03:34.352154 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1442/2893] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:34 2022] GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:34.415881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e1865f9f-44be-413f-a916-f14b8ac5fc32 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:34.416508 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e1865f9f-44be-413f-a916-f14b8ac5fc32 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:34.422913 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e1865f9f-44be-413f-a916-f14b8ac5fc32 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:34.423388 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e1865f9f-44be-413f-a916-f14b8ac5fc32 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:34.423848 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e1865f9f-44be-413f-a916-f14b8ac5fc32 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:34.424529 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e1865f9f-44be-413f-a916-f14b8ac5fc32 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:34.424976 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e1865f9f-44be-413f-a916-f14b8ac5fc32 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:34.425397 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e1865f9f-44be-413f-a916-f14b8ac5fc32 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:34.485033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e1865f9f-44be-413f-a916-f14b8ac5fc32 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:34.493042 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e1865f9f-44be-413f-a916-f14b8ac5fc32 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081042 Oct 11 07:03:34.493600 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1452/2894] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:34 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:35.026051 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e6233303-5567-4609-a289-6fd2b54afa76 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:35.026660 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e6233303-5567-4609-a289-6fd2b54afa76 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:35.032736 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e6233303-5567-4609-a289-6fd2b54afa76 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:35.033212 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e6233303-5567-4609-a289-6fd2b54afa76 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:35.033644 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e6233303-5567-4609-a289-6fd2b54afa76 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:35.034331 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e6233303-5567-4609-a289-6fd2b54afa76 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:35.034800 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e6233303-5567-4609-a289-6fd2b54afa76 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:35.035206 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e6233303-5567-4609-a289-6fd2b54afa76 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:35.158670 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e6233303-5567-4609-a289-6fd2b54afa76 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:35.167815 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e6233303-5567-4609-a289-6fd2b54afa76 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:35.169258 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e6233303-5567-4609-a289-6fd2b54afa76 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:35.170405 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e6233303-5567-4609-a289-6fd2b54afa76 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.148246 Oct 11 07:03:35.170958 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1443/2895] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:35 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:03:35.374459 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-73b24095-bbcc-43a0-8a1b-71ae1404aac7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:35.375071 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-73b24095-bbcc-43a0-8a1b-71ae1404aac7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: edea36de-eaed-4410-81f5-b9a3643849c2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:35.376941 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:03:35.382538 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-73b24095-bbcc-43a0-8a1b-71ae1404aac7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:35.383014 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-73b24095-bbcc-43a0-8a1b-71ae1404aac7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:35.383486 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-73b24095-bbcc-43a0-8a1b-71ae1404aac7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:35.384226 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-73b24095-bbcc-43a0-8a1b-71ae1404aac7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:35.384689 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-73b24095-bbcc-43a0-8a1b-71ae1404aac7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:35.385107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-73b24095-bbcc-43a0-8a1b-71ae1404aac7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:35.508964 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-73b24095-bbcc-43a0-8a1b-71ae1404aac7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:35.515634 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0b971227-2204-4191-8236-235370ce21b8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:35.516249 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0b971227-2204-4191-8236-235370ce21b8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:35.516958 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-73b24095-bbcc-43a0-8a1b-71ae1404aac7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2" status: 200 len: 1366 microversion: 2.1 time: 0.146245 Oct 11 07:03:35.517504 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1453/2896] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:35 2022] GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:35.522780 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b971227-2204-4191-8236-235370ce21b8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:35.523266 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b971227-2204-4191-8236-235370ce21b8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:35.523739 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b971227-2204-4191-8236-235370ce21b8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:35.524438 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b971227-2204-4191-8236-235370ce21b8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:35.525408 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b971227-2204-4191-8236-235370ce21b8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:35.525831 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0b971227-2204-4191-8236-235370ce21b8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:35.589553 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0b971227-2204-4191-8236-235370ce21b8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:35.597610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0b971227-2204-4191-8236-235370ce21b8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085786 Oct 11 07:03:35.598159 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1444/2897] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:35 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:03:36.196256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b062b2b3-1600-456a-8ca3-3aa99403c0f3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:36.197463 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b062b2b3-1600-456a-8ca3-3aa99403c0f3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:36.203771 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b062b2b3-1600-456a-8ca3-3aa99403c0f3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:36.204238 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b062b2b3-1600-456a-8ca3-3aa99403c0f3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:36.204688 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b062b2b3-1600-456a-8ca3-3aa99403c0f3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:36.205399 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b062b2b3-1600-456a-8ca3-3aa99403c0f3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:36.205842 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b062b2b3-1600-456a-8ca3-3aa99403c0f3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:36.206256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b062b2b3-1600-456a-8ca3-3aa99403c0f3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:36.336872 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b062b2b3-1600-456a-8ca3-3aa99403c0f3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:36.345491 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b062b2b3-1600-456a-8ca3-3aa99403c0f3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:36.346960 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b062b2b3-1600-456a-8ca3-3aa99403c0f3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:36.348154 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b062b2b3-1600-456a-8ca3-3aa99403c0f3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.155887 Oct 11 07:03:36.348724 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1454/2898] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:36 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:03:36.540710 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3e094ce8-e4f5-412b-b5f1-dd93a9eaf78f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:36.541261 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3e094ce8-e4f5-412b-b5f1-dd93a9eaf78f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: edea36de-eaed-4410-81f5-b9a3643849c2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:36.547623 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e094ce8-e4f5-412b-b5f1-dd93a9eaf78f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:36.548103 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e094ce8-e4f5-412b-b5f1-dd93a9eaf78f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:36.548532 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e094ce8-e4f5-412b-b5f1-dd93a9eaf78f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:36.549216 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e094ce8-e4f5-412b-b5f1-dd93a9eaf78f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:36.549663 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e094ce8-e4f5-412b-b5f1-dd93a9eaf78f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:36.550086 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3e094ce8-e4f5-412b-b5f1-dd93a9eaf78f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:36.621207 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-38323cda-63c9-48d6-b7bb-705de438aaf9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:36.621821 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-38323cda-63c9-48d6-b7bb-705de438aaf9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:36.628187 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-38323cda-63c9-48d6-b7bb-705de438aaf9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:36.628669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-38323cda-63c9-48d6-b7bb-705de438aaf9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:36.629100 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-38323cda-63c9-48d6-b7bb-705de438aaf9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:36.629799 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-38323cda-63c9-48d6-b7bb-705de438aaf9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:36.630246 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-38323cda-63c9-48d6-b7bb-705de438aaf9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:36.630670 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-38323cda-63c9-48d6-b7bb-705de438aaf9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:36.676679 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3e094ce8-e4f5-412b-b5f1-dd93a9eaf78f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:36.684921 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3e094ce8-e4f5-412b-b5f1-dd93a9eaf78f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2" status: 200 len: 1366 microversion: 2.1 time: 0.148696 Oct 11 07:03:36.685472 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1445/2899] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:36 2022] GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:36.692688 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-38323cda-63c9-48d6-b7bb-705de438aaf9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:36.700810 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-38323cda-63c9-48d6-b7bb-705de438aaf9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.084096 Oct 11 07:03:36.701362 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1455/2900] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:36 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:03:37.373158 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9d8eff0f-a80c-413d-947f-727f48b7a274 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:37.373758 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9d8eff0f-a80c-413d-947f-727f48b7a274 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:37.379974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9d8eff0f-a80c-413d-947f-727f48b7a274 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:37.380455 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9d8eff0f-a80c-413d-947f-727f48b7a274 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:37.380884 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9d8eff0f-a80c-413d-947f-727f48b7a274 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:37.381569 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9d8eff0f-a80c-413d-947f-727f48b7a274 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:37.382021 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9d8eff0f-a80c-413d-947f-727f48b7a274 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:37.382440 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9d8eff0f-a80c-413d-947f-727f48b7a274 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:37.509411 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9d8eff0f-a80c-413d-947f-727f48b7a274 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:37.518266 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9d8eff0f-a80c-413d-947f-727f48b7a274 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:37.519726 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9d8eff0f-a80c-413d-947f-727f48b7a274 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:37.520878 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9d8eff0f-a80c-413d-947f-727f48b7a274 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.151655 Oct 11 07:03:37.521427 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1446/2901] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:37 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:03:37.707527 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f06a93a2-7637-41e9-aedb-0dc2276623f1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:37.708093 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f06a93a2-7637-41e9-aedb-0dc2276623f1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: edea36de-eaed-4410-81f5-b9a3643849c2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:37.709942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=8 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:03:37.715965 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f06a93a2-7637-41e9-aedb-0dc2276623f1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:37.716440 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f06a93a2-7637-41e9-aedb-0dc2276623f1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:37.716890 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f06a93a2-7637-41e9-aedb-0dc2276623f1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:37.717574 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f06a93a2-7637-41e9-aedb-0dc2276623f1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:37.718053 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f06a93a2-7637-41e9-aedb-0dc2276623f1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:37.718445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f06a93a2-7637-41e9-aedb-0dc2276623f1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:37.723132 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c1b15e22-5863-410f-b7bc-dc1512dfbc6a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:37.723770 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c1b15e22-5863-410f-b7bc-dc1512dfbc6a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:37.730048 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1b15e22-5863-410f-b7bc-dc1512dfbc6a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:37.730520 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1b15e22-5863-410f-b7bc-dc1512dfbc6a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:37.730944 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1b15e22-5863-410f-b7bc-dc1512dfbc6a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:37.731677 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1b15e22-5863-410f-b7bc-dc1512dfbc6a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:37.732122 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1b15e22-5863-410f-b7bc-dc1512dfbc6a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:37.732547 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c1b15e22-5863-410f-b7bc-dc1512dfbc6a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:37.799631 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c1b15e22-5863-410f-b7bc-dc1512dfbc6a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:37.808766 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c1b15e22-5863-410f-b7bc-dc1512dfbc6a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.089321 Oct 11 07:03:37.809324 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1447/2902] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:37 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:37.852785 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f06a93a2-7637-41e9-aedb-0dc2276623f1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:37.860830 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f06a93a2-7637-41e9-aedb-0dc2276623f1 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2" status: 200 len: 1366 microversion: 2.1 time: 0.157194 Oct 11 07:03:37.861476 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1456/2903] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:37 2022] GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:38.007197 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-5adb1e95-dd75-40ab-b372-f357d340204e req-194c6213-17ed-457c-9522-43033f74a74e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edea36de-eaed-4410-81f5-b9a3643849c2", "name": "network-vif-plugged", "status": "completed", "tag": "23bd824c-911b-4ca8-a97f-28c788b0eca8"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:03:38.017885 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-5adb1e95-dd75-40ab-b372-f357d340204e req-194c6213-17ed-457c-9522-43033f74a74e service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:38.018368 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-5adb1e95-dd75-40ab-b372-f357d340204e req-194c6213-17ed-457c-9522-43033f74a74e service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:38.018796 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-5adb1e95-dd75-40ab-b372-f357d340204e req-194c6213-17ed-457c-9522-43033f74a74e service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:38.029809 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-5adb1e95-dd75-40ab-b372-f357d340204e req-194c6213-17ed-457c-9522-43033f74a74e service nova] Creating event network-vif-plugged:23bd824c-911b-4ca8-a97f-28c788b0eca8 for instance edea36de-eaed-4410-81f5-b9a3643849c2 on hv-cinder-85495 Oct 11 07:03:38.034530 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-5adb1e95-dd75-40ab-b372-f357d340204e req-194c6213-17ed-457c-9522-43033f74a74e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088037 Oct 11 07:03:38.035079 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1448/2904] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:03:38.547783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-de5429a2-8f74-4301-a5a2-8d53e15ff9d7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:38.548326 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-de5429a2-8f74-4301-a5a2-8d53e15ff9d7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:38.554274 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-de5429a2-8f74-4301-a5a2-8d53e15ff9d7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:38.554752 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-de5429a2-8f74-4301-a5a2-8d53e15ff9d7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:38.555183 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-de5429a2-8f74-4301-a5a2-8d53e15ff9d7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:38.555914 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-de5429a2-8f74-4301-a5a2-8d53e15ff9d7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:38.556434 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-de5429a2-8f74-4301-a5a2-8d53e15ff9d7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:38.556858 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-de5429a2-8f74-4301-a5a2-8d53e15ff9d7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:38.682160 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-de5429a2-8f74-4301-a5a2-8d53e15ff9d7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:38.690651 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-de5429a2-8f74-4301-a5a2-8d53e15ff9d7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:38.692122 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-de5429a2-8f74-4301-a5a2-8d53e15ff9d7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:38.693274 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-de5429a2-8f74-4301-a5a2-8d53e15ff9d7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.150056 Oct 11 07:03:38.693825 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1457/2905] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:38 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:03:38.828779 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=10 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:03:38.833583 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c968098a-b972-4c89-9c9f-f5266258605b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:38.834305 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c968098a-b972-4c89-9c9f-f5266258605b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:38.841273 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c968098a-b972-4c89-9c9f-f5266258605b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:38.841752 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c968098a-b972-4c89-9c9f-f5266258605b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:38.842182 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c968098a-b972-4c89-9c9f-f5266258605b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:38.842862 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c968098a-b972-4c89-9c9f-f5266258605b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:38.843344 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c968098a-b972-4c89-9c9f-f5266258605b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:38.843791 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c968098a-b972-4c89-9c9f-f5266258605b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:38.863613 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:03:38.884241 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-61f84f5c-0908-46d9-bce7-e94863d378c8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:38.885343 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-61f84f5c-0908-46d9-bce7-e94863d378c8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: edea36de-eaed-4410-81f5-b9a3643849c2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:38.892160 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-61f84f5c-0908-46d9-bce7-e94863d378c8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:38.892646 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-61f84f5c-0908-46d9-bce7-e94863d378c8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:38.893080 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-61f84f5c-0908-46d9-bce7-e94863d378c8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:38.893781 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-61f84f5c-0908-46d9-bce7-e94863d378c8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:38.894228 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-61f84f5c-0908-46d9-bce7-e94863d378c8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:38.894655 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-61f84f5c-0908-46d9-bce7-e94863d378c8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:38.909079 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c968098a-b972-4c89-9c9f-f5266258605b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:38.917306 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c968098a-b972-4c89-9c9f-f5266258605b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.089561 Oct 11 07:03:38.917869 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1449/2906] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:38 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:39.022877 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-61f84f5c-0908-46d9-bce7-e94863d378c8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:39.031057 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-61f84f5c-0908-46d9-bce7-e94863d378c8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2" status: 200 len: 1366 microversion: 2.1 time: 0.150570 Oct 11 07:03:39.031638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1458/2907] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:38 2022] GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:39.718070 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-68b57576-0ac5-485e-aaf2-899269bd6b5b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:39.718673 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-68b57576-0ac5-485e-aaf2-899269bd6b5b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:39.724814 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-68b57576-0ac5-485e-aaf2-899269bd6b5b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:39.725291 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-68b57576-0ac5-485e-aaf2-899269bd6b5b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:39.725724 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-68b57576-0ac5-485e-aaf2-899269bd6b5b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:39.726405 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-68b57576-0ac5-485e-aaf2-899269bd6b5b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:39.726854 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-68b57576-0ac5-485e-aaf2-899269bd6b5b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:39.727273 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-68b57576-0ac5-485e-aaf2-899269bd6b5b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:39.855710 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-68b57576-0ac5-485e-aaf2-899269bd6b5b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:39.864198 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-68b57576-0ac5-485e-aaf2-899269bd6b5b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:39.865617 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-68b57576-0ac5-485e-aaf2-899269bd6b5b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:39.866817 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-68b57576-0ac5-485e-aaf2-899269bd6b5b tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.152633 Oct 11 07:03:39.867365 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1450/2908] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:39 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:03:39.939573 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d4e7b87d-1dca-417d-9cec-65cdb24f4fd1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:39.940177 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d4e7b87d-1dca-417d-9cec-65cdb24f4fd1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:39.942494 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:03:39.947883 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d4e7b87d-1dca-417d-9cec-65cdb24f4fd1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:39.948352 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d4e7b87d-1dca-417d-9cec-65cdb24f4fd1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:39.948776 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d4e7b87d-1dca-417d-9cec-65cdb24f4fd1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:39.949450 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d4e7b87d-1dca-417d-9cec-65cdb24f4fd1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:39.949889 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d4e7b87d-1dca-417d-9cec-65cdb24f4fd1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:39.950306 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d4e7b87d-1dca-417d-9cec-65cdb24f4fd1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:40.011871 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d4e7b87d-1dca-417d-9cec-65cdb24f4fd1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:40.019798 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d4e7b87d-1dca-417d-9cec-65cdb24f4fd1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.084025 Oct 11 07:03:40.020349 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1459/2909] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:39 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:40.053371 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a1b70580-812a-43a6-b528-8e3c6cea764d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:40.054011 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a1b70580-812a-43a6-b528-8e3c6cea764d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: edea36de-eaed-4410-81f5-b9a3643849c2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:40.059932 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a1b70580-812a-43a6-b528-8e3c6cea764d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:40.060405 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a1b70580-812a-43a6-b528-8e3c6cea764d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:40.060833 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a1b70580-812a-43a6-b528-8e3c6cea764d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:40.061517 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a1b70580-812a-43a6-b528-8e3c6cea764d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:40.061967 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a1b70580-812a-43a6-b528-8e3c6cea764d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:40.062390 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a1b70580-812a-43a6-b528-8e3c6cea764d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:40.193985 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a1b70580-812a-43a6-b528-8e3c6cea764d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:40.201642 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a1b70580-812a-43a6-b528-8e3c6cea764d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2" status: 200 len: 1556 microversion: 2.1 time: 0.152122 Oct 11 07:03:40.202203 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1451/2910] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:40 2022] GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2 => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:40.224323 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5b35d48b-8583-435c-b0ac-27a44aa25946 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:40.224805 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5b35d48b-8583-435c-b0ac-27a44aa25946 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: edea36de-eaed-4410-81f5-b9a3643849c2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:40.231163 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5b35d48b-8583-435c-b0ac-27a44aa25946 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:40.231668 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5b35d48b-8583-435c-b0ac-27a44aa25946 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:40.232089 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5b35d48b-8583-435c-b0ac-27a44aa25946 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:40.232761 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5b35d48b-8583-435c-b0ac-27a44aa25946 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:40.233202 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5b35d48b-8583-435c-b0ac-27a44aa25946 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:40.233616 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5b35d48b-8583-435c-b0ac-27a44aa25946 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:40.308439 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5b35d48b-8583-435c-b0ac-27a44aa25946 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087886 Oct 11 07:03:40.309023 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1460/2911] 10.222.0.39 () {58 vars in 1275 bytes} [Tue Oct 11 07:03:40 2022] GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:03:40.893180 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3cf010c0-cc78-41b0-9ce7-3aa56dc13729 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:40.893730 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3cf010c0-cc78-41b0-9ce7-3aa56dc13729 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:40.900105 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3cf010c0-cc78-41b0-9ce7-3aa56dc13729 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:40.900581 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3cf010c0-cc78-41b0-9ce7-3aa56dc13729 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:40.901014 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3cf010c0-cc78-41b0-9ce7-3aa56dc13729 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:40.901692 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3cf010c0-cc78-41b0-9ce7-3aa56dc13729 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:40.902135 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3cf010c0-cc78-41b0-9ce7-3aa56dc13729 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:40.902550 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3cf010c0-cc78-41b0-9ce7-3aa56dc13729 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:41.028422 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3cf010c0-cc78-41b0-9ce7-3aa56dc13729 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:41.036888 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3cf010c0-cc78-41b0-9ce7-3aa56dc13729 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:41.038318 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3cf010c0-cc78-41b0-9ce7-3aa56dc13729 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:41.039492 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3cf010c0-cc78-41b0-9ce7-3aa56dc13729 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.150338 Oct 11 07:03:41.040039 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1452/2912] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:40 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:03:41.042562 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-92d308a7-0b79-46cf-84e2-c2894ddfb26e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:41.043176 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-92d308a7-0b79-46cf-84e2-c2894ddfb26e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:41.049868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-92d308a7-0b79-46cf-84e2-c2894ddfb26e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:41.050580 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-92d308a7-0b79-46cf-84e2-c2894ddfb26e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:41.051198 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-92d308a7-0b79-46cf-84e2-c2894ddfb26e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:41.051928 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-92d308a7-0b79-46cf-84e2-c2894ddfb26e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:41.052380 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-92d308a7-0b79-46cf-84e2-c2894ddfb26e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:41.053007 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-92d308a7-0b79-46cf-84e2-c2894ddfb26e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:41.141236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-92d308a7-0b79-46cf-84e2-c2894ddfb26e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:41.149449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-92d308a7-0b79-46cf-84e2-c2894ddfb26e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.111089 Oct 11 07:03:41.150144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1461/2913] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:41 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:41.505345 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-4cb153d5-623b-4d41-a703-8bfe65a7fc13 req-7881bf47-cc03-4762-a55b-063bef60a16e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edea36de-eaed-4410-81f5-b9a3643849c2", "tag": "23bd824c-911b-4ca8-a97f-28c788b0eca8"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:03:41.515075 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-4cb153d5-623b-4d41-a703-8bfe65a7fc13 req-7881bf47-cc03-4762-a55b-063bef60a16e service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:41.515661 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-4cb153d5-623b-4d41-a703-8bfe65a7fc13 req-7881bf47-cc03-4762-a55b-063bef60a16e service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:41.516183 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-4cb153d5-623b-4d41-a703-8bfe65a7fc13 req-7881bf47-cc03-4762-a55b-063bef60a16e service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:41.527345 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-4cb153d5-623b-4d41-a703-8bfe65a7fc13 req-7881bf47-cc03-4762-a55b-063bef60a16e service nova] Creating event network-changed:23bd824c-911b-4ca8-a97f-28c788b0eca8 for instance edea36de-eaed-4410-81f5-b9a3643849c2 on hv-cinder-85495 Oct 11 07:03:41.532461 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-4cb153d5-623b-4d41-a703-8bfe65a7fc13 req-7881bf47-cc03-4762-a55b-063bef60a16e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030821 Oct 11 07:03:41.533129 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1453/2914] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:03:42.065841 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-460aaf21-8637-48be-af1e-818015d38782 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:42.067069 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-460aaf21-8637-48be-af1e-818015d38782 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:42.074668 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-460aaf21-8637-48be-af1e-818015d38782 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:42.075545 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-460aaf21-8637-48be-af1e-818015d38782 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:42.075980 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-460aaf21-8637-48be-af1e-818015d38782 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:42.076858 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-460aaf21-8637-48be-af1e-818015d38782 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:42.077308 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-460aaf21-8637-48be-af1e-818015d38782 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:42.077734 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-460aaf21-8637-48be-af1e-818015d38782 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:42.172714 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ff179596-e755-41da-94a3-af8cd87e9209 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:42.174177 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ff179596-e755-41da-94a3-af8cd87e9209 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:42.181653 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff179596-e755-41da-94a3-af8cd87e9209 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:42.182262 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff179596-e755-41da-94a3-af8cd87e9209 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:42.182587 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff179596-e755-41da-94a3-af8cd87e9209 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:42.183291 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff179596-e755-41da-94a3-af8cd87e9209 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:42.184000 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff179596-e755-41da-94a3-af8cd87e9209 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:42.184649 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff179596-e755-41da-94a3-af8cd87e9209 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:42.216862 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-460aaf21-8637-48be-af1e-818015d38782 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:42.226727 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-460aaf21-8637-48be-af1e-818015d38782 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:42.229005 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-460aaf21-8637-48be-af1e-818015d38782 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:42.230187 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-460aaf21-8637-48be-af1e-818015d38782 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.168657 Oct 11 07:03:42.230946 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1462/2915] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:42 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:03:42.250628 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ff179596-e755-41da-94a3-af8cd87e9209 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:42.259034 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ff179596-e755-41da-94a3-af8cd87e9209 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.090315 Oct 11 07:03:42.259667 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1454/2916] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:42 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:43.255913 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-440164c6-b78f-4c57-b7cf-157e990f948c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:43.256457 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-440164c6-b78f-4c57-b7cf-157e990f948c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:43.263008 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-440164c6-b78f-4c57-b7cf-157e990f948c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:43.263646 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-440164c6-b78f-4c57-b7cf-157e990f948c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:43.264156 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-440164c6-b78f-4c57-b7cf-157e990f948c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:43.264762 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-440164c6-b78f-4c57-b7cf-157e990f948c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:43.265206 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-440164c6-b78f-4c57-b7cf-157e990f948c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:43.265624 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-440164c6-b78f-4c57-b7cf-157e990f948c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:43.281665 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9712ac07-83e1-4b74-9631-3169bfe7f5c9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:43.282264 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9712ac07-83e1-4b74-9631-3169bfe7f5c9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:43.288629 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9712ac07-83e1-4b74-9631-3169bfe7f5c9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:43.289104 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9712ac07-83e1-4b74-9631-3169bfe7f5c9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:43.289529 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9712ac07-83e1-4b74-9631-3169bfe7f5c9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:43.290212 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9712ac07-83e1-4b74-9631-3169bfe7f5c9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:43.291174 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9712ac07-83e1-4b74-9631-3169bfe7f5c9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:43.291624 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9712ac07-83e1-4b74-9631-3169bfe7f5c9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:43.351845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9712ac07-83e1-4b74-9631-3169bfe7f5c9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:43.360478 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9712ac07-83e1-4b74-9631-3169bfe7f5c9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082544 Oct 11 07:03:43.361047 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1455/2917] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:43 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:03:43.394507 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-440164c6-b78f-4c57-b7cf-157e990f948c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:43.403504 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-440164c6-b78f-4c57-b7cf-157e990f948c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:43.404943 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-440164c6-b78f-4c57-b7cf-157e990f948c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:43.406129 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-440164c6-b78f-4c57-b7cf-157e990f948c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.154207 Oct 11 07:03:43.406899 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1463/2918] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:43 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:03:44.383203 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1fbc1ff3-e177-4ab4-9c39-f3703daaf8d0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:44.383902 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1fbc1ff3-e177-4ab4-9c39-f3703daaf8d0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:44.390589 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fbc1ff3-e177-4ab4-9c39-f3703daaf8d0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:44.391067 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fbc1ff3-e177-4ab4-9c39-f3703daaf8d0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:44.391526 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fbc1ff3-e177-4ab4-9c39-f3703daaf8d0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:44.392213 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fbc1ff3-e177-4ab4-9c39-f3703daaf8d0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:44.392661 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fbc1ff3-e177-4ab4-9c39-f3703daaf8d0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:44.393081 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fbc1ff3-e177-4ab4-9c39-f3703daaf8d0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:44.431136 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-dfe6fa45-bedb-4994-a6f2-1c69670795d1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:44.431767 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-dfe6fa45-bedb-4994-a6f2-1c69670795d1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:44.438156 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dfe6fa45-bedb-4994-a6f2-1c69670795d1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:44.438626 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dfe6fa45-bedb-4994-a6f2-1c69670795d1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:44.439048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dfe6fa45-bedb-4994-a6f2-1c69670795d1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:44.439764 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dfe6fa45-bedb-4994-a6f2-1c69670795d1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:44.440202 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dfe6fa45-bedb-4994-a6f2-1c69670795d1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:44.440616 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dfe6fa45-bedb-4994-a6f2-1c69670795d1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:44.457772 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1fbc1ff3-e177-4ab4-9c39-f3703daaf8d0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:44.466507 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1fbc1ff3-e177-4ab4-9c39-f3703daaf8d0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.087110 Oct 11 07:03:44.467071 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1456/2919] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:44 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:44.569461 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-dfe6fa45-bedb-4994-a6f2-1c69670795d1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:44.577849 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-dfe6fa45-bedb-4994-a6f2-1c69670795d1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:44.579267 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-dfe6fa45-bedb-4994-a6f2-1c69670795d1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:44.580440 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-dfe6fa45-bedb-4994-a6f2-1c69670795d1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.153071 Oct 11 07:03:44.580992 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1464/2920] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:44 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:03:45.491659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cbf83c4f-fac0-41e0-b9de-85821f76ed8a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:45.492271 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cbf83c4f-fac0-41e0-b9de-85821f76ed8a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:45.499319 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cbf83c4f-fac0-41e0-b9de-85821f76ed8a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:45.499830 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cbf83c4f-fac0-41e0-b9de-85821f76ed8a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:45.500263 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cbf83c4f-fac0-41e0-b9de-85821f76ed8a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:45.500952 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cbf83c4f-fac0-41e0-b9de-85821f76ed8a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:45.501403 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cbf83c4f-fac0-41e0-b9de-85821f76ed8a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:45.501824 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cbf83c4f-fac0-41e0-b9de-85821f76ed8a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:45.563267 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cbf83c4f-fac0-41e0-b9de-85821f76ed8a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:45.571320 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cbf83c4f-fac0-41e0-b9de-85821f76ed8a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083550 Oct 11 07:03:45.571909 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1457/2921] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:45 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:45.605930 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f9e8273c-6559-43e5-a72e-6b58e3401268 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:45.606540 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f9e8273c-6559-43e5-a72e-6b58e3401268 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:45.613075 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f9e8273c-6559-43e5-a72e-6b58e3401268 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:45.613553 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f9e8273c-6559-43e5-a72e-6b58e3401268 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:45.613981 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f9e8273c-6559-43e5-a72e-6b58e3401268 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:45.614665 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f9e8273c-6559-43e5-a72e-6b58e3401268 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:45.615114 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f9e8273c-6559-43e5-a72e-6b58e3401268 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:45.615560 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f9e8273c-6559-43e5-a72e-6b58e3401268 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:45.740343 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f9e8273c-6559-43e5-a72e-6b58e3401268 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:45.749410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f9e8273c-6559-43e5-a72e-6b58e3401268 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:45.750843 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f9e8273c-6559-43e5-a72e-6b58e3401268 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:45.752028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f9e8273c-6559-43e5-a72e-6b58e3401268 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.150507 Oct 11 07:03:45.752574 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1465/2922] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:45 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:03:46.593573 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1fa1c962-b2f1-41b9-8cdc-656c49e425ac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:46.594182 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1fa1c962-b2f1-41b9-8cdc-656c49e425ac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:46.596274 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 07:03:46.596418 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Tue Oct 11 07:03:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d (ip 10.222.0.39) !!! Oct 11 07:03:46.602810 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fa1c962-b2f1-41b9-8cdc-656c49e425ac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:46.603294 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fa1c962-b2f1-41b9-8cdc-656c49e425ac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:46.603764 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fa1c962-b2f1-41b9-8cdc-656c49e425ac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:46.604458 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fa1c962-b2f1-41b9-8cdc-656c49e425ac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:46.604914 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fa1c962-b2f1-41b9-8cdc-656c49e425ac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:46.605337 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fa1c962-b2f1-41b9-8cdc-656c49e425ac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:46.666532 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1fa1c962-b2f1-41b9-8cdc-656c49e425ac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:46.674597 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1fa1c962-b2f1-41b9-8cdc-656c49e425ac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.084897 Oct 11 07:03:46.675155 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1458/2923] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:46 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:46.776933 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-68c35110-4060-4a08-87a3-e6c12ecbb618 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:46.777531 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-68c35110-4060-4a08-87a3-e6c12ecbb618 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:46.784184 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-68c35110-4060-4a08-87a3-e6c12ecbb618 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:46.784658 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-68c35110-4060-4a08-87a3-e6c12ecbb618 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:46.785086 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-68c35110-4060-4a08-87a3-e6c12ecbb618 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:46.785758 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-68c35110-4060-4a08-87a3-e6c12ecbb618 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:46.786195 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-68c35110-4060-4a08-87a3-e6c12ecbb618 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:46.786607 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-68c35110-4060-4a08-87a3-e6c12ecbb618 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:46.916566 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-68c35110-4060-4a08-87a3-e6c12ecbb618 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:46.924867 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-68c35110-4060-4a08-87a3-e6c12ecbb618 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:46.926276 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-68c35110-4060-4a08-87a3-e6c12ecbb618 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:46.927410 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-68c35110-4060-4a08-87a3-e6c12ecbb618 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.154414 Oct 11 07:03:46.927981 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1466/2924] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:46 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:03:47.698537 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9c141b3e-9f57-4f17-9149-dce383dcd3db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:47.699085 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9c141b3e-9f57-4f17-9149-dce383dcd3db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:47.705055 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9c141b3e-9f57-4f17-9149-dce383dcd3db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:47.705535 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9c141b3e-9f57-4f17-9149-dce383dcd3db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:47.705967 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9c141b3e-9f57-4f17-9149-dce383dcd3db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:47.706681 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9c141b3e-9f57-4f17-9149-dce383dcd3db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:47.707131 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9c141b3e-9f57-4f17-9149-dce383dcd3db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:47.707583 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9c141b3e-9f57-4f17-9149-dce383dcd3db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:47.767301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9c141b3e-9f57-4f17-9149-dce383dcd3db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:47.775439 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9c141b3e-9f57-4f17-9149-dce383dcd3db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081620 Oct 11 07:03:47.775994 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1459/2925] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:47 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:47.953172 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ad3bfb77-b880-4077-bc5c-08e908e53cc7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:47.953740 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ad3bfb77-b880-4077-bc5c-08e908e53cc7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:47.960217 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ad3bfb77-b880-4077-bc5c-08e908e53cc7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:47.960687 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ad3bfb77-b880-4077-bc5c-08e908e53cc7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:47.961116 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ad3bfb77-b880-4077-bc5c-08e908e53cc7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:47.961804 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ad3bfb77-b880-4077-bc5c-08e908e53cc7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:47.962241 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ad3bfb77-b880-4077-bc5c-08e908e53cc7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:47.962660 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ad3bfb77-b880-4077-bc5c-08e908e53cc7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:48.087733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ad3bfb77-b880-4077-bc5c-08e908e53cc7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:48.091083 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:03:48.097146 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ad3bfb77-b880-4077-bc5c-08e908e53cc7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:48.098568 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ad3bfb77-b880-4077-bc5c-08e908e53cc7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:48.099750 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ad3bfb77-b880-4077-bc5c-08e908e53cc7 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.150536 Oct 11 07:03:48.100311 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1467/2926] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:47 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:03:48.797827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2835793c-f6fc-4c2f-bd9e-599b87f7c0b3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:48.798347 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2835793c-f6fc-4c2f-bd9e-599b87f7c0b3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:48.804774 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2835793c-f6fc-4c2f-bd9e-599b87f7c0b3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:48.805255 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2835793c-f6fc-4c2f-bd9e-599b87f7c0b3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:48.805689 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2835793c-f6fc-4c2f-bd9e-599b87f7c0b3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:48.806425 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2835793c-f6fc-4c2f-bd9e-599b87f7c0b3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:48.806876 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2835793c-f6fc-4c2f-bd9e-599b87f7c0b3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:48.807302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2835793c-f6fc-4c2f-bd9e-599b87f7c0b3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:48.871255 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2835793c-f6fc-4c2f-bd9e-599b87f7c0b3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:48.879384 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2835793c-f6fc-4c2f-bd9e-599b87f7c0b3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085504 Oct 11 07:03:48.879953 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1460/2927] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:48 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:49.125550 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4ef57c7a-ba3d-447b-90bc-7142c4d3882c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:49.126158 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4ef57c7a-ba3d-447b-90bc-7142c4d3882c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:49.132544 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ef57c7a-ba3d-447b-90bc-7142c4d3882c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:49.133020 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ef57c7a-ba3d-447b-90bc-7142c4d3882c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:49.133452 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ef57c7a-ba3d-447b-90bc-7142c4d3882c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:49.134745 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ef57c7a-ba3d-447b-90bc-7142c4d3882c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:49.135190 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ef57c7a-ba3d-447b-90bc-7142c4d3882c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:49.135648 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ef57c7a-ba3d-447b-90bc-7142c4d3882c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:49.261121 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4ef57c7a-ba3d-447b-90bc-7142c4d3882c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:49.269589 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4ef57c7a-ba3d-447b-90bc-7142c4d3882c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:49.271017 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4ef57c7a-ba3d-447b-90bc-7142c4d3882c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:49.272200 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4ef57c7a-ba3d-447b-90bc-7142c4d3882c tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.150755 Oct 11 07:03:49.272747 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1468/2928] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:49 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:03:49.903062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d44a9eb3-3420-4f51-9200-cac5e7178403 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:49.903675 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d44a9eb3-3420-4f51-9200-cac5e7178403 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:49.910201 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d44a9eb3-3420-4f51-9200-cac5e7178403 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:49.910717 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d44a9eb3-3420-4f51-9200-cac5e7178403 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:49.911149 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d44a9eb3-3420-4f51-9200-cac5e7178403 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:49.911873 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d44a9eb3-3420-4f51-9200-cac5e7178403 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:49.912328 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d44a9eb3-3420-4f51-9200-cac5e7178403 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:49.912749 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d44a9eb3-3420-4f51-9200-cac5e7178403 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:49.977474 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d44a9eb3-3420-4f51-9200-cac5e7178403 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:49.986224 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d44a9eb3-3420-4f51-9200-cac5e7178403 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.087466 Oct 11 07:03:49.986791 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1461/2929] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:49 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:50.298153 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-798c56e9-3361-4f00-8c0d-3e70246c44dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:50.298680 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-798c56e9-3361-4f00-8c0d-3e70246c44dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:50.305047 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-798c56e9-3361-4f00-8c0d-3e70246c44dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:50.305512 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-798c56e9-3361-4f00-8c0d-3e70246c44dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:50.307943 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-798c56e9-3361-4f00-8c0d-3e70246c44dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:50.308641 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-798c56e9-3361-4f00-8c0d-3e70246c44dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:50.309111 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-798c56e9-3361-4f00-8c0d-3e70246c44dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:50.309530 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-798c56e9-3361-4f00-8c0d-3e70246c44dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:50.438880 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-798c56e9-3361-4f00-8c0d-3e70246c44dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:50.447369 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-798c56e9-3361-4f00-8c0d-3e70246c44dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:50.448822 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-798c56e9-3361-4f00-8c0d-3e70246c44dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:50.449971 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-798c56e9-3361-4f00-8c0d-3e70246c44dd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 200 len: 1801 microversion: 2.20 time: 0.155850 Oct 11 07:03:50.450517 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1469/2930] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:50 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:03:50.475332 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7eb7701e-3e2a-4549-abda-ac8a52078d52 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '.version_select at 0x7f8e2a49cf70>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:50.494080 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7eb7701e-3e2a-4549-abda-ac8a52078d52 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1818048256" status: 204 len: 0 microversion: 2.20 time: 0.022607 Oct 11 07:03:50.494617 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1462/2931] 10.222.0.39 () {60 vars in 1262 bytes} [Tue Oct 11 07:03:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1818048256 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 07:03:51.010701 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c3683690-abf0-435b-a8d6-852c99129ebf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:51.011668 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c3683690-abf0-435b-a8d6-852c99129ebf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:51.017657 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c3683690-abf0-435b-a8d6-852c99129ebf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:51.018209 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c3683690-abf0-435b-a8d6-852c99129ebf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:51.018716 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c3683690-abf0-435b-a8d6-852c99129ebf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:51.019432 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c3683690-abf0-435b-a8d6-852c99129ebf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:51.019888 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c3683690-abf0-435b-a8d6-852c99129ebf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:51.020307 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c3683690-abf0-435b-a8d6-852c99129ebf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:51.088099 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c3683690-abf0-435b-a8d6-852c99129ebf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:51.096343 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c3683690-abf0-435b-a8d6-852c99129ebf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.090558 Oct 11 07:03:51.096911 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1470/2932] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:51 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:51.378144 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-c6b9798c-1e8c-446b-ab11-30ab41a006d5 req-4d9d6cce-1750-4da4-a158-167e1640a600 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43d48211-8dab-4abd-8c95-e850b83382ff", "tag": "f963366d-bbf2-4aff-84d1-f61c69977089"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:03:51.388962 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-c6b9798c-1e8c-446b-ab11-30ab41a006d5 req-4d9d6cce-1750-4da4-a158-167e1640a600 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:51.389590 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-c6b9798c-1e8c-446b-ab11-30ab41a006d5 req-4d9d6cce-1750-4da4-a158-167e1640a600 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:51.389957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-c6b9798c-1e8c-446b-ab11-30ab41a006d5 req-4d9d6cce-1750-4da4-a158-167e1640a600 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:51.410388 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-c6b9798c-1e8c-446b-ab11-30ab41a006d5 req-4d9d6cce-1750-4da4-a158-167e1640a600 service nova] Creating event network-changed:f963366d-bbf2-4aff-84d1-f61c69977089 for instance 43d48211-8dab-4abd-8c95-e850b83382ff on hv-cinder-85495 Oct 11 07:03:51.429570 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-c6b9798c-1e8c-446b-ab11-30ab41a006d5 req-4d9d6cce-1750-4da4-a158-167e1640a600 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054059 Oct 11 07:03:51.430452 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1463/2933] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:03:51.621597 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3eb1515d-2cb2-4096-8549-ab36dbf78634 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Action: 'create', calling method: .version_select at 0x7f8e26d3e9d0>, body: {"keypair": {"name": "tempest-keypair-523764400", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxaLix8z2il5xLnWqT86MXx1fyv04pg0qynyZl1Gq1LP2VlCReFaQ8uE+Q4rDr40zil+QPeSK4QBMP6KAEGpMo9U1jaNVSn0oG8e1EWcsMsfm9aZhzuZ/CgGGhtn4bXeQ=="}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:03:51.652134 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-3eb1515d-2cb2-4096-8549-ab36dbf78634 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Getting quotas for project ec4a4c53c1c744688b3bf91e806286bf. Resources: {'key_pairs'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 07:03:51.656364 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-3eb1515d-2cb2-4096-8549-ab36dbf78634 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Getting quotas for user f95c1cd09e1042abbb5725f241ce147d and project ec4a4c53c1c744688b3bf91e806286bf. Resources: {'key_pairs'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 07:03:51.682664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3eb1515d-2cb2-4096-8549-ab36dbf78634 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.066622 Oct 11 07:03:51.684095 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1471/2934] 10.222.0.39 () {62 vars in 1200 bytes} [Tue Oct 11 07:03:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 69 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 07:03:52.121158 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-036724a9-7304-4dcb-83da-8bbee32de6c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:52.121858 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-036724a9-7304-4dcb-83da-8bbee32de6c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:52.128431 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-036724a9-7304-4dcb-83da-8bbee32de6c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:52.128916 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-036724a9-7304-4dcb-83da-8bbee32de6c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:52.129547 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-036724a9-7304-4dcb-83da-8bbee32de6c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:52.130244 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-036724a9-7304-4dcb-83da-8bbee32de6c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:52.130917 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-036724a9-7304-4dcb-83da-8bbee32de6c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:52.131338 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-036724a9-7304-4dcb-83da-8bbee32de6c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:52.202483 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-036724a9-7304-4dcb-83da-8bbee32de6c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:52.215553 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-036724a9-7304-4dcb-83da-8bbee32de6c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.100116 Oct 11 07:03:52.216229 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1464/2935] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:52 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:53.160735 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b27be1c4-31a0-41c6-8ca0-5504914b414e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-309665134", "imageRef": "2303551c-410e-4a2b-8eeb-dea686876901", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3b290ad2-90c3-4ca5-88a3-9d0ec13dbcae"}], "security_groups": [{"name": "tempest-securitygroup--488691067"}], "key_name": "tempest-keypair-523764400", "user_data": "}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:03:53.242956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-81df6783-37ad-454a-b8bc-bb75185457a8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:53.243619 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-81df6783-37ad-454a-b8bc-bb75185457a8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:53.249743 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81df6783-37ad-454a-b8bc-bb75185457a8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:53.250222 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81df6783-37ad-454a-b8bc-bb75185457a8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:53.250653 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81df6783-37ad-454a-b8bc-bb75185457a8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:53.251350 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81df6783-37ad-454a-b8bc-bb75185457a8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:53.251829 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81df6783-37ad-454a-b8bc-bb75185457a8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:53.252246 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81df6783-37ad-454a-b8bc-bb75185457a8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:53.261411 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.network.neutron [None req-b27be1c4-31a0-41c6-8ca0-5504914b414e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] validate_networks() for [('3b290ad2-90c3-4ca5-88a3-9d0ec13dbcae', None, None, None, None, None)] {{(pid=125266) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 07:03:53.315918 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-81df6783-37ad-454a-b8bc-bb75185457a8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:53.324500 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-81df6783-37ad-454a-b8bc-bb75185457a8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085190 Oct 11 07:03:53.325066 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1465/2936] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:53 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:03:53.626000 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-b27be1c4-31a0-41c6-8ca0-5504914b414e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Flavor limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 07:03:53.626524 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-b27be1c4-31a0-41c6-8ca0-5504914b414e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Image limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 07:03:53.627025 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-b27be1c4-31a0-41c6-8ca0-5504914b414e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Flavor pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 07:03:53.627522 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-b27be1c4-31a0-41c6-8ca0-5504914b414e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Image pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 07:03:53.627938 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-b27be1c4-31a0-41c6-8ca0-5504914b414e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 07:03:53.637431 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b27be1c4-31a0-41c6-8ca0-5504914b414e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:53.637903 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b27be1c4-31a0-41c6-8ca0-5504914b414e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:53.638335 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b27be1c4-31a0-41c6-8ca0-5504914b414e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:53.639057 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b27be1c4-31a0-41c6-8ca0-5504914b414e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:53.639546 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b27be1c4-31a0-41c6-8ca0-5504914b414e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:53.639972 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b27be1c4-31a0-41c6-8ca0-5504914b414e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:53.656295 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-b27be1c4-31a0-41c6-8ca0-5504914b414e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Getting quotas for project ec4a4c53c1c744688b3bf91e806286bf. Resources: {'cores', 'ram', 'instances'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 07:03:53.660041 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-b27be1c4-31a0-41c6-8ca0-5504914b414e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Getting quotas for user f95c1cd09e1042abbb5725f241ce147d and project ec4a4c53c1c744688b3bf91e806286bf. Resources: {'cores', 'ram', 'instances'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 07:03:53.670736 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b27be1c4-31a0-41c6-8ca0-5504914b414e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Going to run 1 instances... {{(pid=125266) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 07:03:53.672881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b27be1c4-31a0-41c6-8ca0-5504914b414e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: f26806d8-9180-4109-b3df-cadb68b7a0f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2303551c-410e-4a2b-8eeb-dea686876901',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 07:03:53.721656 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b27be1c4-31a0-41c6-8ca0-5504914b414e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.565663 Oct 11 07:03:53.722482 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1472/2937] 10.222.0.39 () {62 vars in 1188 bytes} [Tue Oct 11 07:03:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 07:03:53.734054 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-eeb40c66-fcd2-4744-9437-c2e650e242a2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:53.734662 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-eeb40c66-fcd2-4744-9437-c2e650e242a2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: f26806d8-9180-4109-b3df-cadb68b7a0f2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:53.736633 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:03:53.792606 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-eeb40c66-fcd2-4744-9437-c2e650e242a2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:53.799937 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-eeb40c66-fcd2-4744-9437-c2e650e242a2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:53.801360 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-eeb40c66-fcd2-4744-9437-c2e650e242a2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:53.802451 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-eeb40c66-fcd2-4744-9437-c2e650e242a2 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2" status: 200 len: 1280 microversion: 2.20 time: 0.072299 Oct 11 07:03:53.803010 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1466/2938] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:53 2022] GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2 => generated 1280 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:03:54.348139 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7c1568cf-a1bf-46cd-85d9-0469d5ea6820 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:54.348757 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7c1568cf-a1bf-46cd-85d9-0469d5ea6820 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:54.355306 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7c1568cf-a1bf-46cd-85d9-0469d5ea6820 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:54.355821 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7c1568cf-a1bf-46cd-85d9-0469d5ea6820 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:54.356257 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7c1568cf-a1bf-46cd-85d9-0469d5ea6820 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:54.356942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7c1568cf-a1bf-46cd-85d9-0469d5ea6820 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:54.357394 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7c1568cf-a1bf-46cd-85d9-0469d5ea6820 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:54.358362 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7c1568cf-a1bf-46cd-85d9-0469d5ea6820 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:54.425003 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7c1568cf-a1bf-46cd-85d9-0469d5ea6820 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:54.433759 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7c1568cf-a1bf-46cd-85d9-0469d5ea6820 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.090053 Oct 11 07:03:54.434681 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1473/2939] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:54 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:54.827549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-451fc367-1bf0-4dae-aae0-8989acf09642 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:54.828093 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-451fc367-1bf0-4dae-aae0-8989acf09642 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: f26806d8-9180-4109-b3df-cadb68b7a0f2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:54.834314 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-451fc367-1bf0-4dae-aae0-8989acf09642 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:54.835377 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-451fc367-1bf0-4dae-aae0-8989acf09642 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:54.835830 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-451fc367-1bf0-4dae-aae0-8989acf09642 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:54.836538 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-451fc367-1bf0-4dae-aae0-8989acf09642 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:54.836984 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-451fc367-1bf0-4dae-aae0-8989acf09642 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:54.837397 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-451fc367-1bf0-4dae-aae0-8989acf09642 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:54.899002 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-451fc367-1bf0-4dae-aae0-8989acf09642 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:54.907579 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-451fc367-1bf0-4dae-aae0-8989acf09642 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:54.908999 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-451fc367-1bf0-4dae-aae0-8989acf09642 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:54.910077 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-451fc367-1bf0-4dae-aae0-8989acf09642 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2" status: 200 len: 1332 microversion: 2.20 time: 0.086557 Oct 11 07:03:54.910624 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1467/2940] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:54 2022] GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2 => generated 1332 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:03:55.457313 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d6fd18e0-0bf0-45d1-ad1f-130e86b54a18 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:55.457912 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d6fd18e0-0bf0-45d1-ad1f-130e86b54a18 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:55.464803 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d6fd18e0-0bf0-45d1-ad1f-130e86b54a18 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:55.465280 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d6fd18e0-0bf0-45d1-ad1f-130e86b54a18 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:55.465704 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d6fd18e0-0bf0-45d1-ad1f-130e86b54a18 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:55.466389 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d6fd18e0-0bf0-45d1-ad1f-130e86b54a18 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:55.466833 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d6fd18e0-0bf0-45d1-ad1f-130e86b54a18 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:55.467255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d6fd18e0-0bf0-45d1-ad1f-130e86b54a18 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:55.536175 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d6fd18e0-0bf0-45d1-ad1f-130e86b54a18 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:55.544198 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d6fd18e0-0bf0-45d1-ad1f-130e86b54a18 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.090677 Oct 11 07:03:55.544754 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1474/2941] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:55 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:55.935867 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-92db3f17-b97e-4435-8f81-7b212481e9a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:55.936476 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-92db3f17-b97e-4435-8f81-7b212481e9a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: f26806d8-9180-4109-b3df-cadb68b7a0f2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:55.943221 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-92db3f17-b97e-4435-8f81-7b212481e9a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:55.943732 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-92db3f17-b97e-4435-8f81-7b212481e9a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:55.944163 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-92db3f17-b97e-4435-8f81-7b212481e9a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:55.945065 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-92db3f17-b97e-4435-8f81-7b212481e9a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:55.945680 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-92db3f17-b97e-4435-8f81-7b212481e9a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:55.946106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-92db3f17-b97e-4435-8f81-7b212481e9a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:56.083803 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-92db3f17-b97e-4435-8f81-7b212481e9a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:56.091961 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-92db3f17-b97e-4435-8f81-7b212481e9a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:56.093395 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-92db3f17-b97e-4435-8f81-7b212481e9a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:56.094493 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-92db3f17-b97e-4435-8f81-7b212481e9a6 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2" status: 200 len: 1405 microversion: 2.20 time: 0.163080 Oct 11 07:03:56.095045 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1468/2942] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:55 2022] GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:03:56.516362 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-d7e08f39-a98f-4f61-8260-6fa81253959d req-55a42d9a-23ec-481e-ba48-54ddd11431b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f26806d8-9180-4109-b3df-cadb68b7a0f2", "tag": "f5d88c2f-f487-48c3-afda-5249683216f6"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:03:56.527700 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-d7e08f39-a98f-4f61-8260-6fa81253959d req-55a42d9a-23ec-481e-ba48-54ddd11431b8 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:56.528192 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-d7e08f39-a98f-4f61-8260-6fa81253959d req-55a42d9a-23ec-481e-ba48-54ddd11431b8 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:56.528617 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-d7e08f39-a98f-4f61-8260-6fa81253959d req-55a42d9a-23ec-481e-ba48-54ddd11431b8 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:56.540034 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-d7e08f39-a98f-4f61-8260-6fa81253959d req-55a42d9a-23ec-481e-ba48-54ddd11431b8 service nova] Creating event network-changed:f5d88c2f-f487-48c3-afda-5249683216f6 for instance f26806d8-9180-4109-b3df-cadb68b7a0f2 on hv-cinder-85495 Oct 11 07:03:56.544017 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR oslo.messaging._drivers.impl_rabbit [req-d7e08f39-a98f-4f61-8260-6fa81253959d req-55a42d9a-23ec-481e-ba48-54ddd11431b8 service nova] [a16afc89-c289-4a57-90cc-4b4e3ebdbdd8] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 07:03:56.567920 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ce285aca-75e0-4330-b69e-1520b4e48bc7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:56.568630 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ce285aca-75e0-4330-b69e-1520b4e48bc7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:56.575205 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ce285aca-75e0-4330-b69e-1520b4e48bc7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:56.575717 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ce285aca-75e0-4330-b69e-1520b4e48bc7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:56.576154 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ce285aca-75e0-4330-b69e-1520b4e48bc7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:56.576919 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ce285aca-75e0-4330-b69e-1520b4e48bc7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:56.577372 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ce285aca-75e0-4330-b69e-1520b4e48bc7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:56.577797 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ce285aca-75e0-4330-b69e-1520b4e48bc7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:56.597360 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:03:56.645548 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ce285aca-75e0-4330-b69e-1520b4e48bc7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:56.654895 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ce285aca-75e0-4330-b69e-1520b4e48bc7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.090795 Oct 11 07:03:56.655470 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1469/2943] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:56 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:03:57.120078 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8529b996-1ede-4e89-a567-ed0c1923c8b9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:57.120722 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8529b996-1ede-4e89-a567-ed0c1923c8b9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: f26806d8-9180-4109-b3df-cadb68b7a0f2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:57.127126 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8529b996-1ede-4e89-a567-ed0c1923c8b9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:57.127656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8529b996-1ede-4e89-a567-ed0c1923c8b9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:57.128092 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8529b996-1ede-4e89-a567-ed0c1923c8b9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:57.128788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8529b996-1ede-4e89-a567-ed0c1923c8b9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:57.129242 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8529b996-1ede-4e89-a567-ed0c1923c8b9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:57.129665 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8529b996-1ede-4e89-a567-ed0c1923c8b9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:57.256063 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8529b996-1ede-4e89-a567-ed0c1923c8b9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:57.264890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8529b996-1ede-4e89-a567-ed0c1923c8b9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:57.266329 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8529b996-1ede-4e89-a567-ed0c1923c8b9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:57.267435 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8529b996-1ede-4e89-a567-ed0c1923c8b9 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2" status: 200 len: 1405 microversion: 2.20 time: 0.151919 Oct 11 07:03:57.268011 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1470/2944] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:57 2022] GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2 => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:03:57.551332 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO oslo.messaging._drivers.impl_rabbit [req-d7e08f39-a98f-4f61-8260-6fa81253959d req-55a42d9a-23ec-481e-ba48-54ddd11431b8 service nova] [a16afc89-c289-4a57-90cc-4b4e3ebdbdd8] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 47492. Oct 11 07:03:57.554717 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-d7e08f39-a98f-4f61-8260-6fa81253959d req-55a42d9a-23ec-481e-ba48-54ddd11431b8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.042475 Oct 11 07:03:57.555311 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1475/2945] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 07:03:57.678038 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-52b0edf5-c762-414d-bb01-2d13bc340fea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:57.678601 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-52b0edf5-c762-414d-bb01-2d13bc340fea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:57.685132 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-52b0edf5-c762-414d-bb01-2d13bc340fea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:57.685614 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-52b0edf5-c762-414d-bb01-2d13bc340fea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:57.686045 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-52b0edf5-c762-414d-bb01-2d13bc340fea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:57.686728 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-52b0edf5-c762-414d-bb01-2d13bc340fea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:57.687199 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-52b0edf5-c762-414d-bb01-2d13bc340fea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:57.687626 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-52b0edf5-c762-414d-bb01-2d13bc340fea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:57.747507 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-52b0edf5-c762-414d-bb01-2d13bc340fea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:57.755585 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-52b0edf5-c762-414d-bb01-2d13bc340fea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081393 Oct 11 07:03:57.756141 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1471/2946] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:57 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:58.292656 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-957feb2a-5932-4c3e-b9f3-a88319822789 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:58.293346 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-957feb2a-5932-4c3e-b9f3-a88319822789 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: f26806d8-9180-4109-b3df-cadb68b7a0f2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:58.299357 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-957feb2a-5932-4c3e-b9f3-a88319822789 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:58.299861 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-957feb2a-5932-4c3e-b9f3-a88319822789 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:58.300292 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-957feb2a-5932-4c3e-b9f3-a88319822789 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:58.300977 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-957feb2a-5932-4c3e-b9f3-a88319822789 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:58.301425 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-957feb2a-5932-4c3e-b9f3-a88319822789 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:58.301850 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-957feb2a-5932-4c3e-b9f3-a88319822789 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:58.530930 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-957feb2a-5932-4c3e-b9f3-a88319822789 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:58.539069 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-957feb2a-5932-4c3e-b9f3-a88319822789 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:58.540537 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-957feb2a-5932-4c3e-b9f3-a88319822789 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:58.541683 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-957feb2a-5932-4c3e-b9f3-a88319822789 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2" status: 200 len: 1405 microversion: 2.20 time: 0.253341 Oct 11 07:03:58.542236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1476/2947] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:58 2022] GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2 => generated 1405 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:03:58.778178 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4ab69c7a-996b-49e0-81f4-c4312a97a5d0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:58.778736 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4ab69c7a-996b-49e0-81f4-c4312a97a5d0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:58.785123 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4ab69c7a-996b-49e0-81f4-c4312a97a5d0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:58.785631 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4ab69c7a-996b-49e0-81f4-c4312a97a5d0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:58.786060 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4ab69c7a-996b-49e0-81f4-c4312a97a5d0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:58.786743 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4ab69c7a-996b-49e0-81f4-c4312a97a5d0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:58.787192 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4ab69c7a-996b-49e0-81f4-c4312a97a5d0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:58.787641 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4ab69c7a-996b-49e0-81f4-c4312a97a5d0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:58.849582 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4ab69c7a-996b-49e0-81f4-c4312a97a5d0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:58.857596 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4ab69c7a-996b-49e0-81f4-c4312a97a5d0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083351 Oct 11 07:03:58.858147 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1472/2948] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:58 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:03:59.567309 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b365cc63-1763-456d-9efc-eb750af8b339 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:59.567946 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b365cc63-1763-456d-9efc-eb750af8b339 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: f26806d8-9180-4109-b3df-cadb68b7a0f2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:59.574261 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b365cc63-1763-456d-9efc-eb750af8b339 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:59.574740 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b365cc63-1763-456d-9efc-eb750af8b339 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:59.575175 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b365cc63-1763-456d-9efc-eb750af8b339 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:59.575897 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b365cc63-1763-456d-9efc-eb750af8b339 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:59.576346 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b365cc63-1763-456d-9efc-eb750af8b339 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:59.576766 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b365cc63-1763-456d-9efc-eb750af8b339 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:59.706253 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b365cc63-1763-456d-9efc-eb750af8b339 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:59.714821 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b365cc63-1763-456d-9efc-eb750af8b339 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:59.716278 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b365cc63-1763-456d-9efc-eb750af8b339 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:59.717400 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b365cc63-1763-456d-9efc-eb750af8b339 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2" status: 200 len: 1405 microversion: 2.20 time: 0.154024 Oct 11 07:03:59.717947 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1477/2949] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:03:59 2022] GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:03:59.880893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b8377d28-3478-471a-8ce9-c1cd7c5a596e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:03:59.881492 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b8377d28-3478-471a-8ce9-c1cd7c5a596e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:03:59.888550 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8377d28-3478-471a-8ce9-c1cd7c5a596e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:59.889023 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8377d28-3478-471a-8ce9-c1cd7c5a596e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:59.889464 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8377d28-3478-471a-8ce9-c1cd7c5a596e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:59.890130 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8377d28-3478-471a-8ce9-c1cd7c5a596e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:03:59.890597 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8377d28-3478-471a-8ce9-c1cd7c5a596e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:03:59.890996 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8377d28-3478-471a-8ce9-c1cd7c5a596e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:03:59.954620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b8377d28-3478-471a-8ce9-c1cd7c5a596e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:03:59.962819 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b8377d28-3478-471a-8ce9-c1cd7c5a596e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085775 Oct 11 07:03:59.964076 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1473/2950] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:03:59 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:00.742112 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ff921b45-df5e-4f86-9533-207964d9ccae tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:00.742682 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ff921b45-df5e-4f86-9533-207964d9ccae tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: f26806d8-9180-4109-b3df-cadb68b7a0f2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:00.749577 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff921b45-df5e-4f86-9533-207964d9ccae tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:00.750044 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff921b45-df5e-4f86-9533-207964d9ccae tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:00.750470 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff921b45-df5e-4f86-9533-207964d9ccae tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:00.751147 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff921b45-df5e-4f86-9533-207964d9ccae tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:00.751617 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff921b45-df5e-4f86-9533-207964d9ccae tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:00.752031 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff921b45-df5e-4f86-9533-207964d9ccae tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:00.876639 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ff921b45-df5e-4f86-9533-207964d9ccae tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:00.884524 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ff921b45-df5e-4f86-9533-207964d9ccae tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:00.886206 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ff921b45-df5e-4f86-9533-207964d9ccae tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:00.887286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ff921b45-df5e-4f86-9533-207964d9ccae tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2" status: 200 len: 1405 microversion: 2.20 time: 0.149165 Oct 11 07:04:00.887858 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1478/2951] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:04:00 2022] GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2 => generated 1405 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:04:00.986322 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-80b1cc13-9bd1-4fca-973e-32be8af99021 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:00.986958 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-80b1cc13-9bd1-4fca-973e-32be8af99021 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:00.993456 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-80b1cc13-9bd1-4fca-973e-32be8af99021 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:00.993877 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-80b1cc13-9bd1-4fca-973e-32be8af99021 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:00.994310 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-80b1cc13-9bd1-4fca-973e-32be8af99021 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:00.994998 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-80b1cc13-9bd1-4fca-973e-32be8af99021 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:00.995469 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-80b1cc13-9bd1-4fca-973e-32be8af99021 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:00.995892 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-80b1cc13-9bd1-4fca-973e-32be8af99021 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:01.055713 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-80b1cc13-9bd1-4fca-973e-32be8af99021 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:01.063692 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-80b1cc13-9bd1-4fca-973e-32be8af99021 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081180 Oct 11 07:04:01.064271 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1474/2952] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:00 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:01.912008 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5f99f10d-325c-4888-9e03-02a673452648 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:01.912630 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5f99f10d-325c-4888-9e03-02a673452648 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: f26806d8-9180-4109-b3df-cadb68b7a0f2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:01.919383 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5f99f10d-325c-4888-9e03-02a673452648 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:01.919890 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5f99f10d-325c-4888-9e03-02a673452648 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:01.920322 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5f99f10d-325c-4888-9e03-02a673452648 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:01.921017 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5f99f10d-325c-4888-9e03-02a673452648 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:01.921467 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5f99f10d-325c-4888-9e03-02a673452648 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:01.921888 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5f99f10d-325c-4888-9e03-02a673452648 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:02.037028 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-85ba2daa-d147-4b76-a92b-0bdcdd5ad76d req-e04584b0-c22d-4d81-9827-636ee29ccbe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f26806d8-9180-4109-b3df-cadb68b7a0f2", "name": "network-vif-plugged", "status": "completed", "tag": "f5d88c2f-f487-48c3-afda-5249683216f6"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:04:02.048127 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-85ba2daa-d147-4b76-a92b-0bdcdd5ad76d req-e04584b0-c22d-4d81-9827-636ee29ccbe1 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:02.048607 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-85ba2daa-d147-4b76-a92b-0bdcdd5ad76d req-e04584b0-c22d-4d81-9827-636ee29ccbe1 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:02.049036 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-85ba2daa-d147-4b76-a92b-0bdcdd5ad76d req-e04584b0-c22d-4d81-9827-636ee29ccbe1 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:02.060265 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5f99f10d-325c-4888-9e03-02a673452648 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:02.061032 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-85ba2daa-d147-4b76-a92b-0bdcdd5ad76d req-e04584b0-c22d-4d81-9827-636ee29ccbe1 service nova] Creating event network-vif-plugged:f5d88c2f-f487-48c3-afda-5249683216f6 for instance f26806d8-9180-4109-b3df-cadb68b7a0f2 on hv-cinder-85495 Oct 11 07:04:02.066029 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-85ba2daa-d147-4b76-a92b-0bdcdd5ad76d req-e04584b0-c22d-4d81-9827-636ee29ccbe1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032788 Oct 11 07:04:02.066981 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1475/2953] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 07:04:02.071087 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5f99f10d-325c-4888-9e03-02a673452648 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:02.072647 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5f99f10d-325c-4888-9e03-02a673452648 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:02.073809 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5f99f10d-325c-4888-9e03-02a673452648 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2" status: 200 len: 1405 microversion: 2.20 time: 0.165794 Oct 11 07:04:02.091038 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1479/2954] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:04:01 2022] GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2 => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:04:02.091697 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6066e105-05f8-4f31-b624-bb3344de5a52 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:02.091697 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6066e105-05f8-4f31-b624-bb3344de5a52 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:02.097199 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6066e105-05f8-4f31-b624-bb3344de5a52 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:02.097676 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6066e105-05f8-4f31-b624-bb3344de5a52 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:02.098136 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6066e105-05f8-4f31-b624-bb3344de5a52 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:02.098850 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6066e105-05f8-4f31-b624-bb3344de5a52 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:02.099584 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6066e105-05f8-4f31-b624-bb3344de5a52 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:02.100010 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6066e105-05f8-4f31-b624-bb3344de5a52 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:02.170730 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6066e105-05f8-4f31-b624-bb3344de5a52 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:02.180149 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6066e105-05f8-4f31-b624-bb3344de5a52 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.097190 Oct 11 07:04:02.181182 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1476/2955] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:02 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:03.098540 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-54fb6ede-8017-465b-835f-ba0556a629fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:03.099080 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-54fb6ede-8017-465b-835f-ba0556a629fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: f26806d8-9180-4109-b3df-cadb68b7a0f2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:03.105456 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54fb6ede-8017-465b-835f-ba0556a629fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:03.105937 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54fb6ede-8017-465b-835f-ba0556a629fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:03.106370 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54fb6ede-8017-465b-835f-ba0556a629fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:03.107060 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54fb6ede-8017-465b-835f-ba0556a629fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:03.107538 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54fb6ede-8017-465b-835f-ba0556a629fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:03.107965 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-54fb6ede-8017-465b-835f-ba0556a629fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:03.204546 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-15178ff7-311f-4b86-9528-b4aacb9993c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:03.205158 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-15178ff7-311f-4b86-9528-b4aacb9993c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:03.211602 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15178ff7-311f-4b86-9528-b4aacb9993c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:03.212120 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15178ff7-311f-4b86-9528-b4aacb9993c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:03.212556 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15178ff7-311f-4b86-9528-b4aacb9993c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:03.213250 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15178ff7-311f-4b86-9528-b4aacb9993c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:03.213700 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15178ff7-311f-4b86-9528-b4aacb9993c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:03.214130 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15178ff7-311f-4b86-9528-b4aacb9993c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:03.239965 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-54fb6ede-8017-465b-835f-ba0556a629fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:03.249408 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-54fb6ede-8017-465b-835f-ba0556a629fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:03.250826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-54fb6ede-8017-465b-835f-ba0556a629fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:03.251956 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-54fb6ede-8017-465b-835f-ba0556a629fd tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2" status: 200 len: 1405 microversion: 2.20 time: 0.157381 Oct 11 07:04:03.252849 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1480/2956] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:04:03 2022] GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:04:03.279167 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-15178ff7-311f-4b86-9528-b4aacb9993c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:03.289053 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-15178ff7-311f-4b86-9528-b4aacb9993c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.088242 Oct 11 07:04:03.290178 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1477/2957] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:03 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:04:04.313464 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a1029959-6721-43aa-8042-e7dc614d762e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:04.314024 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a1029959-6721-43aa-8042-e7dc614d762e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:04.315917 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:04:04.316573 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=10 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:04:04.323502 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a1029959-6721-43aa-8042-e7dc614d762e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:04.323976 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a1029959-6721-43aa-8042-e7dc614d762e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:04.324674 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a1029959-6721-43aa-8042-e7dc614d762e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:04.325359 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a1029959-6721-43aa-8042-e7dc614d762e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:04.325798 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a1029959-6721-43aa-8042-e7dc614d762e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:04.326212 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a1029959-6721-43aa-8042-e7dc614d762e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:04.335589 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-38c15f03-246e-4881-b3f2-706b1c5b80ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:04.336191 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-38c15f03-246e-4881-b3f2-706b1c5b80ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: f26806d8-9180-4109-b3df-cadb68b7a0f2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:04.339867 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=2 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:04:04.344427 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38c15f03-246e-4881-b3f2-706b1c5b80ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:04.344897 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38c15f03-246e-4881-b3f2-706b1c5b80ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:04.345329 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38c15f03-246e-4881-b3f2-706b1c5b80ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:04.346016 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38c15f03-246e-4881-b3f2-706b1c5b80ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:04.346460 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38c15f03-246e-4881-b3f2-706b1c5b80ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:04.346873 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38c15f03-246e-4881-b3f2-706b1c5b80ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:04.391525 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a1029959-6721-43aa-8042-e7dc614d762e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:04.399708 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a1029959-6721-43aa-8042-e7dc614d762e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.090475 Oct 11 07:04:04.400270 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1481/2958] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:04 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:04.477620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-38c15f03-246e-4881-b3f2-706b1c5b80ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:04.485457 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-38c15f03-246e-4881-b3f2-706b1c5b80ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:04.486874 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-38c15f03-246e-4881-b3f2-706b1c5b80ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:04.488033 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-38c15f03-246e-4881-b3f2-706b1c5b80ba tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2" status: 200 len: 1596 microversion: 2.20 time: 0.156292 Oct 11 07:04:04.488578 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1478/2959] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:04:04 2022] GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2 => generated 1596 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 07:04:04.512697 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ec3891a1-b02b-4343-94ca-c5ce89833cf1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:04.513187 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ec3891a1-b02b-4343-94ca-c5ce89833cf1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: f26806d8-9180-4109-b3df-cadb68b7a0f2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:04.519078 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec3891a1-b02b-4343-94ca-c5ce89833cf1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:04.519596 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec3891a1-b02b-4343-94ca-c5ce89833cf1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:04.520029 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec3891a1-b02b-4343-94ca-c5ce89833cf1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:04.520710 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec3891a1-b02b-4343-94ca-c5ce89833cf1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:04.521157 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec3891a1-b02b-4343-94ca-c5ce89833cf1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:04.521575 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ec3891a1-b02b-4343-94ca-c5ce89833cf1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:04.598599 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ec3891a1-b02b-4343-94ca-c5ce89833cf1 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090518 Oct 11 07:04:04.599178 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1482/2960] 10.222.0.39 () {60 vars in 1316 bytes} [Tue Oct 11 07:04:04 2022] GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 07:04:05.423336 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-85da6f85-286f-4726-a03d-7dcf2ea70de5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:05.423980 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-85da6f85-286f-4726-a03d-7dcf2ea70de5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:05.430623 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85da6f85-286f-4726-a03d-7dcf2ea70de5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:05.431098 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85da6f85-286f-4726-a03d-7dcf2ea70de5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:05.431553 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85da6f85-286f-4726-a03d-7dcf2ea70de5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:05.432236 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85da6f85-286f-4726-a03d-7dcf2ea70de5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:05.432701 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85da6f85-286f-4726-a03d-7dcf2ea70de5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:05.433118 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-85da6f85-286f-4726-a03d-7dcf2ea70de5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:05.499231 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-53432e9a-1667-4763-b6af-e878456c1e2c req-f5f6f629-5e3f-4589-b367-632a575b4d2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f26806d8-9180-4109-b3df-cadb68b7a0f2", "tag": "f5d88c2f-f487-48c3-afda-5249683216f6"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:04:05.508920 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-53432e9a-1667-4763-b6af-e878456c1e2c req-f5f6f629-5e3f-4589-b367-632a575b4d2c service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:05.509081 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-85da6f85-286f-4726-a03d-7dcf2ea70de5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:05.509210 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-53432e9a-1667-4763-b6af-e878456c1e2c req-f5f6f629-5e3f-4589-b367-632a575b4d2c service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:05.509625 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-53432e9a-1667-4763-b6af-e878456c1e2c req-f5f6f629-5e3f-4589-b367-632a575b4d2c service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:05.518081 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-85da6f85-286f-4726-a03d-7dcf2ea70de5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.098423 Oct 11 07:04:05.518549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1479/2961] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:05 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:05.521718 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-53432e9a-1667-4763-b6af-e878456c1e2c req-f5f6f629-5e3f-4589-b367-632a575b4d2c service nova] Creating event network-changed:f5d88c2f-f487-48c3-afda-5249683216f6 for instance f26806d8-9180-4109-b3df-cadb68b7a0f2 on hv-cinder-85495 Oct 11 07:04:05.528619 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-53432e9a-1667-4763-b6af-e878456c1e2c req-f5f6f629-5e3f-4589-b367-632a575b4d2c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033634 Oct 11 07:04:05.529620 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1483/2962] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:04:06.541967 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d3939c9e-e14a-4fe0-b74d-5b59aee3403b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:06.542576 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d3939c9e-e14a-4fe0-b74d-5b59aee3403b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:06.549024 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d3939c9e-e14a-4fe0-b74d-5b59aee3403b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:06.549499 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d3939c9e-e14a-4fe0-b74d-5b59aee3403b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:06.549934 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d3939c9e-e14a-4fe0-b74d-5b59aee3403b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:06.550615 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d3939c9e-e14a-4fe0-b74d-5b59aee3403b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:06.551065 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d3939c9e-e14a-4fe0-b74d-5b59aee3403b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:06.551516 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d3939c9e-e14a-4fe0-b74d-5b59aee3403b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:06.611210 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d3939c9e-e14a-4fe0-b74d-5b59aee3403b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:06.619927 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d3939c9e-e14a-4fe0-b74d-5b59aee3403b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081875 Oct 11 07:04:06.620460 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1480/2963] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:06 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:07.643351 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-661f4fdc-f767-413d-b69a-5d138dbf8fd6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:07.644081 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-661f4fdc-f767-413d-b69a-5d138dbf8fd6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:07.650327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-661f4fdc-f767-413d-b69a-5d138dbf8fd6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:07.650744 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-661f4fdc-f767-413d-b69a-5d138dbf8fd6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:07.651178 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-661f4fdc-f767-413d-b69a-5d138dbf8fd6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:07.651906 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-661f4fdc-f767-413d-b69a-5d138dbf8fd6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:07.652364 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-661f4fdc-f767-413d-b69a-5d138dbf8fd6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:07.652785 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-661f4fdc-f767-413d-b69a-5d138dbf8fd6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:07.718236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-661f4fdc-f767-413d-b69a-5d138dbf8fd6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:07.726442 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-661f4fdc-f767-413d-b69a-5d138dbf8fd6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.087721 Oct 11 07:04:07.726998 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1484/2964] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:07 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:08.749269 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b9f45794-da24-4b17-863a-5c1b571ba8ae tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:08.749873 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b9f45794-da24-4b17-863a-5c1b571ba8ae tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:08.756335 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b9f45794-da24-4b17-863a-5c1b571ba8ae tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:08.756812 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b9f45794-da24-4b17-863a-5c1b571ba8ae tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:08.757241 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b9f45794-da24-4b17-863a-5c1b571ba8ae tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:08.757930 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b9f45794-da24-4b17-863a-5c1b571ba8ae tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:08.758375 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b9f45794-da24-4b17-863a-5c1b571ba8ae tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:08.758792 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b9f45794-da24-4b17-863a-5c1b571ba8ae tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:08.822953 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b9f45794-da24-4b17-863a-5c1b571ba8ae tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:08.831184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b9f45794-da24-4b17-863a-5c1b571ba8ae tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085796 Oct 11 07:04:08.831772 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1481/2965] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:08 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:09.854623 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-15be2f89-8ba5-44bd-89e6-f1f593e27d6f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:09.855250 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-15be2f89-8ba5-44bd-89e6-f1f593e27d6f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:09.861723 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-15be2f89-8ba5-44bd-89e6-f1f593e27d6f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:09.862202 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-15be2f89-8ba5-44bd-89e6-f1f593e27d6f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:09.862632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-15be2f89-8ba5-44bd-89e6-f1f593e27d6f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:09.863322 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-15be2f89-8ba5-44bd-89e6-f1f593e27d6f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:09.863800 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-15be2f89-8ba5-44bd-89e6-f1f593e27d6f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:09.864226 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-15be2f89-8ba5-44bd-89e6-f1f593e27d6f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:09.925393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-15be2f89-8ba5-44bd-89e6-f1f593e27d6f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:09.933527 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-15be2f89-8ba5-44bd-89e6-f1f593e27d6f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083336 Oct 11 07:04:09.934086 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1485/2966] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:09 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:10.956107 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-fc7cb280-6f39-47d5-b894-7e2bd96cb511 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:10.956703 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-fc7cb280-6f39-47d5-b894-7e2bd96cb511 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:10.963936 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc7cb280-6f39-47d5-b894-7e2bd96cb511 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:10.964415 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc7cb280-6f39-47d5-b894-7e2bd96cb511 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:10.964846 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc7cb280-6f39-47d5-b894-7e2bd96cb511 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:10.965531 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc7cb280-6f39-47d5-b894-7e2bd96cb511 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:10.965980 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc7cb280-6f39-47d5-b894-7e2bd96cb511 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:10.966403 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fc7cb280-6f39-47d5-b894-7e2bd96cb511 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:11.026982 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-fc7cb280-6f39-47d5-b894-7e2bd96cb511 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:11.035110 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-fc7cb280-6f39-47d5-b894-7e2bd96cb511 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082853 Oct 11 07:04:11.035706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1482/2967] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:10 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:12.057579 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fa94218b-bbc1-4e5e-9626-7404f0f6b30e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:12.058207 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fa94218b-bbc1-4e5e-9626-7404f0f6b30e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:12.060638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:04:12.065804 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa94218b-bbc1-4e5e-9626-7404f0f6b30e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:12.066280 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa94218b-bbc1-4e5e-9626-7404f0f6b30e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:12.066709 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa94218b-bbc1-4e5e-9626-7404f0f6b30e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:12.067387 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa94218b-bbc1-4e5e-9626-7404f0f6b30e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:12.067856 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa94218b-bbc1-4e5e-9626-7404f0f6b30e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:12.068273 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fa94218b-bbc1-4e5e-9626-7404f0f6b30e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:12.128240 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fa94218b-bbc1-4e5e-9626-7404f0f6b30e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:12.136486 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fa94218b-bbc1-4e5e-9626-7404f0f6b30e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083354 Oct 11 07:04:12.137038 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1486/2968] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:12 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:13.159969 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2d12db24-600b-4d12-9ec3-ccc8c116b25c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:13.160582 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2d12db24-600b-4d12-9ec3-ccc8c116b25c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:13.167647 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d12db24-600b-4d12-9ec3-ccc8c116b25c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:13.168132 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d12db24-600b-4d12-9ec3-ccc8c116b25c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:13.168570 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d12db24-600b-4d12-9ec3-ccc8c116b25c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:13.169261 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d12db24-600b-4d12-9ec3-ccc8c116b25c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:13.169717 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d12db24-600b-4d12-9ec3-ccc8c116b25c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:13.170141 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d12db24-600b-4d12-9ec3-ccc8c116b25c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:13.230265 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2d12db24-600b-4d12-9ec3-ccc8c116b25c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:13.238306 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2d12db24-600b-4d12-9ec3-ccc8c116b25c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082168 Oct 11 07:04:13.238867 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1483/2969] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:13 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:14.261255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5c5ec361-a431-4217-b72b-72853bca718e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:14.261846 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5c5ec361-a431-4217-b72b-72853bca718e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:14.268248 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5c5ec361-a431-4217-b72b-72853bca718e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:14.268718 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5c5ec361-a431-4217-b72b-72853bca718e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:14.269141 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5c5ec361-a431-4217-b72b-72853bca718e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:14.269813 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5c5ec361-a431-4217-b72b-72853bca718e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:14.270258 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5c5ec361-a431-4217-b72b-72853bca718e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:14.270669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5c5ec361-a431-4217-b72b-72853bca718e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:14.330700 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5c5ec361-a431-4217-b72b-72853bca718e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:14.334045 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:04:14.339711 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5c5ec361-a431-4217-b72b-72853bca718e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082638 Oct 11 07:04:14.340259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1487/2970] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:14 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:15.362781 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bdf3cb03-7a24-4a96-b315-df0a38f210e7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:15.363436 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bdf3cb03-7a24-4a96-b315-df0a38f210e7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:15.369930 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bdf3cb03-7a24-4a96-b315-df0a38f210e7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:15.370413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bdf3cb03-7a24-4a96-b315-df0a38f210e7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:15.370847 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bdf3cb03-7a24-4a96-b315-df0a38f210e7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:15.371577 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bdf3cb03-7a24-4a96-b315-df0a38f210e7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:15.372033 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bdf3cb03-7a24-4a96-b315-df0a38f210e7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:15.372455 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bdf3cb03-7a24-4a96-b315-df0a38f210e7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:15.432910 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-bdf3cb03-7a24-4a96-b315-df0a38f210e7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:15.441160 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bdf3cb03-7a24-4a96-b315-df0a38f210e7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082194 Oct 11 07:04:15.441709 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1484/2971] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:15 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:16.464460 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-67635a53-8c88-4459-9bff-9bbb0748fb16 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:16.465096 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-67635a53-8c88-4459-9bff-9bbb0748fb16 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:16.471616 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67635a53-8c88-4459-9bff-9bbb0748fb16 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:16.472092 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67635a53-8c88-4459-9bff-9bbb0748fb16 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:16.472524 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67635a53-8c88-4459-9bff-9bbb0748fb16 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:16.473215 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67635a53-8c88-4459-9bff-9bbb0748fb16 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:16.473663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67635a53-8c88-4459-9bff-9bbb0748fb16 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:16.474089 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-67635a53-8c88-4459-9bff-9bbb0748fb16 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:16.538658 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-67635a53-8c88-4459-9bff-9bbb0748fb16 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:16.547298 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-67635a53-8c88-4459-9bff-9bbb0748fb16 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.086996 Oct 11 07:04:16.547887 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1488/2972] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:16 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:17.274051 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c072c61e-7655-444e-aeff-d974a9514ed3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:17.274595 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c072c61e-7655-444e-aeff-d974a9514ed3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: edea36de-eaed-4410-81f5-b9a3643849c2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:17.281000 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c072c61e-7655-444e-aeff-d974a9514ed3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:17.281483 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c072c61e-7655-444e-aeff-d974a9514ed3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:17.281921 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c072c61e-7655-444e-aeff-d974a9514ed3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:17.282610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c072c61e-7655-444e-aeff-d974a9514ed3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:17.283065 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c072c61e-7655-444e-aeff-d974a9514ed3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:17.283519 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c072c61e-7655-444e-aeff-d974a9514ed3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:17.306922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c072c61e-7655-444e-aeff-d974a9514ed3 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2/ips" status: 200 len: 150 microversion: 2.1 time: 0.036109 Oct 11 07:04:17.307488 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1485/2973] 10.222.0.39 () {58 vars in 1248 bytes} [Tue Oct 11 07:04:17 2022] GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:04:17.569730 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b3568a39-6232-4afd-a202-408b8d5b0e55 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:17.570332 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b3568a39-6232-4afd-a202-408b8d5b0e55 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:17.576622 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b3568a39-6232-4afd-a202-408b8d5b0e55 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:17.577091 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b3568a39-6232-4afd-a202-408b8d5b0e55 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:17.577515 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b3568a39-6232-4afd-a202-408b8d5b0e55 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:17.578198 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b3568a39-6232-4afd-a202-408b8d5b0e55 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:17.578639 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b3568a39-6232-4afd-a202-408b8d5b0e55 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:17.579051 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b3568a39-6232-4afd-a202-408b8d5b0e55 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:17.640390 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b3568a39-6232-4afd-a202-408b8d5b0e55 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:17.648522 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b3568a39-6232-4afd-a202-408b8d5b0e55 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082613 Oct 11 07:04:17.649081 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1489/2974] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:17 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:18.671775 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2d3c72cc-d2ed-4b79-b507-208c436c52ed tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:18.672361 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2d3c72cc-d2ed-4b79-b507-208c436c52ed tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:18.678356 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d3c72cc-d2ed-4b79-b507-208c436c52ed tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:18.678838 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d3c72cc-d2ed-4b79-b507-208c436c52ed tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:18.679277 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d3c72cc-d2ed-4b79-b507-208c436c52ed tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:18.679990 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d3c72cc-d2ed-4b79-b507-208c436c52ed tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:18.680447 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d3c72cc-d2ed-4b79-b507-208c436c52ed tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:18.680871 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2d3c72cc-d2ed-4b79-b507-208c436c52ed tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:18.746175 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2d3c72cc-d2ed-4b79-b507-208c436c52ed tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:18.754850 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2d3c72cc-d2ed-4b79-b507-208c436c52ed tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.087024 Oct 11 07:04:18.755403 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1486/2975] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:18 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:19.778254 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1704dde4-b6a1-4a9c-adac-d9f0f964f4f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:19.778796 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1704dde4-b6a1-4a9c-adac-d9f0f964f4f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:19.785317 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1704dde4-b6a1-4a9c-adac-d9f0f964f4f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:19.785794 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1704dde4-b6a1-4a9c-adac-d9f0f964f4f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:19.786251 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1704dde4-b6a1-4a9c-adac-d9f0f964f4f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:19.786937 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1704dde4-b6a1-4a9c-adac-d9f0f964f4f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:19.787385 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1704dde4-b6a1-4a9c-adac-d9f0f964f4f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:19.787831 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1704dde4-b6a1-4a9c-adac-d9f0f964f4f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:19.847700 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1704dde4-b6a1-4a9c-adac-d9f0f964f4f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:19.856432 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1704dde4-b6a1-4a9c-adac-d9f0f964f4f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082623 Oct 11 07:04:19.856992 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1490/2976] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:19 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:20.878125 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-41e1b7f7-e0b7-44d1-810e-fc965eb3e170 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:20.878736 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-41e1b7f7-e0b7-44d1-810e-fc965eb3e170 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:20.885133 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41e1b7f7-e0b7-44d1-810e-fc965eb3e170 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:20.885870 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41e1b7f7-e0b7-44d1-810e-fc965eb3e170 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:20.886302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41e1b7f7-e0b7-44d1-810e-fc965eb3e170 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:20.886991 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41e1b7f7-e0b7-44d1-810e-fc965eb3e170 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:20.887462 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41e1b7f7-e0b7-44d1-810e-fc965eb3e170 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:20.887886 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41e1b7f7-e0b7-44d1-810e-fc965eb3e170 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:20.891746 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:04:20.947529 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-41e1b7f7-e0b7-44d1-810e-fc965eb3e170 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:20.955565 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-41e1b7f7-e0b7-44d1-810e-fc965eb3e170 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081307 Oct 11 07:04:20.956115 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1487/2977] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:20 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:21.978914 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e0fd48a3-aebc-462a-a0ca-bbf39e5d0867 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:21.979576 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e0fd48a3-aebc-462a-a0ca-bbf39e5d0867 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:21.985508 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0fd48a3-aebc-462a-a0ca-bbf39e5d0867 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:21.985981 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0fd48a3-aebc-462a-a0ca-bbf39e5d0867 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:21.986412 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0fd48a3-aebc-462a-a0ca-bbf39e5d0867 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:21.987093 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0fd48a3-aebc-462a-a0ca-bbf39e5d0867 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:21.987574 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0fd48a3-aebc-462a-a0ca-bbf39e5d0867 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:21.987999 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e0fd48a3-aebc-462a-a0ca-bbf39e5d0867 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:22.047284 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e0fd48a3-aebc-462a-a0ca-bbf39e5d0867 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:22.055461 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e0fd48a3-aebc-462a-a0ca-bbf39e5d0867 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081158 Oct 11 07:04:22.056022 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1491/2978] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:21 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:23.078214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a626f9c9-02a3-4cb2-851f-e172d4404dfd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:23.078827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a626f9c9-02a3-4cb2-851f-e172d4404dfd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:23.085306 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a626f9c9-02a3-4cb2-851f-e172d4404dfd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:23.085786 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a626f9c9-02a3-4cb2-851f-e172d4404dfd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:23.086223 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a626f9c9-02a3-4cb2-851f-e172d4404dfd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:23.086914 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a626f9c9-02a3-4cb2-851f-e172d4404dfd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:23.087369 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a626f9c9-02a3-4cb2-851f-e172d4404dfd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:23.087817 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a626f9c9-02a3-4cb2-851f-e172d4404dfd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:23.147775 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a626f9c9-02a3-4cb2-851f-e172d4404dfd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:23.155758 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a626f9c9-02a3-4cb2-851f-e172d4404dfd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081377 Oct 11 07:04:23.156323 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1488/2979] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:23 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:24.178710 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-343db7e0-a076-4916-b2f9-a2f4db8a8949 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:24.179322 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-343db7e0-a076-4916-b2f9-a2f4db8a8949 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:24.185733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-343db7e0-a076-4916-b2f9-a2f4db8a8949 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:24.186204 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-343db7e0-a076-4916-b2f9-a2f4db8a8949 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:24.186632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-343db7e0-a076-4916-b2f9-a2f4db8a8949 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:24.187307 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-343db7e0-a076-4916-b2f9-a2f4db8a8949 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:24.187771 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-343db7e0-a076-4916-b2f9-a2f4db8a8949 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:24.188187 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-343db7e0-a076-4916-b2f9-a2f4db8a8949 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:24.251185 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-343db7e0-a076-4916-b2f9-a2f4db8a8949 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:24.259239 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-343db7e0-a076-4916-b2f9-a2f4db8a8949 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.084369 Oct 11 07:04:24.259836 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1492/2980] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:24 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:25.282088 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-eae6034c-21ee-49e0-aace-d79c84bbf08d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:25.282693 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-eae6034c-21ee-49e0-aace-d79c84bbf08d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:25.285024 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=48 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:04:25.290434 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eae6034c-21ee-49e0-aace-d79c84bbf08d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:25.290916 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eae6034c-21ee-49e0-aace-d79c84bbf08d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:25.291374 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eae6034c-21ee-49e0-aace-d79c84bbf08d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:25.292100 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eae6034c-21ee-49e0-aace-d79c84bbf08d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:25.292547 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eae6034c-21ee-49e0-aace-d79c84bbf08d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:25.293040 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-eae6034c-21ee-49e0-aace-d79c84bbf08d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:25.353408 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-eae6034c-21ee-49e0-aace-d79c84bbf08d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:25.361462 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-eae6034c-21ee-49e0-aace-d79c84bbf08d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083235 Oct 11 07:04:25.362015 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1489/2981] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:25 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:26.383641 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3e879269-684d-4ba6-aa61-f5b4355ffa57 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:26.384840 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3e879269-684d-4ba6-aa61-f5b4355ffa57 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:26.391559 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e879269-684d-4ba6-aa61-f5b4355ffa57 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:26.392036 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e879269-684d-4ba6-aa61-f5b4355ffa57 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:26.392465 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e879269-684d-4ba6-aa61-f5b4355ffa57 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:26.393151 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e879269-684d-4ba6-aa61-f5b4355ffa57 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:26.393596 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e879269-684d-4ba6-aa61-f5b4355ffa57 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:26.394012 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e879269-684d-4ba6-aa61-f5b4355ffa57 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:26.454679 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3e879269-684d-4ba6-aa61-f5b4355ffa57 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:26.462745 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3e879269-684d-4ba6-aa61-f5b4355ffa57 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082966 Oct 11 07:04:26.463305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1493/2982] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:26 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:27.485071 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-807686a4-e32b-499e-b4f6-5e87a03f7033 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:27.485672 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-807686a4-e32b-499e-b4f6-5e87a03f7033 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:27.492162 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-807686a4-e32b-499e-b4f6-5e87a03f7033 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:27.492641 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-807686a4-e32b-499e-b4f6-5e87a03f7033 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:27.493065 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-807686a4-e32b-499e-b4f6-5e87a03f7033 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:27.494309 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-807686a4-e32b-499e-b4f6-5e87a03f7033 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:27.494753 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-807686a4-e32b-499e-b4f6-5e87a03f7033 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:27.495169 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-807686a4-e32b-499e-b4f6-5e87a03f7033 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:27.560135 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-807686a4-e32b-499e-b4f6-5e87a03f7033 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:27.568151 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-807686a4-e32b-499e-b4f6-5e87a03f7033 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.086909 Oct 11 07:04:27.568710 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1490/2983] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:27 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:28.590279 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-047969ae-ed07-4675-afef-f9b4939b3004 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:28.590873 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-047969ae-ed07-4675-afef-f9b4939b3004 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:28.597235 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-047969ae-ed07-4675-afef-f9b4939b3004 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:28.597710 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-047969ae-ed07-4675-afef-f9b4939b3004 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:28.598134 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-047969ae-ed07-4675-afef-f9b4939b3004 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:28.598841 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-047969ae-ed07-4675-afef-f9b4939b3004 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:28.599280 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-047969ae-ed07-4675-afef-f9b4939b3004 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:28.599719 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-047969ae-ed07-4675-afef-f9b4939b3004 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:28.659266 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-047969ae-ed07-4675-afef-f9b4939b3004 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:28.667707 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-047969ae-ed07-4675-afef-f9b4939b3004 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081300 Oct 11 07:04:28.668255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1494/2984] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:28 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:29.690548 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-87233551-f95f-4097-b62b-969723a875eb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:29.691082 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-87233551-f95f-4097-b62b-969723a875eb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:29.698242 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87233551-f95f-4097-b62b-969723a875eb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:29.698721 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87233551-f95f-4097-b62b-969723a875eb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:29.699157 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87233551-f95f-4097-b62b-969723a875eb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:29.699874 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87233551-f95f-4097-b62b-969723a875eb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:29.700338 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87233551-f95f-4097-b62b-969723a875eb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:29.700755 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-87233551-f95f-4097-b62b-969723a875eb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:29.761325 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-87233551-f95f-4097-b62b-969723a875eb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:29.769522 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-87233551-f95f-4097-b62b-969723a875eb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082871 Oct 11 07:04:29.770077 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1491/2985] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:29 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:30.792680 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8a1681a8-a29c-4116-9ca1-86a2574cff44 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:30.793253 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8a1681a8-a29c-4116-9ca1-86a2574cff44 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:30.799694 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8a1681a8-a29c-4116-9ca1-86a2574cff44 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:30.800180 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8a1681a8-a29c-4116-9ca1-86a2574cff44 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:30.800613 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8a1681a8-a29c-4116-9ca1-86a2574cff44 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:30.801305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8a1681a8-a29c-4116-9ca1-86a2574cff44 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:30.801758 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8a1681a8-a29c-4116-9ca1-86a2574cff44 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:30.802184 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8a1681a8-a29c-4116-9ca1-86a2574cff44 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:30.865103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8a1681a8-a29c-4116-9ca1-86a2574cff44 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:30.873258 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8a1681a8-a29c-4116-9ca1-86a2574cff44 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.084984 Oct 11 07:04:30.873982 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1495/2986] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:30 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:31.896463 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-53f6d703-df37-4a72-a522-5a23fe6868c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:31.897071 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-53f6d703-df37-4a72-a522-5a23fe6868c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:31.903523 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-53f6d703-df37-4a72-a522-5a23fe6868c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:31.904002 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-53f6d703-df37-4a72-a522-5a23fe6868c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:31.904434 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-53f6d703-df37-4a72-a522-5a23fe6868c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:31.905120 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-53f6d703-df37-4a72-a522-5a23fe6868c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:31.905569 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-53f6d703-df37-4a72-a522-5a23fe6868c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:31.905989 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-53f6d703-df37-4a72-a522-5a23fe6868c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:31.966545 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-53f6d703-df37-4a72-a522-5a23fe6868c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:31.974724 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-53f6d703-df37-4a72-a522-5a23fe6868c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082143 Oct 11 07:04:31.975285 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1492/2987] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:31 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:32.997466 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-05a85817-288e-4cf3-a48c-d2accb4232ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:32.998089 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-05a85817-288e-4cf3-a48c-d2accb4232ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:33.004458 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05a85817-288e-4cf3-a48c-d2accb4232ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:33.004937 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05a85817-288e-4cf3-a48c-d2accb4232ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:33.005374 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05a85817-288e-4cf3-a48c-d2accb4232ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:33.006074 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05a85817-288e-4cf3-a48c-d2accb4232ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:33.006520 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05a85817-288e-4cf3-a48c-d2accb4232ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:33.006941 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-05a85817-288e-4cf3-a48c-d2accb4232ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:33.070984 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-05a85817-288e-4cf3-a48c-d2accb4232ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:33.079714 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-05a85817-288e-4cf3-a48c-d2accb4232ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.086023 Oct 11 07:04:33.080275 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1496/2988] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:32 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:34.101722 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6e4d8078-c73c-472e-9a7e-671e1bc52a50 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:34.102334 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6e4d8078-c73c-472e-9a7e-671e1bc52a50 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:34.108753 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e4d8078-c73c-472e-9a7e-671e1bc52a50 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:34.109237 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e4d8078-c73c-472e-9a7e-671e1bc52a50 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:34.109668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e4d8078-c73c-472e-9a7e-671e1bc52a50 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:34.110359 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e4d8078-c73c-472e-9a7e-671e1bc52a50 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:34.110811 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e4d8078-c73c-472e-9a7e-671e1bc52a50 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:34.111234 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6e4d8078-c73c-472e-9a7e-671e1bc52a50 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:34.174588 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6e4d8078-c73c-472e-9a7e-671e1bc52a50 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:34.183264 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6e4d8078-c73c-472e-9a7e-671e1bc52a50 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085418 Oct 11 07:04:34.183855 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1493/2989] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:34 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:35.206129 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-410be962-8c54-4402-a48a-96edae70348b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:35.206709 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-410be962-8c54-4402-a48a-96edae70348b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:35.213693 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-410be962-8c54-4402-a48a-96edae70348b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:35.214125 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-410be962-8c54-4402-a48a-96edae70348b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:35.214624 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-410be962-8c54-4402-a48a-96edae70348b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:35.215306 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-410be962-8c54-4402-a48a-96edae70348b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:35.215772 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-410be962-8c54-4402-a48a-96edae70348b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:35.216189 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-410be962-8c54-4402-a48a-96edae70348b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:35.276395 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-410be962-8c54-4402-a48a-96edae70348b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:35.284539 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-410be962-8c54-4402-a48a-96edae70348b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082231 Oct 11 07:04:35.285089 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1497/2990] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:35 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:36.307175 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1a837614-11a3-4c61-9a59-3a5607da037c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:36.307749 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1a837614-11a3-4c61-9a59-3a5607da037c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:36.314137 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1a837614-11a3-4c61-9a59-3a5607da037c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:36.314650 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1a837614-11a3-4c61-9a59-3a5607da037c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:36.315083 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1a837614-11a3-4c61-9a59-3a5607da037c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:36.315822 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1a837614-11a3-4c61-9a59-3a5607da037c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:36.316277 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1a837614-11a3-4c61-9a59-3a5607da037c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:36.316696 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1a837614-11a3-4c61-9a59-3a5607da037c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:36.380253 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1a837614-11a3-4c61-9a59-3a5607da037c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:36.388674 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1a837614-11a3-4c61-9a59-3a5607da037c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085445 Oct 11 07:04:36.389233 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1494/2991] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:36 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:37.411551 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5139ad62-bbe1-46b9-8ef9-00ce5bbfa564 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:37.412167 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5139ad62-bbe1-46b9-8ef9-00ce5bbfa564 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:37.419290 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5139ad62-bbe1-46b9-8ef9-00ce5bbfa564 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:37.419805 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5139ad62-bbe1-46b9-8ef9-00ce5bbfa564 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:37.420240 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5139ad62-bbe1-46b9-8ef9-00ce5bbfa564 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:37.420935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5139ad62-bbe1-46b9-8ef9-00ce5bbfa564 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:37.421385 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5139ad62-bbe1-46b9-8ef9-00ce5bbfa564 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:37.421808 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5139ad62-bbe1-46b9-8ef9-00ce5bbfa564 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:37.483647 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5139ad62-bbe1-46b9-8ef9-00ce5bbfa564 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:37.491673 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5139ad62-bbe1-46b9-8ef9-00ce5bbfa564 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083950 Oct 11 07:04:37.492222 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1498/2992] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:37 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:38.515692 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-37dbf629-5867-41bd-a6df-8dd82fb04417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:38.516301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-37dbf629-5867-41bd-a6df-8dd82fb04417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:38.522831 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-37dbf629-5867-41bd-a6df-8dd82fb04417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:38.523305 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-37dbf629-5867-41bd-a6df-8dd82fb04417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:38.523766 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-37dbf629-5867-41bd-a6df-8dd82fb04417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:38.524449 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-37dbf629-5867-41bd-a6df-8dd82fb04417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:38.524924 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-37dbf629-5867-41bd-a6df-8dd82fb04417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:38.525325 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-37dbf629-5867-41bd-a6df-8dd82fb04417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:38.585790 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-37dbf629-5867-41bd-a6df-8dd82fb04417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:38.595511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-37dbf629-5867-41bd-a6df-8dd82fb04417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083665 Oct 11 07:04:38.596073 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1495/2993] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:38 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:39.617874 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-91cc0743-dd61-4ccb-a423-dc3c83c7a970 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:39.618527 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-91cc0743-dd61-4ccb-a423-dc3c83c7a970 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:39.624938 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-91cc0743-dd61-4ccb-a423-dc3c83c7a970 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:39.625419 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-91cc0743-dd61-4ccb-a423-dc3c83c7a970 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:39.625852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-91cc0743-dd61-4ccb-a423-dc3c83c7a970 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:39.626541 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-91cc0743-dd61-4ccb-a423-dc3c83c7a970 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:39.626991 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-91cc0743-dd61-4ccb-a423-dc3c83c7a970 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:39.627433 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-91cc0743-dd61-4ccb-a423-dc3c83c7a970 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:39.688057 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-91cc0743-dd61-4ccb-a423-dc3c83c7a970 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:39.696570 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-91cc0743-dd61-4ccb-a423-dc3c83c7a970 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082056 Oct 11 07:04:39.697132 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1499/2994] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:39 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:40.281493 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cd9edc3f-8162-4d24-b28e-95b8e0342448 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:40.282073 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cd9edc3f-8162-4d24-b28e-95b8e0342448 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: f26806d8-9180-4109-b3df-cadb68b7a0f2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:40.288680 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cd9edc3f-8162-4d24-b28e-95b8e0342448 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:40.289150 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cd9edc3f-8162-4d24-b28e-95b8e0342448 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:40.290085 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cd9edc3f-8162-4d24-b28e-95b8e0342448 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:40.290759 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cd9edc3f-8162-4d24-b28e-95b8e0342448 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:40.291203 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cd9edc3f-8162-4d24-b28e-95b8e0342448 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:40.291646 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cd9edc3f-8162-4d24-b28e-95b8e0342448 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:40.314510 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cd9edc3f-8162-4d24-b28e-95b8e0342448 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2/ips" status: 200 len: 151 microversion: 2.20 time: 0.036925 Oct 11 07:04:40.315049 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1496/2995] 10.222.0.39 () {60 vars in 1289 bytes} [Tue Oct 11 07:04:40 2022] GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 07:04:40.719299 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f093e270-4adf-4bce-8969-97fd08b41a63 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:40.719924 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f093e270-4adf-4bce-8969-97fd08b41a63 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:40.726439 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f093e270-4adf-4bce-8969-97fd08b41a63 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:40.726910 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f093e270-4adf-4bce-8969-97fd08b41a63 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:40.727334 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f093e270-4adf-4bce-8969-97fd08b41a63 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:40.728689 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f093e270-4adf-4bce-8969-97fd08b41a63 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:40.729135 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f093e270-4adf-4bce-8969-97fd08b41a63 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:40.729550 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f093e270-4adf-4bce-8969-97fd08b41a63 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:40.793221 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f093e270-4adf-4bce-8969-97fd08b41a63 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:40.801443 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f093e270-4adf-4bce-8969-97fd08b41a63 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085963 Oct 11 07:04:40.801997 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1500/2996] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:40 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:41.824414 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d0c7ab6e-cb0f-4f04-b65e-08a76950f0b3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:41.824964 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d0c7ab6e-cb0f-4f04-b65e-08a76950f0b3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:41.831314 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0c7ab6e-cb0f-4f04-b65e-08a76950f0b3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:41.831826 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0c7ab6e-cb0f-4f04-b65e-08a76950f0b3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:41.832256 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0c7ab6e-cb0f-4f04-b65e-08a76950f0b3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:41.832940 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0c7ab6e-cb0f-4f04-b65e-08a76950f0b3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:41.833388 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0c7ab6e-cb0f-4f04-b65e-08a76950f0b3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:41.833807 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0c7ab6e-cb0f-4f04-b65e-08a76950f0b3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:41.894863 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d0c7ab6e-cb0f-4f04-b65e-08a76950f0b3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:41.903216 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d0c7ab6e-cb0f-4f04-b65e-08a76950f0b3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082686 Oct 11 07:04:41.903808 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1497/2997] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:41 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:42.926276 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-64c2bc46-defd-40e6-b66e-7ec4c96cda87 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:42.926875 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-64c2bc46-defd-40e6-b66e-7ec4c96cda87 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:42.929341 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=30 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:04:42.934587 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-64c2bc46-defd-40e6-b66e-7ec4c96cda87 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:42.935060 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-64c2bc46-defd-40e6-b66e-7ec4c96cda87 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:42.935508 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-64c2bc46-defd-40e6-b66e-7ec4c96cda87 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:42.936191 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-64c2bc46-defd-40e6-b66e-7ec4c96cda87 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:42.936674 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-64c2bc46-defd-40e6-b66e-7ec4c96cda87 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:42.937093 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-64c2bc46-defd-40e6-b66e-7ec4c96cda87 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:42.999351 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-64c2bc46-defd-40e6-b66e-7ec4c96cda87 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:43.007623 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-64c2bc46-defd-40e6-b66e-7ec4c96cda87 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085331 Oct 11 07:04:43.008174 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1501/2998] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:42 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:44.031108 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b8848571-c3d0-475d-9ead-5bc99f43dc6c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:44.031704 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b8848571-c3d0-475d-9ead-5bc99f43dc6c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:44.038181 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8848571-c3d0-475d-9ead-5bc99f43dc6c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:44.038653 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8848571-c3d0-475d-9ead-5bc99f43dc6c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:44.039079 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8848571-c3d0-475d-9ead-5bc99f43dc6c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:44.039798 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8848571-c3d0-475d-9ead-5bc99f43dc6c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:44.040244 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8848571-c3d0-475d-9ead-5bc99f43dc6c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:44.040673 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8848571-c3d0-475d-9ead-5bc99f43dc6c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:44.100579 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b8848571-c3d0-475d-9ead-5bc99f43dc6c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:44.109118 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b8848571-c3d0-475d-9ead-5bc99f43dc6c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081858 Oct 11 07:04:44.109664 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1498/2999] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:44 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:45.131549 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-af7e27f7-a89d-4c06-974f-760c2b3e1d3c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:45.132160 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-af7e27f7-a89d-4c06-974f-760c2b3e1d3c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:45.138840 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af7e27f7-a89d-4c06-974f-760c2b3e1d3c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:45.139323 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af7e27f7-a89d-4c06-974f-760c2b3e1d3c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:45.139787 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af7e27f7-a89d-4c06-974f-760c2b3e1d3c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:45.140479 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af7e27f7-a89d-4c06-974f-760c2b3e1d3c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:45.140930 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af7e27f7-a89d-4c06-974f-760c2b3e1d3c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:45.141363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af7e27f7-a89d-4c06-974f-760c2b3e1d3c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:45.201191 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-af7e27f7-a89d-4c06-974f-760c2b3e1d3c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:45.209183 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-af7e27f7-a89d-4c06-974f-760c2b3e1d3c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081543 Oct 11 07:04:45.209751 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1502/3000] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:45 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:46.231721 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a80577e6-f352-462b-ba52-aeee27d143d1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:46.232347 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a80577e6-f352-462b-ba52-aeee27d143d1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:46.238700 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a80577e6-f352-462b-ba52-aeee27d143d1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:46.239188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a80577e6-f352-462b-ba52-aeee27d143d1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:46.239726 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a80577e6-f352-462b-ba52-aeee27d143d1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:46.240416 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a80577e6-f352-462b-ba52-aeee27d143d1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:46.240869 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a80577e6-f352-462b-ba52-aeee27d143d1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:46.241291 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a80577e6-f352-462b-ba52-aeee27d143d1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:46.304786 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a80577e6-f352-462b-ba52-aeee27d143d1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:46.313379 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a80577e6-f352-462b-ba52-aeee27d143d1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085605 Oct 11 07:04:46.313931 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1499/3001] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:46 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:47.337455 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f0ade118-af57-44e9-8701-378eb994fd92 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:47.338074 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f0ade118-af57-44e9-8701-378eb994fd92 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:47.344386 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f0ade118-af57-44e9-8701-378eb994fd92 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:47.344864 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f0ade118-af57-44e9-8701-378eb994fd92 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:47.345301 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f0ade118-af57-44e9-8701-378eb994fd92 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:47.345977 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f0ade118-af57-44e9-8701-378eb994fd92 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:47.346429 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f0ade118-af57-44e9-8701-378eb994fd92 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:47.346847 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f0ade118-af57-44e9-8701-378eb994fd92 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:47.349363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=91 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:04:47.407907 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f0ade118-af57-44e9-8701-378eb994fd92 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:47.416643 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f0ade118-af57-44e9-8701-378eb994fd92 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082500 Oct 11 07:04:47.417195 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1503/3002] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:47 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:48.439041 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-32f64bba-1187-40f3-bda4-ae66afdfa513 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:48.439683 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-32f64bba-1187-40f3-bda4-ae66afdfa513 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:48.445852 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-32f64bba-1187-40f3-bda4-ae66afdfa513 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:48.446329 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-32f64bba-1187-40f3-bda4-ae66afdfa513 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:48.446758 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-32f64bba-1187-40f3-bda4-ae66afdfa513 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:48.447529 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-32f64bba-1187-40f3-bda4-ae66afdfa513 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:48.447986 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-32f64bba-1187-40f3-bda4-ae66afdfa513 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:48.448406 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-32f64bba-1187-40f3-bda4-ae66afdfa513 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:48.510742 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-32f64bba-1187-40f3-bda4-ae66afdfa513 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:48.518843 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-32f64bba-1187-40f3-bda4-ae66afdfa513 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083571 Oct 11 07:04:48.519398 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1500/3003] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:48 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:49.542509 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-214f2d06-c93d-4788-a6ba-97b09b53c2a6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:49.543117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-214f2d06-c93d-4788-a6ba-97b09b53c2a6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:49.549720 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-214f2d06-c93d-4788-a6ba-97b09b53c2a6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:49.550195 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-214f2d06-c93d-4788-a6ba-97b09b53c2a6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:49.550627 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-214f2d06-c93d-4788-a6ba-97b09b53c2a6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:49.551312 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-214f2d06-c93d-4788-a6ba-97b09b53c2a6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:49.551785 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-214f2d06-c93d-4788-a6ba-97b09b53c2a6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:49.552207 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-214f2d06-c93d-4788-a6ba-97b09b53c2a6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:49.615997 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-214f2d06-c93d-4788-a6ba-97b09b53c2a6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:49.624933 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-214f2d06-c93d-4788-a6ba-97b09b53c2a6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.086915 Oct 11 07:04:49.625486 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1504/3004] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:49 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:50.652408 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-18f8050c-7802-49f0-b979-4de0638584b7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:50.653022 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-18f8050c-7802-49f0-b979-4de0638584b7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:50.659598 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-18f8050c-7802-49f0-b979-4de0638584b7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:50.660027 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-18f8050c-7802-49f0-b979-4de0638584b7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:50.660467 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-18f8050c-7802-49f0-b979-4de0638584b7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:50.661158 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-18f8050c-7802-49f0-b979-4de0638584b7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:50.661619 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-18f8050c-7802-49f0-b979-4de0638584b7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:50.662040 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-18f8050c-7802-49f0-b979-4de0638584b7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:50.722611 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-18f8050c-7802-49f0-b979-4de0638584b7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:50.730759 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-18f8050c-7802-49f0-b979-4de0638584b7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082853 Oct 11 07:04:50.731316 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1501/3005] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:50 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:51.753713 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-570bfdff-1e40-4202-a347-5dc1477d57f3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:51.754249 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-570bfdff-1e40-4202-a347-5dc1477d57f3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:51.760670 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-570bfdff-1e40-4202-a347-5dc1477d57f3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:51.761146 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-570bfdff-1e40-4202-a347-5dc1477d57f3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:51.761580 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-570bfdff-1e40-4202-a347-5dc1477d57f3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:51.762270 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-570bfdff-1e40-4202-a347-5dc1477d57f3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:51.762721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-570bfdff-1e40-4202-a347-5dc1477d57f3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:51.763142 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-570bfdff-1e40-4202-a347-5dc1477d57f3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:51.823497 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-570bfdff-1e40-4202-a347-5dc1477d57f3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:51.831773 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-570bfdff-1e40-4202-a347-5dc1477d57f3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081971 Oct 11 07:04:51.832331 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1505/3006] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:51 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:52.855664 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8ff27212-357e-4136-8894-db81b97a93c6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:52.856266 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8ff27212-357e-4136-8894-db81b97a93c6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:52.862543 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8ff27212-357e-4136-8894-db81b97a93c6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:52.863017 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8ff27212-357e-4136-8894-db81b97a93c6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:52.863461 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8ff27212-357e-4136-8894-db81b97a93c6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:52.864140 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8ff27212-357e-4136-8894-db81b97a93c6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:52.864583 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8ff27212-357e-4136-8894-db81b97a93c6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:52.864998 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8ff27212-357e-4136-8894-db81b97a93c6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:52.867484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=87 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:04:52.927148 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8ff27212-357e-4136-8894-db81b97a93c6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:52.935241 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8ff27212-357e-4136-8894-db81b97a93c6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083915 Oct 11 07:04:52.935826 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1502/3007] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:52 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:53.957776 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b4c12f2f-5e73-4117-879a-b0eb9e54f712 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:53.958379 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b4c12f2f-5e73-4117-879a-b0eb9e54f712 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:53.965345 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b4c12f2f-5e73-4117-879a-b0eb9e54f712 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:53.965821 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b4c12f2f-5e73-4117-879a-b0eb9e54f712 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:53.966252 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b4c12f2f-5e73-4117-879a-b0eb9e54f712 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:53.966937 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b4c12f2f-5e73-4117-879a-b0eb9e54f712 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:53.967391 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b4c12f2f-5e73-4117-879a-b0eb9e54f712 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:53.967838 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b4c12f2f-5e73-4117-879a-b0eb9e54f712 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:54.028422 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b4c12f2f-5e73-4117-879a-b0eb9e54f712 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:54.036480 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b4c12f2f-5e73-4117-879a-b0eb9e54f712 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082541 Oct 11 07:04:54.037032 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1506/3008] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:53 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:55.060360 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-03b59124-44fb-4ab3-85c3-0c4fb2cb77a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:55.060956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-03b59124-44fb-4ab3-85c3-0c4fb2cb77a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:55.067438 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-03b59124-44fb-4ab3-85c3-0c4fb2cb77a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:55.067933 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-03b59124-44fb-4ab3-85c3-0c4fb2cb77a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:55.068404 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-03b59124-44fb-4ab3-85c3-0c4fb2cb77a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:55.069101 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-03b59124-44fb-4ab3-85c3-0c4fb2cb77a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:55.069554 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-03b59124-44fb-4ab3-85c3-0c4fb2cb77a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:55.069982 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-03b59124-44fb-4ab3-85c3-0c4fb2cb77a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:55.132579 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-03b59124-44fb-4ab3-85c3-0c4fb2cb77a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:55.141047 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-03b59124-44fb-4ab3-85c3-0c4fb2cb77a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085205 Oct 11 07:04:55.141601 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1503/3009] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:55 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:56.164470 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-23e809ef-0a0d-4413-b866-cdfb537c1194 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:56.165080 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-23e809ef-0a0d-4413-b866-cdfb537c1194 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:56.172228 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-23e809ef-0a0d-4413-b866-cdfb537c1194 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:56.172708 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-23e809ef-0a0d-4413-b866-cdfb537c1194 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:56.173144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-23e809ef-0a0d-4413-b866-cdfb537c1194 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:56.173832 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-23e809ef-0a0d-4413-b866-cdfb537c1194 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:56.174281 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-23e809ef-0a0d-4413-b866-cdfb537c1194 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:56.174701 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-23e809ef-0a0d-4413-b866-cdfb537c1194 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:56.234719 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-23e809ef-0a0d-4413-b866-cdfb537c1194 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:56.242862 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-23e809ef-0a0d-4413-b866-cdfb537c1194 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082239 Oct 11 07:04:56.243440 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1507/3010] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:56 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:57.265733 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e14e1bf2-d160-4a3a-a962-d777985d2a5d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:57.266336 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e14e1bf2-d160-4a3a-a962-d777985d2a5d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:57.268657 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=30 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:04:57.274401 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e14e1bf2-d160-4a3a-a962-d777985d2a5d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:57.274885 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e14e1bf2-d160-4a3a-a962-d777985d2a5d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:57.275323 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e14e1bf2-d160-4a3a-a962-d777985d2a5d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:57.276043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e14e1bf2-d160-4a3a-a962-d777985d2a5d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:57.276496 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e14e1bf2-d160-4a3a-a962-d777985d2a5d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:57.276919 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e14e1bf2-d160-4a3a-a962-d777985d2a5d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:57.336712 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e14e1bf2-d160-4a3a-a962-d777985d2a5d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:57.344884 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e14e1bf2-d160-4a3a-a962-d777985d2a5d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083024 Oct 11 07:04:57.345443 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1504/3011] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:57 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:58.367716 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8beea813-4436-4575-920e-fc4903a9be61 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:58.368344 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8beea813-4436-4575-920e-fc4903a9be61 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:58.375241 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8beea813-4436-4575-920e-fc4903a9be61 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:58.375747 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8beea813-4436-4575-920e-fc4903a9be61 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:58.376177 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8beea813-4436-4575-920e-fc4903a9be61 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:58.376868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8beea813-4436-4575-920e-fc4903a9be61 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:58.377342 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8beea813-4436-4575-920e-fc4903a9be61 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:58.377758 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8beea813-4436-4575-920e-fc4903a9be61 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:58.442593 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8beea813-4436-4575-920e-fc4903a9be61 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:58.451398 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8beea813-4436-4575-920e-fc4903a9be61 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.087544 Oct 11 07:04:58.451972 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1508/3012] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:58 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:04:59.473811 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6f0caf24-102b-476e-ad47-d1860ed7fc26 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:04:59.474422 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6f0caf24-102b-476e-ad47-d1860ed7fc26 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:04:59.480798 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6f0caf24-102b-476e-ad47-d1860ed7fc26 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:59.481276 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6f0caf24-102b-476e-ad47-d1860ed7fc26 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:59.481712 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6f0caf24-102b-476e-ad47-d1860ed7fc26 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:59.482398 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6f0caf24-102b-476e-ad47-d1860ed7fc26 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:04:59.482846 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6f0caf24-102b-476e-ad47-d1860ed7fc26 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:04:59.483266 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6f0caf24-102b-476e-ad47-d1860ed7fc26 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:04:59.546111 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6f0caf24-102b-476e-ad47-d1860ed7fc26 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:04:59.554237 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6f0caf24-102b-476e-ad47-d1860ed7fc26 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.084283 Oct 11 07:04:59.554785 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1505/3013] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:04:59 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:00.576504 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-709cd360-d565-4dee-b3e4-fa614185a947 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:00.577110 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-709cd360-d565-4dee-b3e4-fa614185a947 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:00.583708 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-709cd360-d565-4dee-b3e4-fa614185a947 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:00.584183 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-709cd360-d565-4dee-b3e4-fa614185a947 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:00.584609 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-709cd360-d565-4dee-b3e4-fa614185a947 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:00.585288 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-709cd360-d565-4dee-b3e4-fa614185a947 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:00.585730 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-709cd360-d565-4dee-b3e4-fa614185a947 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:00.586147 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-709cd360-d565-4dee-b3e4-fa614185a947 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:00.645338 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-709cd360-d565-4dee-b3e4-fa614185a947 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:00.653803 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-709cd360-d565-4dee-b3e4-fa614185a947 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081107 Oct 11 07:05:00.654359 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1509/3014] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:00 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:01.676598 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-90710aad-2595-4234-8adb-958e16babc65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:01.677213 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-90710aad-2595-4234-8adb-958e16babc65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:01.683714 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-90710aad-2595-4234-8adb-958e16babc65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:01.684198 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-90710aad-2595-4234-8adb-958e16babc65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:01.684630 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-90710aad-2595-4234-8adb-958e16babc65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:01.685319 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-90710aad-2595-4234-8adb-958e16babc65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:01.685768 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-90710aad-2595-4234-8adb-958e16babc65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:01.686191 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-90710aad-2595-4234-8adb-958e16babc65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:01.748013 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-90710aad-2595-4234-8adb-958e16babc65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:01.756023 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-90710aad-2595-4234-8adb-958e16babc65 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083250 Oct 11 07:05:01.756579 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1506/3015] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:01 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:02.779264 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c66b0aa7-6c64-4468-85c1-416ce9cc06a8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:02.779840 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c66b0aa7-6c64-4468-85c1-416ce9cc06a8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:02.786186 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c66b0aa7-6c64-4468-85c1-416ce9cc06a8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:02.786660 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c66b0aa7-6c64-4468-85c1-416ce9cc06a8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:02.787084 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c66b0aa7-6c64-4468-85c1-416ce9cc06a8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:02.787795 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c66b0aa7-6c64-4468-85c1-416ce9cc06a8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:02.788251 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c66b0aa7-6c64-4468-85c1-416ce9cc06a8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:02.788672 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c66b0aa7-6c64-4468-85c1-416ce9cc06a8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:02.851571 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c66b0aa7-6c64-4468-85c1-416ce9cc06a8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:02.860291 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c66b0aa7-6c64-4468-85c1-416ce9cc06a8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085473 Oct 11 07:05:02.860852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1510/3016] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:02 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:03.882180 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d319661b-c68a-466a-a9cb-5f47f185dd6b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:03.882814 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d319661b-c68a-466a-a9cb-5f47f185dd6b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:03.889500 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d319661b-c68a-466a-a9cb-5f47f185dd6b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:03.889977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d319661b-c68a-466a-a9cb-5f47f185dd6b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:03.890406 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d319661b-c68a-466a-a9cb-5f47f185dd6b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:03.891099 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d319661b-c68a-466a-a9cb-5f47f185dd6b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:03.891603 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d319661b-c68a-466a-a9cb-5f47f185dd6b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:03.892022 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d319661b-c68a-466a-a9cb-5f47f185dd6b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:03.954732 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d319661b-c68a-466a-a9cb-5f47f185dd6b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:03.963028 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d319661b-c68a-466a-a9cb-5f47f185dd6b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.084781 Oct 11 07:05:03.963614 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1507/3017] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:03 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:04.985976 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a9da2e6b-c58d-483f-b555-d47352ee9b01 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:04.986622 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a9da2e6b-c58d-483f-b555-d47352ee9b01 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:04.993020 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9da2e6b-c58d-483f-b555-d47352ee9b01 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:04.994003 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9da2e6b-c58d-483f-b555-d47352ee9b01 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:04.994431 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9da2e6b-c58d-483f-b555-d47352ee9b01 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:04.995113 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9da2e6b-c58d-483f-b555-d47352ee9b01 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:04.995588 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9da2e6b-c58d-483f-b555-d47352ee9b01 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:04.996009 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9da2e6b-c58d-483f-b555-d47352ee9b01 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:05.055673 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a9da2e6b-c58d-483f-b555-d47352ee9b01 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:05.064143 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a9da2e6b-c58d-483f-b555-d47352ee9b01 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081995 Oct 11 07:05:05.064701 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1511/3018] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:04 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:06.086700 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f3011f83-d67e-404f-aadd-97049bab7399 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:06.087989 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f3011f83-d67e-404f-aadd-97049bab7399 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:06.094170 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3011f83-d67e-404f-aadd-97049bab7399 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:06.094648 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3011f83-d67e-404f-aadd-97049bab7399 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:06.095080 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3011f83-d67e-404f-aadd-97049bab7399 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:06.095802 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3011f83-d67e-404f-aadd-97049bab7399 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:06.096250 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3011f83-d67e-404f-aadd-97049bab7399 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:06.096671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3011f83-d67e-404f-aadd-97049bab7399 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:06.157893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f3011f83-d67e-404f-aadd-97049bab7399 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:06.165995 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f3011f83-d67e-404f-aadd-97049bab7399 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083263 Oct 11 07:05:06.166725 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1508/3019] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:06 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:07.188414 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f56bc068-34a8-4d52-aab8-f9a1c10727ff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:07.189024 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f56bc068-34a8-4d52-aab8-f9a1c10727ff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:07.195434 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f56bc068-34a8-4d52-aab8-f9a1c10727ff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:07.195929 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f56bc068-34a8-4d52-aab8-f9a1c10727ff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:07.196367 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f56bc068-34a8-4d52-aab8-f9a1c10727ff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:07.197061 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f56bc068-34a8-4d52-aab8-f9a1c10727ff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:07.197513 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f56bc068-34a8-4d52-aab8-f9a1c10727ff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:07.197940 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f56bc068-34a8-4d52-aab8-f9a1c10727ff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:07.261517 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f56bc068-34a8-4d52-aab8-f9a1c10727ff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:07.269598 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f56bc068-34a8-4d52-aab8-f9a1c10727ff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085078 Oct 11 07:05:07.270152 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1512/3020] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:07 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:08.292923 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bdb189fa-42a1-4084-8f7d-03f7cec5249a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:08.293464 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bdb189fa-42a1-4084-8f7d-03f7cec5249a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:08.299869 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bdb189fa-42a1-4084-8f7d-03f7cec5249a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:08.300347 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bdb189fa-42a1-4084-8f7d-03f7cec5249a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:08.300789 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bdb189fa-42a1-4084-8f7d-03f7cec5249a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:08.301473 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bdb189fa-42a1-4084-8f7d-03f7cec5249a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:08.301922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bdb189fa-42a1-4084-8f7d-03f7cec5249a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:08.302343 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bdb189fa-42a1-4084-8f7d-03f7cec5249a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:08.362132 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-bdb189fa-42a1-4084-8f7d-03f7cec5249a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:08.370874 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bdb189fa-42a1-4084-8f7d-03f7cec5249a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082359 Oct 11 07:05:08.371433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1509/3021] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:08 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:09.392481 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-77e18597-0101-4e0a-b9de-4d17c93b9297 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:09.393083 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-77e18597-0101-4e0a-b9de-4d17c93b9297 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:09.400020 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77e18597-0101-4e0a-b9de-4d17c93b9297 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:09.400497 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77e18597-0101-4e0a-b9de-4d17c93b9297 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:09.400922 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77e18597-0101-4e0a-b9de-4d17c93b9297 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:09.401601 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77e18597-0101-4e0a-b9de-4d17c93b9297 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:09.402099 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77e18597-0101-4e0a-b9de-4d17c93b9297 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:09.402519 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-77e18597-0101-4e0a-b9de-4d17c93b9297 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:09.463012 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-77e18597-0101-4e0a-b9de-4d17c93b9297 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:09.471040 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-77e18597-0101-4e0a-b9de-4d17c93b9297 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082340 Oct 11 07:05:09.471928 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1513/3022] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:09 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:10.493785 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e5923f3f-037d-4770-aca3-b8e8fba717eb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:10.494514 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e5923f3f-037d-4770-aca3-b8e8fba717eb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:10.501055 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e5923f3f-037d-4770-aca3-b8e8fba717eb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:10.501539 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e5923f3f-037d-4770-aca3-b8e8fba717eb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:10.501978 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e5923f3f-037d-4770-aca3-b8e8fba717eb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:10.502677 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e5923f3f-037d-4770-aca3-b8e8fba717eb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:10.503128 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e5923f3f-037d-4770-aca3-b8e8fba717eb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:10.503583 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e5923f3f-037d-4770-aca3-b8e8fba717eb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:10.567508 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e5923f3f-037d-4770-aca3-b8e8fba717eb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:10.575617 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e5923f3f-037d-4770-aca3-b8e8fba717eb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.086159 Oct 11 07:05:10.576177 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1510/3023] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:10 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:11.598016 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8b912d8b-22d0-44da-b2fc-e1d8901c2f8a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:11.598616 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8b912d8b-22d0-44da-b2fc-e1d8901c2f8a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:11.605095 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8b912d8b-22d0-44da-b2fc-e1d8901c2f8a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:11.605566 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8b912d8b-22d0-44da-b2fc-e1d8901c2f8a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:11.605992 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8b912d8b-22d0-44da-b2fc-e1d8901c2f8a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:11.606664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8b912d8b-22d0-44da-b2fc-e1d8901c2f8a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:11.607106 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8b912d8b-22d0-44da-b2fc-e1d8901c2f8a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:11.607542 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8b912d8b-22d0-44da-b2fc-e1d8901c2f8a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:11.667084 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8b912d8b-22d0-44da-b2fc-e1d8901c2f8a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:11.675009 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8b912d8b-22d0-44da-b2fc-e1d8901c2f8a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.080856 Oct 11 07:05:11.675581 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1514/3024] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:11 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:12.697195 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f21e7f72-0e83-4a4e-9166-28fd6f58b89c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:12.697809 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f21e7f72-0e83-4a4e-9166-28fd6f58b89c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:12.704313 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f21e7f72-0e83-4a4e-9166-28fd6f58b89c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:12.704792 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f21e7f72-0e83-4a4e-9166-28fd6f58b89c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:12.705224 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f21e7f72-0e83-4a4e-9166-28fd6f58b89c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:12.705912 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f21e7f72-0e83-4a4e-9166-28fd6f58b89c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:12.706360 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f21e7f72-0e83-4a4e-9166-28fd6f58b89c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:12.706779 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f21e7f72-0e83-4a4e-9166-28fd6f58b89c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:12.769551 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f21e7f72-0e83-4a4e-9166-28fd6f58b89c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:12.778158 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f21e7f72-0e83-4a4e-9166-28fd6f58b89c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.084812 Oct 11 07:05:12.778709 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1511/3025] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:12 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:13.800474 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b3da65df-2f53-4b17-9e79-883795553799 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:13.801086 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b3da65df-2f53-4b17-9e79-883795553799 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:13.803467 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=28 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:05:13.808647 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b3da65df-2f53-4b17-9e79-883795553799 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:13.809141 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b3da65df-2f53-4b17-9e79-883795553799 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:13.809577 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b3da65df-2f53-4b17-9e79-883795553799 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:13.810267 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b3da65df-2f53-4b17-9e79-883795553799 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:13.810715 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b3da65df-2f53-4b17-9e79-883795553799 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:13.811137 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b3da65df-2f53-4b17-9e79-883795553799 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:13.873439 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b3da65df-2f53-4b17-9e79-883795553799 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:13.881508 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b3da65df-2f53-4b17-9e79-883795553799 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.084895 Oct 11 07:05:13.882058 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1515/3026] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:13 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:14.904654 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e1db683d-3ff4-496c-8b57-9fa72ce73160 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:14.905267 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e1db683d-3ff4-496c-8b57-9fa72ce73160 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:14.911702 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e1db683d-3ff4-496c-8b57-9fa72ce73160 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:14.912178 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e1db683d-3ff4-496c-8b57-9fa72ce73160 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:14.912609 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e1db683d-3ff4-496c-8b57-9fa72ce73160 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:14.913295 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e1db683d-3ff4-496c-8b57-9fa72ce73160 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:14.913744 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e1db683d-3ff4-496c-8b57-9fa72ce73160 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:14.914161 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e1db683d-3ff4-496c-8b57-9fa72ce73160 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:14.974478 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e1db683d-3ff4-496c-8b57-9fa72ce73160 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:14.983280 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e1db683d-3ff4-496c-8b57-9fa72ce73160 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082501 Oct 11 07:05:14.983872 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1512/3027] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:14 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:16.005701 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4e280454-03dc-41d7-b7c6-bed10be883d1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:16.006309 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4e280454-03dc-41d7-b7c6-bed10be883d1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:16.013547 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4e280454-03dc-41d7-b7c6-bed10be883d1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:16.014027 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4e280454-03dc-41d7-b7c6-bed10be883d1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:16.014463 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4e280454-03dc-41d7-b7c6-bed10be883d1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:16.015152 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4e280454-03dc-41d7-b7c6-bed10be883d1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:16.015646 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4e280454-03dc-41d7-b7c6-bed10be883d1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:16.016076 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4e280454-03dc-41d7-b7c6-bed10be883d1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:16.079254 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4e280454-03dc-41d7-b7c6-bed10be883d1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:16.088156 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4e280454-03dc-41d7-b7c6-bed10be883d1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.086360 Oct 11 07:05:16.088719 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1516/3028] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:16 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:17.110033 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d310fc55-e4fd-49b6-b955-32b32a304fc9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:17.110640 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d310fc55-e4fd-49b6-b955-32b32a304fc9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:17.116986 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d310fc55-e4fd-49b6-b955-32b32a304fc9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:17.117461 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d310fc55-e4fd-49b6-b955-32b32a304fc9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:17.117888 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d310fc55-e4fd-49b6-b955-32b32a304fc9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:17.118571 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d310fc55-e4fd-49b6-b955-32b32a304fc9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:17.119013 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d310fc55-e4fd-49b6-b955-32b32a304fc9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:17.119451 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d310fc55-e4fd-49b6-b955-32b32a304fc9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:17.181513 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d310fc55-e4fd-49b6-b955-32b32a304fc9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:17.189454 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d310fc55-e4fd-49b6-b955-32b32a304fc9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083287 Oct 11 07:05:17.190007 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1513/3029] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:17 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:18.212270 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9a164e98-7996-4ed0-a15f-138cdabab7c9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:18.212824 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9a164e98-7996-4ed0-a15f-138cdabab7c9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:18.219444 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9a164e98-7996-4ed0-a15f-138cdabab7c9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:18.219922 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9a164e98-7996-4ed0-a15f-138cdabab7c9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:18.220352 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9a164e98-7996-4ed0-a15f-138cdabab7c9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:18.221033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9a164e98-7996-4ed0-a15f-138cdabab7c9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:18.221475 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9a164e98-7996-4ed0-a15f-138cdabab7c9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:18.221899 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9a164e98-7996-4ed0-a15f-138cdabab7c9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:18.224517 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=84 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:05:18.283574 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9a164e98-7996-4ed0-a15f-138cdabab7c9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:18.291614 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9a164e98-7996-4ed0-a15f-138cdabab7c9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083883 Oct 11 07:05:18.292169 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1517/3030] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:18 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:19.222716 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-415c206d-8cc0-4508-a053-503b0f74b85f req-0ce216c9-4cf2-448c-aef7-74c244dc5018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2ce136a-30ab-4986-931e-5af38b37875e", "name": "network-vif-deleted", "tag": "3280a926-f599-464d-a89c-2446cca4d1a4"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:05:19.234038 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-415c206d-8cc0-4508-a053-503b0f74b85f req-0ce216c9-4cf2-448c-aef7-74c244dc5018 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:19.234506 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-415c206d-8cc0-4508-a053-503b0f74b85f req-0ce216c9-4cf2-448c-aef7-74c244dc5018 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:19.234936 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-415c206d-8cc0-4508-a053-503b0f74b85f req-0ce216c9-4cf2-448c-aef7-74c244dc5018 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:19.246215 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-415c206d-8cc0-4508-a053-503b0f74b85f req-0ce216c9-4cf2-448c-aef7-74c244dc5018 service nova] Creating event network-vif-deleted:3280a926-f599-464d-a89c-2446cca4d1a4 for instance a2ce136a-30ab-4986-931e-5af38b37875e on hv-cinder-85495 Oct 11 07:05:19.253084 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-415c206d-8cc0-4508-a053-503b0f74b85f req-0ce216c9-4cf2-448c-aef7-74c244dc5018 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033103 Oct 11 07:05:19.253668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1514/3031] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:05:19.313897 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8f84aeb3-b85b-46a6-b85d-9b4974d3beff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:19.314527 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8f84aeb3-b85b-46a6-b85d-9b4974d3beff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:19.321263 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f84aeb3-b85b-46a6-b85d-9b4974d3beff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:19.321817 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f84aeb3-b85b-46a6-b85d-9b4974d3beff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:19.322245 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f84aeb3-b85b-46a6-b85d-9b4974d3beff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:19.322934 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f84aeb3-b85b-46a6-b85d-9b4974d3beff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:19.323381 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f84aeb3-b85b-46a6-b85d-9b4974d3beff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:19.323835 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f84aeb3-b85b-46a6-b85d-9b4974d3beff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:19.383879 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8f84aeb3-b85b-46a6-b85d-9b4974d3beff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:19.392176 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8f84aeb3-b85b-46a6-b85d-9b4974d3beff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082166 Oct 11 07:05:19.392725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1518/3032] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:19 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:20.416323 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8a6354fd-87fa-4607-b95e-73abf696fcb5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:20.417009 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8a6354fd-87fa-4607-b95e-73abf696fcb5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:20.423574 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8a6354fd-87fa-4607-b95e-73abf696fcb5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:20.424048 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8a6354fd-87fa-4607-b95e-73abf696fcb5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:20.424475 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8a6354fd-87fa-4607-b95e-73abf696fcb5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:20.425156 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8a6354fd-87fa-4607-b95e-73abf696fcb5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:20.425601 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8a6354fd-87fa-4607-b95e-73abf696fcb5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:20.426017 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8a6354fd-87fa-4607-b95e-73abf696fcb5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:20.485931 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8a6354fd-87fa-4607-b95e-73abf696fcb5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:20.494538 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8a6354fd-87fa-4607-b95e-73abf696fcb5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082944 Oct 11 07:05:20.495085 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1515/3033] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:20 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:21.517567 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-87489ff5-83b2-4ecc-bb8c-902d3299ac7f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:21.518169 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-87489ff5-83b2-4ecc-bb8c-902d3299ac7f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:21.524086 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-87489ff5-83b2-4ecc-bb8c-902d3299ac7f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:21.524555 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-87489ff5-83b2-4ecc-bb8c-902d3299ac7f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:21.524979 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-87489ff5-83b2-4ecc-bb8c-902d3299ac7f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:21.525650 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-87489ff5-83b2-4ecc-bb8c-902d3299ac7f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:21.526090 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-87489ff5-83b2-4ecc-bb8c-902d3299ac7f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:21.526506 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-87489ff5-83b2-4ecc-bb8c-902d3299ac7f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:21.586287 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-87489ff5-83b2-4ecc-bb8c-902d3299ac7f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:21.594244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-87489ff5-83b2-4ecc-bb8c-902d3299ac7f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.080712 Oct 11 07:05:21.594787 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1519/3034] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:21 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:22.616400 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-41f832bf-70b3-4bec-862e-2a148c4d1266 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:22.617029 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-41f832bf-70b3-4bec-862e-2a148c4d1266 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:22.623330 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41f832bf-70b3-4bec-862e-2a148c4d1266 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:22.623827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41f832bf-70b3-4bec-862e-2a148c4d1266 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:22.624250 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41f832bf-70b3-4bec-862e-2a148c4d1266 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:22.624921 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41f832bf-70b3-4bec-862e-2a148c4d1266 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:22.625364 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41f832bf-70b3-4bec-862e-2a148c4d1266 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:22.625774 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41f832bf-70b3-4bec-862e-2a148c4d1266 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:22.688186 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-41f832bf-70b3-4bec-862e-2a148c4d1266 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:22.696635 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-41f832bf-70b3-4bec-862e-2a148c4d1266 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.084057 Oct 11 07:05:22.697183 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1516/3035] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:22 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:23.718677 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-322cdeab-25d0-41fc-b718-edfa0a63ceb4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:23.719288 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-322cdeab-25d0-41fc-b718-edfa0a63ceb4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:23.725872 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-322cdeab-25d0-41fc-b718-edfa0a63ceb4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:23.726358 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-322cdeab-25d0-41fc-b718-edfa0a63ceb4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:23.726794 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-322cdeab-25d0-41fc-b718-edfa0a63ceb4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:23.727502 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-322cdeab-25d0-41fc-b718-edfa0a63ceb4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:23.727956 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-322cdeab-25d0-41fc-b718-edfa0a63ceb4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:23.728378 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-322cdeab-25d0-41fc-b718-edfa0a63ceb4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:23.790227 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-322cdeab-25d0-41fc-b718-edfa0a63ceb4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:23.798255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-322cdeab-25d0-41fc-b718-edfa0a63ceb4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083392 Oct 11 07:05:23.798802 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1520/3036] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:23 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:24.821113 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-632d9485-ff4f-44a8-85a6-8293f2378419 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:24.821665 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-632d9485-ff4f-44a8-85a6-8293f2378419 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:24.828185 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-632d9485-ff4f-44a8-85a6-8293f2378419 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:24.828662 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-632d9485-ff4f-44a8-85a6-8293f2378419 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:24.829095 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-632d9485-ff4f-44a8-85a6-8293f2378419 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:24.829778 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-632d9485-ff4f-44a8-85a6-8293f2378419 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:24.830225 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-632d9485-ff4f-44a8-85a6-8293f2378419 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:24.830644 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-632d9485-ff4f-44a8-85a6-8293f2378419 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:24.834664 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=86 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:05:24.891041 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-632d9485-ff4f-44a8-85a6-8293f2378419 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:24.899266 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-632d9485-ff4f-44a8-85a6-8293f2378419 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082048 Oct 11 07:05:24.899851 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1517/3037] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:24 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:25.924563 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6169d67a-d959-400e-8202-2d1cc88e16d5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:25.925170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6169d67a-d959-400e-8202-2d1cc88e16d5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:25.932234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6169d67a-d959-400e-8202-2d1cc88e16d5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:25.932712 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6169d67a-d959-400e-8202-2d1cc88e16d5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:25.933136 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6169d67a-d959-400e-8202-2d1cc88e16d5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:25.933812 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6169d67a-d959-400e-8202-2d1cc88e16d5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:25.934253 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6169d67a-d959-400e-8202-2d1cc88e16d5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:25.934668 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6169d67a-d959-400e-8202-2d1cc88e16d5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:25.997468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6169d67a-d959-400e-8202-2d1cc88e16d5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:26.005380 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6169d67a-d959-400e-8202-2d1cc88e16d5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085727 Oct 11 07:05:26.005993 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1521/3038] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:25 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:27.029372 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b9a57c3a-4278-4198-8641-ae6404743c2e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:27.029975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b9a57c3a-4278-4198-8641-ae6404743c2e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:27.036647 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b9a57c3a-4278-4198-8641-ae6404743c2e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:27.037120 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b9a57c3a-4278-4198-8641-ae6404743c2e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:27.037548 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b9a57c3a-4278-4198-8641-ae6404743c2e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:27.038229 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b9a57c3a-4278-4198-8641-ae6404743c2e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:27.038675 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b9a57c3a-4278-4198-8641-ae6404743c2e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:27.039086 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b9a57c3a-4278-4198-8641-ae6404743c2e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:27.098436 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b9a57c3a-4278-4198-8641-ae6404743c2e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:27.106441 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b9a57c3a-4278-4198-8641-ae6404743c2e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081505 Oct 11 07:05:27.106992 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1518/3039] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:27 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:28.129099 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-96922df1-6ac4-46d6-9e51-135e7acb2521 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:28.129710 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-96922df1-6ac4-46d6-9e51-135e7acb2521 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:28.137371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96922df1-6ac4-46d6-9e51-135e7acb2521 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:28.137852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96922df1-6ac4-46d6-9e51-135e7acb2521 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:28.138286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96922df1-6ac4-46d6-9e51-135e7acb2521 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:28.138993 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96922df1-6ac4-46d6-9e51-135e7acb2521 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:28.139451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96922df1-6ac4-46d6-9e51-135e7acb2521 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:28.139878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-96922df1-6ac4-46d6-9e51-135e7acb2521 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:28.201718 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-96922df1-6ac4-46d6-9e51-135e7acb2521 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:28.209888 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-96922df1-6ac4-46d6-9e51-135e7acb2521 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.084704 Oct 11 07:05:28.210445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1522/3040] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:28 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:29.232454 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-dc9d151c-6435-4ae3-83b5-054bc55f012e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:29.233060 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-dc9d151c-6435-4ae3-83b5-054bc55f012e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:29.235354 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=30 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:05:29.240657 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dc9d151c-6435-4ae3-83b5-054bc55f012e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:29.241132 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dc9d151c-6435-4ae3-83b5-054bc55f012e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:29.241563 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dc9d151c-6435-4ae3-83b5-054bc55f012e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:29.242251 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dc9d151c-6435-4ae3-83b5-054bc55f012e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:29.242698 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dc9d151c-6435-4ae3-83b5-054bc55f012e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:29.243116 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dc9d151c-6435-4ae3-83b5-054bc55f012e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:29.303804 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-dc9d151c-6435-4ae3-83b5-054bc55f012e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:29.312465 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-dc9d151c-6435-4ae3-83b5-054bc55f012e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083920 Oct 11 07:05:29.313018 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1519/3041] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:29 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:30.333912 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-68f9bbed-9bfb-489f-987c-7db108a59417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:30.334539 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-68f9bbed-9bfb-489f-987c-7db108a59417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:30.341533 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-68f9bbed-9bfb-489f-987c-7db108a59417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:30.342028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-68f9bbed-9bfb-489f-987c-7db108a59417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:30.342449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-68f9bbed-9bfb-489f-987c-7db108a59417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:30.343120 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-68f9bbed-9bfb-489f-987c-7db108a59417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:30.343589 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-68f9bbed-9bfb-489f-987c-7db108a59417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:30.344004 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-68f9bbed-9bfb-489f-987c-7db108a59417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:30.403880 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-68f9bbed-9bfb-489f-987c-7db108a59417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:30.412413 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-68f9bbed-9bfb-489f-987c-7db108a59417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082309 Oct 11 07:05:30.413021 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1523/3042] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:30 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:31.434919 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bcf5f3c8-af47-4917-b628-182641357389 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:31.435541 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bcf5f3c8-af47-4917-b628-182641357389 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:31.441958 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bcf5f3c8-af47-4917-b628-182641357389 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:31.442427 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bcf5f3c8-af47-4917-b628-182641357389 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:31.442849 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bcf5f3c8-af47-4917-b628-182641357389 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:31.443552 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bcf5f3c8-af47-4917-b628-182641357389 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:31.443997 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bcf5f3c8-af47-4917-b628-182641357389 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:31.444413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bcf5f3c8-af47-4917-b628-182641357389 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:31.510848 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-bcf5f3c8-af47-4917-b628-182641357389 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:31.518978 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bcf5f3c8-af47-4917-b628-182641357389 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.088357 Oct 11 07:05:31.519559 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1520/3043] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:31 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:32.541102 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6d9a6d15-57f1-4399-95ce-bf7d2ac2e4a3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:32.541776 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6d9a6d15-57f1-4399-95ce-bf7d2ac2e4a3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:32.548202 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6d9a6d15-57f1-4399-95ce-bf7d2ac2e4a3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:32.548676 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6d9a6d15-57f1-4399-95ce-bf7d2ac2e4a3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:32.549106 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6d9a6d15-57f1-4399-95ce-bf7d2ac2e4a3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:32.549786 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6d9a6d15-57f1-4399-95ce-bf7d2ac2e4a3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:32.550233 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6d9a6d15-57f1-4399-95ce-bf7d2ac2e4a3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:32.550649 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6d9a6d15-57f1-4399-95ce-bf7d2ac2e4a3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:32.611225 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6d9a6d15-57f1-4399-95ce-bf7d2ac2e4a3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:32.619310 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6d9a6d15-57f1-4399-95ce-bf7d2ac2e4a3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082065 Oct 11 07:05:32.620434 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1524/3044] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:32 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:33.642356 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-be3796d2-5cd4-426d-a39f-f7bac05aeee6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:33.642965 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-be3796d2-5cd4-426d-a39f-f7bac05aeee6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:33.649470 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-be3796d2-5cd4-426d-a39f-f7bac05aeee6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:33.649952 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-be3796d2-5cd4-426d-a39f-f7bac05aeee6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:33.650386 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-be3796d2-5cd4-426d-a39f-f7bac05aeee6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:33.651603 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-be3796d2-5cd4-426d-a39f-f7bac05aeee6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:33.652059 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-be3796d2-5cd4-426d-a39f-f7bac05aeee6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:33.652483 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-be3796d2-5cd4-426d-a39f-f7bac05aeee6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:33.712914 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-be3796d2-5cd4-426d-a39f-f7bac05aeee6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:33.721673 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-be3796d2-5cd4-426d-a39f-f7bac05aeee6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083193 Oct 11 07:05:33.722235 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1521/3045] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:33 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:34.744623 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7f14f9c1-e4a2-4847-9830-235e0146e079 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:34.745210 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7f14f9c1-e4a2-4847-9830-235e0146e079 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:34.752330 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7f14f9c1-e4a2-4847-9830-235e0146e079 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:34.752803 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7f14f9c1-e4a2-4847-9830-235e0146e079 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:34.753233 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7f14f9c1-e4a2-4847-9830-235e0146e079 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:34.753915 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7f14f9c1-e4a2-4847-9830-235e0146e079 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:34.754365 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7f14f9c1-e4a2-4847-9830-235e0146e079 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:34.754783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7f14f9c1-e4a2-4847-9830-235e0146e079 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:34.817956 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7f14f9c1-e4a2-4847-9830-235e0146e079 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:34.826035 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7f14f9c1-e4a2-4847-9830-235e0146e079 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085283 Oct 11 07:05:34.826593 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1525/3046] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:34 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:35.848847 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ab9d73eb-846e-4d14-bbf5-180e4354370a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:35.849458 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ab9d73eb-846e-4d14-bbf5-180e4354370a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:35.856484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ab9d73eb-846e-4d14-bbf5-180e4354370a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:35.856958 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ab9d73eb-846e-4d14-bbf5-180e4354370a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:35.857388 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ab9d73eb-846e-4d14-bbf5-180e4354370a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:35.858071 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ab9d73eb-846e-4d14-bbf5-180e4354370a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:35.858516 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ab9d73eb-846e-4d14-bbf5-180e4354370a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:35.858933 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ab9d73eb-846e-4d14-bbf5-180e4354370a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:35.918832 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ab9d73eb-846e-4d14-bbf5-180e4354370a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:35.926867 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ab9d73eb-846e-4d14-bbf5-180e4354370a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081868 Oct 11 07:05:35.927439 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1522/3047] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:35 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:36.949056 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-06d1d61e-8614-4773-98b4-7e9799a70c26 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:36.949642 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-06d1d61e-8614-4773-98b4-7e9799a70c26 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:36.956704 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-06d1d61e-8614-4773-98b4-7e9799a70c26 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:36.957178 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-06d1d61e-8614-4773-98b4-7e9799a70c26 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:36.957604 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-06d1d61e-8614-4773-98b4-7e9799a70c26 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:36.958285 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-06d1d61e-8614-4773-98b4-7e9799a70c26 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:36.958729 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-06d1d61e-8614-4773-98b4-7e9799a70c26 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:36.959146 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-06d1d61e-8614-4773-98b4-7e9799a70c26 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:37.018870 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-06d1d61e-8614-4773-98b4-7e9799a70c26 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:37.026891 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-06d1d61e-8614-4773-98b4-7e9799a70c26 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081672 Oct 11 07:05:37.027464 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1526/3048] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:36 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:38.049647 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b10bbd75-2163-463b-9a99-af436fe11bb9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:38.050280 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b10bbd75-2163-463b-9a99-af436fe11bb9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:38.056597 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b10bbd75-2163-463b-9a99-af436fe11bb9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:38.057070 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b10bbd75-2163-463b-9a99-af436fe11bb9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:38.057494 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b10bbd75-2163-463b-9a99-af436fe11bb9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:38.058172 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b10bbd75-2163-463b-9a99-af436fe11bb9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:38.058614 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b10bbd75-2163-463b-9a99-af436fe11bb9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:38.059025 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b10bbd75-2163-463b-9a99-af436fe11bb9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:38.123974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b10bbd75-2163-463b-9a99-af436fe11bb9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:38.132016 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b10bbd75-2163-463b-9a99-af436fe11bb9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.086197 Oct 11 07:05:38.132571 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1523/3049] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:38 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:39.155335 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2f0e1769-00a3-4a82-97e9-69fdcfe6e7d6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:39.155967 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2f0e1769-00a3-4a82-97e9-69fdcfe6e7d6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:39.162242 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f0e1769-00a3-4a82-97e9-69fdcfe6e7d6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:39.162710 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f0e1769-00a3-4a82-97e9-69fdcfe6e7d6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:39.163136 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f0e1769-00a3-4a82-97e9-69fdcfe6e7d6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:39.163839 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f0e1769-00a3-4a82-97e9-69fdcfe6e7d6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:39.164281 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f0e1769-00a3-4a82-97e9-69fdcfe6e7d6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:39.164692 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f0e1769-00a3-4a82-97e9-69fdcfe6e7d6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:39.224629 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2f0e1769-00a3-4a82-97e9-69fdcfe6e7d6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:39.233200 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2f0e1769-00a3-4a82-97e9-69fdcfe6e7d6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081842 Oct 11 07:05:39.233765 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1527/3050] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:39 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:40.256828 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2df24631-b4cb-4c94-a22b-cf5885ee99db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:40.257419 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2df24631-b4cb-4c94-a22b-cf5885ee99db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:40.264629 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2df24631-b4cb-4c94-a22b-cf5885ee99db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:40.265098 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2df24631-b4cb-4c94-a22b-cf5885ee99db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:40.265526 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2df24631-b4cb-4c94-a22b-cf5885ee99db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:40.266201 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2df24631-b4cb-4c94-a22b-cf5885ee99db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:40.266649 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2df24631-b4cb-4c94-a22b-cf5885ee99db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:40.267059 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2df24631-b4cb-4c94-a22b-cf5885ee99db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:40.330336 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2df24631-b4cb-4c94-a22b-cf5885ee99db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:40.338389 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2df24631-b4cb-4c94-a22b-cf5885ee99db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085377 Oct 11 07:05:40.339274 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1524/3051] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:40 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:41.360921 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2ae0d61a-5e6f-4942-a67d-829fd44f6682 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:41.361505 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2ae0d61a-5e6f-4942-a67d-829fd44f6682 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:41.367963 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ae0d61a-5e6f-4942-a67d-829fd44f6682 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:41.368438 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ae0d61a-5e6f-4942-a67d-829fd44f6682 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:41.368865 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ae0d61a-5e6f-4942-a67d-829fd44f6682 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:41.369549 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ae0d61a-5e6f-4942-a67d-829fd44f6682 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:41.369993 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ae0d61a-5e6f-4942-a67d-829fd44f6682 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:41.370408 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ae0d61a-5e6f-4942-a67d-829fd44f6682 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:41.433042 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2ae0d61a-5e6f-4942-a67d-829fd44f6682 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:41.441182 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2ae0d61a-5e6f-4942-a67d-829fd44f6682 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.084116 Oct 11 07:05:41.441739 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1528/3052] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:41 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:42.464162 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-88f32db9-49b0-46a7-b5bb-7e085ef77574 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:42.464769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-88f32db9-49b0-46a7-b5bb-7e085ef77574 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:42.471679 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-88f32db9-49b0-46a7-b5bb-7e085ef77574 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:42.472156 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-88f32db9-49b0-46a7-b5bb-7e085ef77574 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:42.472587 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-88f32db9-49b0-46a7-b5bb-7e085ef77574 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:42.473271 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-88f32db9-49b0-46a7-b5bb-7e085ef77574 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:42.473721 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-88f32db9-49b0-46a7-b5bb-7e085ef77574 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:42.474143 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-88f32db9-49b0-46a7-b5bb-7e085ef77574 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:42.534089 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-88f32db9-49b0-46a7-b5bb-7e085ef77574 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:42.542079 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-88f32db9-49b0-46a7-b5bb-7e085ef77574 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081778 Oct 11 07:05:42.542631 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1525/3053] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:42 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:43.565419 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2911036c-7ee3-420a-8de6-61c906fe92be tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:43.566023 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2911036c-7ee3-420a-8de6-61c906fe92be tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:43.572471 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2911036c-7ee3-420a-8de6-61c906fe92be tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:43.572940 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2911036c-7ee3-420a-8de6-61c906fe92be tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:43.573364 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2911036c-7ee3-420a-8de6-61c906fe92be tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:43.574038 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2911036c-7ee3-420a-8de6-61c906fe92be tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:43.574479 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2911036c-7ee3-420a-8de6-61c906fe92be tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:43.574896 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2911036c-7ee3-420a-8de6-61c906fe92be tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:43.637228 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2911036c-7ee3-420a-8de6-61c906fe92be tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:43.645391 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2911036c-7ee3-420a-8de6-61c906fe92be tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083791 Oct 11 07:05:43.645948 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1529/3054] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:43 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:44.667969 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-96d336ba-80da-4a9d-b149-52cec9a8f948 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:44.668507 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-96d336ba-80da-4a9d-b149-52cec9a8f948 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:44.674909 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-96d336ba-80da-4a9d-b149-52cec9a8f948 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:44.675391 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-96d336ba-80da-4a9d-b149-52cec9a8f948 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:44.675852 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-96d336ba-80da-4a9d-b149-52cec9a8f948 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:44.676567 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-96d336ba-80da-4a9d-b149-52cec9a8f948 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:44.677018 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-96d336ba-80da-4a9d-b149-52cec9a8f948 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:44.677437 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-96d336ba-80da-4a9d-b149-52cec9a8f948 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:44.739050 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-96d336ba-80da-4a9d-b149-52cec9a8f948 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:44.747109 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-96d336ba-80da-4a9d-b149-52cec9a8f948 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083067 Oct 11 07:05:44.748197 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1526/3055] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:44 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:45.770187 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-486c0b93-4d42-4f68-b503-2b067b56cf6d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:45.770721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-486c0b93-4d42-4f68-b503-2b067b56cf6d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:45.773419 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=30 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:05:45.778643 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-486c0b93-4d42-4f68-b503-2b067b56cf6d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:45.779711 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-486c0b93-4d42-4f68-b503-2b067b56cf6d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:45.780143 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-486c0b93-4d42-4f68-b503-2b067b56cf6d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:45.780822 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-486c0b93-4d42-4f68-b503-2b067b56cf6d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:45.781265 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-486c0b93-4d42-4f68-b503-2b067b56cf6d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:45.781682 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-486c0b93-4d42-4f68-b503-2b067b56cf6d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:45.842195 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-486c0b93-4d42-4f68-b503-2b067b56cf6d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:45.850220 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-486c0b93-4d42-4f68-b503-2b067b56cf6d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083986 Oct 11 07:05:45.850770 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1530/3056] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:45 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:46.872198 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-29e3628f-dc9f-409f-82a3-c8e9d684d295 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:46.872833 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-29e3628f-dc9f-409f-82a3-c8e9d684d295 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:46.879636 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-29e3628f-dc9f-409f-82a3-c8e9d684d295 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:46.880124 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-29e3628f-dc9f-409f-82a3-c8e9d684d295 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:46.880552 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-29e3628f-dc9f-409f-82a3-c8e9d684d295 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:46.881230 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-29e3628f-dc9f-409f-82a3-c8e9d684d295 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:46.881672 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-29e3628f-dc9f-409f-82a3-c8e9d684d295 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:46.882085 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-29e3628f-dc9f-409f-82a3-c8e9d684d295 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:47.093956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-29e3628f-dc9f-409f-82a3-c8e9d684d295 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:47.102130 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-29e3628f-dc9f-409f-82a3-c8e9d684d295 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.233737 Oct 11 07:05:47.102674 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1527/3057] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:46 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:48.126097 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-10be9c5d-048e-4981-95e6-78c9364a5417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:48.126695 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-10be9c5d-048e-4981-95e6-78c9364a5417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:48.133197 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-10be9c5d-048e-4981-95e6-78c9364a5417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:48.133931 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-10be9c5d-048e-4981-95e6-78c9364a5417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:48.134377 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-10be9c5d-048e-4981-95e6-78c9364a5417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:48.135062 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-10be9c5d-048e-4981-95e6-78c9364a5417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:48.135539 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-10be9c5d-048e-4981-95e6-78c9364a5417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:48.135966 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-10be9c5d-048e-4981-95e6-78c9364a5417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:48.195871 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-10be9c5d-048e-4981-95e6-78c9364a5417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:48.204414 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-10be9c5d-048e-4981-95e6-78c9364a5417 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082220 Oct 11 07:05:48.204970 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1531/3058] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:48 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:49.227172 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-854b9b9e-703b-41bd-90c2-1116420db670 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:49.227845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-854b9b9e-703b-41bd-90c2-1116420db670 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:49.234498 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-854b9b9e-703b-41bd-90c2-1116420db670 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:49.234990 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-854b9b9e-703b-41bd-90c2-1116420db670 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:49.235433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-854b9b9e-703b-41bd-90c2-1116420db670 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:49.236117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-854b9b9e-703b-41bd-90c2-1116420db670 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:49.236560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-854b9b9e-703b-41bd-90c2-1116420db670 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:49.236972 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-854b9b9e-703b-41bd-90c2-1116420db670 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:49.299335 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-854b9b9e-703b-41bd-90c2-1116420db670 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:49.307392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-854b9b9e-703b-41bd-90c2-1116420db670 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.084037 Oct 11 07:05:49.307948 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1528/3059] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:49 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:50.329339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b49fdc94-0bf9-4c3d-999e-a75dabcd214e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:50.329871 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b49fdc94-0bf9-4c3d-999e-a75dabcd214e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:50.336213 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b49fdc94-0bf9-4c3d-999e-a75dabcd214e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:50.336686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b49fdc94-0bf9-4c3d-999e-a75dabcd214e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:50.337115 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b49fdc94-0bf9-4c3d-999e-a75dabcd214e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:50.337794 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b49fdc94-0bf9-4c3d-999e-a75dabcd214e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:50.338240 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b49fdc94-0bf9-4c3d-999e-a75dabcd214e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:50.338666 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b49fdc94-0bf9-4c3d-999e-a75dabcd214e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:50.341174 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=90 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:05:50.405033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b49fdc94-0bf9-4c3d-999e-a75dabcd214e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:50.413457 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b49fdc94-0bf9-4c3d-999e-a75dabcd214e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.087985 Oct 11 07:05:50.414019 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1532/3060] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:50 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:51.436762 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-460906f3-c355-4be2-ba2c-16701a186693 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:51.437372 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-460906f3-c355-4be2-ba2c-16701a186693 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:51.444017 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-460906f3-c355-4be2-ba2c-16701a186693 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:51.444497 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-460906f3-c355-4be2-ba2c-16701a186693 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:51.444930 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-460906f3-c355-4be2-ba2c-16701a186693 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:51.445617 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-460906f3-c355-4be2-ba2c-16701a186693 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:51.446067 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-460906f3-c355-4be2-ba2c-16701a186693 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:51.446488 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-460906f3-c355-4be2-ba2c-16701a186693 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:51.506040 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-460906f3-c355-4be2-ba2c-16701a186693 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:51.515110 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-460906f3-c355-4be2-ba2c-16701a186693 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082763 Oct 11 07:05:51.515699 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1529/3061] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:51 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:52.537569 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9db35630-de25-4a59-9c51-885a4bff6e26 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:52.538202 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9db35630-de25-4a59-9c51-885a4bff6e26 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:52.544106 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9db35630-de25-4a59-9c51-885a4bff6e26 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:52.544582 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9db35630-de25-4a59-9c51-885a4bff6e26 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:52.545584 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9db35630-de25-4a59-9c51-885a4bff6e26 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:52.546266 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9db35630-de25-4a59-9c51-885a4bff6e26 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:52.546745 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9db35630-de25-4a59-9c51-885a4bff6e26 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:52.547169 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9db35630-de25-4a59-9c51-885a4bff6e26 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:52.609547 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9db35630-de25-4a59-9c51-885a4bff6e26 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:52.617572 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9db35630-de25-4a59-9c51-885a4bff6e26 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083970 Oct 11 07:05:52.618125 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1533/3062] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:52 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:53.639922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-420b7f62-7d91-414f-9fe1-9d8dcea836db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:53.640520 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-420b7f62-7d91-414f-9fe1-9d8dcea836db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:53.646869 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-420b7f62-7d91-414f-9fe1-9d8dcea836db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:53.647339 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-420b7f62-7d91-414f-9fe1-9d8dcea836db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:53.647793 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-420b7f62-7d91-414f-9fe1-9d8dcea836db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:53.648505 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-420b7f62-7d91-414f-9fe1-9d8dcea836db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:53.648951 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-420b7f62-7d91-414f-9fe1-9d8dcea836db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:53.649363 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-420b7f62-7d91-414f-9fe1-9d8dcea836db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:53.708975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-420b7f62-7d91-414f-9fe1-9d8dcea836db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:53.717609 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-420b7f62-7d91-414f-9fe1-9d8dcea836db tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081551 Oct 11 07:05:53.718157 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1530/3063] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:53 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:54.740701 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-44cd1173-1791-4b60-9685-554d61942463 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:54.741252 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-44cd1173-1791-4b60-9685-554d61942463 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:54.747652 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-44cd1173-1791-4b60-9685-554d61942463 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:54.748123 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-44cd1173-1791-4b60-9685-554d61942463 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:54.748550 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-44cd1173-1791-4b60-9685-554d61942463 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:54.749228 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-44cd1173-1791-4b60-9685-554d61942463 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:54.749694 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-44cd1173-1791-4b60-9685-554d61942463 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:54.750107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-44cd1173-1791-4b60-9685-554d61942463 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:54.811389 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-44cd1173-1791-4b60-9685-554d61942463 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:54.819532 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-44cd1173-1791-4b60-9685-554d61942463 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082688 Oct 11 07:05:54.820080 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1534/3064] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:54 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:55.842284 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-032d9d83-35cb-4e20-b940-34f2df0ce86c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:55.842803 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-032d9d83-35cb-4e20-b940-34f2df0ce86c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:55.849190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-032d9d83-35cb-4e20-b940-34f2df0ce86c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:55.849668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-032d9d83-35cb-4e20-b940-34f2df0ce86c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:55.850096 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-032d9d83-35cb-4e20-b940-34f2df0ce86c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:55.850781 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-032d9d83-35cb-4e20-b940-34f2df0ce86c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:55.851300 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-032d9d83-35cb-4e20-b940-34f2df0ce86c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:55.851744 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-032d9d83-35cb-4e20-b940-34f2df0ce86c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:55.855560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=84 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:05:55.912799 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-032d9d83-35cb-4e20-b940-34f2df0ce86c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:55.920904 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-032d9d83-35cb-4e20-b940-34f2df0ce86c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082554 Oct 11 07:05:55.921460 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1531/3065] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:55 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:56.943714 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b536a55c-11ed-4a16-9e9d-161d28d06ec6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:56.944350 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b536a55c-11ed-4a16-9e9d-161d28d06ec6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:56.951235 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b536a55c-11ed-4a16-9e9d-161d28d06ec6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:56.951890 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b536a55c-11ed-4a16-9e9d-161d28d06ec6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:56.952315 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b536a55c-11ed-4a16-9e9d-161d28d06ec6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:56.953021 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b536a55c-11ed-4a16-9e9d-161d28d06ec6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:56.953464 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b536a55c-11ed-4a16-9e9d-161d28d06ec6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:56.953877 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b536a55c-11ed-4a16-9e9d-161d28d06ec6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:57.015814 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b536a55c-11ed-4a16-9e9d-161d28d06ec6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:57.023826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b536a55c-11ed-4a16-9e9d-161d28d06ec6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083964 Oct 11 07:05:57.024396 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1535/3066] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:56 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:58.046865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-19146cab-6204-4485-830f-8ca592fffc99 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:58.047506 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-19146cab-6204-4485-830f-8ca592fffc99 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:58.054058 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-19146cab-6204-4485-830f-8ca592fffc99 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:58.054539 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-19146cab-6204-4485-830f-8ca592fffc99 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:58.054976 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-19146cab-6204-4485-830f-8ca592fffc99 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:58.055696 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-19146cab-6204-4485-830f-8ca592fffc99 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:58.056147 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-19146cab-6204-4485-830f-8ca592fffc99 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:58.056565 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-19146cab-6204-4485-830f-8ca592fffc99 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:58.119508 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-19146cab-6204-4485-830f-8ca592fffc99 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:58.130459 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-19146cab-6204-4485-830f-8ca592fffc99 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.087140 Oct 11 07:05:58.131057 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1532/3067] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:58 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:05:59.153841 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-026eddf0-b064-4292-b92f-d8096d31b3a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:05:59.154460 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-026eddf0-b064-4292-b92f-d8096d31b3a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:05:59.161064 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-026eddf0-b064-4292-b92f-d8096d31b3a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:59.161528 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-026eddf0-b064-4292-b92f-d8096d31b3a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:59.161948 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-026eddf0-b064-4292-b92f-d8096d31b3a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:59.162617 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-026eddf0-b064-4292-b92f-d8096d31b3a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:05:59.163058 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-026eddf0-b064-4292-b92f-d8096d31b3a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:05:59.163488 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-026eddf0-b064-4292-b92f-d8096d31b3a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:05:59.223236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-026eddf0-b064-4292-b92f-d8096d31b3a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:05:59.231360 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-026eddf0-b064-4292-b92f-d8096d31b3a4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081279 Oct 11 07:05:59.232565 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1536/3068] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:05:59 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:00.254628 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5b03a311-cc25-4085-a74f-9129fce6508d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:00.255258 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5b03a311-cc25-4085-a74f-9129fce6508d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:00.257552 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=28 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:06:00.262934 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b03a311-cc25-4085-a74f-9129fce6508d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:00.264015 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b03a311-cc25-4085-a74f-9129fce6508d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:00.264443 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b03a311-cc25-4085-a74f-9129fce6508d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:00.265121 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b03a311-cc25-4085-a74f-9129fce6508d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:00.265568 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b03a311-cc25-4085-a74f-9129fce6508d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:00.265985 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b03a311-cc25-4085-a74f-9129fce6508d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:00.327620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5b03a311-cc25-4085-a74f-9129fce6508d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:00.335749 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5b03a311-cc25-4085-a74f-9129fce6508d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.084933 Oct 11 07:06:00.336299 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1533/3069] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:00 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:01.358138 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bab5d81b-6c23-4677-810d-c0f0d7e97f99 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:01.358749 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bab5d81b-6c23-4677-810d-c0f0d7e97f99 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:01.365279 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bab5d81b-6c23-4677-810d-c0f0d7e97f99 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:01.365757 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bab5d81b-6c23-4677-810d-c0f0d7e97f99 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:01.366189 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bab5d81b-6c23-4677-810d-c0f0d7e97f99 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:01.366874 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bab5d81b-6c23-4677-810d-c0f0d7e97f99 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:01.367328 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bab5d81b-6c23-4677-810d-c0f0d7e97f99 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:01.367783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bab5d81b-6c23-4677-810d-c0f0d7e97f99 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:01.431384 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bab5d81b-6c23-4677-810d-c0f0d7e97f99 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:01.439703 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bab5d81b-6c23-4677-810d-c0f0d7e97f99 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085948 Oct 11 07:06:01.440263 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1537/3070] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:01 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:02.463331 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0110931e-2267-4e8c-aeca-0ee725cdc4ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:02.464040 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0110931e-2267-4e8c-aeca-0ee725cdc4ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:02.470351 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0110931e-2267-4e8c-aeca-0ee725cdc4ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:02.470827 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0110931e-2267-4e8c-aeca-0ee725cdc4ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:02.471260 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0110931e-2267-4e8c-aeca-0ee725cdc4ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:02.471979 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0110931e-2267-4e8c-aeca-0ee725cdc4ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:02.472429 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0110931e-2267-4e8c-aeca-0ee725cdc4ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:02.472850 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0110931e-2267-4e8c-aeca-0ee725cdc4ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:02.534186 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0110931e-2267-4e8c-aeca-0ee725cdc4ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:02.542441 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0110931e-2267-4e8c-aeca-0ee725cdc4ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083024 Oct 11 07:06:02.542983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1534/3071] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:02 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:03.565826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6738997b-69ed-434c-9231-5d82f4ab3e10 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:03.566432 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6738997b-69ed-434c-9231-5d82f4ab3e10 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:03.572926 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6738997b-69ed-434c-9231-5d82f4ab3e10 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:03.573403 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6738997b-69ed-434c-9231-5d82f4ab3e10 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:03.573834 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6738997b-69ed-434c-9231-5d82f4ab3e10 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:03.574517 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6738997b-69ed-434c-9231-5d82f4ab3e10 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:03.574966 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6738997b-69ed-434c-9231-5d82f4ab3e10 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:03.575384 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6738997b-69ed-434c-9231-5d82f4ab3e10 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:03.636225 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6738997b-69ed-434c-9231-5d82f4ab3e10 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:03.644327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6738997b-69ed-434c-9231-5d82f4ab3e10 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082355 Oct 11 07:06:03.644886 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1538/3072] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:03 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:04.666690 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ac40939c-6b77-46b8-ba26-20d685921072 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:04.667248 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ac40939c-6b77-46b8-ba26-20d685921072 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:04.673639 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ac40939c-6b77-46b8-ba26-20d685921072 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:04.674115 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ac40939c-6b77-46b8-ba26-20d685921072 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:04.674547 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ac40939c-6b77-46b8-ba26-20d685921072 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:04.675231 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ac40939c-6b77-46b8-ba26-20d685921072 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:04.675704 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ac40939c-6b77-46b8-ba26-20d685921072 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:04.676124 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ac40939c-6b77-46b8-ba26-20d685921072 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:04.735784 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ac40939c-6b77-46b8-ba26-20d685921072 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:04.743933 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ac40939c-6b77-46b8-ba26-20d685921072 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081142 Oct 11 07:06:04.744486 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1535/3073] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:04 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:05.768234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a2f39421-d5dc-4263-b7a2-b0ca9268393c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:05.768834 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a2f39421-d5dc-4263-b7a2-b0ca9268393c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:05.775126 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a2f39421-d5dc-4263-b7a2-b0ca9268393c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:05.775634 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a2f39421-d5dc-4263-b7a2-b0ca9268393c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:05.776060 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a2f39421-d5dc-4263-b7a2-b0ca9268393c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:05.776740 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a2f39421-d5dc-4263-b7a2-b0ca9268393c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:05.777180 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a2f39421-d5dc-4263-b7a2-b0ca9268393c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:05.777595 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a2f39421-d5dc-4263-b7a2-b0ca9268393c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:05.837778 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a2f39421-d5dc-4263-b7a2-b0ca9268393c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:05.845935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a2f39421-d5dc-4263-b7a2-b0ca9268393c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081563 Oct 11 07:06:05.846486 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1539/3074] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:05 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:06.868745 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-787b5a05-4f75-45af-8b40-642b41c8f034 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:06.869381 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-787b5a05-4f75-45af-8b40-642b41c8f034 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:06.875768 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-787b5a05-4f75-45af-8b40-642b41c8f034 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:06.876189 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-787b5a05-4f75-45af-8b40-642b41c8f034 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:06.876620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-787b5a05-4f75-45af-8b40-642b41c8f034 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:06.877304 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-787b5a05-4f75-45af-8b40-642b41c8f034 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:06.877757 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-787b5a05-4f75-45af-8b40-642b41c8f034 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:06.878174 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-787b5a05-4f75-45af-8b40-642b41c8f034 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:06.941264 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-787b5a05-4f75-45af-8b40-642b41c8f034 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:06.949514 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-787b5a05-4f75-45af-8b40-642b41c8f034 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.084687 Oct 11 07:06:06.950061 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1536/3075] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:06 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:07.972849 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-91ba422a-7380-4e5e-8ad0-9290c088f586 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:07.973451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-91ba422a-7380-4e5e-8ad0-9290c088f586 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:07.979893 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-91ba422a-7380-4e5e-8ad0-9290c088f586 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:07.980365 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-91ba422a-7380-4e5e-8ad0-9290c088f586 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:07.980794 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-91ba422a-7380-4e5e-8ad0-9290c088f586 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:07.981471 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-91ba422a-7380-4e5e-8ad0-9290c088f586 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:07.982494 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-91ba422a-7380-4e5e-8ad0-9290c088f586 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:07.982905 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-91ba422a-7380-4e5e-8ad0-9290c088f586 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:08.042932 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-91ba422a-7380-4e5e-8ad0-9290c088f586 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:08.051726 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-91ba422a-7380-4e5e-8ad0-9290c088f586 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082747 Oct 11 07:06:08.052274 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1540/3076] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:07 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:09.073371 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-303989a4-fe51-403a-abe6-f6bf5a9267ca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:09.073981 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-303989a4-fe51-403a-abe6-f6bf5a9267ca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:09.080994 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-303989a4-fe51-403a-abe6-f6bf5a9267ca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:09.081472 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-303989a4-fe51-403a-abe6-f6bf5a9267ca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:09.081924 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-303989a4-fe51-403a-abe6-f6bf5a9267ca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:09.082596 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-303989a4-fe51-403a-abe6-f6bf5a9267ca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:09.083049 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-303989a4-fe51-403a-abe6-f6bf5a9267ca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:09.083504 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-303989a4-fe51-403a-abe6-f6bf5a9267ca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:09.146078 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-303989a4-fe51-403a-abe6-f6bf5a9267ca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:09.154848 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-303989a4-fe51-403a-abe6-f6bf5a9267ca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085380 Oct 11 07:06:09.155401 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1537/3077] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:09 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:10.178161 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5779d03b-73f3-45b5-a3c6-7e125ea47b75 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:10.178753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5779d03b-73f3-45b5-a3c6-7e125ea47b75 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:10.185551 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5779d03b-73f3-45b5-a3c6-7e125ea47b75 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:10.186024 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5779d03b-73f3-45b5-a3c6-7e125ea47b75 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:10.186446 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5779d03b-73f3-45b5-a3c6-7e125ea47b75 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:10.187119 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5779d03b-73f3-45b5-a3c6-7e125ea47b75 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:10.187597 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5779d03b-73f3-45b5-a3c6-7e125ea47b75 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:10.188006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5779d03b-73f3-45b5-a3c6-7e125ea47b75 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:10.254278 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5779d03b-73f3-45b5-a3c6-7e125ea47b75 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:10.262640 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5779d03b-73f3-45b5-a3c6-7e125ea47b75 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.088424 Oct 11 07:06:10.263754 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1541/3078] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:10 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:11.285536 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b4ab69aa-e767-482e-864b-ef9de7515b4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:11.286146 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b4ab69aa-e767-482e-864b-ef9de7515b4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:11.292549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b4ab69aa-e767-482e-864b-ef9de7515b4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:11.293021 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b4ab69aa-e767-482e-864b-ef9de7515b4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:11.293452 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b4ab69aa-e767-482e-864b-ef9de7515b4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:11.294129 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b4ab69aa-e767-482e-864b-ef9de7515b4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:11.294579 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b4ab69aa-e767-482e-864b-ef9de7515b4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:11.294999 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b4ab69aa-e767-482e-864b-ef9de7515b4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:11.356817 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b4ab69aa-e767-482e-864b-ef9de7515b4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:11.364904 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b4ab69aa-e767-482e-864b-ef9de7515b4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083215 Oct 11 07:06:11.365709 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1538/3079] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:11 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:12.386619 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-86056f29-8063-4022-b78b-6aff11e37ddc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:12.387205 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-86056f29-8063-4022-b78b-6aff11e37ddc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:12.394161 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-86056f29-8063-4022-b78b-6aff11e37ddc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:12.394631 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-86056f29-8063-4022-b78b-6aff11e37ddc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:12.395053 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-86056f29-8063-4022-b78b-6aff11e37ddc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:12.395753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-86056f29-8063-4022-b78b-6aff11e37ddc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:12.396196 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-86056f29-8063-4022-b78b-6aff11e37ddc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:12.396613 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-86056f29-8063-4022-b78b-6aff11e37ddc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:12.459393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-86056f29-8063-4022-b78b-6aff11e37ddc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:12.467970 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-86056f29-8063-4022-b78b-6aff11e37ddc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085461 Oct 11 07:06:12.468515 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1542/3080] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:12 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:13.490954 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2f9da0da-05c8-477c-80ac-e12e2fcf8fec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:13.491594 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2f9da0da-05c8-477c-80ac-e12e2fcf8fec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:13.498474 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2f9da0da-05c8-477c-80ac-e12e2fcf8fec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:13.498949 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2f9da0da-05c8-477c-80ac-e12e2fcf8fec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:13.499387 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2f9da0da-05c8-477c-80ac-e12e2fcf8fec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:13.500092 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2f9da0da-05c8-477c-80ac-e12e2fcf8fec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:13.500541 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2f9da0da-05c8-477c-80ac-e12e2fcf8fec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:13.500959 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2f9da0da-05c8-477c-80ac-e12e2fcf8fec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:13.563702 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2f9da0da-05c8-477c-80ac-e12e2fcf8fec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:13.572109 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2f9da0da-05c8-477c-80ac-e12e2fcf8fec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.084950 Oct 11 07:06:13.572661 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1539/3081] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:13 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:14.594593 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e015da91-f1b8-4119-a672-1ca50a529bcb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:14.595193 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e015da91-f1b8-4119-a672-1ca50a529bcb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:14.601527 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e015da91-f1b8-4119-a672-1ca50a529bcb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:14.601995 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e015da91-f1b8-4119-a672-1ca50a529bcb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:14.602415 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e015da91-f1b8-4119-a672-1ca50a529bcb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:14.603086 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e015da91-f1b8-4119-a672-1ca50a529bcb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:14.603564 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e015da91-f1b8-4119-a672-1ca50a529bcb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:14.603977 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e015da91-f1b8-4119-a672-1ca50a529bcb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:14.664058 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e015da91-f1b8-4119-a672-1ca50a529bcb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:14.672575 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e015da91-f1b8-4119-a672-1ca50a529bcb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082400 Oct 11 07:06:14.673127 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1543/3082] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:14 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:15.694753 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7deb2214-97a2-451d-8866-19403140e9c0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:15.695323 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7deb2214-97a2-451d-8866-19403140e9c0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:15.701705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7deb2214-97a2-451d-8866-19403140e9c0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:15.702182 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7deb2214-97a2-451d-8866-19403140e9c0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:15.702612 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7deb2214-97a2-451d-8866-19403140e9c0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:15.703295 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7deb2214-97a2-451d-8866-19403140e9c0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:15.703791 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7deb2214-97a2-451d-8866-19403140e9c0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:15.704214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7deb2214-97a2-451d-8866-19403140e9c0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:15.766776 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7deb2214-97a2-451d-8866-19403140e9c0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:15.774853 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7deb2214-97a2-451d-8866-19403140e9c0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.084011 Oct 11 07:06:15.775402 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1540/3083] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:15 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:16.797787 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-62efe4a7-da04-4e8e-a627-44c60afab281 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:16.798389 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-62efe4a7-da04-4e8e-a627-44c60afab281 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:16.800672 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=28 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:06:16.805818 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62efe4a7-da04-4e8e-a627-44c60afab281 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:16.806293 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62efe4a7-da04-4e8e-a627-44c60afab281 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:16.806714 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62efe4a7-da04-4e8e-a627-44c60afab281 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:16.807438 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62efe4a7-da04-4e8e-a627-44c60afab281 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:16.807880 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62efe4a7-da04-4e8e-a627-44c60afab281 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:16.808296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-62efe4a7-da04-4e8e-a627-44c60afab281 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:16.868109 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-62efe4a7-da04-4e8e-a627-44c60afab281 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:16.876114 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-62efe4a7-da04-4e8e-a627-44c60afab281 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082714 Oct 11 07:06:16.876661 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1544/3084] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:16 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:17.898353 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ce98a670-5d12-4f8d-8b1f-427a677a8f8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:17.898984 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ce98a670-5d12-4f8d-8b1f-427a677a8f8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:17.904928 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ce98a670-5d12-4f8d-8b1f-427a677a8f8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:17.905425 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ce98a670-5d12-4f8d-8b1f-427a677a8f8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:17.905849 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ce98a670-5d12-4f8d-8b1f-427a677a8f8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:17.906527 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ce98a670-5d12-4f8d-8b1f-427a677a8f8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:17.906970 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ce98a670-5d12-4f8d-8b1f-427a677a8f8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:17.907383 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ce98a670-5d12-4f8d-8b1f-427a677a8f8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:17.967025 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ce98a670-5d12-4f8d-8b1f-427a677a8f8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:17.975125 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ce98a670-5d12-4f8d-8b1f-427a677a8f8c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.080757 Oct 11 07:06:17.975710 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1541/3085] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:17 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:18.998363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-349cfd1d-eb9b-4d61-b393-4e0ccbbe8eaf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:18.998960 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-349cfd1d-eb9b-4d61-b393-4e0ccbbe8eaf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:19.005403 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-349cfd1d-eb9b-4d61-b393-4e0ccbbe8eaf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:19.005878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-349cfd1d-eb9b-4d61-b393-4e0ccbbe8eaf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:19.006317 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-349cfd1d-eb9b-4d61-b393-4e0ccbbe8eaf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:19.006995 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-349cfd1d-eb9b-4d61-b393-4e0ccbbe8eaf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:19.007460 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-349cfd1d-eb9b-4d61-b393-4e0ccbbe8eaf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:19.007881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-349cfd1d-eb9b-4d61-b393-4e0ccbbe8eaf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:19.070788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-349cfd1d-eb9b-4d61-b393-4e0ccbbe8eaf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:19.078965 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-349cfd1d-eb9b-4d61-b393-4e0ccbbe8eaf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085037 Oct 11 07:06:19.079538 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1545/3086] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:18 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:20.102056 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-159943a5-4c1a-4557-bc77-bdfb10812f53 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:20.102917 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-159943a5-4c1a-4557-bc77-bdfb10812f53 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:20.109776 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-159943a5-4c1a-4557-bc77-bdfb10812f53 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:20.110253 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-159943a5-4c1a-4557-bc77-bdfb10812f53 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:20.110687 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-159943a5-4c1a-4557-bc77-bdfb10812f53 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:20.111373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-159943a5-4c1a-4557-bc77-bdfb10812f53 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:20.111857 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-159943a5-4c1a-4557-bc77-bdfb10812f53 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:20.112282 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-159943a5-4c1a-4557-bc77-bdfb10812f53 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:20.172166 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-159943a5-4c1a-4557-bc77-bdfb10812f53 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:20.180197 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-159943a5-4c1a-4557-bc77-bdfb10812f53 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082083 Oct 11 07:06:20.180752 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1542/3087] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:20 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:06:21.203583 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ca170d8a-07ce-4f46-b73b-a7e9eb1c7031 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:21.204434 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ca170d8a-07ce-4f46-b73b-a7e9eb1c7031 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:21.210476 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ca170d8a-07ce-4f46-b73b-a7e9eb1c7031 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:21.210945 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ca170d8a-07ce-4f46-b73b-a7e9eb1c7031 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:21.211368 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ca170d8a-07ce-4f46-b73b-a7e9eb1c7031 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:21.212068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ca170d8a-07ce-4f46-b73b-a7e9eb1c7031 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:21.212510 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ca170d8a-07ce-4f46-b73b-a7e9eb1c7031 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:21.212926 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ca170d8a-07ce-4f46-b73b-a7e9eb1c7031 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:21.216080 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=84 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:06:21.275560 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ca170d8a-07ce-4f46-b73b-a7e9eb1c7031 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:21.283726 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ca170d8a-07ce-4f46-b73b-a7e9eb1c7031 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.084428 Oct 11 07:06:21.284283 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1546/3088] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:21 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:22.306571 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-fe003ceb-ef59-42f1-834e-612373ae2801 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:22.307182 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-fe003ceb-ef59-42f1-834e-612373ae2801 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:22.314136 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fe003ceb-ef59-42f1-834e-612373ae2801 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:22.314653 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fe003ceb-ef59-42f1-834e-612373ae2801 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:22.315092 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fe003ceb-ef59-42f1-834e-612373ae2801 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:22.315814 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fe003ceb-ef59-42f1-834e-612373ae2801 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:22.316272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fe003ceb-ef59-42f1-834e-612373ae2801 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:22.316695 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fe003ceb-ef59-42f1-834e-612373ae2801 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:22.377186 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-fe003ceb-ef59-42f1-834e-612373ae2801 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:22.385535 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-fe003ceb-ef59-42f1-834e-612373ae2801 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082868 Oct 11 07:06:22.386085 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1543/3089] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:22 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:23.408688 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-22163875-fd94-4341-8677-dcba3ff7c583 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:23.409330 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-22163875-fd94-4341-8677-dcba3ff7c583 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:23.415880 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-22163875-fd94-4341-8677-dcba3ff7c583 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:23.416352 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-22163875-fd94-4341-8677-dcba3ff7c583 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:23.416778 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-22163875-fd94-4341-8677-dcba3ff7c583 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:23.417468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-22163875-fd94-4341-8677-dcba3ff7c583 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:23.417915 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-22163875-fd94-4341-8677-dcba3ff7c583 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:23.418334 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-22163875-fd94-4341-8677-dcba3ff7c583 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:23.478774 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-22163875-fd94-4341-8677-dcba3ff7c583 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:23.486921 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-22163875-fd94-4341-8677-dcba3ff7c583 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082081 Oct 11 07:06:23.487493 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1547/3090] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:23 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:24.510295 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1cf6eb87-6d29-4f7b-849d-d4b6df127798 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:24.510906 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1cf6eb87-6d29-4f7b-849d-d4b6df127798 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:24.517321 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1cf6eb87-6d29-4f7b-849d-d4b6df127798 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:24.517805 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1cf6eb87-6d29-4f7b-849d-d4b6df127798 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:24.518244 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1cf6eb87-6d29-4f7b-849d-d4b6df127798 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:24.518933 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1cf6eb87-6d29-4f7b-849d-d4b6df127798 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:24.519387 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1cf6eb87-6d29-4f7b-849d-d4b6df127798 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:24.519835 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1cf6eb87-6d29-4f7b-849d-d4b6df127798 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:24.581983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1cf6eb87-6d29-4f7b-849d-d4b6df127798 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:24.590530 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1cf6eb87-6d29-4f7b-849d-d4b6df127798 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083874 Oct 11 07:06:24.591086 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1544/3091] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:24 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:25.613032 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d9e93d2e-802e-4af3-ad98-c0b6d6939d0e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:25.613652 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d9e93d2e-802e-4af3-ad98-c0b6d6939d0e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:25.620052 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d9e93d2e-802e-4af3-ad98-c0b6d6939d0e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:25.620526 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d9e93d2e-802e-4af3-ad98-c0b6d6939d0e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:25.620954 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d9e93d2e-802e-4af3-ad98-c0b6d6939d0e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:25.622237 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d9e93d2e-802e-4af3-ad98-c0b6d6939d0e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:25.622680 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d9e93d2e-802e-4af3-ad98-c0b6d6939d0e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:25.623097 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d9e93d2e-802e-4af3-ad98-c0b6d6939d0e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:25.684548 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d9e93d2e-802e-4af3-ad98-c0b6d6939d0e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:25.692592 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d9e93d2e-802e-4af3-ad98-c0b6d6939d0e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083356 Oct 11 07:06:25.693154 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1548/3092] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:25 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:26.715748 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6b45468b-2c88-45ed-a7fe-e3da75cd2beb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:26.716381 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6b45468b-2c88-45ed-a7fe-e3da75cd2beb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:26.722747 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6b45468b-2c88-45ed-a7fe-e3da75cd2beb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:26.723221 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6b45468b-2c88-45ed-a7fe-e3da75cd2beb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:26.723685 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6b45468b-2c88-45ed-a7fe-e3da75cd2beb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:26.724375 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6b45468b-2c88-45ed-a7fe-e3da75cd2beb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:26.724825 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6b45468b-2c88-45ed-a7fe-e3da75cd2beb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:26.725245 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6b45468b-2c88-45ed-a7fe-e3da75cd2beb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:26.727805 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=84 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:06:26.786156 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6b45468b-2c88-45ed-a7fe-e3da75cd2beb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:26.794874 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6b45468b-2c88-45ed-a7fe-e3da75cd2beb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083582 Oct 11 07:06:26.795447 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1545/3093] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:26 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:27.816486 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e106a4d1-95ca-4267-a578-188fb0f121d7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:27.817028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e106a4d1-95ca-4267-a578-188fb0f121d7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:27.823309 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e106a4d1-95ca-4267-a578-188fb0f121d7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:27.823805 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e106a4d1-95ca-4267-a578-188fb0f121d7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:27.824229 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e106a4d1-95ca-4267-a578-188fb0f121d7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:27.824897 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e106a4d1-95ca-4267-a578-188fb0f121d7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:27.825335 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e106a4d1-95ca-4267-a578-188fb0f121d7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:27.825751 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e106a4d1-95ca-4267-a578-188fb0f121d7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:27.890024 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e106a4d1-95ca-4267-a578-188fb0f121d7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:27.898067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e106a4d1-95ca-4267-a578-188fb0f121d7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085512 Oct 11 07:06:27.898611 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1549/3094] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:27 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:06:28.920902 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7fe99ad6-7538-4f36-b073-3f459ea33dbf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:28.921504 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7fe99ad6-7538-4f36-b073-3f459ea33dbf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:28.927847 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7fe99ad6-7538-4f36-b073-3f459ea33dbf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:28.928316 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7fe99ad6-7538-4f36-b073-3f459ea33dbf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:28.928744 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7fe99ad6-7538-4f36-b073-3f459ea33dbf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:28.929422 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7fe99ad6-7538-4f36-b073-3f459ea33dbf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:28.929866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7fe99ad6-7538-4f36-b073-3f459ea33dbf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:28.930280 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7fe99ad6-7538-4f36-b073-3f459ea33dbf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:28.991386 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7fe99ad6-7538-4f36-b073-3f459ea33dbf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:28.999569 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7fe99ad6-7538-4f36-b073-3f459ea33dbf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083024 Oct 11 07:06:29.000119 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1546/3095] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:28 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:30.022475 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9e4843f9-cf94-434e-bafb-a47519d0a2c6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:30.023080 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9e4843f9-cf94-434e-bafb-a47519d0a2c6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:30.030060 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e4843f9-cf94-434e-bafb-a47519d0a2c6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:30.030541 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e4843f9-cf94-434e-bafb-a47519d0a2c6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:30.030972 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e4843f9-cf94-434e-bafb-a47519d0a2c6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:30.031687 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e4843f9-cf94-434e-bafb-a47519d0a2c6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:30.032134 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e4843f9-cf94-434e-bafb-a47519d0a2c6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:30.032554 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e4843f9-cf94-434e-bafb-a47519d0a2c6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:30.093017 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9e4843f9-cf94-434e-bafb-a47519d0a2c6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:30.101078 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9e4843f9-cf94-434e-bafb-a47519d0a2c6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082806 Oct 11 07:06:30.101638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1550/3096] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:30 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:31.124229 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8b78c8d2-e82b-417d-bc65-0a25c2dc0cad tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:31.124835 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8b78c8d2-e82b-417d-bc65-0a25c2dc0cad tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:31.127245 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=28 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:06:31.132357 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8b78c8d2-e82b-417d-bc65-0a25c2dc0cad tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:31.133093 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8b78c8d2-e82b-417d-bc65-0a25c2dc0cad tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:31.133530 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8b78c8d2-e82b-417d-bc65-0a25c2dc0cad tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:31.134219 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8b78c8d2-e82b-417d-bc65-0a25c2dc0cad tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:31.134667 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8b78c8d2-e82b-417d-bc65-0a25c2dc0cad tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:31.135091 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8b78c8d2-e82b-417d-bc65-0a25c2dc0cad tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:31.195217 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8b78c8d2-e82b-417d-bc65-0a25c2dc0cad tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:31.203972 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8b78c8d2-e82b-417d-bc65-0a25c2dc0cad tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.084066 Oct 11 07:06:31.204736 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1547/3097] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:31 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:32.226099 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4c9f8790-7627-4610-ab61-af677c328d32 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:32.226746 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4c9f8790-7627-4610-ab61-af677c328d32 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:32.233219 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4c9f8790-7627-4610-ab61-af677c328d32 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:32.233695 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4c9f8790-7627-4610-ab61-af677c328d32 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:32.234129 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4c9f8790-7627-4610-ab61-af677c328d32 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:32.234817 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4c9f8790-7627-4610-ab61-af677c328d32 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:32.235268 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4c9f8790-7627-4610-ab61-af677c328d32 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:32.235731 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4c9f8790-7627-4610-ab61-af677c328d32 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:32.295720 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4c9f8790-7627-4610-ab61-af677c328d32 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:32.303767 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4c9f8790-7627-4610-ab61-af677c328d32 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081485 Oct 11 07:06:32.304331 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1551/3098] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:32 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:33.326061 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b34ef54c-b403-486b-b580-2fa081563373 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:33.326669 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b34ef54c-b403-486b-b580-2fa081563373 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:33.333075 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b34ef54c-b403-486b-b580-2fa081563373 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:33.333551 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b34ef54c-b403-486b-b580-2fa081563373 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:33.333979 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b34ef54c-b403-486b-b580-2fa081563373 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:33.334656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b34ef54c-b403-486b-b580-2fa081563373 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:33.335101 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b34ef54c-b403-486b-b580-2fa081563373 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:33.335558 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b34ef54c-b403-486b-b580-2fa081563373 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:33.399549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b34ef54c-b403-486b-b580-2fa081563373 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:33.408299 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b34ef54c-b403-486b-b580-2fa081563373 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.086109 Oct 11 07:06:33.408886 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1548/3099] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:33 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:34.431187 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-959a532f-cf9c-4634-8977-184fe42eae61 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:34.431895 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-959a532f-cf9c-4634-8977-184fe42eae61 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:34.439167 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-959a532f-cf9c-4634-8977-184fe42eae61 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:34.439684 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-959a532f-cf9c-4634-8977-184fe42eae61 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:34.440118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-959a532f-cf9c-4634-8977-184fe42eae61 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:34.440810 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-959a532f-cf9c-4634-8977-184fe42eae61 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:34.441260 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-959a532f-cf9c-4634-8977-184fe42eae61 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:34.441682 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-959a532f-cf9c-4634-8977-184fe42eae61 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:34.501390 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-959a532f-cf9c-4634-8977-184fe42eae61 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:34.509696 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-959a532f-cf9c-4634-8977-184fe42eae61 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082319 Oct 11 07:06:34.510253 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1552/3100] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:34 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:35.532494 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7bf54900-4f62-4a17-b303-3338d994b687 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:35.533099 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7bf54900-4f62-4a17-b303-3338d994b687 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:35.539523 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7bf54900-4f62-4a17-b303-3338d994b687 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:35.539999 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7bf54900-4f62-4a17-b303-3338d994b687 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:35.540455 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7bf54900-4f62-4a17-b303-3338d994b687 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:35.541132 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7bf54900-4f62-4a17-b303-3338d994b687 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:35.541578 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7bf54900-4f62-4a17-b303-3338d994b687 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:35.541993 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7bf54900-4f62-4a17-b303-3338d994b687 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:35.601774 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7bf54900-4f62-4a17-b303-3338d994b687 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:35.610441 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7bf54900-4f62-4a17-b303-3338d994b687 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082276 Oct 11 07:06:35.610985 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1549/3101] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:35 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:36.633009 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-40016c2e-5cb8-430c-b0b9-cbba51a8636a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:36.633613 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-40016c2e-5cb8-430c-b0b9-cbba51a8636a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:36.639970 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-40016c2e-5cb8-430c-b0b9-cbba51a8636a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:36.640439 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-40016c2e-5cb8-430c-b0b9-cbba51a8636a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:36.640867 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-40016c2e-5cb8-430c-b0b9-cbba51a8636a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:36.641537 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-40016c2e-5cb8-430c-b0b9-cbba51a8636a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:36.641975 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-40016c2e-5cb8-430c-b0b9-cbba51a8636a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:36.642384 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-40016c2e-5cb8-430c-b0b9-cbba51a8636a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:36.704724 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-40016c2e-5cb8-430c-b0b9-cbba51a8636a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:36.712794 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-40016c2e-5cb8-430c-b0b9-cbba51a8636a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083914 Oct 11 07:06:36.713343 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1553/3102] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:36 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:37.734061 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4fc25469-16d7-41a7-9bee-a95bd87704ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:37.734588 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4fc25469-16d7-41a7-9bee-a95bd87704ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:37.740908 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4fc25469-16d7-41a7-9bee-a95bd87704ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:37.741383 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4fc25469-16d7-41a7-9bee-a95bd87704ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:37.741812 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4fc25469-16d7-41a7-9bee-a95bd87704ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:37.742493 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4fc25469-16d7-41a7-9bee-a95bd87704ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:37.742937 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4fc25469-16d7-41a7-9bee-a95bd87704ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:37.743355 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4fc25469-16d7-41a7-9bee-a95bd87704ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:37.803379 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4fc25469-16d7-41a7-9bee-a95bd87704ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:37.811857 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4fc25469-16d7-41a7-9bee-a95bd87704ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081189 Oct 11 07:06:37.812401 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1550/3103] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:37 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:38.835244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cadc8e4c-73e4-4366-9d54-2e440c4da51a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:38.835825 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cadc8e4c-73e4-4366-9d54-2e440c4da51a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:38.842081 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cadc8e4c-73e4-4366-9d54-2e440c4da51a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:38.843220 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cadc8e4c-73e4-4366-9d54-2e440c4da51a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:38.843659 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cadc8e4c-73e4-4366-9d54-2e440c4da51a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:38.844336 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cadc8e4c-73e4-4366-9d54-2e440c4da51a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:38.844774 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cadc8e4c-73e4-4366-9d54-2e440c4da51a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:38.845184 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cadc8e4c-73e4-4366-9d54-2e440c4da51a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:38.904447 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cadc8e4c-73e4-4366-9d54-2e440c4da51a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:38.913281 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cadc8e4c-73e4-4366-9d54-2e440c4da51a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081950 Oct 11 07:06:38.913836 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1554/3104] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:38 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:39.935473 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ac968738-3f0e-4b4f-9836-9a9c8525a3fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:39.936109 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ac968738-3f0e-4b4f-9836-9a9c8525a3fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:39.942413 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ac968738-3f0e-4b4f-9836-9a9c8525a3fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:39.942890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ac968738-3f0e-4b4f-9836-9a9c8525a3fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:39.943324 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ac968738-3f0e-4b4f-9836-9a9c8525a3fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:39.944031 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ac968738-3f0e-4b4f-9836-9a9c8525a3fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:39.944489 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ac968738-3f0e-4b4f-9836-9a9c8525a3fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:39.944910 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ac968738-3f0e-4b4f-9836-9a9c8525a3fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:40.005312 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ac968738-3f0e-4b4f-9836-9a9c8525a3fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:40.013707 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ac968738-3f0e-4b4f-9836-9a9c8525a3fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082104 Oct 11 07:06:40.014293 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1551/3105] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:39 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:41.035811 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-21df654b-e65e-4d0c-8e34-e2007ccc0413 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:41.036361 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-21df654b-e65e-4d0c-8e34-e2007ccc0413 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:41.042755 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21df654b-e65e-4d0c-8e34-e2007ccc0413 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:41.043227 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21df654b-e65e-4d0c-8e34-e2007ccc0413 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:41.043686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21df654b-e65e-4d0c-8e34-e2007ccc0413 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:41.044363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21df654b-e65e-4d0c-8e34-e2007ccc0413 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:41.044805 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21df654b-e65e-4d0c-8e34-e2007ccc0413 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:41.045220 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21df654b-e65e-4d0c-8e34-e2007ccc0413 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:41.107147 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-21df654b-e65e-4d0c-8e34-e2007ccc0413 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:41.115684 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-21df654b-e65e-4d0c-8e34-e2007ccc0413 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083747 Oct 11 07:06:41.116232 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1555/3106] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:41 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:42.138920 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bacae8ac-2631-4501-80d6-8fcf7f3ae494 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:42.139567 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bacae8ac-2631-4501-80d6-8fcf7f3ae494 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:42.146094 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bacae8ac-2631-4501-80d6-8fcf7f3ae494 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:42.146578 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bacae8ac-2631-4501-80d6-8fcf7f3ae494 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:42.147014 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bacae8ac-2631-4501-80d6-8fcf7f3ae494 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:42.147749 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bacae8ac-2631-4501-80d6-8fcf7f3ae494 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:42.148205 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bacae8ac-2631-4501-80d6-8fcf7f3ae494 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:42.148631 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bacae8ac-2631-4501-80d6-8fcf7f3ae494 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:42.211689 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-bacae8ac-2631-4501-80d6-8fcf7f3ae494 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:42.220332 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bacae8ac-2631-4501-80d6-8fcf7f3ae494 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085343 Oct 11 07:06:42.220883 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1552/3107] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:42 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:43.243146 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cc2a0e56-54c3-4e3c-a3d4-9d6b6c973d5d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:43.243759 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cc2a0e56-54c3-4e3c-a3d4-9d6b6c973d5d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:43.250602 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc2a0e56-54c3-4e3c-a3d4-9d6b6c973d5d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:43.251072 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc2a0e56-54c3-4e3c-a3d4-9d6b6c973d5d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:43.251523 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc2a0e56-54c3-4e3c-a3d4-9d6b6c973d5d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:43.252195 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc2a0e56-54c3-4e3c-a3d4-9d6b6c973d5d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:43.252636 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc2a0e56-54c3-4e3c-a3d4-9d6b6c973d5d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:43.253047 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc2a0e56-54c3-4e3c-a3d4-9d6b6c973d5d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:43.313468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cc2a0e56-54c3-4e3c-a3d4-9d6b6c973d5d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:43.321411 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cc2a0e56-54c3-4e3c-a3d4-9d6b6c973d5d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082062 Oct 11 07:06:43.321964 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1556/3108] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:43 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:44.344849 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e7f1f68a-c16e-4069-ad42-ad737b6365ff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:44.345443 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e7f1f68a-c16e-4069-ad42-ad737b6365ff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:44.351900 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7f1f68a-c16e-4069-ad42-ad737b6365ff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:44.352385 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7f1f68a-c16e-4069-ad42-ad737b6365ff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:44.352824 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7f1f68a-c16e-4069-ad42-ad737b6365ff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:44.353523 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7f1f68a-c16e-4069-ad42-ad737b6365ff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:44.353979 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7f1f68a-c16e-4069-ad42-ad737b6365ff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:44.354407 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e7f1f68a-c16e-4069-ad42-ad737b6365ff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:44.416460 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e7f1f68a-c16e-4069-ad42-ad737b6365ff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:44.424708 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e7f1f68a-c16e-4069-ad42-ad737b6365ff tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.084352 Oct 11 07:06:44.425265 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1553/3109] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:44 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:45.446844 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0e4089bf-5eba-418e-923d-6122408973d6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:45.447489 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0e4089bf-5eba-418e-923d-6122408973d6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:45.454526 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0e4089bf-5eba-418e-923d-6122408973d6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:45.455005 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0e4089bf-5eba-418e-923d-6122408973d6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:45.455457 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0e4089bf-5eba-418e-923d-6122408973d6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:45.456148 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0e4089bf-5eba-418e-923d-6122408973d6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:45.456598 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0e4089bf-5eba-418e-923d-6122408973d6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:45.457025 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0e4089bf-5eba-418e-923d-6122408973d6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:45.519376 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0e4089bf-5eba-418e-923d-6122408973d6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:45.527536 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0e4089bf-5eba-418e-923d-6122408973d6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.084543 Oct 11 07:06:45.528091 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1557/3110] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:45 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:46.549935 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-540b9586-1947-4b72-b1be-af2a22c7e74d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:46.550543 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-540b9586-1947-4b72-b1be-af2a22c7e74d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:46.556974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-540b9586-1947-4b72-b1be-af2a22c7e74d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:46.557456 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-540b9586-1947-4b72-b1be-af2a22c7e74d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:46.557890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-540b9586-1947-4b72-b1be-af2a22c7e74d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:46.558580 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-540b9586-1947-4b72-b1be-af2a22c7e74d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:46.559035 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-540b9586-1947-4b72-b1be-af2a22c7e74d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:46.559483 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-540b9586-1947-4b72-b1be-af2a22c7e74d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:46.620414 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-540b9586-1947-4b72-b1be-af2a22c7e74d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:46.628533 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-540b9586-1947-4b72-b1be-af2a22c7e74d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082480 Oct 11 07:06:46.629085 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1554/3111] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:46 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:47.651549 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b7169747-39cd-49d7-a292-1a939ee1178d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:47.652162 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b7169747-39cd-49d7-a292-1a939ee1178d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:47.654547 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=28 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:06:47.659946 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b7169747-39cd-49d7-a292-1a939ee1178d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:47.660361 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b7169747-39cd-49d7-a292-1a939ee1178d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:47.660785 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b7169747-39cd-49d7-a292-1a939ee1178d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:47.661466 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b7169747-39cd-49d7-a292-1a939ee1178d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:47.661906 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b7169747-39cd-49d7-a292-1a939ee1178d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:47.662323 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b7169747-39cd-49d7-a292-1a939ee1178d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:47.722214 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b7169747-39cd-49d7-a292-1a939ee1178d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:47.730311 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b7169747-39cd-49d7-a292-1a939ee1178d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082644 Oct 11 07:06:47.730865 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1558/3112] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:47 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:48.752745 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a65268c6-d32b-4c2a-8e61-9098be9515f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:48.753293 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a65268c6-d32b-4c2a-8e61-9098be9515f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:48.759473 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a65268c6-d32b-4c2a-8e61-9098be9515f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:48.759959 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a65268c6-d32b-4c2a-8e61-9098be9515f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:48.760512 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a65268c6-d32b-4c2a-8e61-9098be9515f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:48.761074 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a65268c6-d32b-4c2a-8e61-9098be9515f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:48.761528 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a65268c6-d32b-4c2a-8e61-9098be9515f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:48.761948 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a65268c6-d32b-4c2a-8e61-9098be9515f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:48.821978 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a65268c6-d32b-4c2a-8e61-9098be9515f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:48.830653 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a65268c6-d32b-4c2a-8e61-9098be9515f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081978 Oct 11 07:06:48.831206 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1555/3113] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:48 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:49.853007 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8def985d-fc3d-4866-8332-72f7242dee35 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:49.853624 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8def985d-fc3d-4866-8332-72f7242dee35 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:49.860067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8def985d-fc3d-4866-8332-72f7242dee35 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:49.860547 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8def985d-fc3d-4866-8332-72f7242dee35 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:49.860990 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8def985d-fc3d-4866-8332-72f7242dee35 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:49.861680 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8def985d-fc3d-4866-8332-72f7242dee35 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:49.862132 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8def985d-fc3d-4866-8332-72f7242dee35 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:49.862556 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8def985d-fc3d-4866-8332-72f7242dee35 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:49.966824 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8def985d-fc3d-4866-8332-72f7242dee35 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:49.974916 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8def985d-fc3d-4866-8332-72f7242dee35 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.125717 Oct 11 07:06:49.975493 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1559/3114] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:49 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:51.047338 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b1d4d00f-0975-460d-916c-f4446143101a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:51.048000 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b1d4d00f-0975-460d-916c-f4446143101a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:51.053986 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b1d4d00f-0975-460d-916c-f4446143101a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:51.054466 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b1d4d00f-0975-460d-916c-f4446143101a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:51.054899 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b1d4d00f-0975-460d-916c-f4446143101a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:51.055625 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b1d4d00f-0975-460d-916c-f4446143101a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:51.056142 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b1d4d00f-0975-460d-916c-f4446143101a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:51.056566 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b1d4d00f-0975-460d-916c-f4446143101a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:51.120816 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b1d4d00f-0975-460d-916c-f4446143101a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:51.129528 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b1d4d00f-0975-460d-916c-f4446143101a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.135926 Oct 11 07:06:51.130076 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1556/3115] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:50 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:52.152155 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fd0c61a4-4e25-4111-9a79-1fbe5073b112 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:52.152748 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fd0c61a4-4e25-4111-9a79-1fbe5073b112 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:52.158716 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fd0c61a4-4e25-4111-9a79-1fbe5073b112 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:52.159188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fd0c61a4-4e25-4111-9a79-1fbe5073b112 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:52.159767 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fd0c61a4-4e25-4111-9a79-1fbe5073b112 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:52.160445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fd0c61a4-4e25-4111-9a79-1fbe5073b112 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:52.160884 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fd0c61a4-4e25-4111-9a79-1fbe5073b112 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:52.161297 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fd0c61a4-4e25-4111-9a79-1fbe5073b112 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:52.163772 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=84 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:06:52.224344 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fd0c61a4-4e25-4111-9a79-1fbe5073b112 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:52.232305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fd0c61a4-4e25-4111-9a79-1fbe5073b112 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.084142 Oct 11 07:06:52.232859 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1560/3116] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:52 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:53.254023 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bc6e7eae-85c7-4802-8e7c-90330904f985 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:53.254615 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bc6e7eae-85c7-4802-8e7c-90330904f985 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:53.261332 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bc6e7eae-85c7-4802-8e7c-90330904f985 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:53.261854 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bc6e7eae-85c7-4802-8e7c-90330904f985 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:53.262288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bc6e7eae-85c7-4802-8e7c-90330904f985 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:53.262983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bc6e7eae-85c7-4802-8e7c-90330904f985 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:53.263455 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bc6e7eae-85c7-4802-8e7c-90330904f985 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:53.263883 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bc6e7eae-85c7-4802-8e7c-90330904f985 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:53.323925 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-bc6e7eae-85c7-4802-8e7c-90330904f985 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:53.332564 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bc6e7eae-85c7-4802-8e7c-90330904f985 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082363 Oct 11 07:06:53.333117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1557/3117] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:53 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:54.355514 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-af620443-0f28-4d10-9b58-fadcf44e3f49 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:54.356127 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-af620443-0f28-4d10-9b58-fadcf44e3f49 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:54.363115 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af620443-0f28-4d10-9b58-fadcf44e3f49 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:54.363633 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af620443-0f28-4d10-9b58-fadcf44e3f49 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:54.364071 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af620443-0f28-4d10-9b58-fadcf44e3f49 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:54.364762 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af620443-0f28-4d10-9b58-fadcf44e3f49 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:54.365211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af620443-0f28-4d10-9b58-fadcf44e3f49 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:54.365633 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-af620443-0f28-4d10-9b58-fadcf44e3f49 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:54.428916 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-af620443-0f28-4d10-9b58-fadcf44e3f49 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:54.437216 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-af620443-0f28-4d10-9b58-fadcf44e3f49 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085586 Oct 11 07:06:54.437770 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1561/3118] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:54 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:55.459774 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7e38fe5c-7edd-4d81-856d-21fe2e7ad493 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:55.460383 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7e38fe5c-7edd-4d81-856d-21fe2e7ad493 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:55.466730 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7e38fe5c-7edd-4d81-856d-21fe2e7ad493 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:55.467204 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7e38fe5c-7edd-4d81-856d-21fe2e7ad493 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:55.467668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7e38fe5c-7edd-4d81-856d-21fe2e7ad493 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:55.468355 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7e38fe5c-7edd-4d81-856d-21fe2e7ad493 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:55.468806 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7e38fe5c-7edd-4d81-856d-21fe2e7ad493 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:55.469232 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7e38fe5c-7edd-4d81-856d-21fe2e7ad493 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:55.528613 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7e38fe5c-7edd-4d81-856d-21fe2e7ad493 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:55.536658 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7e38fe5c-7edd-4d81-856d-21fe2e7ad493 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.080726 Oct 11 07:06:55.537226 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1558/3119] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:55 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:56.559189 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-dd7e723a-72bf-4a63-8141-c2e38f02996c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:56.559821 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-dd7e723a-72bf-4a63-8141-c2e38f02996c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:56.566805 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dd7e723a-72bf-4a63-8141-c2e38f02996c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:56.567281 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dd7e723a-72bf-4a63-8141-c2e38f02996c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:56.567741 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dd7e723a-72bf-4a63-8141-c2e38f02996c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:56.568432 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dd7e723a-72bf-4a63-8141-c2e38f02996c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:56.568883 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dd7e723a-72bf-4a63-8141-c2e38f02996c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:56.569307 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-dd7e723a-72bf-4a63-8141-c2e38f02996c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:56.631766 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-dd7e723a-72bf-4a63-8141-c2e38f02996c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:56.640067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-dd7e723a-72bf-4a63-8141-c2e38f02996c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.084687 Oct 11 07:06:56.640626 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1562/3120] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:56 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:57.663603 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-948eef7e-cb80-4cc5-b40d-faec66c2678f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:57.664155 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-948eef7e-cb80-4cc5-b40d-faec66c2678f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:57.670555 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-948eef7e-cb80-4cc5-b40d-faec66c2678f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:57.671031 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-948eef7e-cb80-4cc5-b40d-faec66c2678f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:57.671493 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-948eef7e-cb80-4cc5-b40d-faec66c2678f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:57.672210 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-948eef7e-cb80-4cc5-b40d-faec66c2678f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:57.672660 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-948eef7e-cb80-4cc5-b40d-faec66c2678f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:57.673077 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-948eef7e-cb80-4cc5-b40d-faec66c2678f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:57.676912 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=84 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:06:57.733001 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-948eef7e-cb80-4cc5-b40d-faec66c2678f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:57.741066 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-948eef7e-cb80-4cc5-b40d-faec66c2678f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081417 Oct 11 07:06:57.741623 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1559/3121] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:57 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:58.763450 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-89fac545-d61f-49da-9943-f2fd1d7a42f2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:58.764033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-89fac545-d61f-49da-9943-f2fd1d7a42f2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:58.766365 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 07:06:58.766540 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Tue Oct 11 07:06:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d (ip 10.222.0.39) !!! Oct 11 07:06:58.771948 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89fac545-d61f-49da-9943-f2fd1d7a42f2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:58.772424 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89fac545-d61f-49da-9943-f2fd1d7a42f2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:58.772852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89fac545-d61f-49da-9943-f2fd1d7a42f2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:58.773537 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89fac545-d61f-49da-9943-f2fd1d7a42f2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:58.773984 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89fac545-d61f-49da-9943-f2fd1d7a42f2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:58.774402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-89fac545-d61f-49da-9943-f2fd1d7a42f2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:58.835377 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-89fac545-d61f-49da-9943-f2fd1d7a42f2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:58.843506 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-89fac545-d61f-49da-9943-f2fd1d7a42f2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083946 Oct 11 07:06:58.844060 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1563/3122] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:58 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:06:59.866582 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a0033457-1aae-4776-973c-c4ab66766ec0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:06:59.867189 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a0033457-1aae-4776-973c-c4ab66766ec0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:06:59.869630 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 07:06:59.869759 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Tue Oct 11 07:06:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d (ip 10.222.0.39) !!! Oct 11 07:06:59.881400 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a0033457-1aae-4776-973c-c4ab66766ec0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:59.881878 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a0033457-1aae-4776-973c-c4ab66766ec0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:59.882566 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a0033457-1aae-4776-973c-c4ab66766ec0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:59.883253 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a0033457-1aae-4776-973c-c4ab66766ec0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:06:59.883737 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a0033457-1aae-4776-973c-c4ab66766ec0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:06:59.884187 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a0033457-1aae-4776-973c-c4ab66766ec0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:06:59.948545 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a0033457-1aae-4776-973c-c4ab66766ec0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:06:59.956683 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a0033457-1aae-4776-973c-c4ab66766ec0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.093998 Oct 11 07:06:59.957230 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1560/3123] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:06:59 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:00.979007 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d6b6caa2-491e-4ef9-9661-18b4190d9a49 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:00.979692 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d6b6caa2-491e-4ef9-9661-18b4190d9a49 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:00.986130 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d6b6caa2-491e-4ef9-9661-18b4190d9a49 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:00.986604 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d6b6caa2-491e-4ef9-9661-18b4190d9a49 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:00.987036 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d6b6caa2-491e-4ef9-9661-18b4190d9a49 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:00.987749 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d6b6caa2-491e-4ef9-9661-18b4190d9a49 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:00.988198 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d6b6caa2-491e-4ef9-9661-18b4190d9a49 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:00.988618 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d6b6caa2-491e-4ef9-9661-18b4190d9a49 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:01.048721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d6b6caa2-491e-4ef9-9661-18b4190d9a49 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:01.057076 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d6b6caa2-491e-4ef9-9661-18b4190d9a49 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081745 Oct 11 07:07:01.057640 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1564/3124] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:00 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:02.080683 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-59a92e51-0f33-41e1-bb6e-d6ed36dfe62c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:02.081299 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-59a92e51-0f33-41e1-bb6e-d6ed36dfe62c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:02.083605 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=28 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:07:02.088730 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-59a92e51-0f33-41e1-bb6e-d6ed36dfe62c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:02.089212 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-59a92e51-0f33-41e1-bb6e-d6ed36dfe62c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:02.089649 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-59a92e51-0f33-41e1-bb6e-d6ed36dfe62c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:02.090342 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-59a92e51-0f33-41e1-bb6e-d6ed36dfe62c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:02.090800 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-59a92e51-0f33-41e1-bb6e-d6ed36dfe62c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:02.091225 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-59a92e51-0f33-41e1-bb6e-d6ed36dfe62c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:02.151787 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-59a92e51-0f33-41e1-bb6e-d6ed36dfe62c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:02.160480 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-59a92e51-0f33-41e1-bb6e-d6ed36dfe62c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.084176 Oct 11 07:07:02.161038 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1561/3125] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:02 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:03.182299 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3ccc8559-3ea9-4dab-b346-eaa5010bf9fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:03.182905 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3ccc8559-3ea9-4dab-b346-eaa5010bf9fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:03.189411 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3ccc8559-3ea9-4dab-b346-eaa5010bf9fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:03.189888 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3ccc8559-3ea9-4dab-b346-eaa5010bf9fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:03.190320 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3ccc8559-3ea9-4dab-b346-eaa5010bf9fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:03.191003 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3ccc8559-3ea9-4dab-b346-eaa5010bf9fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:03.191480 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3ccc8559-3ea9-4dab-b346-eaa5010bf9fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:03.191904 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3ccc8559-3ea9-4dab-b346-eaa5010bf9fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:03.254627 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3ccc8559-3ea9-4dab-b346-eaa5010bf9fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:03.262989 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3ccc8559-3ea9-4dab-b346-eaa5010bf9fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.084513 Oct 11 07:07:03.263563 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1565/3126] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:03 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:04.285197 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1bbe9d9a-5a04-4b40-8260-a179adef8a62 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:04.285872 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1bbe9d9a-5a04-4b40-8260-a179adef8a62 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:04.292352 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1bbe9d9a-5a04-4b40-8260-a179adef8a62 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:04.292830 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1bbe9d9a-5a04-4b40-8260-a179adef8a62 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:04.293262 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1bbe9d9a-5a04-4b40-8260-a179adef8a62 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:04.293952 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1bbe9d9a-5a04-4b40-8260-a179adef8a62 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:04.294405 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1bbe9d9a-5a04-4b40-8260-a179adef8a62 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:04.294828 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1bbe9d9a-5a04-4b40-8260-a179adef8a62 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:04.355656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1bbe9d9a-5a04-4b40-8260-a179adef8a62 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:04.364232 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1bbe9d9a-5a04-4b40-8260-a179adef8a62 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082934 Oct 11 07:07:04.364788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1562/3127] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:04 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:05.387378 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f8ccc563-58a6-4569-8d00-81c65a6ed013 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:05.387989 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f8ccc563-58a6-4569-8d00-81c65a6ed013 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:05.394916 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f8ccc563-58a6-4569-8d00-81c65a6ed013 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:05.395385 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f8ccc563-58a6-4569-8d00-81c65a6ed013 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:05.395837 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f8ccc563-58a6-4569-8d00-81c65a6ed013 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:05.396515 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f8ccc563-58a6-4569-8d00-81c65a6ed013 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:05.396960 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f8ccc563-58a6-4569-8d00-81c65a6ed013 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:05.397374 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f8ccc563-58a6-4569-8d00-81c65a6ed013 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:05.457361 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f8ccc563-58a6-4569-8d00-81c65a6ed013 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:05.465327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f8ccc563-58a6-4569-8d00-81c65a6ed013 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081752 Oct 11 07:07:05.465875 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1566/3128] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:05 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:06.488162 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c8431e30-9382-40c2-861e-088439601130 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:06.488801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c8431e30-9382-40c2-861e-088439601130 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:06.495242 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8431e30-9382-40c2-861e-088439601130 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:06.495749 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8431e30-9382-40c2-861e-088439601130 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:06.496182 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8431e30-9382-40c2-861e-088439601130 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:06.496877 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8431e30-9382-40c2-861e-088439601130 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:06.497328 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8431e30-9382-40c2-861e-088439601130 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:06.497750 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c8431e30-9382-40c2-861e-088439601130 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:06.557944 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c8431e30-9382-40c2-861e-088439601130 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:06.566045 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c8431e30-9382-40c2-861e-088439601130 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081746 Oct 11 07:07:06.566585 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1563/3129] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:06 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:07.588225 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4beb1c5b-1a82-42c0-8c5f-72ae0ce6ed2c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:07.588833 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4beb1c5b-1a82-42c0-8c5f-72ae0ce6ed2c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:07.595018 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4beb1c5b-1a82-42c0-8c5f-72ae0ce6ed2c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:07.595519 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4beb1c5b-1a82-42c0-8c5f-72ae0ce6ed2c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:07.595952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4beb1c5b-1a82-42c0-8c5f-72ae0ce6ed2c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:07.596636 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4beb1c5b-1a82-42c0-8c5f-72ae0ce6ed2c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:07.597592 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4beb1c5b-1a82-42c0-8c5f-72ae0ce6ed2c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:07.598153 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4beb1c5b-1a82-42c0-8c5f-72ae0ce6ed2c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:07.658590 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4beb1c5b-1a82-42c0-8c5f-72ae0ce6ed2c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:07.667631 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4beb1c5b-1a82-42c0-8c5f-72ae0ce6ed2c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082924 Oct 11 07:07:07.667987 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1567/3130] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:07 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:08.691546 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-20836f95-a7f7-4391-b17b-37c1a4cb3cce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:08.692078 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-20836f95-a7f7-4391-b17b-37c1a4cb3cce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:08.694024 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 07:07:08.694172 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Tue Oct 11 07:07:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d (ip 10.222.0.39) !!! Oct 11 07:07:08.700166 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20836f95-a7f7-4391-b17b-37c1a4cb3cce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:08.700649 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20836f95-a7f7-4391-b17b-37c1a4cb3cce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:08.701081 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20836f95-a7f7-4391-b17b-37c1a4cb3cce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:08.701770 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20836f95-a7f7-4391-b17b-37c1a4cb3cce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:08.702220 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20836f95-a7f7-4391-b17b-37c1a4cb3cce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:08.702642 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20836f95-a7f7-4391-b17b-37c1a4cb3cce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:08.767542 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-20836f95-a7f7-4391-b17b-37c1a4cb3cce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:08.775712 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-20836f95-a7f7-4391-b17b-37c1a4cb3cce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.088651 Oct 11 07:07:08.776272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1564/3131] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:08 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:09.798603 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-84eaf050-3f15-4d7b-9976-46dccb03171a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:09.799204 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-84eaf050-3f15-4d7b-9976-46dccb03171a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:09.801238 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 07:07:09.801371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Tue Oct 11 07:07:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d (ip 10.222.0.39) !!! Oct 11 07:07:09.807742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-84eaf050-3f15-4d7b-9976-46dccb03171a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:09.808245 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-84eaf050-3f15-4d7b-9976-46dccb03171a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:09.808683 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-84eaf050-3f15-4d7b-9976-46dccb03171a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:09.809365 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-84eaf050-3f15-4d7b-9976-46dccb03171a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:09.809809 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-84eaf050-3f15-4d7b-9976-46dccb03171a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:09.810226 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-84eaf050-3f15-4d7b-9976-46dccb03171a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:09.874380 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-84eaf050-3f15-4d7b-9976-46dccb03171a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:09.883178 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-84eaf050-3f15-4d7b-9976-46dccb03171a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.088911 Oct 11 07:07:09.883765 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1568/3132] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:09 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:10.905756 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-10b8c82e-861a-4618-be0f-c956c16b358c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:10.906456 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-10b8c82e-861a-4618-be0f-c956c16b358c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:10.913377 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-10b8c82e-861a-4618-be0f-c956c16b358c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:10.913852 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-10b8c82e-861a-4618-be0f-c956c16b358c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:10.914284 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-10b8c82e-861a-4618-be0f-c956c16b358c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:10.914968 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-10b8c82e-861a-4618-be0f-c956c16b358c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:10.915449 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-10b8c82e-861a-4618-be0f-c956c16b358c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:10.915852 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-10b8c82e-861a-4618-be0f-c956c16b358c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:10.977193 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-10b8c82e-861a-4618-be0f-c956c16b358c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:10.985325 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-10b8c82e-861a-4618-be0f-c956c16b358c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083362 Oct 11 07:07:10.985881 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1565/3133] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:10 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:12.009292 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2f63df68-2895-4716-8c83-5f3d6fadd8ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:12.009926 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2f63df68-2895-4716-8c83-5f3d6fadd8ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:12.016292 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f63df68-2895-4716-8c83-5f3d6fadd8ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:12.016766 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f63df68-2895-4716-8c83-5f3d6fadd8ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:12.017191 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f63df68-2895-4716-8c83-5f3d6fadd8ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:12.017869 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f63df68-2895-4716-8c83-5f3d6fadd8ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:12.018315 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f63df68-2895-4716-8c83-5f3d6fadd8ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:12.019284 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2f63df68-2895-4716-8c83-5f3d6fadd8ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:12.079318 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2f63df68-2895-4716-8c83-5f3d6fadd8ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:12.087391 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2f63df68-2895-4716-8c83-5f3d6fadd8ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082206 Oct 11 07:07:12.087980 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1569/3134] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:12 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:13.109738 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2cb16446-6f81-408b-ba6c-ad22e28ea9ca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:13.110341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2cb16446-6f81-408b-ba6c-ad22e28ea9ca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:13.117195 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2cb16446-6f81-408b-ba6c-ad22e28ea9ca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:13.117667 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2cb16446-6f81-408b-ba6c-ad22e28ea9ca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:13.118094 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2cb16446-6f81-408b-ba6c-ad22e28ea9ca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:13.118774 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2cb16446-6f81-408b-ba6c-ad22e28ea9ca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:13.119219 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2cb16446-6f81-408b-ba6c-ad22e28ea9ca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:13.119667 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2cb16446-6f81-408b-ba6c-ad22e28ea9ca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:13.181801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2cb16446-6f81-408b-ba6c-ad22e28ea9ca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:13.189751 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2cb16446-6f81-408b-ba6c-ad22e28ea9ca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083909 Oct 11 07:07:13.190297 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1566/3135] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:13 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:14.212652 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d7e90140-937a-4ec9-b003-3add179027e5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:14.213256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d7e90140-937a-4ec9-b003-3add179027e5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:14.219781 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7e90140-937a-4ec9-b003-3add179027e5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:14.220252 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7e90140-937a-4ec9-b003-3add179027e5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:14.220679 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7e90140-937a-4ec9-b003-3add179027e5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:14.221357 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7e90140-937a-4ec9-b003-3add179027e5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:14.221819 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7e90140-937a-4ec9-b003-3add179027e5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:14.222218 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7e90140-937a-4ec9-b003-3add179027e5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:14.282527 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d7e90140-937a-4ec9-b003-3add179027e5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:14.290709 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d7e90140-937a-4ec9-b003-3add179027e5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081913 Oct 11 07:07:14.291266 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1570/3136] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:14 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:15.313691 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-700091e8-8eb9-4b4f-834b-df23be330952 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:15.314302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-700091e8-8eb9-4b4f-834b-df23be330952 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:15.321445 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-700091e8-8eb9-4b4f-834b-df23be330952 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:15.321925 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-700091e8-8eb9-4b4f-834b-df23be330952 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:15.322361 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-700091e8-8eb9-4b4f-834b-df23be330952 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:15.323063 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-700091e8-8eb9-4b4f-834b-df23be330952 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:15.323545 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-700091e8-8eb9-4b4f-834b-df23be330952 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:15.323972 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-700091e8-8eb9-4b4f-834b-df23be330952 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:15.384217 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-700091e8-8eb9-4b4f-834b-df23be330952 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:15.392249 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-700091e8-8eb9-4b4f-834b-df23be330952 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082403 Oct 11 07:07:15.392804 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1567/3137] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:15 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:16.414491 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c8daf637-d0b2-44f9-835a-eb382b1e2423 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:16.415128 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c8daf637-d0b2-44f9-835a-eb382b1e2423 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:16.421726 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c8daf637-d0b2-44f9-835a-eb382b1e2423 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:16.422206 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c8daf637-d0b2-44f9-835a-eb382b1e2423 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:16.422633 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c8daf637-d0b2-44f9-835a-eb382b1e2423 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:16.423319 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c8daf637-d0b2-44f9-835a-eb382b1e2423 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:16.423815 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c8daf637-d0b2-44f9-835a-eb382b1e2423 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:16.424242 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c8daf637-d0b2-44f9-835a-eb382b1e2423 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:16.485041 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c8daf637-d0b2-44f9-835a-eb382b1e2423 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:16.493198 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c8daf637-d0b2-44f9-835a-eb382b1e2423 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082517 Oct 11 07:07:16.493758 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1571/3138] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:16 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:17.516581 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1d51f1df-d1f8-4bb6-91dd-a11643591bf7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:17.517184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1d51f1df-d1f8-4bb6-91dd-a11643591bf7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:17.523868 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d51f1df-d1f8-4bb6-91dd-a11643591bf7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:17.524344 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d51f1df-d1f8-4bb6-91dd-a11643591bf7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:17.524797 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d51f1df-d1f8-4bb6-91dd-a11643591bf7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:17.525457 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d51f1df-d1f8-4bb6-91dd-a11643591bf7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:17.525901 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d51f1df-d1f8-4bb6-91dd-a11643591bf7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:17.526316 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1d51f1df-d1f8-4bb6-91dd-a11643591bf7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:17.641870 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1d51f1df-d1f8-4bb6-91dd-a11643591bf7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:17.650504 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1d51f1df-d1f8-4bb6-91dd-a11643591bf7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.137884 Oct 11 07:07:17.651067 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1568/3139] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:17 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:18.673354 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bea133cd-d017-49d1-a569-99d14f0cc034 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:18.673920 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bea133cd-d017-49d1-a569-99d14f0cc034 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:18.676797 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=28 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:07:18.681923 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bea133cd-d017-49d1-a569-99d14f0cc034 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:18.682402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bea133cd-d017-49d1-a569-99d14f0cc034 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:18.682833 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bea133cd-d017-49d1-a569-99d14f0cc034 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:18.683548 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bea133cd-d017-49d1-a569-99d14f0cc034 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:18.683997 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bea133cd-d017-49d1-a569-99d14f0cc034 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:18.684418 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bea133cd-d017-49d1-a569-99d14f0cc034 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:18.748034 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bea133cd-d017-49d1-a569-99d14f0cc034 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:18.756111 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bea133cd-d017-49d1-a569-99d14f0cc034 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.086648 Oct 11 07:07:18.756668 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1572/3140] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:18 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:19.778654 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a8e69b93-aa8b-4d83-8982-56c9acb8498f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:19.779228 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a8e69b93-aa8b-4d83-8982-56c9acb8498f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:19.785628 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a8e69b93-aa8b-4d83-8982-56c9acb8498f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:19.786109 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a8e69b93-aa8b-4d83-8982-56c9acb8498f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:19.786546 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a8e69b93-aa8b-4d83-8982-56c9acb8498f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:19.787233 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a8e69b93-aa8b-4d83-8982-56c9acb8498f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:19.787720 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a8e69b93-aa8b-4d83-8982-56c9acb8498f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:19.788141 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a8e69b93-aa8b-4d83-8982-56c9acb8498f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:19.848607 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a8e69b93-aa8b-4d83-8982-56c9acb8498f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:19.856722 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a8e69b93-aa8b-4d83-8982-56c9acb8498f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082037 Oct 11 07:07:19.857281 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1569/3141] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:19 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:20.879952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-76a74f9f-c8f7-4dc3-a235-e4b1adc2bbaf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:20.880581 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-76a74f9f-c8f7-4dc3-a235-e4b1adc2bbaf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:20.887167 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-76a74f9f-c8f7-4dc3-a235-e4b1adc2bbaf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:20.887665 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-76a74f9f-c8f7-4dc3-a235-e4b1adc2bbaf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:20.888092 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-76a74f9f-c8f7-4dc3-a235-e4b1adc2bbaf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:20.888766 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-76a74f9f-c8f7-4dc3-a235-e4b1adc2bbaf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:20.889216 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-76a74f9f-c8f7-4dc3-a235-e4b1adc2bbaf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:20.889627 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-76a74f9f-c8f7-4dc3-a235-e4b1adc2bbaf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:20.949210 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-76a74f9f-c8f7-4dc3-a235-e4b1adc2bbaf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:20.957819 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-76a74f9f-c8f7-4dc3-a235-e4b1adc2bbaf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082219 Oct 11 07:07:20.958369 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1573/3142] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:20 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:21.979016 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-754cd14d-81a1-41b0-a33e-6ad901a1138e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:21.979656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-754cd14d-81a1-41b0-a33e-6ad901a1138e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:21.986083 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-754cd14d-81a1-41b0-a33e-6ad901a1138e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:21.986558 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-754cd14d-81a1-41b0-a33e-6ad901a1138e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:21.986988 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-754cd14d-81a1-41b0-a33e-6ad901a1138e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:21.988232 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-754cd14d-81a1-41b0-a33e-6ad901a1138e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:21.988716 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-754cd14d-81a1-41b0-a33e-6ad901a1138e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:21.989138 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-754cd14d-81a1-41b0-a33e-6ad901a1138e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:22.048649 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-754cd14d-81a1-41b0-a33e-6ad901a1138e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:22.057245 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-754cd14d-81a1-41b0-a33e-6ad901a1138e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082042 Oct 11 07:07:22.057800 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1570/3143] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:21 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:23.080154 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9e568d33-6a42-46b6-8b75-442ff85b0ccc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:23.080772 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9e568d33-6a42-46b6-8b75-442ff85b0ccc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:23.087710 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e568d33-6a42-46b6-8b75-442ff85b0ccc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:23.088181 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e568d33-6a42-46b6-8b75-442ff85b0ccc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:23.088608 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e568d33-6a42-46b6-8b75-442ff85b0ccc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:23.089285 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e568d33-6a42-46b6-8b75-442ff85b0ccc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:23.089727 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e568d33-6a42-46b6-8b75-442ff85b0ccc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:23.090143 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9e568d33-6a42-46b6-8b75-442ff85b0ccc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:23.092628 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=84 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:07:23.153815 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9e568d33-6a42-46b6-8b75-442ff85b0ccc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:23.161891 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9e568d33-6a42-46b6-8b75-442ff85b0ccc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085620 Oct 11 07:07:23.162443 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1574/3144] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:23 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:24.184540 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6c141a64-d7de-4fc3-b40b-192a564a2d95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:24.185140 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6c141a64-d7de-4fc3-b40b-192a564a2d95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:24.191572 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c141a64-d7de-4fc3-b40b-192a564a2d95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:24.192053 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c141a64-d7de-4fc3-b40b-192a564a2d95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:24.192489 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c141a64-d7de-4fc3-b40b-192a564a2d95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:24.193184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c141a64-d7de-4fc3-b40b-192a564a2d95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:24.193637 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c141a64-d7de-4fc3-b40b-192a564a2d95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:24.194071 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6c141a64-d7de-4fc3-b40b-192a564a2d95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:24.253926 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6c141a64-d7de-4fc3-b40b-192a564a2d95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:24.262286 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6c141a64-d7de-4fc3-b40b-192a564a2d95 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081574 Oct 11 07:07:24.262845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1571/3145] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:24 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:25.285805 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3a48d1da-465d-4f10-9f0c-7dce9967f163 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:25.286397 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3a48d1da-465d-4f10-9f0c-7dce9967f163 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:25.292847 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3a48d1da-465d-4f10-9f0c-7dce9967f163 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:25.293323 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3a48d1da-465d-4f10-9f0c-7dce9967f163 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:25.293755 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3a48d1da-465d-4f10-9f0c-7dce9967f163 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:25.294436 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3a48d1da-465d-4f10-9f0c-7dce9967f163 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:25.294884 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3a48d1da-465d-4f10-9f0c-7dce9967f163 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:25.295301 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3a48d1da-465d-4f10-9f0c-7dce9967f163 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:25.354681 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3a48d1da-465d-4f10-9f0c-7dce9967f163 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:25.363382 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3a48d1da-465d-4f10-9f0c-7dce9967f163 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081901 Oct 11 07:07:25.364273 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1575/3146] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:25 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:26.386051 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-79f4afd3-0a3b-44ec-85a5-276f063005b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:26.386631 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-79f4afd3-0a3b-44ec-85a5-276f063005b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:26.393034 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-79f4afd3-0a3b-44ec-85a5-276f063005b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:26.393509 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-79f4afd3-0a3b-44ec-85a5-276f063005b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:26.393938 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-79f4afd3-0a3b-44ec-85a5-276f063005b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:26.394618 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-79f4afd3-0a3b-44ec-85a5-276f063005b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:26.395066 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-79f4afd3-0a3b-44ec-85a5-276f063005b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:26.395507 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-79f4afd3-0a3b-44ec-85a5-276f063005b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:26.459033 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-79f4afd3-0a3b-44ec-85a5-276f063005b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:26.467311 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-79f4afd3-0a3b-44ec-85a5-276f063005b0 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085389 Oct 11 07:07:26.467896 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1572/3147] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:26 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:27.489599 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5b24a91e-dcba-4537-9a04-745d850a6154 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:27.490208 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5b24a91e-dcba-4537-9a04-745d850a6154 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:27.492210 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 07:07:27.492345 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Tue Oct 11 07:07:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d (ip 10.222.0.39) !!! Oct 11 07:07:27.498889 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5b24a91e-dcba-4537-9a04-745d850a6154 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:27.499363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5b24a91e-dcba-4537-9a04-745d850a6154 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:27.499814 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5b24a91e-dcba-4537-9a04-745d850a6154 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:27.500503 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5b24a91e-dcba-4537-9a04-745d850a6154 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:27.500948 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5b24a91e-dcba-4537-9a04-745d850a6154 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:27.501366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5b24a91e-dcba-4537-9a04-745d850a6154 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:27.568581 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5b24a91e-dcba-4537-9a04-745d850a6154 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:27.578262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5b24a91e-dcba-4537-9a04-745d850a6154 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.092516 Oct 11 07:07:27.578909 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1576/3148] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:27 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:28.602246 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-22d3d584-bd8b-4174-afc6-b55eb4ab0045 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:28.602859 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-22d3d584-bd8b-4174-afc6-b55eb4ab0045 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:28.609266 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-22d3d584-bd8b-4174-afc6-b55eb4ab0045 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:28.609744 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-22d3d584-bd8b-4174-afc6-b55eb4ab0045 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:28.610177 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-22d3d584-bd8b-4174-afc6-b55eb4ab0045 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:28.610871 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-22d3d584-bd8b-4174-afc6-b55eb4ab0045 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:28.611334 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-22d3d584-bd8b-4174-afc6-b55eb4ab0045 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:28.611785 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-22d3d584-bd8b-4174-afc6-b55eb4ab0045 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:28.615732 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=84 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:07:28.674163 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-22d3d584-bd8b-4174-afc6-b55eb4ab0045 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:28.682335 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-22d3d584-bd8b-4174-afc6-b55eb4ab0045 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083999 Oct 11 07:07:28.682894 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1573/3149] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:28 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:29.705259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e7e809fe-59dc-417a-82b7-cfe0c0e99325 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:29.705798 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e7e809fe-59dc-417a-82b7-cfe0c0e99325 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:29.712214 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7e809fe-59dc-417a-82b7-cfe0c0e99325 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:29.712686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7e809fe-59dc-417a-82b7-cfe0c0e99325 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:29.713122 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7e809fe-59dc-417a-82b7-cfe0c0e99325 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:29.713802 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7e809fe-59dc-417a-82b7-cfe0c0e99325 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:29.714247 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7e809fe-59dc-417a-82b7-cfe0c0e99325 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:29.714693 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7e809fe-59dc-417a-82b7-cfe0c0e99325 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:29.774656 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e7e809fe-59dc-417a-82b7-cfe0c0e99325 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:29.782756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e7e809fe-59dc-417a-82b7-cfe0c0e99325 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081544 Oct 11 07:07:29.783317 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1577/3150] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:29 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:30.805735 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0791192f-a0ff-4ca0-83ba-18eba72f8435 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:30.806302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0791192f-a0ff-4ca0-83ba-18eba72f8435 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:30.812633 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0791192f-a0ff-4ca0-83ba-18eba72f8435 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:30.813108 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0791192f-a0ff-4ca0-83ba-18eba72f8435 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:30.813543 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0791192f-a0ff-4ca0-83ba-18eba72f8435 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:30.814233 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0791192f-a0ff-4ca0-83ba-18eba72f8435 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:30.814710 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0791192f-a0ff-4ca0-83ba-18eba72f8435 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:30.815152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0791192f-a0ff-4ca0-83ba-18eba72f8435 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:30.874807 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0791192f-a0ff-4ca0-83ba-18eba72f8435 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:30.883307 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0791192f-a0ff-4ca0-83ba-18eba72f8435 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081399 Oct 11 07:07:30.883741 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1574/3151] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:30 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:31.905817 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9b14f2b1-068f-49dc-90e6-a8ac5e7583a7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:31.906446 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9b14f2b1-068f-49dc-90e6-a8ac5e7583a7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:31.913432 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9b14f2b1-068f-49dc-90e6-a8ac5e7583a7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:31.913899 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9b14f2b1-068f-49dc-90e6-a8ac5e7583a7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:31.914323 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9b14f2b1-068f-49dc-90e6-a8ac5e7583a7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:31.915028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9b14f2b1-068f-49dc-90e6-a8ac5e7583a7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:31.915490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9b14f2b1-068f-49dc-90e6-a8ac5e7583a7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:31.915907 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9b14f2b1-068f-49dc-90e6-a8ac5e7583a7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:31.976571 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9b14f2b1-068f-49dc-90e6-a8ac5e7583a7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:31.984478 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9b14f2b1-068f-49dc-90e6-a8ac5e7583a7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082513 Oct 11 07:07:31.985028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1578/3152] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:31 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:33.006938 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c4fa1745-5c10-45b0-b60f-2c0d04d89f20 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:33.007577 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c4fa1745-5c10-45b0-b60f-2c0d04d89f20 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:33.010216 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=28 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:07:33.015378 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4fa1745-5c10-45b0-b60f-2c0d04d89f20 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:33.015888 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4fa1745-5c10-45b0-b60f-2c0d04d89f20 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:33.016323 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4fa1745-5c10-45b0-b60f-2c0d04d89f20 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:33.017010 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4fa1745-5c10-45b0-b60f-2c0d04d89f20 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:33.017460 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4fa1745-5c10-45b0-b60f-2c0d04d89f20 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:33.018425 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4fa1745-5c10-45b0-b60f-2c0d04d89f20 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:33.077669 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c4fa1745-5c10-45b0-b60f-2c0d04d89f20 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:33.086188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c4fa1745-5c10-45b0-b60f-2c0d04d89f20 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083317 Oct 11 07:07:33.086733 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1575/3153] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:33 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:34.109259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ef08b3b8-cb41-41bb-86fa-34d849600e45 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:34.109865 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ef08b3b8-cb41-41bb-86fa-34d849600e45 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:34.116921 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef08b3b8-cb41-41bb-86fa-34d849600e45 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:34.117393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef08b3b8-cb41-41bb-86fa-34d849600e45 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:34.117820 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef08b3b8-cb41-41bb-86fa-34d849600e45 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:34.118500 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef08b3b8-cb41-41bb-86fa-34d849600e45 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:34.118944 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef08b3b8-cb41-41bb-86fa-34d849600e45 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:34.119363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef08b3b8-cb41-41bb-86fa-34d849600e45 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:34.179690 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ef08b3b8-cb41-41bb-86fa-34d849600e45 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:34.187731 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ef08b3b8-cb41-41bb-86fa-34d849600e45 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082269 Oct 11 07:07:34.188281 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1579/3154] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:34 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:35.210795 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-851c427b-3ab7-46f3-aa22-22487b77a685 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:35.211453 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-851c427b-3ab7-46f3-aa22-22487b77a685 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:35.218304 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-851c427b-3ab7-46f3-aa22-22487b77a685 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:35.218788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-851c427b-3ab7-46f3-aa22-22487b77a685 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:35.219217 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-851c427b-3ab7-46f3-aa22-22487b77a685 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:35.219950 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-851c427b-3ab7-46f3-aa22-22487b77a685 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:35.220397 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-851c427b-3ab7-46f3-aa22-22487b77a685 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:35.220849 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-851c427b-3ab7-46f3-aa22-22487b77a685 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:35.283510 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-851c427b-3ab7-46f3-aa22-22487b77a685 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:35.291538 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-851c427b-3ab7-46f3-aa22-22487b77a685 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.084559 Oct 11 07:07:35.292089 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1576/3155] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:35 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:36.314199 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-310f9a3a-6bc3-4b84-b315-641ba6216569 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:36.314828 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-310f9a3a-6bc3-4b84-b315-641ba6216569 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:36.321308 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-310f9a3a-6bc3-4b84-b315-641ba6216569 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:36.321777 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-310f9a3a-6bc3-4b84-b315-641ba6216569 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:36.322203 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-310f9a3a-6bc3-4b84-b315-641ba6216569 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:36.322877 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-310f9a3a-6bc3-4b84-b315-641ba6216569 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:36.323315 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-310f9a3a-6bc3-4b84-b315-641ba6216569 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:36.323753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-310f9a3a-6bc3-4b84-b315-641ba6216569 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:36.388784 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-310f9a3a-6bc3-4b84-b315-641ba6216569 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:36.397385 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-310f9a3a-6bc3-4b84-b315-641ba6216569 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.087078 Oct 11 07:07:36.397935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1580/3156] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:36 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:37.420312 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d29170ca-1230-41bc-ac5e-c08fd74851ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:37.420959 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d29170ca-1230-41bc-ac5e-c08fd74851ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:37.428124 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d29170ca-1230-41bc-ac5e-c08fd74851ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:37.428615 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d29170ca-1230-41bc-ac5e-c08fd74851ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:37.429054 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d29170ca-1230-41bc-ac5e-c08fd74851ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:37.429750 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d29170ca-1230-41bc-ac5e-c08fd74851ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:37.430205 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d29170ca-1230-41bc-ac5e-c08fd74851ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:37.430631 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d29170ca-1230-41bc-ac5e-c08fd74851ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:37.491431 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d29170ca-1230-41bc-ac5e-c08fd74851ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:37.499598 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d29170ca-1230-41bc-ac5e-c08fd74851ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083101 Oct 11 07:07:37.500153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1577/3157] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:37 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:38.521901 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-73382c90-66d8-4b69-8288-cbd96345b9c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:38.522504 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-73382c90-66d8-4b69-8288-cbd96345b9c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:38.528911 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-73382c90-66d8-4b69-8288-cbd96345b9c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:38.529387 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-73382c90-66d8-4b69-8288-cbd96345b9c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:38.529814 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-73382c90-66d8-4b69-8288-cbd96345b9c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:38.530522 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-73382c90-66d8-4b69-8288-cbd96345b9c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:38.530950 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-73382c90-66d8-4b69-8288-cbd96345b9c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:38.531363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-73382c90-66d8-4b69-8288-cbd96345b9c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:38.593022 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-73382c90-66d8-4b69-8288-cbd96345b9c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:38.601670 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-73382c90-66d8-4b69-8288-cbd96345b9c7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.084186 Oct 11 07:07:38.602229 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1581/3158] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:38 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:39.624270 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-35d7e4f1-1fba-4971-b0ab-85f70e7a328a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:39.624877 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-35d7e4f1-1fba-4971-b0ab-85f70e7a328a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:39.631692 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-35d7e4f1-1fba-4971-b0ab-85f70e7a328a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:39.632168 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-35d7e4f1-1fba-4971-b0ab-85f70e7a328a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:39.632594 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-35d7e4f1-1fba-4971-b0ab-85f70e7a328a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:39.633275 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-35d7e4f1-1fba-4971-b0ab-85f70e7a328a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:39.633720 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-35d7e4f1-1fba-4971-b0ab-85f70e7a328a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:39.634131 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-35d7e4f1-1fba-4971-b0ab-85f70e7a328a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:39.694209 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-35d7e4f1-1fba-4971-b0ab-85f70e7a328a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:39.702282 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-35d7e4f1-1fba-4971-b0ab-85f70e7a328a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081899 Oct 11 07:07:39.702835 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1578/3159] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:39 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:40.724670 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b64f3d07-a0cc-4804-927b-0b8bbfc1b3c5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:40.725399 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b64f3d07-a0cc-4804-927b-0b8bbfc1b3c5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:40.731764 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b64f3d07-a0cc-4804-927b-0b8bbfc1b3c5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:40.732236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b64f3d07-a0cc-4804-927b-0b8bbfc1b3c5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:40.732657 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b64f3d07-a0cc-4804-927b-0b8bbfc1b3c5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:40.733336 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b64f3d07-a0cc-4804-927b-0b8bbfc1b3c5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:40.733774 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b64f3d07-a0cc-4804-927b-0b8bbfc1b3c5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:40.734184 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b64f3d07-a0cc-4804-927b-0b8bbfc1b3c5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:40.798301 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b64f3d07-a0cc-4804-927b-0b8bbfc1b3c5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:40.806951 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b64f3d07-a0cc-4804-927b-0b8bbfc1b3c5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.086114 Oct 11 07:07:40.807525 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1582/3160] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:40 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:41.831059 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d116e780-e03b-470e-82a3-28929df53acc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:41.831612 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d116e780-e03b-470e-82a3-28929df53acc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:41.837955 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d116e780-e03b-470e-82a3-28929df53acc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:41.838438 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d116e780-e03b-470e-82a3-28929df53acc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:41.838880 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d116e780-e03b-470e-82a3-28929df53acc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:41.839614 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d116e780-e03b-470e-82a3-28929df53acc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:41.840067 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d116e780-e03b-470e-82a3-28929df53acc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:41.840488 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d116e780-e03b-470e-82a3-28929df53acc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:41.902927 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d116e780-e03b-470e-82a3-28929df53acc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:41.911040 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d116e780-e03b-470e-82a3-28929df53acc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.084846 Oct 11 07:07:41.911621 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1579/3161] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:41 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:42.933442 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6c64d4c0-803e-4b89-8e70-d54ce92ee48c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:42.934022 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6c64d4c0-803e-4b89-8e70-d54ce92ee48c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:42.940360 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6c64d4c0-803e-4b89-8e70-d54ce92ee48c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:42.940823 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6c64d4c0-803e-4b89-8e70-d54ce92ee48c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:42.941247 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6c64d4c0-803e-4b89-8e70-d54ce92ee48c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:42.941921 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6c64d4c0-803e-4b89-8e70-d54ce92ee48c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:42.942363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6c64d4c0-803e-4b89-8e70-d54ce92ee48c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:42.942774 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6c64d4c0-803e-4b89-8e70-d54ce92ee48c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:43.002102 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6c64d4c0-803e-4b89-8e70-d54ce92ee48c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:43.010349 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6c64d4c0-803e-4b89-8e70-d54ce92ee48c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.080737 Oct 11 07:07:43.010903 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1583/3162] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:42 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:44.033294 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1cc9a98b-257d-4853-9283-085f9317213c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:44.033956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1cc9a98b-257d-4853-9283-085f9317213c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:44.040387 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1cc9a98b-257d-4853-9283-085f9317213c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:44.040871 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1cc9a98b-257d-4853-9283-085f9317213c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:44.041306 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1cc9a98b-257d-4853-9283-085f9317213c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:44.041996 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1cc9a98b-257d-4853-9283-085f9317213c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:44.042452 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1cc9a98b-257d-4853-9283-085f9317213c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:44.042886 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1cc9a98b-257d-4853-9283-085f9317213c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:44.106792 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1cc9a98b-257d-4853-9283-085f9317213c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:44.114976 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1cc9a98b-257d-4853-9283-085f9317213c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085504 Oct 11 07:07:44.115560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1580/3163] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:44 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:45.137973 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b589643c-5ab1-4bda-ae4b-33fe4af684ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:45.138603 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b589643c-5ab1-4bda-ae4b-33fe4af684ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:45.144950 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b589643c-5ab1-4bda-ae4b-33fe4af684ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:45.145418 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b589643c-5ab1-4bda-ae4b-33fe4af684ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:45.145843 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b589643c-5ab1-4bda-ae4b-33fe4af684ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:45.146518 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b589643c-5ab1-4bda-ae4b-33fe4af684ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:45.146958 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b589643c-5ab1-4bda-ae4b-33fe4af684ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:45.147373 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b589643c-5ab1-4bda-ae4b-33fe4af684ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:45.209428 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b589643c-5ab1-4bda-ae4b-33fe4af684ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:45.217431 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b589643c-5ab1-4bda-ae4b-33fe4af684ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083275 Oct 11 07:07:45.217989 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1584/3164] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:45 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:46.240472 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7af739b7-b734-4861-8b03-d4fa19e4b0ca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:46.241078 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7af739b7-b734-4861-8b03-d4fa19e4b0ca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:46.247529 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7af739b7-b734-4861-8b03-d4fa19e4b0ca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:46.248014 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7af739b7-b734-4861-8b03-d4fa19e4b0ca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:46.248447 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7af739b7-b734-4861-8b03-d4fa19e4b0ca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:46.249160 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7af739b7-b734-4861-8b03-d4fa19e4b0ca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:46.249605 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7af739b7-b734-4861-8b03-d4fa19e4b0ca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:46.250028 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7af739b7-b734-4861-8b03-d4fa19e4b0ca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:46.310195 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7af739b7-b734-4861-8b03-d4fa19e4b0ca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:46.318304 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7af739b7-b734-4861-8b03-d4fa19e4b0ca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082506 Oct 11 07:07:46.318855 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1581/3165] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:46 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:47.340693 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9894dd3d-91bb-45e7-86e1-5d1853cf35ab tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:47.341312 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9894dd3d-91bb-45e7-86e1-5d1853cf35ab tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:47.347810 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9894dd3d-91bb-45e7-86e1-5d1853cf35ab tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:47.348291 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9894dd3d-91bb-45e7-86e1-5d1853cf35ab tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:47.348726 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9894dd3d-91bb-45e7-86e1-5d1853cf35ab tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:47.349412 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9894dd3d-91bb-45e7-86e1-5d1853cf35ab tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:47.349863 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9894dd3d-91bb-45e7-86e1-5d1853cf35ab tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:47.350289 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9894dd3d-91bb-45e7-86e1-5d1853cf35ab tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:47.410932 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9894dd3d-91bb-45e7-86e1-5d1853cf35ab tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:47.419110 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9894dd3d-91bb-45e7-86e1-5d1853cf35ab tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082283 Oct 11 07:07:47.419704 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1585/3166] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:47 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:48.442342 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-dd4f581b-7ac8-4389-b006-94d4d0f3fffa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:48.442981 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-dd4f581b-7ac8-4389-b006-94d4d0f3fffa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:48.449173 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dd4f581b-7ac8-4389-b006-94d4d0f3fffa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:48.449649 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dd4f581b-7ac8-4389-b006-94d4d0f3fffa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:48.450082 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dd4f581b-7ac8-4389-b006-94d4d0f3fffa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:48.450770 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dd4f581b-7ac8-4389-b006-94d4d0f3fffa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:48.451223 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dd4f581b-7ac8-4389-b006-94d4d0f3fffa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:48.451669 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-dd4f581b-7ac8-4389-b006-94d4d0f3fffa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:48.511099 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-dd4f581b-7ac8-4389-b006-94d4d0f3fffa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:48.520612 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-dd4f581b-7ac8-4389-b006-94d4d0f3fffa tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081847 Oct 11 07:07:48.520612 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1582/3167] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:48 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:49.543757 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-aacef881-1a61-4415-88d7-0d445164859e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:49.544358 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-aacef881-1a61-4415-88d7-0d445164859e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:49.546651 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=28 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:07:49.551860 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aacef881-1a61-4415-88d7-0d445164859e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:49.552331 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aacef881-1a61-4415-88d7-0d445164859e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:49.552755 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aacef881-1a61-4415-88d7-0d445164859e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:49.553423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aacef881-1a61-4415-88d7-0d445164859e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:49.553862 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aacef881-1a61-4415-88d7-0d445164859e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:49.554274 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aacef881-1a61-4415-88d7-0d445164859e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:49.613541 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-aacef881-1a61-4415-88d7-0d445164859e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:49.621561 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-aacef881-1a61-4415-88d7-0d445164859e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081662 Oct 11 07:07:49.622100 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1586/3168] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:49 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:50.644189 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d164e84f-15fb-427e-ae07-891b25b1eb73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:50.644798 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d164e84f-15fb-427e-ae07-891b25b1eb73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:50.651186 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d164e84f-15fb-427e-ae07-891b25b1eb73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:50.651702 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d164e84f-15fb-427e-ae07-891b25b1eb73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:50.652139 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d164e84f-15fb-427e-ae07-891b25b1eb73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:50.652826 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d164e84f-15fb-427e-ae07-891b25b1eb73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:50.653283 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d164e84f-15fb-427e-ae07-891b25b1eb73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:50.653702 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d164e84f-15fb-427e-ae07-891b25b1eb73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:50.713565 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d164e84f-15fb-427e-ae07-891b25b1eb73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:50.722166 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d164e84f-15fb-427e-ae07-891b25b1eb73 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081872 Oct 11 07:07:50.722716 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1583/3169] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:50 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:51.745051 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fc3e4ede-a8dd-4175-9566-a4d4e5e55bca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:51.745587 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fc3e4ede-a8dd-4175-9566-a4d4e5e55bca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:51.751711 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fc3e4ede-a8dd-4175-9566-a4d4e5e55bca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:51.752184 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fc3e4ede-a8dd-4175-9566-a4d4e5e55bca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:51.752608 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fc3e4ede-a8dd-4175-9566-a4d4e5e55bca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:51.753281 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fc3e4ede-a8dd-4175-9566-a4d4e5e55bca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:51.753720 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fc3e4ede-a8dd-4175-9566-a4d4e5e55bca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:51.754132 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fc3e4ede-a8dd-4175-9566-a4d4e5e55bca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:51.816673 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fc3e4ede-a8dd-4175-9566-a4d4e5e55bca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:51.824733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fc3e4ede-a8dd-4175-9566-a4d4e5e55bca tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083574 Oct 11 07:07:51.825285 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1587/3170] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:51 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:52.847518 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3a0c8cc8-879d-43d4-967b-b0b37fef6ab3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:52.848076 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3a0c8cc8-879d-43d4-967b-b0b37fef6ab3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:52.854424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a0c8cc8-879d-43d4-967b-b0b37fef6ab3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:52.854902 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a0c8cc8-879d-43d4-967b-b0b37fef6ab3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:52.855332 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a0c8cc8-879d-43d4-967b-b0b37fef6ab3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:52.856044 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a0c8cc8-879d-43d4-967b-b0b37fef6ab3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:52.856494 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a0c8cc8-879d-43d4-967b-b0b37fef6ab3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:52.856915 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3a0c8cc8-879d-43d4-967b-b0b37fef6ab3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:52.919750 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3a0c8cc8-879d-43d4-967b-b0b37fef6ab3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:52.928458 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3a0c8cc8-879d-43d4-967b-b0b37fef6ab3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.084868 Oct 11 07:07:52.929018 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1584/3171] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:52 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:53.950846 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c1376d2c-ca9b-497f-a1b8-85c622336d04 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:53.951760 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c1376d2c-ca9b-497f-a1b8-85c622336d04 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:53.958860 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c1376d2c-ca9b-497f-a1b8-85c622336d04 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:53.959399 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c1376d2c-ca9b-497f-a1b8-85c622336d04 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:53.959819 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c1376d2c-ca9b-497f-a1b8-85c622336d04 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:53.960515 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c1376d2c-ca9b-497f-a1b8-85c622336d04 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:53.960964 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c1376d2c-ca9b-497f-a1b8-85c622336d04 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:53.961387 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c1376d2c-ca9b-497f-a1b8-85c622336d04 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:53.965299 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=84 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:07:54.027157 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c1376d2c-ca9b-497f-a1b8-85c622336d04 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:54.035408 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c1376d2c-ca9b-497f-a1b8-85c622336d04 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.088379 Oct 11 07:07:54.035993 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1588/3172] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:53 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:55.058312 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e73cae2c-a560-49e1-818c-ef68dfce0a8b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:55.058926 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e73cae2c-a560-49e1-818c-ef68dfce0a8b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:55.066041 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e73cae2c-a560-49e1-818c-ef68dfce0a8b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:55.066519 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e73cae2c-a560-49e1-818c-ef68dfce0a8b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:55.066952 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e73cae2c-a560-49e1-818c-ef68dfce0a8b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:55.067680 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e73cae2c-a560-49e1-818c-ef68dfce0a8b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:55.068130 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e73cae2c-a560-49e1-818c-ef68dfce0a8b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:55.068553 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e73cae2c-a560-49e1-818c-ef68dfce0a8b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:55.345949 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e73cae2c-a560-49e1-818c-ef68dfce0a8b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:55.354083 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e73cae2c-a560-49e1-818c-ef68dfce0a8b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.299603 Oct 11 07:07:55.354631 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1585/3173] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:55 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:56.376638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-02e26f1f-70d5-491a-bc34-93c497f8c46e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:56.377252 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-02e26f1f-70d5-491a-bc34-93c497f8c46e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:56.383837 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02e26f1f-70d5-491a-bc34-93c497f8c46e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:56.384304 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02e26f1f-70d5-491a-bc34-93c497f8c46e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:56.384725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02e26f1f-70d5-491a-bc34-93c497f8c46e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:56.385405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02e26f1f-70d5-491a-bc34-93c497f8c46e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:56.385845 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02e26f1f-70d5-491a-bc34-93c497f8c46e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:56.386261 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02e26f1f-70d5-491a-bc34-93c497f8c46e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:56.450775 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-02e26f1f-70d5-491a-bc34-93c497f8c46e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:56.458822 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-02e26f1f-70d5-491a-bc34-93c497f8c46e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.086024 Oct 11 07:07:56.459372 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1589/3174] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:56 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:57.480627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-638ba9c4-7231-49da-b703-caa3dcaa373f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:57.481247 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-638ba9c4-7231-49da-b703-caa3dcaa373f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:57.488254 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-638ba9c4-7231-49da-b703-caa3dcaa373f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:57.488737 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-638ba9c4-7231-49da-b703-caa3dcaa373f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:57.489175 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-638ba9c4-7231-49da-b703-caa3dcaa373f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:57.489864 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-638ba9c4-7231-49da-b703-caa3dcaa373f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:57.490314 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-638ba9c4-7231-49da-b703-caa3dcaa373f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:57.490737 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-638ba9c4-7231-49da-b703-caa3dcaa373f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:57.553319 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-638ba9c4-7231-49da-b703-caa3dcaa373f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:57.561519 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-638ba9c4-7231-49da-b703-caa3dcaa373f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.084728 Oct 11 07:07:57.562075 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1586/3175] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:57 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:58.583793 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-196b86da-0b44-42d0-82c1-e542765f7bd7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:58.584399 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-196b86da-0b44-42d0-82c1-e542765f7bd7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:58.590944 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-196b86da-0b44-42d0-82c1-e542765f7bd7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:58.591504 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-196b86da-0b44-42d0-82c1-e542765f7bd7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:58.591947 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-196b86da-0b44-42d0-82c1-e542765f7bd7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:58.592633 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-196b86da-0b44-42d0-82c1-e542765f7bd7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:58.593077 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-196b86da-0b44-42d0-82c1-e542765f7bd7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:58.593496 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-196b86da-0b44-42d0-82c1-e542765f7bd7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:58.654503 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-196b86da-0b44-42d0-82c1-e542765f7bd7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:58.662650 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-196b86da-0b44-42d0-82c1-e542765f7bd7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082569 Oct 11 07:07:58.663155 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1590/3176] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:58 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:07:59.685299 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-58a3d136-bb05-4fc7-a000-f906eba80e78 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:07:59.685847 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-58a3d136-bb05-4fc7-a000-f906eba80e78 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:07:59.692490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-58a3d136-bb05-4fc7-a000-f906eba80e78 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:59.692970 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-58a3d136-bb05-4fc7-a000-f906eba80e78 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:59.693406 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-58a3d136-bb05-4fc7-a000-f906eba80e78 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:59.694095 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-58a3d136-bb05-4fc7-a000-f906eba80e78 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:07:59.694548 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-58a3d136-bb05-4fc7-a000-f906eba80e78 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:07:59.694969 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-58a3d136-bb05-4fc7-a000-f906eba80e78 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:07:59.698877 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=84 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:07:59.754329 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-58a3d136-bb05-4fc7-a000-f906eba80e78 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:07:59.762590 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-58a3d136-bb05-4fc7-a000-f906eba80e78 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081240 Oct 11 07:07:59.763139 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1587/3177] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:07:59 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:00.785743 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8266cc72-b930-404c-8981-a166d73b6f85 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:00.786288 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8266cc72-b930-404c-8981-a166d73b6f85 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:00.792606 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8266cc72-b930-404c-8981-a166d73b6f85 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:00.793082 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8266cc72-b930-404c-8981-a166d73b6f85 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:00.793516 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8266cc72-b930-404c-8981-a166d73b6f85 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:00.794203 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8266cc72-b930-404c-8981-a166d73b6f85 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:00.794649 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8266cc72-b930-404c-8981-a166d73b6f85 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:00.795067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8266cc72-b930-404c-8981-a166d73b6f85 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:00.854853 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8266cc72-b930-404c-8981-a166d73b6f85 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:00.862958 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8266cc72-b930-404c-8981-a166d73b6f85 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081907 Oct 11 07:08:00.863535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1591/3178] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:00 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:01.885394 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ba4aeb00-44ee-46cd-8158-1d3a11a92069 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:01.886007 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ba4aeb00-44ee-46cd-8158-1d3a11a92069 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:01.892111 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba4aeb00-44ee-46cd-8158-1d3a11a92069 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:01.892587 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba4aeb00-44ee-46cd-8158-1d3a11a92069 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:01.893020 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba4aeb00-44ee-46cd-8158-1d3a11a92069 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:01.893710 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba4aeb00-44ee-46cd-8158-1d3a11a92069 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:01.894161 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba4aeb00-44ee-46cd-8158-1d3a11a92069 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:01.894582 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ba4aeb00-44ee-46cd-8158-1d3a11a92069 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:01.954234 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ba4aeb00-44ee-46cd-8158-1d3a11a92069 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:01.962287 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ba4aeb00-44ee-46cd-8158-1d3a11a92069 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081065 Oct 11 07:08:01.962846 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1588/3179] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:01 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:02.985641 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b01df7dc-53b6-4e8a-b88b-5156e6f38770 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:02.986276 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b01df7dc-53b6-4e8a-b88b-5156e6f38770 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:02.992702 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b01df7dc-53b6-4e8a-b88b-5156e6f38770 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:02.993171 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b01df7dc-53b6-4e8a-b88b-5156e6f38770 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:02.993593 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b01df7dc-53b6-4e8a-b88b-5156e6f38770 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:02.994268 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b01df7dc-53b6-4e8a-b88b-5156e6f38770 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:02.994707 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b01df7dc-53b6-4e8a-b88b-5156e6f38770 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:02.995121 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b01df7dc-53b6-4e8a-b88b-5156e6f38770 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:03.057627 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b01df7dc-53b6-4e8a-b88b-5156e6f38770 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:03.065542 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b01df7dc-53b6-4e8a-b88b-5156e6f38770 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.084276 Oct 11 07:08:03.066088 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1592/3180] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:02 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:04.088524 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3125ec74-9c72-4e83-b5aa-219732179941 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:04.089091 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3125ec74-9c72-4e83-b5aa-219732179941 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:04.091384 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=28 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:08:04.096604 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3125ec74-9c72-4e83-b5aa-219732179941 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:04.097084 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3125ec74-9c72-4e83-b5aa-219732179941 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:04.097519 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3125ec74-9c72-4e83-b5aa-219732179941 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:04.098207 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3125ec74-9c72-4e83-b5aa-219732179941 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:04.098655 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3125ec74-9c72-4e83-b5aa-219732179941 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:04.099076 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3125ec74-9c72-4e83-b5aa-219732179941 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:04.162551 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3125ec74-9c72-4e83-b5aa-219732179941 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:04.170607 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3125ec74-9c72-4e83-b5aa-219732179941 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085986 Oct 11 07:08:04.171158 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1589/3181] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:04 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:05.193548 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9a962873-7737-4942-ab40-b0d738c50263 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:05.194151 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9a962873-7737-4942-ab40-b0d738c50263 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:05.200542 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9a962873-7737-4942-ab40-b0d738c50263 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:05.201013 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9a962873-7737-4942-ab40-b0d738c50263 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:05.201440 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9a962873-7737-4942-ab40-b0d738c50263 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:05.202124 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9a962873-7737-4942-ab40-b0d738c50263 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:05.202567 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9a962873-7737-4942-ab40-b0d738c50263 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:05.202992 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9a962873-7737-4942-ab40-b0d738c50263 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:05.262845 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9a962873-7737-4942-ab40-b0d738c50263 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:05.271502 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9a962873-7737-4942-ab40-b0d738c50263 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081820 Oct 11 07:08:05.272056 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1593/3182] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:05 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:06.294148 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-54fc6eae-c7ad-4288-8cbf-e3d6cd45599e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:06.294735 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-54fc6eae-c7ad-4288-8cbf-e3d6cd45599e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:06.301629 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-54fc6eae-c7ad-4288-8cbf-e3d6cd45599e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:06.302104 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-54fc6eae-c7ad-4288-8cbf-e3d6cd45599e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:06.302532 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-54fc6eae-c7ad-4288-8cbf-e3d6cd45599e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:06.303224 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-54fc6eae-c7ad-4288-8cbf-e3d6cd45599e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:06.303702 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-54fc6eae-c7ad-4288-8cbf-e3d6cd45599e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:06.304122 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-54fc6eae-c7ad-4288-8cbf-e3d6cd45599e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:06.363712 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-54fc6eae-c7ad-4288-8cbf-e3d6cd45599e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:06.371869 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-54fc6eae-c7ad-4288-8cbf-e3d6cd45599e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081589 Oct 11 07:08:06.372420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1590/3183] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:06 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:07.394403 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5fd69f42-ec47-4564-afe7-5ed485b02328 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:07.395001 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5fd69f42-ec47-4564-afe7-5ed485b02328 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:07.401296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5fd69f42-ec47-4564-afe7-5ed485b02328 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:07.401772 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5fd69f42-ec47-4564-afe7-5ed485b02328 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:07.402196 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5fd69f42-ec47-4564-afe7-5ed485b02328 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:07.402875 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5fd69f42-ec47-4564-afe7-5ed485b02328 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:07.403315 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5fd69f42-ec47-4564-afe7-5ed485b02328 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:07.403763 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5fd69f42-ec47-4564-afe7-5ed485b02328 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:07.465402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5fd69f42-ec47-4564-afe7-5ed485b02328 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:07.473623 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5fd69f42-ec47-4564-afe7-5ed485b02328 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083521 Oct 11 07:08:07.474181 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1594/3184] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:07 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:08.496435 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8ce0a8e4-0e0b-4290-90f8-49213688097d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:08.497043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8ce0a8e4-0e0b-4290-90f8-49213688097d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:08.504034 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8ce0a8e4-0e0b-4290-90f8-49213688097d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:08.504508 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8ce0a8e4-0e0b-4290-90f8-49213688097d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:08.504936 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8ce0a8e4-0e0b-4290-90f8-49213688097d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:08.505616 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8ce0a8e4-0e0b-4290-90f8-49213688097d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:08.506318 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8ce0a8e4-0e0b-4290-90f8-49213688097d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:08.506735 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8ce0a8e4-0e0b-4290-90f8-49213688097d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:08.566804 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8ce0a8e4-0e0b-4290-90f8-49213688097d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:08.574940 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8ce0a8e4-0e0b-4290-90f8-49213688097d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082357 Oct 11 07:08:08.575514 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1591/3185] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:08 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:09.597068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0f35525f-db57-459b-8ea7-0bdbff4928cd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:09.597610 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0f35525f-db57-459b-8ea7-0bdbff4928cd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:09.604024 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0f35525f-db57-459b-8ea7-0bdbff4928cd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:09.604500 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0f35525f-db57-459b-8ea7-0bdbff4928cd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:09.604926 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0f35525f-db57-459b-8ea7-0bdbff4928cd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:09.605607 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0f35525f-db57-459b-8ea7-0bdbff4928cd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:09.606048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0f35525f-db57-459b-8ea7-0bdbff4928cd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:09.606463 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0f35525f-db57-459b-8ea7-0bdbff4928cd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:09.666884 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0f35525f-db57-459b-8ea7-0bdbff4928cd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:09.675101 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0f35525f-db57-459b-8ea7-0bdbff4928cd tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081884 Oct 11 07:08:09.675692 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1595/3186] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:09 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:10.697893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a63df42b-1aba-4c83-8840-03c48f65a30a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:10.698441 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a63df42b-1aba-4c83-8840-03c48f65a30a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:10.705454 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a63df42b-1aba-4c83-8840-03c48f65a30a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:10.705928 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a63df42b-1aba-4c83-8840-03c48f65a30a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:10.706360 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a63df42b-1aba-4c83-8840-03c48f65a30a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:10.707046 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a63df42b-1aba-4c83-8840-03c48f65a30a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:10.707526 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a63df42b-1aba-4c83-8840-03c48f65a30a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:10.707949 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a63df42b-1aba-4c83-8840-03c48f65a30a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:10.768826 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a63df42b-1aba-4c83-8840-03c48f65a30a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:10.779264 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a63df42b-1aba-4c83-8840-03c48f65a30a tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085212 Oct 11 07:08:10.779882 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1592/3187] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:10 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:11.802970 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a6f6087c-57b4-4743-a5f7-0284304051ad tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:11.803542 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a6f6087c-57b4-4743-a5f7-0284304051ad tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:11.809933 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6f6087c-57b4-4743-a5f7-0284304051ad tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:11.810404 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6f6087c-57b4-4743-a5f7-0284304051ad tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:11.810860 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6f6087c-57b4-4743-a5f7-0284304051ad tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:11.811573 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6f6087c-57b4-4743-a5f7-0284304051ad tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:11.812024 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6f6087c-57b4-4743-a5f7-0284304051ad tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:11.812440 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a6f6087c-57b4-4743-a5f7-0284304051ad tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:11.874541 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a6f6087c-57b4-4743-a5f7-0284304051ad tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:11.882826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a6f6087c-57b4-4743-a5f7-0284304051ad tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.084393 Oct 11 07:08:11.883383 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1596/3188] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:11 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:12.904701 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a26dc8da-27ad-4118-b07b-d44e004be2ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:12.905329 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a26dc8da-27ad-4118-b07b-d44e004be2ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:12.911630 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a26dc8da-27ad-4118-b07b-d44e004be2ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:12.912109 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a26dc8da-27ad-4118-b07b-d44e004be2ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:12.912535 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a26dc8da-27ad-4118-b07b-d44e004be2ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:12.913220 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a26dc8da-27ad-4118-b07b-d44e004be2ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:12.913665 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a26dc8da-27ad-4118-b07b-d44e004be2ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:12.914082 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a26dc8da-27ad-4118-b07b-d44e004be2ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:12.979524 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a26dc8da-27ad-4118-b07b-d44e004be2ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:12.988160 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a26dc8da-27ad-4118-b07b-d44e004be2ec tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.087270 Oct 11 07:08:12.988717 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1593/3189] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:12 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:14.011371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9f0b6892-ab64-4211-b8ed-99f693353cc8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:14.012001 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9f0b6892-ab64-4211-b8ed-99f693353cc8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:14.019200 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9f0b6892-ab64-4211-b8ed-99f693353cc8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:14.019699 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9f0b6892-ab64-4211-b8ed-99f693353cc8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:14.020130 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9f0b6892-ab64-4211-b8ed-99f693353cc8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:14.020816 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9f0b6892-ab64-4211-b8ed-99f693353cc8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:14.021262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9f0b6892-ab64-4211-b8ed-99f693353cc8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:14.021679 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9f0b6892-ab64-4211-b8ed-99f693353cc8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:14.081480 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9f0b6892-ab64-4211-b8ed-99f693353cc8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:14.089518 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9f0b6892-ab64-4211-b8ed-99f693353cc8 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081964 Oct 11 07:08:14.090107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1597/3190] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:14 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:08:15.112282 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d3a06e9c-00d7-44cd-b41d-4cae5513e26d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:15.112909 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d3a06e9c-00d7-44cd-b41d-4cae5513e26d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:15.119233 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d3a06e9c-00d7-44cd-b41d-4cae5513e26d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:15.119735 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d3a06e9c-00d7-44cd-b41d-4cae5513e26d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:15.120161 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d3a06e9c-00d7-44cd-b41d-4cae5513e26d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:15.120836 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d3a06e9c-00d7-44cd-b41d-4cae5513e26d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:15.121279 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d3a06e9c-00d7-44cd-b41d-4cae5513e26d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:15.121692 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d3a06e9c-00d7-44cd-b41d-4cae5513e26d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:15.181633 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d3a06e9c-00d7-44cd-b41d-4cae5513e26d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:15.189638 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d3a06e9c-00d7-44cd-b41d-4cae5513e26d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081636 Oct 11 07:08:15.190815 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1594/3191] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:15 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:16.212549 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-91330ad9-380c-44db-b284-da8c04ac4724 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:16.213158 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-91330ad9-380c-44db-b284-da8c04ac4724 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:16.219554 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-91330ad9-380c-44db-b284-da8c04ac4724 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:16.220028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-91330ad9-380c-44db-b284-da8c04ac4724 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:16.220453 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-91330ad9-380c-44db-b284-da8c04ac4724 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:16.221140 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-91330ad9-380c-44db-b284-da8c04ac4724 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:16.221581 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-91330ad9-380c-44db-b284-da8c04ac4724 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:16.222221 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-91330ad9-380c-44db-b284-da8c04ac4724 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:16.282000 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-91330ad9-380c-44db-b284-da8c04ac4724 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:16.290206 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-91330ad9-380c-44db-b284-da8c04ac4724 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081540 Oct 11 07:08:16.290762 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1598/3192] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:16 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:17.312477 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ecffab7e-59ac-4db4-887d-25f8502c68e3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:17.313089 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ecffab7e-59ac-4db4-887d-25f8502c68e3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:17.319389 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ecffab7e-59ac-4db4-887d-25f8502c68e3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:17.319892 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ecffab7e-59ac-4db4-887d-25f8502c68e3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:17.320319 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ecffab7e-59ac-4db4-887d-25f8502c68e3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:17.321025 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ecffab7e-59ac-4db4-887d-25f8502c68e3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:17.321474 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ecffab7e-59ac-4db4-887d-25f8502c68e3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:17.321886 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ecffab7e-59ac-4db4-887d-25f8502c68e3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:17.382289 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ecffab7e-59ac-4db4-887d-25f8502c68e3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:17.390739 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ecffab7e-59ac-4db4-887d-25f8502c68e3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082042 Oct 11 07:08:17.391293 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1595/3193] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:17 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:18.413396 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4ee925bf-a409-420a-9508-250c00080ef4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:18.414040 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4ee925bf-a409-420a-9508-250c00080ef4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:18.420460 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ee925bf-a409-420a-9508-250c00080ef4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:18.420934 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ee925bf-a409-420a-9508-250c00080ef4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:18.421363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ee925bf-a409-420a-9508-250c00080ef4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:18.422043 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ee925bf-a409-420a-9508-250c00080ef4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:18.422488 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ee925bf-a409-420a-9508-250c00080ef4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:18.422907 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ee925bf-a409-420a-9508-250c00080ef4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:18.485802 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4ee925bf-a409-420a-9508-250c00080ef4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:18.493904 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4ee925bf-a409-420a-9508-250c00080ef4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.084355 Oct 11 07:08:18.494455 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1599/3194] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:18 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:19.517109 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4d1ce030-81bc-43c1-9e2a-52b1626cc282 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:19.518266 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4d1ce030-81bc-43c1-9e2a-52b1626cc282 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:19.524390 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4d1ce030-81bc-43c1-9e2a-52b1626cc282 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:19.524861 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4d1ce030-81bc-43c1-9e2a-52b1626cc282 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:19.525289 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4d1ce030-81bc-43c1-9e2a-52b1626cc282 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:19.525967 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4d1ce030-81bc-43c1-9e2a-52b1626cc282 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:19.526416 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4d1ce030-81bc-43c1-9e2a-52b1626cc282 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:19.526834 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4d1ce030-81bc-43c1-9e2a-52b1626cc282 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:19.587734 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4d1ce030-81bc-43c1-9e2a-52b1626cc282 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:19.596368 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4d1ce030-81bc-43c1-9e2a-52b1626cc282 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082515 Oct 11 07:08:19.596928 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1596/3195] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:19 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:20.618640 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7525c3c0-b4e7-439b-b6b9-18c690469057 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:20.619281 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7525c3c0-b4e7-439b-b6b9-18c690469057 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:20.621956 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=28 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:08:20.627470 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7525c3c0-b4e7-439b-b6b9-18c690469057 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:20.627954 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7525c3c0-b4e7-439b-b6b9-18c690469057 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:20.628385 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7525c3c0-b4e7-439b-b6b9-18c690469057 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:20.629587 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7525c3c0-b4e7-439b-b6b9-18c690469057 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:20.630039 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7525c3c0-b4e7-439b-b6b9-18c690469057 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:20.632397 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7525c3c0-b4e7-439b-b6b9-18c690469057 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:20.697149 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7525c3c0-b4e7-439b-b6b9-18c690469057 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:20.705380 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7525c3c0-b4e7-439b-b6b9-18c690469057 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.090552 Oct 11 07:08:20.705951 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1600/3196] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:20 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:08:21.729007 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5fd4bb86-6a8e-402f-ad39-82be5de54d56 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:21.729549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5fd4bb86-6a8e-402f-ad39-82be5de54d56 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:21.736011 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5fd4bb86-6a8e-402f-ad39-82be5de54d56 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:21.736488 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5fd4bb86-6a8e-402f-ad39-82be5de54d56 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:21.736917 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5fd4bb86-6a8e-402f-ad39-82be5de54d56 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:21.737599 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5fd4bb86-6a8e-402f-ad39-82be5de54d56 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:21.738045 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5fd4bb86-6a8e-402f-ad39-82be5de54d56 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:21.738463 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5fd4bb86-6a8e-402f-ad39-82be5de54d56 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:21.801405 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5fd4bb86-6a8e-402f-ad39-82be5de54d56 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:21.809452 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5fd4bb86-6a8e-402f-ad39-82be5de54d56 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.084357 Oct 11 07:08:21.809998 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1597/3197] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:21 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:22.831444 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-36f361ff-d8e1-4184-83b4-ed873296f925 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:22.832598 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-36f361ff-d8e1-4184-83b4-ed873296f925 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:22.838623 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-36f361ff-d8e1-4184-83b4-ed873296f925 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:22.839091 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-36f361ff-d8e1-4184-83b4-ed873296f925 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:22.839550 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-36f361ff-d8e1-4184-83b4-ed873296f925 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:22.840228 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-36f361ff-d8e1-4184-83b4-ed873296f925 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:22.840667 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-36f361ff-d8e1-4184-83b4-ed873296f925 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:22.841077 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-36f361ff-d8e1-4184-83b4-ed873296f925 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:22.900815 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-36f361ff-d8e1-4184-83b4-ed873296f925 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:22.908829 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-36f361ff-d8e1-4184-83b4-ed873296f925 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081298 Oct 11 07:08:22.909380 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1601/3198] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:22 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:23.933284 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c43554a8-c67c-4b34-aed7-2d41c3afcf4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:23.933894 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c43554a8-c67c-4b34-aed7-2d41c3afcf4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:23.940267 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c43554a8-c67c-4b34-aed7-2d41c3afcf4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:23.940747 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c43554a8-c67c-4b34-aed7-2d41c3afcf4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:23.941180 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c43554a8-c67c-4b34-aed7-2d41c3afcf4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:23.941867 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c43554a8-c67c-4b34-aed7-2d41c3afcf4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:23.942318 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c43554a8-c67c-4b34-aed7-2d41c3afcf4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:23.942741 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c43554a8-c67c-4b34-aed7-2d41c3afcf4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:24.002375 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c43554a8-c67c-4b34-aed7-2d41c3afcf4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:24.010668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c43554a8-c67c-4b34-aed7-2d41c3afcf4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081306 Oct 11 07:08:24.011227 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1598/3199] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:23 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:25.033556 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-02d7c331-9b99-4b73-8fed-a8c1ba31434c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:25.034096 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-02d7c331-9b99-4b73-8fed-a8c1ba31434c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:25.040929 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02d7c331-9b99-4b73-8fed-a8c1ba31434c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:25.041397 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02d7c331-9b99-4b73-8fed-a8c1ba31434c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:25.041819 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02d7c331-9b99-4b73-8fed-a8c1ba31434c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:25.042494 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02d7c331-9b99-4b73-8fed-a8c1ba31434c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:25.042932 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02d7c331-9b99-4b73-8fed-a8c1ba31434c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:25.043343 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-02d7c331-9b99-4b73-8fed-a8c1ba31434c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:25.045817 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=84 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:08:25.104626 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-02d7c331-9b99-4b73-8fed-a8c1ba31434c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:25.112684 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-02d7c331-9b99-4b73-8fed-a8c1ba31434c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083065 Oct 11 07:08:25.113880 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1602/3200] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:25 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:26.135932 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-388a1716-b6ba-465c-bfad-c8079fe46481 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:26.136554 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-388a1716-b6ba-465c-bfad-c8079fe46481 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:26.142874 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-388a1716-b6ba-465c-bfad-c8079fe46481 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:26.143354 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-388a1716-b6ba-465c-bfad-c8079fe46481 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:26.143822 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-388a1716-b6ba-465c-bfad-c8079fe46481 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:26.145169 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-388a1716-b6ba-465c-bfad-c8079fe46481 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:26.145624 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-388a1716-b6ba-465c-bfad-c8079fe46481 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:26.146051 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-388a1716-b6ba-465c-bfad-c8079fe46481 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:26.209092 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-388a1716-b6ba-465c-bfad-c8079fe46481 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:26.217309 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-388a1716-b6ba-465c-bfad-c8079fe46481 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085188 Oct 11 07:08:26.217857 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1599/3201] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:26 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:27.240115 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fd6a5799-2b19-4734-b8b8-930cdba34117 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:27.240755 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fd6a5799-2b19-4734-b8b8-930cdba34117 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:27.247171 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fd6a5799-2b19-4734-b8b8-930cdba34117 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:27.247763 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fd6a5799-2b19-4734-b8b8-930cdba34117 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:27.248198 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fd6a5799-2b19-4734-b8b8-930cdba34117 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:27.248887 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fd6a5799-2b19-4734-b8b8-930cdba34117 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:27.249338 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fd6a5799-2b19-4734-b8b8-930cdba34117 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:27.249763 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fd6a5799-2b19-4734-b8b8-930cdba34117 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:27.312805 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fd6a5799-2b19-4734-b8b8-930cdba34117 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:27.320876 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fd6a5799-2b19-4734-b8b8-930cdba34117 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085111 Oct 11 07:08:27.321433 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1603/3202] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:27 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:28.343229 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9f7315b9-e1e2-4e10-9af6-b306091a910c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:28.343884 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9f7315b9-e1e2-4e10-9af6-b306091a910c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:28.350234 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9f7315b9-e1e2-4e10-9af6-b306091a910c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:28.350715 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9f7315b9-e1e2-4e10-9af6-b306091a910c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:28.351153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9f7315b9-e1e2-4e10-9af6-b306091a910c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:28.351877 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9f7315b9-e1e2-4e10-9af6-b306091a910c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:28.352330 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9f7315b9-e1e2-4e10-9af6-b306091a910c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:28.352749 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9f7315b9-e1e2-4e10-9af6-b306091a910c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:28.414427 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9f7315b9-e1e2-4e10-9af6-b306091a910c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:28.422714 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9f7315b9-e1e2-4e10-9af6-b306091a910c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083252 Oct 11 07:08:28.423281 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1600/3203] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:28 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:29.445709 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8a25d5e6-f750-47e9-82bd-c8c25ee8f961 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:29.446316 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8a25d5e6-f750-47e9-82bd-c8c25ee8f961 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:29.452744 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8a25d5e6-f750-47e9-82bd-c8c25ee8f961 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:29.453219 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8a25d5e6-f750-47e9-82bd-c8c25ee8f961 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:29.453649 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8a25d5e6-f750-47e9-82bd-c8c25ee8f961 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:29.454327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8a25d5e6-f750-47e9-82bd-c8c25ee8f961 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:29.454773 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8a25d5e6-f750-47e9-82bd-c8c25ee8f961 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:29.455191 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8a25d5e6-f750-47e9-82bd-c8c25ee8f961 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:29.515888 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8a25d5e6-f750-47e9-82bd-c8c25ee8f961 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:29.524444 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8a25d5e6-f750-47e9-82bd-c8c25ee8f961 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082618 Oct 11 07:08:29.525002 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1604/3204] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:29 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:30.548346 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-edfac56d-8fb9-410d-a0ae-c874e22d2a98 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:30.548943 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-edfac56d-8fb9-410d-a0ae-c874e22d2a98 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:30.555935 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-edfac56d-8fb9-410d-a0ae-c874e22d2a98 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:30.556414 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-edfac56d-8fb9-410d-a0ae-c874e22d2a98 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:30.556842 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-edfac56d-8fb9-410d-a0ae-c874e22d2a98 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:30.557519 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-edfac56d-8fb9-410d-a0ae-c874e22d2a98 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:30.557968 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-edfac56d-8fb9-410d-a0ae-c874e22d2a98 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:30.558382 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-edfac56d-8fb9-410d-a0ae-c874e22d2a98 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:30.560871 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=84 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:08:30.622439 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-edfac56d-8fb9-410d-a0ae-c874e22d2a98 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:30.630796 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-edfac56d-8fb9-410d-a0ae-c874e22d2a98 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.086053 Oct 11 07:08:30.631360 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1601/3205] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:30 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:31.653031 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-27d41b2d-13d4-47aa-8c30-7ed4bf612edc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:31.653698 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-27d41b2d-13d4-47aa-8c30-7ed4bf612edc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:31.660236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-27d41b2d-13d4-47aa-8c30-7ed4bf612edc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:31.660646 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-27d41b2d-13d4-47aa-8c30-7ed4bf612edc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:31.661071 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-27d41b2d-13d4-47aa-8c30-7ed4bf612edc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:31.661743 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-27d41b2d-13d4-47aa-8c30-7ed4bf612edc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:31.662185 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-27d41b2d-13d4-47aa-8c30-7ed4bf612edc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:31.662597 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-27d41b2d-13d4-47aa-8c30-7ed4bf612edc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:31.721777 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-27d41b2d-13d4-47aa-8c30-7ed4bf612edc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:31.729679 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-27d41b2d-13d4-47aa-8c30-7ed4bf612edc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.080482 Oct 11 07:08:31.730233 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1605/3206] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:31 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:32.752677 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-de501f39-6562-4681-a972-d83c6347b970 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:32.753723 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-de501f39-6562-4681-a972-d83c6347b970 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:32.760435 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-de501f39-6562-4681-a972-d83c6347b970 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:32.760919 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-de501f39-6562-4681-a972-d83c6347b970 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:32.761355 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-de501f39-6562-4681-a972-d83c6347b970 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:32.762043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-de501f39-6562-4681-a972-d83c6347b970 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:32.762500 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-de501f39-6562-4681-a972-d83c6347b970 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:32.762923 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-de501f39-6562-4681-a972-d83c6347b970 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:32.822722 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-de501f39-6562-4681-a972-d83c6347b970 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:32.830740 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-de501f39-6562-4681-a972-d83c6347b970 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082040 Oct 11 07:08:32.831340 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1602/3207] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:32 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:33.854042 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f2616f02-590c-4519-834c-dc7612b5202e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:33.854669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f2616f02-590c-4519-834c-dc7612b5202e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:33.861056 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f2616f02-590c-4519-834c-dc7612b5202e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:33.861524 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f2616f02-590c-4519-834c-dc7612b5202e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:33.861948 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f2616f02-590c-4519-834c-dc7612b5202e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:33.862650 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f2616f02-590c-4519-834c-dc7612b5202e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:33.863068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f2616f02-590c-4519-834c-dc7612b5202e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:33.863515 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f2616f02-590c-4519-834c-dc7612b5202e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:33.922739 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f2616f02-590c-4519-834c-dc7612b5202e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:33.930732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f2616f02-590c-4519-834c-dc7612b5202e tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.080539 Oct 11 07:08:33.931318 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1606/3208] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:33 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:35.007648 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0617cb20-8057-478b-8f40-554ff833ffa2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:35.008255 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0617cb20-8057-478b-8f40-554ff833ffa2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:35.010515 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=28 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:08:35.015737 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0617cb20-8057-478b-8f40-554ff833ffa2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:35.016213 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0617cb20-8057-478b-8f40-554ff833ffa2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:35.016646 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0617cb20-8057-478b-8f40-554ff833ffa2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:35.017328 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0617cb20-8057-478b-8f40-554ff833ffa2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:35.017773 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0617cb20-8057-478b-8f40-554ff833ffa2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:35.018191 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0617cb20-8057-478b-8f40-554ff833ffa2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:35.077769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0617cb20-8057-478b-8f40-554ff833ffa2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:35.086596 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0617cb20-8057-478b-8f40-554ff833ffa2 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083509 Oct 11 07:08:35.087157 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1603/3209] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:35 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:36.108433 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9c0dd61b-3e28-4554-8b79-2409ce5fb767 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:36.109041 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9c0dd61b-3e28-4554-8b79-2409ce5fb767 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:36.115444 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c0dd61b-3e28-4554-8b79-2409ce5fb767 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:36.115930 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c0dd61b-3e28-4554-8b79-2409ce5fb767 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:36.116362 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c0dd61b-3e28-4554-8b79-2409ce5fb767 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:36.117042 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c0dd61b-3e28-4554-8b79-2409ce5fb767 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:36.117492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c0dd61b-3e28-4554-8b79-2409ce5fb767 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:36.117909 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9c0dd61b-3e28-4554-8b79-2409ce5fb767 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:36.181983 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9c0dd61b-3e28-4554-8b79-2409ce5fb767 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:36.190349 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9c0dd61b-3e28-4554-8b79-2409ce5fb767 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085679 Oct 11 07:08:36.191188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1607/3210] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:36 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:37.213607 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e205cb57-8594-4e8e-9f04-e930b5cb1adf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:37.214240 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e205cb57-8594-4e8e-9f04-e930b5cb1adf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:37.220706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e205cb57-8594-4e8e-9f04-e930b5cb1adf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:37.221184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e205cb57-8594-4e8e-9f04-e930b5cb1adf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:37.221618 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e205cb57-8594-4e8e-9f04-e930b5cb1adf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:37.222304 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e205cb57-8594-4e8e-9f04-e930b5cb1adf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:37.222756 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e205cb57-8594-4e8e-9f04-e930b5cb1adf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:37.223177 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e205cb57-8594-4e8e-9f04-e930b5cb1adf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:37.283868 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e205cb57-8594-4e8e-9f04-e930b5cb1adf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:37.292083 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e205cb57-8594-4e8e-9f04-e930b5cb1adf tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082335 Oct 11 07:08:37.292640 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1604/3211] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:37 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:38.314265 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5702c351-4a8a-4d0d-9bd0-f171c3dea0fb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:38.314843 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5702c351-4a8a-4d0d-9bd0-f171c3dea0fb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:38.321418 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5702c351-4a8a-4d0d-9bd0-f171c3dea0fb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:38.321895 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5702c351-4a8a-4d0d-9bd0-f171c3dea0fb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:38.322323 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5702c351-4a8a-4d0d-9bd0-f171c3dea0fb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:38.323010 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5702c351-4a8a-4d0d-9bd0-f171c3dea0fb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:38.323472 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5702c351-4a8a-4d0d-9bd0-f171c3dea0fb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:38.323892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5702c351-4a8a-4d0d-9bd0-f171c3dea0fb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:38.383721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5702c351-4a8a-4d0d-9bd0-f171c3dea0fb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:38.392184 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5702c351-4a8a-4d0d-9bd0-f171c3dea0fb tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081874 Oct 11 07:08:38.392741 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1608/3212] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:38 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:39.415654 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1fa051f4-6c0d-4820-ab34-3a3a30d47ae7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:39.416267 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1fa051f4-6c0d-4820-ab34-3a3a30d47ae7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:39.422648 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fa051f4-6c0d-4820-ab34-3a3a30d47ae7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:39.423127 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fa051f4-6c0d-4820-ab34-3a3a30d47ae7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:39.423607 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fa051f4-6c0d-4820-ab34-3a3a30d47ae7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:39.424291 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fa051f4-6c0d-4820-ab34-3a3a30d47ae7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:39.424814 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fa051f4-6c0d-4820-ab34-3a3a30d47ae7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:39.425761 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fa051f4-6c0d-4820-ab34-3a3a30d47ae7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:39.488855 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1fa051f4-6c0d-4820-ab34-3a3a30d47ae7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:39.497129 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1fa051f4-6c0d-4820-ab34-3a3a30d47ae7 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085339 Oct 11 07:08:39.497686 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1605/3213] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:39 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:40.520774 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-21edee09-e46c-48d6-9a4d-e0f12787fa91 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:40.521617 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-21edee09-e46c-48d6-9a4d-e0f12787fa91 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:40.529200 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21edee09-e46c-48d6-9a4d-e0f12787fa91 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:40.529669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21edee09-e46c-48d6-9a4d-e0f12787fa91 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:40.530094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21edee09-e46c-48d6-9a4d-e0f12787fa91 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:40.530773 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21edee09-e46c-48d6-9a4d-e0f12787fa91 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:40.531215 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21edee09-e46c-48d6-9a4d-e0f12787fa91 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:40.531663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21edee09-e46c-48d6-9a4d-e0f12787fa91 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:40.591153 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-21edee09-e46c-48d6-9a4d-e0f12787fa91 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:40.599190 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-21edee09-e46c-48d6-9a4d-e0f12787fa91 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083129 Oct 11 07:08:40.599765 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1609/3214] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:40 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:41.622022 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e300de46-8cf8-4693-9e97-d6d4bd68fdac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:41.622631 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e300de46-8cf8-4693-9e97-d6d4bd68fdac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:41.629824 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e300de46-8cf8-4693-9e97-d6d4bd68fdac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:41.630560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e300de46-8cf8-4693-9e97-d6d4bd68fdac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:41.630990 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e300de46-8cf8-4693-9e97-d6d4bd68fdac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:41.631779 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e300de46-8cf8-4693-9e97-d6d4bd68fdac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:41.632233 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e300de46-8cf8-4693-9e97-d6d4bd68fdac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:41.632652 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e300de46-8cf8-4693-9e97-d6d4bd68fdac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:41.694980 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e300de46-8cf8-4693-9e97-d6d4bd68fdac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:41.703089 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e300de46-8cf8-4693-9e97-d6d4bd68fdac tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.084903 Oct 11 07:08:41.703662 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1606/3215] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:41 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:42.727017 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ff5b4fbe-e0e6-4037-aec6-7318d7f4d32d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:42.727588 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ff5b4fbe-e0e6-4037-aec6-7318d7f4d32d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:42.733997 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff5b4fbe-e0e6-4037-aec6-7318d7f4d32d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:42.734469 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff5b4fbe-e0e6-4037-aec6-7318d7f4d32d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:42.734894 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff5b4fbe-e0e6-4037-aec6-7318d7f4d32d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:42.735599 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff5b4fbe-e0e6-4037-aec6-7318d7f4d32d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:42.736044 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff5b4fbe-e0e6-4037-aec6-7318d7f4d32d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:42.736459 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff5b4fbe-e0e6-4037-aec6-7318d7f4d32d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:42.797076 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ff5b4fbe-e0e6-4037-aec6-7318d7f4d32d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:42.805322 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ff5b4fbe-e0e6-4037-aec6-7318d7f4d32d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082288 Oct 11 07:08:42.805888 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1610/3216] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:42 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:43.827845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1dab436e-e9d2-4d6e-8305-ce0ef495341c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:43.828454 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1dab436e-e9d2-4d6e-8305-ce0ef495341c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:43.835897 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1dab436e-e9d2-4d6e-8305-ce0ef495341c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:43.836376 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1dab436e-e9d2-4d6e-8305-ce0ef495341c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:43.836806 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1dab436e-e9d2-4d6e-8305-ce0ef495341c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:43.837517 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1dab436e-e9d2-4d6e-8305-ce0ef495341c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:43.837962 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1dab436e-e9d2-4d6e-8305-ce0ef495341c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:43.838377 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1dab436e-e9d2-4d6e-8305-ce0ef495341c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:43.897943 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1dab436e-e9d2-4d6e-8305-ce0ef495341c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:43.905932 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1dab436e-e9d2-4d6e-8305-ce0ef495341c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081978 Oct 11 07:08:43.906520 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1607/3217] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:43 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:44.928037 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-63741487-fa0a-4fb0-84ac-273e0bce53f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:44.928646 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-63741487-fa0a-4fb0-84ac-273e0bce53f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:44.935025 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-63741487-fa0a-4fb0-84ac-273e0bce53f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:44.935541 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-63741487-fa0a-4fb0-84ac-273e0bce53f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:44.935977 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-63741487-fa0a-4fb0-84ac-273e0bce53f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:44.936661 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-63741487-fa0a-4fb0-84ac-273e0bce53f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:44.937109 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-63741487-fa0a-4fb0-84ac-273e0bce53f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:44.937527 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-63741487-fa0a-4fb0-84ac-273e0bce53f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:44.999214 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-63741487-fa0a-4fb0-84ac-273e0bce53f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:45.007678 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-63741487-fa0a-4fb0-84ac-273e0bce53f9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083445 Oct 11 07:08:45.008234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1611/3218] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:44 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:46.030051 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-aba9ea4c-0008-4f99-b4ee-98b52645cd4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:46.030660 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-aba9ea4c-0008-4f99-b4ee-98b52645cd4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:46.037578 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aba9ea4c-0008-4f99-b4ee-98b52645cd4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:46.038057 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aba9ea4c-0008-4f99-b4ee-98b52645cd4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:46.038493 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aba9ea4c-0008-4f99-b4ee-98b52645cd4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:46.039184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aba9ea4c-0008-4f99-b4ee-98b52645cd4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:46.039675 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aba9ea4c-0008-4f99-b4ee-98b52645cd4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:46.040100 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-aba9ea4c-0008-4f99-b4ee-98b52645cd4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:46.099600 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-aba9ea4c-0008-4f99-b4ee-98b52645cd4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:46.107633 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-aba9ea4c-0008-4f99-b4ee-98b52645cd4d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081364 Oct 11 07:08:46.108399 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1608/3219] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:46 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:47.131501 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-30963e24-98d7-4131-ac31-532ae29544ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:47.132115 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-30963e24-98d7-4131-ac31-532ae29544ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:47.138523 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-30963e24-98d7-4131-ac31-532ae29544ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:47.139003 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-30963e24-98d7-4131-ac31-532ae29544ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:47.139468 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-30963e24-98d7-4131-ac31-532ae29544ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:47.140165 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-30963e24-98d7-4131-ac31-532ae29544ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:47.140614 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-30963e24-98d7-4131-ac31-532ae29544ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:47.141045 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-30963e24-98d7-4131-ac31-532ae29544ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:47.201379 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-30963e24-98d7-4131-ac31-532ae29544ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:47.209514 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-30963e24-98d7-4131-ac31-532ae29544ce tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082680 Oct 11 07:08:47.210075 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1612/3220] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:47 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:48.231480 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ecfe5736-b248-4004-8c18-f1790570caad tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:48.232048 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ecfe5736-b248-4004-8c18-f1790570caad tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:48.238040 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ecfe5736-b248-4004-8c18-f1790570caad tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:48.238512 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ecfe5736-b248-4004-8c18-f1790570caad tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:48.238938 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ecfe5736-b248-4004-8c18-f1790570caad tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:48.239648 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ecfe5736-b248-4004-8c18-f1790570caad tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:48.240096 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ecfe5736-b248-4004-8c18-f1790570caad tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:48.240512 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ecfe5736-b248-4004-8c18-f1790570caad tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:48.302698 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ecfe5736-b248-4004-8c18-f1790570caad tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:48.310710 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ecfe5736-b248-4004-8c18-f1790570caad tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083151 Oct 11 07:08:48.311276 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1609/3221] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:48 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:49.332970 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fd8cba73-e77b-40ad-814b-19a606c22334 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:49.333565 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fd8cba73-e77b-40ad-814b-19a606c22334 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:49.339981 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fd8cba73-e77b-40ad-814b-19a606c22334 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:49.340461 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fd8cba73-e77b-40ad-814b-19a606c22334 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:49.340894 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fd8cba73-e77b-40ad-814b-19a606c22334 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:49.341582 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fd8cba73-e77b-40ad-814b-19a606c22334 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:49.342032 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fd8cba73-e77b-40ad-814b-19a606c22334 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:49.342456 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fd8cba73-e77b-40ad-814b-19a606c22334 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:49.405654 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fd8cba73-e77b-40ad-814b-19a606c22334 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:49.414827 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fd8cba73-e77b-40ad-814b-19a606c22334 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085784 Oct 11 07:08:49.415510 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1613/3222] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:49 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:50.437416 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3da49a6a-e79a-4845-9a7a-dbc8879dcb27 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:50.438027 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3da49a6a-e79a-4845-9a7a-dbc8879dcb27 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:50.445356 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3da49a6a-e79a-4845-9a7a-dbc8879dcb27 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:50.445833 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3da49a6a-e79a-4845-9a7a-dbc8879dcb27 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:50.446267 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3da49a6a-e79a-4845-9a7a-dbc8879dcb27 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:50.446953 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3da49a6a-e79a-4845-9a7a-dbc8879dcb27 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:50.447405 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3da49a6a-e79a-4845-9a7a-dbc8879dcb27 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:50.447848 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3da49a6a-e79a-4845-9a7a-dbc8879dcb27 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:50.509140 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3da49a6a-e79a-4845-9a7a-dbc8879dcb27 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:50.517130 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3da49a6a-e79a-4845-9a7a-dbc8879dcb27 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083549 Oct 11 07:08:50.517682 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1610/3223] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:50 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:51.539583 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e6bd6c02-eb1e-402e-9c0a-4514127c5105 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:51.540181 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e6bd6c02-eb1e-402e-9c0a-4514127c5105 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:51.542326 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=28 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:08:51.547588 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e6bd6c02-eb1e-402e-9c0a-4514127c5105 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:51.548054 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e6bd6c02-eb1e-402e-9c0a-4514127c5105 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:51.548475 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e6bd6c02-eb1e-402e-9c0a-4514127c5105 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:51.549151 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e6bd6c02-eb1e-402e-9c0a-4514127c5105 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:51.549588 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e6bd6c02-eb1e-402e-9c0a-4514127c5105 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:51.550001 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e6bd6c02-eb1e-402e-9c0a-4514127c5105 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:51.609660 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e6bd6c02-eb1e-402e-9c0a-4514127c5105 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:51.617751 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e6bd6c02-eb1e-402e-9c0a-4514127c5105 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082260 Oct 11 07:08:51.618301 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1614/3224] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:51 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:52.640727 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-9110eb63-2e6a-4ad0-9ee7-4f8015788ff6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:52.641337 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-9110eb63-2e6a-4ad0-9ee7-4f8015788ff6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:52.648060 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9110eb63-2e6a-4ad0-9ee7-4f8015788ff6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:52.648558 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9110eb63-2e6a-4ad0-9ee7-4f8015788ff6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:52.648951 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9110eb63-2e6a-4ad0-9ee7-4f8015788ff6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:52.649630 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9110eb63-2e6a-4ad0-9ee7-4f8015788ff6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:52.650109 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9110eb63-2e6a-4ad0-9ee7-4f8015788ff6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:52.650530 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-9110eb63-2e6a-4ad0-9ee7-4f8015788ff6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:52.710202 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-9110eb63-2e6a-4ad0-9ee7-4f8015788ff6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:52.718327 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-9110eb63-2e6a-4ad0-9ee7-4f8015788ff6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081472 Oct 11 07:08:52.718884 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1611/3225] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:52 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:53.740878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6ebc3d96-0746-4e6c-8047-0c7c44b1ce37 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:53.741418 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6ebc3d96-0746-4e6c-8047-0c7c44b1ce37 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:53.747868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6ebc3d96-0746-4e6c-8047-0c7c44b1ce37 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:53.748343 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6ebc3d96-0746-4e6c-8047-0c7c44b1ce37 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:53.748784 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6ebc3d96-0746-4e6c-8047-0c7c44b1ce37 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:53.749474 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6ebc3d96-0746-4e6c-8047-0c7c44b1ce37 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:53.749924 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6ebc3d96-0746-4e6c-8047-0c7c44b1ce37 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:53.750348 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6ebc3d96-0746-4e6c-8047-0c7c44b1ce37 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:53.813606 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6ebc3d96-0746-4e6c-8047-0c7c44b1ce37 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:53.821684 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6ebc3d96-0746-4e6c-8047-0c7c44b1ce37 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085457 Oct 11 07:08:53.822240 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1615/3226] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:53 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:54.843838 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bc4572a1-3178-435f-8a22-95329fda29ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:54.844435 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bc4572a1-3178-435f-8a22-95329fda29ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:54.851652 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bc4572a1-3178-435f-8a22-95329fda29ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:54.852132 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bc4572a1-3178-435f-8a22-95329fda29ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:54.852564 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bc4572a1-3178-435f-8a22-95329fda29ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:54.853251 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bc4572a1-3178-435f-8a22-95329fda29ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:54.853704 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bc4572a1-3178-435f-8a22-95329fda29ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:54.854123 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bc4572a1-3178-435f-8a22-95329fda29ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:54.914115 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-bc4572a1-3178-435f-8a22-95329fda29ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:54.922306 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bc4572a1-3178-435f-8a22-95329fda29ea tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082314 Oct 11 07:08:54.922859 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1612/3227] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:54 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:55.944634 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-0b4a29f2-17e8-4c2e-b3f8-b65d452dca33 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:55.945223 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-0b4a29f2-17e8-4c2e-b3f8-b65d452dca33 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:55.951717 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b4a29f2-17e8-4c2e-b3f8-b65d452dca33 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:55.952193 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b4a29f2-17e8-4c2e-b3f8-b65d452dca33 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:55.952620 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b4a29f2-17e8-4c2e-b3f8-b65d452dca33 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:55.953301 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b4a29f2-17e8-4c2e-b3f8-b65d452dca33 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:55.953747 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b4a29f2-17e8-4c2e-b3f8-b65d452dca33 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:55.954164 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-0b4a29f2-17e8-4c2e-b3f8-b65d452dca33 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:55.956704 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=84 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:08:56.017902 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-0b4a29f2-17e8-4c2e-b3f8-b65d452dca33 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:56.026022 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-0b4a29f2-17e8-4c2e-b3f8-b65d452dca33 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085321 Oct 11 07:08:56.026579 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1616/3228] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:55 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:57.049327 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-67f7a4dc-914e-4dfb-bb3c-3fe50c052f7f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:57.049924 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-67f7a4dc-914e-4dfb-bb3c-3fe50c052f7f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:57.057016 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-67f7a4dc-914e-4dfb-bb3c-3fe50c052f7f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:57.057494 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-67f7a4dc-914e-4dfb-bb3c-3fe50c052f7f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:57.057925 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-67f7a4dc-914e-4dfb-bb3c-3fe50c052f7f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:57.058632 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-67f7a4dc-914e-4dfb-bb3c-3fe50c052f7f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:57.059083 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-67f7a4dc-914e-4dfb-bb3c-3fe50c052f7f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:57.059536 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-67f7a4dc-914e-4dfb-bb3c-3fe50c052f7f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:57.124066 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-67f7a4dc-914e-4dfb-bb3c-3fe50c052f7f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:57.132984 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-67f7a4dc-914e-4dfb-bb3c-3fe50c052f7f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.087555 Oct 11 07:08:57.133542 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1613/3229] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:57 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:58.154422 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bce46626-1fa4-4668-b5ee-d57cf19b7b31 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:58.155063 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bce46626-1fa4-4668-b5ee-d57cf19b7b31 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:58.161431 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bce46626-1fa4-4668-b5ee-d57cf19b7b31 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:58.161910 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bce46626-1fa4-4668-b5ee-d57cf19b7b31 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:58.162343 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bce46626-1fa4-4668-b5ee-d57cf19b7b31 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:58.163030 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bce46626-1fa4-4668-b5ee-d57cf19b7b31 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:58.163508 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bce46626-1fa4-4668-b5ee-d57cf19b7b31 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:58.163933 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bce46626-1fa4-4668-b5ee-d57cf19b7b31 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:58.224072 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bce46626-1fa4-4668-b5ee-d57cf19b7b31 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:58.232212 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bce46626-1fa4-4668-b5ee-d57cf19b7b31 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081634 Oct 11 07:08:58.232775 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1617/3230] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:58 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:08:59.254120 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c0d1feae-8dd6-4681-ac1b-bcf84312db23 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:08:59.254969 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c0d1feae-8dd6-4681-ac1b-bcf84312db23 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:08:59.262006 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c0d1feae-8dd6-4681-ac1b-bcf84312db23 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:59.262479 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c0d1feae-8dd6-4681-ac1b-bcf84312db23 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:59.262914 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c0d1feae-8dd6-4681-ac1b-bcf84312db23 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:59.263631 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c0d1feae-8dd6-4681-ac1b-bcf84312db23 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:08:59.264079 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c0d1feae-8dd6-4681-ac1b-bcf84312db23 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:08:59.264494 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c0d1feae-8dd6-4681-ac1b-bcf84312db23 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:08:59.324247 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c0d1feae-8dd6-4681-ac1b-bcf84312db23 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:08:59.332315 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c0d1feae-8dd6-4681-ac1b-bcf84312db23 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082066 Oct 11 07:08:59.332869 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1614/3231] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:08:59 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:09:00.354571 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-78874849-0e0f-48e1-b38a-7c83e7751158 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:09:00.355169 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-78874849-0e0f-48e1-b38a-7c83e7751158 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:09:00.361663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-78874849-0e0f-48e1-b38a-7c83e7751158 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:00.362133 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-78874849-0e0f-48e1-b38a-7c83e7751158 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:00.362559 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-78874849-0e0f-48e1-b38a-7c83e7751158 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:00.363242 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-78874849-0e0f-48e1-b38a-7c83e7751158 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:00.363719 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-78874849-0e0f-48e1-b38a-7c83e7751158 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:00.364139 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-78874849-0e0f-48e1-b38a-7c83e7751158 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:00.424535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-78874849-0e0f-48e1-b38a-7c83e7751158 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:09:00.432706 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-78874849-0e0f-48e1-b38a-7c83e7751158 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081951 Oct 11 07:09:00.433266 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1618/3232] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:09:00 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:09:01.455491 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-81560386-0a44-4ba3-899f-48401dbed022 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:09:01.456095 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-81560386-0a44-4ba3-899f-48401dbed022 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:09:01.462892 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81560386-0a44-4ba3-899f-48401dbed022 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:01.463365 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81560386-0a44-4ba3-899f-48401dbed022 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:01.463822 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81560386-0a44-4ba3-899f-48401dbed022 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:01.464504 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81560386-0a44-4ba3-899f-48401dbed022 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:01.464950 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81560386-0a44-4ba3-899f-48401dbed022 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:01.465370 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81560386-0a44-4ba3-899f-48401dbed022 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:01.469160 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=84 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:09:01.525717 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-81560386-0a44-4ba3-899f-48401dbed022 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:09:01.533599 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-81560386-0a44-4ba3-899f-48401dbed022 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081914 Oct 11 07:09:01.534151 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1615/3233] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:09:01 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:09:02.556089 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-10185e30-4fab-4fd0-9436-c7951da35438 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:09:02.556699 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-10185e30-4fab-4fd0-9436-c7951da35438 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:09:02.563023 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-10185e30-4fab-4fd0-9436-c7951da35438 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:02.563530 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-10185e30-4fab-4fd0-9436-c7951da35438 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:02.563959 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-10185e30-4fab-4fd0-9436-c7951da35438 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:02.564641 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-10185e30-4fab-4fd0-9436-c7951da35438 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:02.565087 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-10185e30-4fab-4fd0-9436-c7951da35438 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:02.565505 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-10185e30-4fab-4fd0-9436-c7951da35438 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:02.631837 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-10185e30-4fab-4fd0-9436-c7951da35438 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:09:02.639940 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-10185e30-4fab-4fd0-9436-c7951da35438 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.087694 Oct 11 07:09:02.640501 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1619/3234] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:09:02 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:09:03.664215 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1b6a8abe-6b88-4be1-ad63-562588b6e040 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:09:03.664795 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1b6a8abe-6b88-4be1-ad63-562588b6e040 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:09:03.671241 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1b6a8abe-6b88-4be1-ad63-562588b6e040 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:03.671765 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1b6a8abe-6b88-4be1-ad63-562588b6e040 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:03.672198 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1b6a8abe-6b88-4be1-ad63-562588b6e040 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:03.672887 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1b6a8abe-6b88-4be1-ad63-562588b6e040 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:03.673348 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1b6a8abe-6b88-4be1-ad63-562588b6e040 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:03.673763 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1b6a8abe-6b88-4be1-ad63-562588b6e040 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:03.734399 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1b6a8abe-6b88-4be1-ad63-562588b6e040 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:09:03.742508 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1b6a8abe-6b88-4be1-ad63-562588b6e040 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.082851 Oct 11 07:09:03.743069 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1616/3235] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:09:03 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:09:04.765244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-939bfc3d-9086-4c4a-96ec-86c1e8ad29e5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:09:04.765791 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-939bfc3d-9086-4c4a-96ec-86c1e8ad29e5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:09:04.772898 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-939bfc3d-9086-4c4a-96ec-86c1e8ad29e5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:04.773513 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-939bfc3d-9086-4c4a-96ec-86c1e8ad29e5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:04.774881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-939bfc3d-9086-4c4a-96ec-86c1e8ad29e5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:04.776968 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-939bfc3d-9086-4c4a-96ec-86c1e8ad29e5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:04.778460 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-939bfc3d-9086-4c4a-96ec-86c1e8ad29e5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:04.778896 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-939bfc3d-9086-4c4a-96ec-86c1e8ad29e5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:04.840719 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-939bfc3d-9086-4c4a-96ec-86c1e8ad29e5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:09:04.848843 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-939bfc3d-9086-4c4a-96ec-86c1e8ad29e5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.087536 Oct 11 07:09:04.849403 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1620/3236] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:09:04 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:09:05.869978 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-17533be5-33d6-4ddd-9ff7-00498dc03559 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:09:05.870584 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-17533be5-33d6-4ddd-9ff7-00498dc03559 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:09:05.872979 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=28 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:09:05.878069 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17533be5-33d6-4ddd-9ff7-00498dc03559 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:05.878548 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17533be5-33d6-4ddd-9ff7-00498dc03559 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:05.878996 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17533be5-33d6-4ddd-9ff7-00498dc03559 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:05.879962 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17533be5-33d6-4ddd-9ff7-00498dc03559 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:05.880446 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17533be5-33d6-4ddd-9ff7-00498dc03559 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:05.880895 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-17533be5-33d6-4ddd-9ff7-00498dc03559 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:05.943741 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-17533be5-33d6-4ddd-9ff7-00498dc03559 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:09:05.951843 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-17533be5-33d6-4ddd-9ff7-00498dc03559 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085650 Oct 11 07:09:05.952387 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1617/3237] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:09:05 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:09:06.975260 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b72ccae9-dfe6-431f-8fab-49c75f10cb2f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:09:06.975895 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b72ccae9-dfe6-431f-8fab-49c75f10cb2f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:09:06.982294 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b72ccae9-dfe6-431f-8fab-49c75f10cb2f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:06.982771 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b72ccae9-dfe6-431f-8fab-49c75f10cb2f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:06.983202 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b72ccae9-dfe6-431f-8fab-49c75f10cb2f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:06.983921 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b72ccae9-dfe6-431f-8fab-49c75f10cb2f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:06.984375 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b72ccae9-dfe6-431f-8fab-49c75f10cb2f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:06.984799 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b72ccae9-dfe6-431f-8fab-49c75f10cb2f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:07.044556 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b72ccae9-dfe6-431f-8fab-49c75f10cb2f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:09:07.053341 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b72ccae9-dfe6-431f-8fab-49c75f10cb2f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081731 Oct 11 07:09:07.053900 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1621/3238] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:09:06 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:09:08.075723 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f6bf792a-6d03-4712-9b38-744325e474dc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:09:08.076337 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f6bf792a-6d03-4712-9b38-744325e474dc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:09:08.082751 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f6bf792a-6d03-4712-9b38-744325e474dc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:08.083232 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f6bf792a-6d03-4712-9b38-744325e474dc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:08.083711 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f6bf792a-6d03-4712-9b38-744325e474dc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:08.084398 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f6bf792a-6d03-4712-9b38-744325e474dc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:08.084852 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f6bf792a-6d03-4712-9b38-744325e474dc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:08.085275 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f6bf792a-6d03-4712-9b38-744325e474dc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:08.145324 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f6bf792a-6d03-4712-9b38-744325e474dc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:09:08.153397 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f6bf792a-6d03-4712-9b38-744325e474dc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081497 Oct 11 07:09:08.153950 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1618/3239] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:09:08 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:09:09.176015 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2911ab4f-76b5-4ecd-be30-e15de0eac8fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:09:09.176616 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2911ab4f-76b5-4ecd-be30-e15de0eac8fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:09:09.184165 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2911ab4f-76b5-4ecd-be30-e15de0eac8fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:09.184628 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2911ab4f-76b5-4ecd-be30-e15de0eac8fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:09.185052 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2911ab4f-76b5-4ecd-be30-e15de0eac8fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:09.185740 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2911ab4f-76b5-4ecd-be30-e15de0eac8fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:09.186181 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2911ab4f-76b5-4ecd-be30-e15de0eac8fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:09.186595 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2911ab4f-76b5-4ecd-be30-e15de0eac8fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:09.247022 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2911ab4f-76b5-4ecd-be30-e15de0eac8fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:09:09.255267 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2911ab4f-76b5-4ecd-be30-e15de0eac8fc tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083042 Oct 11 07:09:09.255908 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1622/3240] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:09:09 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:09:10.278148 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ff4ec8d7-9bbc-4ad3-98e4-5c7f14a43119 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:09:10.278785 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ff4ec8d7-9bbc-4ad3-98e4-5c7f14a43119 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:09:10.285138 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff4ec8d7-9bbc-4ad3-98e4-5c7f14a43119 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:10.285617 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff4ec8d7-9bbc-4ad3-98e4-5c7f14a43119 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:10.286049 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff4ec8d7-9bbc-4ad3-98e4-5c7f14a43119 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:10.286731 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff4ec8d7-9bbc-4ad3-98e4-5c7f14a43119 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:10.287182 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff4ec8d7-9bbc-4ad3-98e4-5c7f14a43119 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:10.287629 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ff4ec8d7-9bbc-4ad3-98e4-5c7f14a43119 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:10.348058 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ff4ec8d7-9bbc-4ad3-98e4-5c7f14a43119 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:09:10.356158 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ff4ec8d7-9bbc-4ad3-98e4-5c7f14a43119 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.081837 Oct 11 07:09:10.356715 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1619/3241] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:09:10 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:09:11.378862 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d7e953b4-61e9-48ac-b559-865c4b390e15 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:09:11.379753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d7e953b4-61e9-48ac-b559-865c4b390e15 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:09:11.386132 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7e953b4-61e9-48ac-b559-865c4b390e15 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:11.386608 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7e953b4-61e9-48ac-b559-865c4b390e15 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:11.387037 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7e953b4-61e9-48ac-b559-865c4b390e15 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:11.387755 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7e953b4-61e9-48ac-b559-865c4b390e15 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:11.388206 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7e953b4-61e9-48ac-b559-865c4b390e15 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:11.388633 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7e953b4-61e9-48ac-b559-865c4b390e15 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:11.451672 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d7e953b4-61e9-48ac-b559-865c4b390e15 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:09:11.460417 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d7e953b4-61e9-48ac-b559-865c4b390e15 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085374 Oct 11 07:09:11.460978 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1623/3242] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:09:11 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:09:12.482637 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d58d6ed5-5a85-4a93-ac7d-c54f54e568d3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:09:12.483265 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d58d6ed5-5a85-4a93-ac7d-c54f54e568d3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:09:12.489684 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d58d6ed5-5a85-4a93-ac7d-c54f54e568d3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:12.490153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d58d6ed5-5a85-4a93-ac7d-c54f54e568d3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:12.490606 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d58d6ed5-5a85-4a93-ac7d-c54f54e568d3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:12.491288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d58d6ed5-5a85-4a93-ac7d-c54f54e568d3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:12.491760 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d58d6ed5-5a85-4a93-ac7d-c54f54e568d3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:12.492177 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d58d6ed5-5a85-4a93-ac7d-c54f54e568d3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:12.554340 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d58d6ed5-5a85-4a93-ac7d-c54f54e568d3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:09:12.562421 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d58d6ed5-5a85-4a93-ac7d-c54f54e568d3 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.083646 Oct 11 07:09:12.562972 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1620/3243] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:09:12 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:09:13.585743 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ea9c6a1d-7608-4ddf-9bcb-fe2bf42dbc31 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:09:13.586338 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ea9c6a1d-7608-4ddf-9bcb-fe2bf42dbc31 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:09:13.592765 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ea9c6a1d-7608-4ddf-9bcb-fe2bf42dbc31 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:13.593240 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ea9c6a1d-7608-4ddf-9bcb-fe2bf42dbc31 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:13.593668 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ea9c6a1d-7608-4ddf-9bcb-fe2bf42dbc31 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:13.594356 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ea9c6a1d-7608-4ddf-9bcb-fe2bf42dbc31 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:13.594800 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ea9c6a1d-7608-4ddf-9bcb-fe2bf42dbc31 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:13.595222 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ea9c6a1d-7608-4ddf-9bcb-fe2bf42dbc31 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:13.670677 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ea9c6a1d-7608-4ddf-9bcb-fe2bf42dbc31 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:09:13.678730 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ea9c6a1d-7608-4ddf-9bcb-fe2bf42dbc31 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.097370 Oct 11 07:09:13.679286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1624/3244] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:09:13 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:09:14.701140 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4ef170fb-7193-4512-9fae-98f734b975a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:09:14.701707 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4ef170fb-7193-4512-9fae-98f734b975a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:09:14.708430 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4ef170fb-7193-4512-9fae-98f734b975a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:14.708908 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4ef170fb-7193-4512-9fae-98f734b975a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:14.709339 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4ef170fb-7193-4512-9fae-98f734b975a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:14.710022 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4ef170fb-7193-4512-9fae-98f734b975a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:14.710479 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4ef170fb-7193-4512-9fae-98f734b975a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:14.710896 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4ef170fb-7193-4512-9fae-98f734b975a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:14.774424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4ef170fb-7193-4512-9fae-98f734b975a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:09:14.782507 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4ef170fb-7193-4512-9fae-98f734b975a1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 200 len: 1368 microversion: 2.1 time: 0.085372 Oct 11 07:09:14.783066 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1621/3245] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:09:14 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:09:14.806461 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1d745115-6c38-40e6-aa22-fc7de85090af tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '.version_select at 0x7f8e2a51ff70>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:09:14.827959 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1d745115-6c38-40e6-aa22-fc7de85090af tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1038104129" status: 202 len: 0 microversion: 2.1 time: 0.026057 Oct 11 07:09:14.828514 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1625/3246] 10.222.0.39 () {58 vars in 1221 bytes} [Tue Oct 11 07:09:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1038104129 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 07:09:15.690950 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-80abdfd0-150f-4821-9267-33f4be94596d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Action: 'create', calling method: .version_select at 0x7f8e27123940>, body: {"keypair": {"name": "tempest-keypair-2105190465", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdLQScvt+W8hnBwzqt8W3cosSDArmdgfSR8wqnJacw0hVJ6bo4BQFFqC+uvhrHH/ehAUTsi8eJFvZYdqs0yauN88vUcHLaoYRA7fuZd38iEJ0CMUFBzBolQZX9ls9rb0A=="}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:09:15.707017 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-80abdfd0-150f-4821-9267-33f4be94596d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Getting quotas for project bf094dc7d5f1453ba9112d1a1d3f0d9c. Resources: {'key_pairs'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 07:09:15.710850 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-80abdfd0-150f-4821-9267-33f4be94596d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Getting quotas for user 1c602e0f9e0e4e479a6a3c32febdb14b and project bf094dc7d5f1453ba9112d1a1d3f0d9c. Resources: {'key_pairs'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 07:09:15.735524 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-80abdfd0-150f-4821-9267-33f4be94596d tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048381 Oct 11 07:09:15.736107 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1622/3247] 10.222.0.39 () {60 vars in 1159 bytes} [Tue Oct 11 07:09:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:09:16.929227 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-99d70fb2-65f1-45aa-aa10-fbe54cb6b964 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1517015897", "imageRef": "2303551c-410e-4a2b-8eeb-dea686876901", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e96a53a6-e96c-406d-9212-fd1b88f3fd49"}], "security_groups": [{"name": "tempest-securitygroup--280747962"}], "key_name": "tempest-keypair-2105190465", "user_data": "}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:09:17.030435 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.network.neutron [None req-99d70fb2-65f1-45aa-aa10-fbe54cb6b964 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] validate_networks() for [('e96a53a6-e96c-406d-9212-fd1b88f3fd49', None, None, None, None, None)] {{(pid=125266) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 07:09:17.441789 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-99d70fb2-65f1-45aa-aa10-fbe54cb6b964 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Flavor limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 07:09:17.442214 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-99d70fb2-65f1-45aa-aa10-fbe54cb6b964 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Image limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 07:09:17.442681 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-99d70fb2-65f1-45aa-aa10-fbe54cb6b964 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Flavor pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 07:09:17.443111 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-99d70fb2-65f1-45aa-aa10-fbe54cb6b964 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Image pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 07:09:17.443601 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-99d70fb2-65f1-45aa-aa10-fbe54cb6b964 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 07:09:17.452278 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-99d70fb2-65f1-45aa-aa10-fbe54cb6b964 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:17.452749 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-99d70fb2-65f1-45aa-aa10-fbe54cb6b964 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:17.453174 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-99d70fb2-65f1-45aa-aa10-fbe54cb6b964 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:17.453892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-99d70fb2-65f1-45aa-aa10-fbe54cb6b964 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:17.454333 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-99d70fb2-65f1-45aa-aa10-fbe54cb6b964 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:17.454772 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-99d70fb2-65f1-45aa-aa10-fbe54cb6b964 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:17.471365 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-99d70fb2-65f1-45aa-aa10-fbe54cb6b964 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Getting quotas for project bf094dc7d5f1453ba9112d1a1d3f0d9c. Resources: {'cores', 'ram', 'instances'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 07:09:17.475817 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-99d70fb2-65f1-45aa-aa10-fbe54cb6b964 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Getting quotas for user 1c602e0f9e0e4e479a6a3c32febdb14b and project bf094dc7d5f1453ba9112d1a1d3f0d9c. Resources: {'cores', 'ram', 'instances'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 07:09:17.486432 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-99d70fb2-65f1-45aa-aa10-fbe54cb6b964 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Going to run 1 instances... {{(pid=125266) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 07:09:17.488715 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-99d70fb2-65f1-45aa-aa10-fbe54cb6b964 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2303551c-410e-4a2b-8eeb-dea686876901',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 07:09:17.536900 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-99d70fb2-65f1-45aa-aa10-fbe54cb6b964 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.612351 Oct 11 07:09:17.538094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1626/3248] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Oct 11 07:09:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 07:09:17.549539 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2a145d0f-13ab-48e5-8004-91c0477270e9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:09:17.550145 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2a145d0f-13ab-48e5-8004-91c0477270e9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:09:17.621819 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2a145d0f-13ab-48e5-8004-91c0477270e9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:09:17.628997 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2a145d0f-13ab-48e5-8004-91c0477270e9 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8" status: 200 len: 1238 microversion: 2.1 time: 0.083885 Oct 11 07:09:17.629909 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1623/3249] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:09:17 2022] GET /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 => generated 1238 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:09:18.600205 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-8e192e01-0f7b-464d-983d-b9863946c796 req-01a9e535-d313-4234-af0d-8eca5589edd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f4927d-5233-4d2b-a109-a1739feef2eb", "name": "network-vif-deleted", "tag": "d3558897-9eb2-44a5-8c6f-5fcac13e4072"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:09:18.610750 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-8e192e01-0f7b-464d-983d-b9863946c796 req-01a9e535-d313-4234-af0d-8eca5589edd2 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:18.611222 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-8e192e01-0f7b-464d-983d-b9863946c796 req-01a9e535-d313-4234-af0d-8eca5589edd2 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:18.611667 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-8e192e01-0f7b-464d-983d-b9863946c796 req-01a9e535-d313-4234-af0d-8eca5589edd2 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:18.621510 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-8e192e01-0f7b-464d-983d-b9863946c796 req-01a9e535-d313-4234-af0d-8eca5589edd2 service nova] Creating event network-vif-deleted:d3558897-9eb2-44a5-8c6f-5fcac13e4072 for instance 70f4927d-5233-4d2b-a109-a1739feef2eb on hv-cinder-85495 Oct 11 07:09:18.627209 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-8e192e01-0f7b-464d-983d-b9863946c796 req-01a9e535-d313-4234-af0d-8eca5589edd2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095417 Oct 11 07:09:18.627808 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1627/3250] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:09:18.651842 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3134273a-6e87-4e24-ac82-89063cd82483 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:09:18.652515 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3134273a-6e87-4e24-ac82-89063cd82483 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:09:18.658867 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3134273a-6e87-4e24-ac82-89063cd82483 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:18.659344 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3134273a-6e87-4e24-ac82-89063cd82483 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:18.659814 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3134273a-6e87-4e24-ac82-89063cd82483 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:18.660528 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3134273a-6e87-4e24-ac82-89063cd82483 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:18.660978 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3134273a-6e87-4e24-ac82-89063cd82483 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:18.661399 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3134273a-6e87-4e24-ac82-89063cd82483 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:18.721617 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3134273a-6e87-4e24-ac82-89063cd82483 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:09:18.729866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3134273a-6e87-4e24-ac82-89063cd82483 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8" status: 200 len: 1290 microversion: 2.1 time: 0.081907 Oct 11 07:09:18.730416 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1624/3251] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:09:18 2022] GET /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 => generated 1290 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:09:19.754777 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8f2a10d9-1ee1-4d8e-86c5-5df2bd1f46b4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:09:19.755615 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8f2a10d9-1ee1-4d8e-86c5-5df2bd1f46b4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:09:19.762703 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f2a10d9-1ee1-4d8e-86c5-5df2bd1f46b4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:19.763218 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f2a10d9-1ee1-4d8e-86c5-5df2bd1f46b4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:19.763678 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f2a10d9-1ee1-4d8e-86c5-5df2bd1f46b4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:19.764501 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f2a10d9-1ee1-4d8e-86c5-5df2bd1f46b4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:19.764955 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f2a10d9-1ee1-4d8e-86c5-5df2bd1f46b4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:19.765378 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f2a10d9-1ee1-4d8e-86c5-5df2bd1f46b4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:20.009125 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8f2a10d9-1ee1-4d8e-86c5-5df2bd1f46b4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:09:20.016745 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8f2a10d9-1ee1-4d8e-86c5-5df2bd1f46b4 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8" status: 200 len: 1363 microversion: 2.1 time: 0.268054 Oct 11 07:09:20.017300 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1628/3252] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:09:19 2022] GET /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 => generated 1363 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:09:20.648191 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-53b2f073-5788-488f-b4ba-79f4e5fed95a req-69975e3a-7c4a-41e2-9090-3e8e6130027f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8", "tag": "bed8dfd3-2f4e-4bbc-b2b2-7cbfd4ca400a"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:09:20.657914 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-53b2f073-5788-488f-b4ba-79f4e5fed95a req-69975e3a-7c4a-41e2-9090-3e8e6130027f service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:20.658386 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-53b2f073-5788-488f-b4ba-79f4e5fed95a req-69975e3a-7c4a-41e2-9090-3e8e6130027f service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:20.658807 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-53b2f073-5788-488f-b4ba-79f4e5fed95a req-69975e3a-7c4a-41e2-9090-3e8e6130027f service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:20.670256 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-53b2f073-5788-488f-b4ba-79f4e5fed95a req-69975e3a-7c4a-41e2-9090-3e8e6130027f service nova] Creating event network-changed:bed8dfd3-2f4e-4bbc-b2b2-7cbfd4ca400a for instance 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 on hv-cinder-85495 Oct 11 07:09:20.676164 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-53b2f073-5788-488f-b4ba-79f4e5fed95a req-69975e3a-7c4a-41e2-9090-3e8e6130027f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031616 Oct 11 07:09:20.676747 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1625/3253] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:09:21.040553 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7fbeaeab-7826-480f-8bf5-3126e48b0e24 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:09:21.041222 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7fbeaeab-7826-480f-8bf5-3126e48b0e24 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:09:21.047168 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7fbeaeab-7826-480f-8bf5-3126e48b0e24 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:21.047679 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7fbeaeab-7826-480f-8bf5-3126e48b0e24 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:21.048114 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7fbeaeab-7826-480f-8bf5-3126e48b0e24 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:21.048802 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7fbeaeab-7826-480f-8bf5-3126e48b0e24 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:21.049253 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7fbeaeab-7826-480f-8bf5-3126e48b0e24 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:21.049676 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7fbeaeab-7826-480f-8bf5-3126e48b0e24 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:21.179793 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7fbeaeab-7826-480f-8bf5-3126e48b0e24 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:09:21.187749 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7fbeaeab-7826-480f-8bf5-3126e48b0e24 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8" status: 200 len: 1363 microversion: 2.1 time: 0.151525 Oct 11 07:09:21.188148 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1629/3254] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:09:21 2022] GET /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:09:22.211129 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-104cf9e0-c8f9-475f-9530-b1388852eaf5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:09:22.211790 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-104cf9e0-c8f9-475f-9530-b1388852eaf5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:09:22.218545 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-104cf9e0-c8f9-475f-9530-b1388852eaf5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:22.219033 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-104cf9e0-c8f9-475f-9530-b1388852eaf5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:22.219504 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-104cf9e0-c8f9-475f-9530-b1388852eaf5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:22.220203 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-104cf9e0-c8f9-475f-9530-b1388852eaf5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:22.220659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-104cf9e0-c8f9-475f-9530-b1388852eaf5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:22.221086 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-104cf9e0-c8f9-475f-9530-b1388852eaf5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:22.348874 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-104cf9e0-c8f9-475f-9530-b1388852eaf5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:09:22.356436 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-104cf9e0-c8f9-475f-9530-b1388852eaf5 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8" status: 200 len: 1363 microversion: 2.1 time: 0.150131 Oct 11 07:09:22.356981 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1626/3255] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:09:22 2022] GET /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:09:23.379586 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a47ccdb3-af06-4f7a-a020-f35315797844 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:09:23.380192 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a47ccdb3-af06-4f7a-a020-f35315797844 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:09:23.382670 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:09:23.387915 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a47ccdb3-af06-4f7a-a020-f35315797844 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:23.388350 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a47ccdb3-af06-4f7a-a020-f35315797844 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:23.388781 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a47ccdb3-af06-4f7a-a020-f35315797844 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:23.389467 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a47ccdb3-af06-4f7a-a020-f35315797844 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:23.389916 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a47ccdb3-af06-4f7a-a020-f35315797844 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:23.390331 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a47ccdb3-af06-4f7a-a020-f35315797844 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:23.518196 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a47ccdb3-af06-4f7a-a020-f35315797844 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:09:23.526391 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a47ccdb3-af06-4f7a-a020-f35315797844 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8" status: 200 len: 1363 microversion: 2.1 time: 0.150979 Oct 11 07:09:23.526946 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1630/3256] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:09:23 2022] GET /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:09:24.548216 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-00dd2006-4a38-4451-9ad9-9c9bb52c4e01 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:09:24.548823 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-00dd2006-4a38-4451-9ad9-9c9bb52c4e01 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:09:24.555822 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-00dd2006-4a38-4451-9ad9-9c9bb52c4e01 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:24.556299 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-00dd2006-4a38-4451-9ad9-9c9bb52c4e01 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:24.556731 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-00dd2006-4a38-4451-9ad9-9c9bb52c4e01 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:24.557420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-00dd2006-4a38-4451-9ad9-9c9bb52c4e01 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:24.557869 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-00dd2006-4a38-4451-9ad9-9c9bb52c4e01 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:24.558292 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-00dd2006-4a38-4451-9ad9-9c9bb52c4e01 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:24.685747 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-00dd2006-4a38-4451-9ad9-9c9bb52c4e01 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:09:24.693295 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-00dd2006-4a38-4451-9ad9-9c9bb52c4e01 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8" status: 200 len: 1363 microversion: 2.1 time: 0.148901 Oct 11 07:09:24.693853 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1627/3257] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:09:24 2022] GET /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:09:25.436218 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-a6d63cf5-22d8-4518-8f4d-e68ebc97c1ff req-7249cc69-33f7-433a-baaf-ee9798c40201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8", "name": "network-vif-plugged", "status": "completed", "tag": "bed8dfd3-2f4e-4bbc-b2b2-7cbfd4ca400a"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:09:25.445874 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-a6d63cf5-22d8-4518-8f4d-e68ebc97c1ff req-7249cc69-33f7-433a-baaf-ee9798c40201 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:25.446425 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-a6d63cf5-22d8-4518-8f4d-e68ebc97c1ff req-7249cc69-33f7-433a-baaf-ee9798c40201 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:25.446928 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-a6d63cf5-22d8-4518-8f4d-e68ebc97c1ff req-7249cc69-33f7-433a-baaf-ee9798c40201 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:25.458168 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-a6d63cf5-22d8-4518-8f4d-e68ebc97c1ff req-7249cc69-33f7-433a-baaf-ee9798c40201 service nova] Creating event network-vif-plugged:bed8dfd3-2f4e-4bbc-b2b2-7cbfd4ca400a for instance 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 on hv-cinder-85495 Oct 11 07:09:25.463612 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-a6d63cf5-22d8-4518-8f4d-e68ebc97c1ff req-7249cc69-33f7-433a-baaf-ee9798c40201 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086009 Oct 11 07:09:25.464195 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1631/3258] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:09:25.715983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bf537b60-7c9c-4843-af85-c79b7cc71e75 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:09:25.716592 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bf537b60-7c9c-4843-af85-c79b7cc71e75 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:09:25.722923 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bf537b60-7c9c-4843-af85-c79b7cc71e75 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:25.723382 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bf537b60-7c9c-4843-af85-c79b7cc71e75 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:25.723848 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bf537b60-7c9c-4843-af85-c79b7cc71e75 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:25.724568 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bf537b60-7c9c-4843-af85-c79b7cc71e75 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:25.725021 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bf537b60-7c9c-4843-af85-c79b7cc71e75 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:25.725445 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bf537b60-7c9c-4843-af85-c79b7cc71e75 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:25.854171 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-bf537b60-7c9c-4843-af85-c79b7cc71e75 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:09:25.861783 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bf537b60-7c9c-4843-af85-c79b7cc71e75 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8" status: 200 len: 1363 microversion: 2.1 time: 0.149953 Oct 11 07:09:25.862349 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1628/3259] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:09:25 2022] GET /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:09:26.885622 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-333db313-294c-4dcc-a551-0418af458dee tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:09:26.886306 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-333db313-294c-4dcc-a551-0418af458dee tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:09:26.892382 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-333db313-294c-4dcc-a551-0418af458dee tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:26.892851 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-333db313-294c-4dcc-a551-0418af458dee tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:26.893272 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-333db313-294c-4dcc-a551-0418af458dee tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:26.893941 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-333db313-294c-4dcc-a551-0418af458dee tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:26.894381 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-333db313-294c-4dcc-a551-0418af458dee tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:26.894793 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-333db313-294c-4dcc-a551-0418af458dee tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:26.899170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=78 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:09:27.020271 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-333db313-294c-4dcc-a551-0418af458dee tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:09:27.028437 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-333db313-294c-4dcc-a551-0418af458dee tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8" status: 200 len: 1550 microversion: 2.1 time: 0.147401 Oct 11 07:09:27.029001 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1632/3260] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:09:26 2022] GET /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 => generated 1550 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:09:27.049806 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f3cc0365-8df7-4522-ba96-1cd67dc4f164 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:09:27.050318 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f3cc0365-8df7-4522-ba96-1cd67dc4f164 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:09:27.057132 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3cc0365-8df7-4522-ba96-1cd67dc4f164 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:27.057606 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3cc0365-8df7-4522-ba96-1cd67dc4f164 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:27.058036 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3cc0365-8df7-4522-ba96-1cd67dc4f164 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:27.058725 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3cc0365-8df7-4522-ba96-1cd67dc4f164 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:27.059189 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3cc0365-8df7-4522-ba96-1cd67dc4f164 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:27.059628 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f3cc0365-8df7-4522-ba96-1cd67dc4f164 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:27.133803 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f3cc0365-8df7-4522-ba96-1cd67dc4f164 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087748 Oct 11 07:09:27.134380 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1629/3261] 10.222.0.39 () {58 vars in 1275 bytes} [Tue Oct 11 07:09:27 2022] GET /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:09:28.290847 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-f756fe40-5001-46ff-ae40-a3c9ffa6b014 req-d8377190-5992-4df6-a538-515b2fb445a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8", "tag": "bed8dfd3-2f4e-4bbc-b2b2-7cbfd4ca400a"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:09:28.295654 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:09:28.296313 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=6 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:09:28.302840 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-f756fe40-5001-46ff-ae40-a3c9ffa6b014 req-d8377190-5992-4df6-a538-515b2fb445a8 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:09:28.303311 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-f756fe40-5001-46ff-ae40-a3c9ffa6b014 req-d8377190-5992-4df6-a538-515b2fb445a8 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:09:28.304290 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-f756fe40-5001-46ff-ae40-a3c9ffa6b014 req-d8377190-5992-4df6-a538-515b2fb445a8 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:09:28.315529 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-f756fe40-5001-46ff-ae40-a3c9ffa6b014 req-d8377190-5992-4df6-a538-515b2fb445a8 service nova] Creating event network-changed:bed8dfd3-2f4e-4bbc-b2b2-7cbfd4ca400a for instance 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 on hv-cinder-85495 Oct 11 07:09:28.321146 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-f756fe40-5001-46ff-ae40-a3c9ffa6b014 req-d8377190-5992-4df6-a538-515b2fb445a8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034104 Oct 11 07:09:28.321698 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1633/3262] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:10:03.057594 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=6 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:10:03.059039 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:10:03.059700 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=71 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:10:03.063540 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2f7c8470-c672-4041-8887-d5176820b29f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:10:03.064035 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2f7c8470-c672-4041-8887-d5176820b29f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:10:03.071975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2f7c8470-c672-4041-8887-d5176820b29f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:10:03.072454 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2f7c8470-c672-4041-8887-d5176820b29f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:10:03.072889 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2f7c8470-c672-4041-8887-d5176820b29f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:10:03.073573 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2f7c8470-c672-4041-8887-d5176820b29f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:10:03.074031 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2f7c8470-c672-4041-8887-d5176820b29f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:10:03.074452 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2f7c8470-c672-4041-8887-d5176820b29f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:10:03.096911 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2f7c8470-c672-4041-8887-d5176820b29f tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8/ips" status: 200 len: 147 microversion: 2.1 time: 0.040820 Oct 11 07:10:03.097455 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1630/3263] 10.222.0.39 () {58 vars in 1248 bytes} [Tue Oct 11 07:10:03 2022] GET /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8/ips => generated 147 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:11:03.201389 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b8316774-68c4-4fba-8a9e-5fff1b8a392c] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 07:11:03.201968 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=7 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:11:03.202703 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=7 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:11:03.208998 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-49e82448-bbf7-41f6-82c3-479f09f8beb6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:03.209570 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-49e82448-bbf7-41f6-82c3-479f09f8beb6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:03.218475 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49e82448-bbf7-41f6-82c3-479f09f8beb6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:03.218956 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49e82448-bbf7-41f6-82c3-479f09f8beb6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:03.219589 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49e82448-bbf7-41f6-82c3-479f09f8beb6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:03.220682 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49e82448-bbf7-41f6-82c3-479f09f8beb6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:03.221132 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49e82448-bbf7-41f6-82c3-479f09f8beb6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:03.221549 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-49e82448-bbf7-41f6-82c3-479f09f8beb6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:03.246511 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-49e82448-bbf7-41f6-82c3-479f09f8beb6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8] Going to try to terminate instance {{(pid=125266) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 07:11:03.319984 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-49e82448-bbf7-41f6-82c3-479f09f8beb6 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8" status: 204 len: 0 microversion: 2.1 time: 0.120049 Oct 11 07:11:03.320982 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1634/3264] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Oct 11 07:11:03 2022] DELETE /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 07:11:03.331775 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-06d1faec-60a4-4035-b380-80fa07782f89 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:03.332945 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-06d1faec-60a4-4035-b380-80fa07782f89 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:03.338438 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=2 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:11:03.339198 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=4 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:11:03.340648 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 07:11:03.340815 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Tue Oct 11 07:11:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 (ip 10.222.0.39) !!! Oct 11 07:11:03.357048 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-06d1faec-60a4-4035-b380-80fa07782f89 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:03.357522 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-06d1faec-60a4-4035-b380-80fa07782f89 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:03.357949 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-06d1faec-60a4-4035-b380-80fa07782f89 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:03.358641 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-06d1faec-60a4-4035-b380-80fa07782f89 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:03.359084 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-06d1faec-60a4-4035-b380-80fa07782f89 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:03.359529 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-06d1faec-60a4-4035-b380-80fa07782f89 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:03.490224 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-06d1faec-60a4-4035-b380-80fa07782f89 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:11:03.498270 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-06d1faec-60a4-4035-b380-80fa07782f89 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8" status: 200 len: 1675 microversion: 2.1 time: 0.172760 Oct 11 07:11:03.498820 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1631/3265] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:11:03 2022] GET /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 => generated 1675 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:11:04.523712 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-465509c5-c4db-4171-97db-4308827a917c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:04.525002 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-465509c5-c4db-4171-97db-4308827a917c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:04.533437 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-465509c5-c4db-4171-97db-4308827a917c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:04.533902 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-465509c5-c4db-4171-97db-4308827a917c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:04.534323 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-465509c5-c4db-4171-97db-4308827a917c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:04.534995 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-465509c5-c4db-4171-97db-4308827a917c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:04.535449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-465509c5-c4db-4171-97db-4308827a917c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:04.535867 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-465509c5-c4db-4171-97db-4308827a917c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:04.544509 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO oslo.messaging._drivers.impl_rabbit [-] [b8316774-68c4-4fba-8a9e-5fff1b8a392c] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 48380. Oct 11 07:11:04.670135 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-465509c5-c4db-4171-97db-4308827a917c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:11:04.678173 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-465509c5-c4db-4171-97db-4308827a917c tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8" status: 200 len: 1675 microversion: 2.1 time: 0.158672 Oct 11 07:11:04.678734 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1635/3266] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:11:04 2022] GET /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:11:05.701719 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-67369a0b-1c5c-4ba1-a1a3-2946256f3fa1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:05.701719 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-67369a0b-1c5c-4ba1-a1a3-2946256f3fa1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:05.708401 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-67369a0b-1c5c-4ba1-a1a3-2946256f3fa1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:05.708994 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-67369a0b-1c5c-4ba1-a1a3-2946256f3fa1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:05.709502 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-67369a0b-1c5c-4ba1-a1a3-2946256f3fa1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:05.710197 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-67369a0b-1c5c-4ba1-a1a3-2946256f3fa1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:05.710643 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-67369a0b-1c5c-4ba1-a1a3-2946256f3fa1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:05.711061 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-67369a0b-1c5c-4ba1-a1a3-2946256f3fa1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:05.771135 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-77db4ef3-4bc4-48fe-9729-3fb6ab2e39f4 req-be868c54-02c4-4e8e-a04b-14a42e0bc041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8", "name": "network-vif-deleted", "tag": "bed8dfd3-2f4e-4bbc-b2b2-7cbfd4ca400a"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:11:05.781338 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-77db4ef3-4bc4-48fe-9729-3fb6ab2e39f4 req-be868c54-02c4-4e8e-a04b-14a42e0bc041 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:05.782651 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-77db4ef3-4bc4-48fe-9729-3fb6ab2e39f4 req-be868c54-02c4-4e8e-a04b-14a42e0bc041 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:05.783068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-77db4ef3-4bc4-48fe-9729-3fb6ab2e39f4 req-be868c54-02c4-4e8e-a04b-14a42e0bc041 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:05.786501 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-67369a0b-1c5c-4ba1-a1a3-2946256f3fa1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c602e0f9e0e4e479a6a3c32febdb14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf094dc7d5f1453ba9112d1a1d3f0d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:11:05.795643 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-77db4ef3-4bc4-48fe-9729-3fb6ab2e39f4 req-be868c54-02c4-4e8e-a04b-14a42e0bc041 service nova] Creating event network-vif-deleted:bed8dfd3-2f4e-4bbc-b2b2-7cbfd4ca400a for instance 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 on hv-cinder-85495 Oct 11 07:11:05.799663 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-67369a0b-1c5c-4ba1-a1a3-2946256f3fa1 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8" status: 200 len: 1608 microversion: 2.1 time: 0.101462 Oct 11 07:11:05.800517 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-77db4ef3-4bc4-48fe-9729-3fb6ab2e39f4 req-be868c54-02c4-4e8e-a04b-14a42e0bc041 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032989 Oct 11 07:11:05.811032 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1636/3267] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 07:11:05.812700 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1632/3268] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:11:05 2022] GET /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 => generated 1608 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:11:06.826408 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cf84616b-2fd8-4bcc-9c76-3f0f4dbbf82b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:06.827106 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cf84616b-2fd8-4bcc-9c76-3f0f4dbbf82b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:06.833223 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf84616b-2fd8-4bcc-9c76-3f0f4dbbf82b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:06.833699 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf84616b-2fd8-4bcc-9c76-3f0f4dbbf82b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:06.834130 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf84616b-2fd8-4bcc-9c76-3f0f4dbbf82b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:06.834817 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf84616b-2fd8-4bcc-9c76-3f0f4dbbf82b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:06.835263 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf84616b-2fd8-4bcc-9c76-3f0f4dbbf82b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:06.835721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cf84616b-2fd8-4bcc-9c76-3f0f4dbbf82b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:06.848692 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-cf84616b-2fd8-4bcc-9c76-3f0f4dbbf82b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] HTTP exception thrown: Instance 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 could not be found. Oct 11 07:11:06.850286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cf84616b-2fd8-4bcc-9c76-3f0f4dbbf82b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Request method failure captured: Oct 11 07:11:06.850286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: request: GET /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 HTTP/1.1 Oct 11 07:11:06.850286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept: application/json Oct 11 07:11:06.850286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Oct 11 07:11:06.850286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Connection: close Oct 11 07:11:06.850286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Length: 0 Oct 11 07:11:06.850286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Type: application/json Oct 11 07:11:06.850286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Host: 10.222.0.39 Oct 11 07:11:06.850286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Oct 11 07:11:06.850286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.12 Oct 11 07:11:06.850286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABjRRAsC5gjwxv0YF7d4yPHrvtCndUqSE4LUuVmgbQpA7FGH61SHGQtjkUc9VgoV4UMikth54p4pdy4qWYFrQKk1XtGzAiJBIewqjLBpw1HNHgXCT3jzdwGxfFWntP_SY_R4Ve4MR7ioybA8HuNKthEt7Q2Y1dULWFhCpaPL3hZsDYDFg4 Oct 11 07:11:06.850286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Oct 11 07:11:06.850286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Oct 11 07:11:06.850286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Oct 11 07:11:06.850286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Oct 11 07:11:06.850286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Oct 11 07:11:06.850286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Oct 11 07:11:06.850286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Id: bf094dc7d5f1453ba9112d1a1d3f0d9c Oct 11 07:11:06.850286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-AttachVolumeTestJSON-1051491043 Oct 11 07:11:06.850286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Role: reader,member Oct 11 07:11:06.850286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Oct 11 07:11:06.852136 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bf094dc7d5f1453ba9112d1a1d3f0d9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf094dc7d5f1453ba9112d1a1d3f0d9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf094dc7d5f1453ba9112d1a1d3f0d9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bf094dc7d5f1453ba9112d1a1d3f0d9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 07:11:06.852136 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-AttachVolumeTestJSON-1051491043 Oct 11 07:11:06.852136 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Id: bf094dc7d5f1453ba9112d1a1d3f0d9c Oct 11 07:11:06.852136 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1051491043 Oct 11 07:11:06.852136 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User: tempest-AttachVolumeTestJSON-1051491043-project Oct 11 07:11:06.852136 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Oct 11 07:11:06.852136 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Oct 11 07:11:06.852136 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Id: 1c602e0f9e0e4e479a6a3c32febdb14b Oct 11 07:11:06.852136 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-AttachVolumeTestJSON-1051491043-project Oct 11 07:11:06.852136 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: method: > Oct 11 07:11:06.852136 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: exception: Instance 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 could not be found. Oct 11 07:11:06.852136 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: action_args: {'id': '4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8'} Oct 11 07:11:06.854405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 07:11:06.854405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:11:06.854405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 07:11:06.854405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 07:11:06.854405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 07:11:06.854405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 07:11:06.854405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 07:11:06.854405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 07:11:06.854405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 07:11:06.854405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 07:11:06.854405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 could not be found. Oct 11 07:11:06.854405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:11:06.854405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:11:06.854405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:11:06.854405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:11:06.854405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:11:06.854405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:11:06.854405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 07:11:06.854405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 07:11:06.854405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 07:11:06.856176 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 07:11:06.856176 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 07:11:06.856176 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 07:11:06.856176 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 07:11:06.856176 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 07:11:06.856176 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 07:11:06.856176 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 07:11:06.856176 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 could not be found. Oct 11 07:11:06.856176 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:11:06.856176 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:11:06.856176 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:11:06.856176 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:11:06.856176 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:11:06.856176 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:11:06.856176 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 07:11:06.856176 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 07:11:06.856176 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 could not be found. Oct 11 07:11:06.856176 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:11:06.857741 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cf84616b-2fd8-4bcc-9c76-3f0f4dbbf82b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Returning 404 to user: Instance 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 07:11:06.857741 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cf84616b-2fd8-4bcc-9c76-3f0f4dbbf82b tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8" status: 404 len: 111 microversion: 2.1 time: 0.029916 Oct 11 07:11:06.857741 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1637/3269] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:11:06 2022] GET /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 07:11:06.860939 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-96f67565-a979-4d5c-8b7c-9df7e9033e30 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '.version_select at 0x7f8e2a48a040>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:06.879714 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-96f67565-a979-4d5c-8b7c-9df7e9033e30 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2105190465" status: 202 len: 0 microversion: 2.1 time: 0.022456 Oct 11 07:11:06.880253 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1633/3270] 10.222.0.39 () {58 vars in 1221 bytes} [Tue Oct 11 07:11:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2105190465 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 07:11:07.488873 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cb750d80-c60f-42eb-b5d0-636d9c09d568 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:07.489358 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cb750d80-c60f-42eb-b5d0-636d9c09d568 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:07.496215 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb750d80-c60f-42eb-b5d0-636d9c09d568 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:07.496689 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb750d80-c60f-42eb-b5d0-636d9c09d568 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:07.497114 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb750d80-c60f-42eb-b5d0-636d9c09d568 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:07.497783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb750d80-c60f-42eb-b5d0-636d9c09d568 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:07.498225 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb750d80-c60f-42eb-b5d0-636d9c09d568 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:07.498637 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb750d80-c60f-42eb-b5d0-636d9c09d568 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:07.512247 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-cb750d80-c60f-42eb-b5d0-636d9c09d568 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] HTTP exception thrown: Instance 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 could not be found. Oct 11 07:11:07.513792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cb750d80-c60f-42eb-b5d0-636d9c09d568 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Request method failure captured: Oct 11 07:11:07.513792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: request: DELETE /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 HTTP/1.1 Oct 11 07:11:07.513792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept: application/json Oct 11 07:11:07.513792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Oct 11 07:11:07.513792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Connection: close Oct 11 07:11:07.513792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Length: 0 Oct 11 07:11:07.513792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Type: application/json Oct 11 07:11:07.513792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Host: 10.222.0.39 Oct 11 07:11:07.513792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Oct 11 07:11:07.513792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.12 Oct 11 07:11:07.513792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABjRRAsC5gjwxv0YF7d4yPHrvtCndUqSE4LUuVmgbQpA7FGH61SHGQtjkUc9VgoV4UMikth54p4pdy4qWYFrQKk1XtGzAiJBIewqjLBpw1HNHgXCT3jzdwGxfFWntP_SY_R4Ve4MR7ioybA8HuNKthEt7Q2Y1dULWFhCpaPL3hZsDYDFg4 Oct 11 07:11:07.513792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Oct 11 07:11:07.513792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Oct 11 07:11:07.513792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Oct 11 07:11:07.513792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Oct 11 07:11:07.513792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Oct 11 07:11:07.513792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Oct 11 07:11:07.513792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Id: bf094dc7d5f1453ba9112d1a1d3f0d9c Oct 11 07:11:07.513792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-AttachVolumeTestJSON-1051491043 Oct 11 07:11:07.513792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Role: reader,member Oct 11 07:11:07.513792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Oct 11 07:11:07.515588 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bf094dc7d5f1453ba9112d1a1d3f0d9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf094dc7d5f1453ba9112d1a1d3f0d9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf094dc7d5f1453ba9112d1a1d3f0d9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bf094dc7d5f1453ba9112d1a1d3f0d9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 07:11:07.515588 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-AttachVolumeTestJSON-1051491043 Oct 11 07:11:07.515588 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Id: bf094dc7d5f1453ba9112d1a1d3f0d9c Oct 11 07:11:07.515588 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1051491043 Oct 11 07:11:07.515588 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User: tempest-AttachVolumeTestJSON-1051491043-project Oct 11 07:11:07.515588 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Oct 11 07:11:07.515588 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Oct 11 07:11:07.515588 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Id: 1c602e0f9e0e4e479a6a3c32febdb14b Oct 11 07:11:07.515588 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-AttachVolumeTestJSON-1051491043-project Oct 11 07:11:07.515588 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: method: > Oct 11 07:11:07.515588 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: exception: Instance 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 could not be found. Oct 11 07:11:07.515588 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: action_args: {'id': '4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8'} Oct 11 07:11:07.519451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 07:11:07.519451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:11:07.519451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 07:11:07.519451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 07:11:07.519451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 07:11:07.519451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 07:11:07.519451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 07:11:07.519451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 07:11:07.519451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 07:11:07.519451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 07:11:07.519451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 could not be found. Oct 11 07:11:07.519451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:11:07.519451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:11:07.519451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:11:07.519451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:11:07.519451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:11:07.519451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:11:07.519451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 07:11:07.519451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 07:11:07.519451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 07:11:07.521094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 07:11:07.521094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 07:11:07.521094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 07:11:07.521094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 07:11:07.521094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 07:11:07.521094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 07:11:07.521094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 07:11:07.521094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 07:11:07.521094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 07:11:07.521094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 could not be found. Oct 11 07:11:07.521094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:11:07.521094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:11:07.521094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:11:07.521094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:11:07.521094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:11:07.521094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:11:07.521094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 07:11:07.521094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 07:11:07.521094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 could not be found. Oct 11 07:11:07.521094 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:11:07.522679 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cb750d80-c60f-42eb-b5d0-636d9c09d568 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Returning 404 to user: Instance 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 07:11:07.522679 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cb750d80-c60f-42eb-b5d0-636d9c09d568 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8" status: 404 len: 111 microversion: 2.1 time: 0.030395 Oct 11 07:11:07.522679 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1638/3271] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Oct 11 07:11:07 2022] DELETE /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 07:11:07.523668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-37f574a3-aa21-441a-9cf5-5bcff76347ae tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:07.524311 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-37f574a3-aa21-441a-9cf5-5bcff76347ae tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:07.530825 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-37f574a3-aa21-441a-9cf5-5bcff76347ae tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:07.531305 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-37f574a3-aa21-441a-9cf5-5bcff76347ae tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:07.531769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-37f574a3-aa21-441a-9cf5-5bcff76347ae tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:07.532456 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-37f574a3-aa21-441a-9cf5-5bcff76347ae tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:07.532906 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-37f574a3-aa21-441a-9cf5-5bcff76347ae tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:07.533328 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-37f574a3-aa21-441a-9cf5-5bcff76347ae tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:07.546602 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-37f574a3-aa21-441a-9cf5-5bcff76347ae tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] HTTP exception thrown: Instance 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 could not be found. Oct 11 07:11:07.548272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-37f574a3-aa21-441a-9cf5-5bcff76347ae tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Request method failure captured: Oct 11 07:11:07.548272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: request: GET /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 HTTP/1.1 Oct 11 07:11:07.548272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept: application/json Oct 11 07:11:07.548272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Oct 11 07:11:07.548272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Connection: close Oct 11 07:11:07.548272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Length: 0 Oct 11 07:11:07.548272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Type: application/json Oct 11 07:11:07.548272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Host: 10.222.0.39 Oct 11 07:11:07.548272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Oct 11 07:11:07.548272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.12 Oct 11 07:11:07.548272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABjRRAsC5gjwxv0YF7d4yPHrvtCndUqSE4LUuVmgbQpA7FGH61SHGQtjkUc9VgoV4UMikth54p4pdy4qWYFrQKk1XtGzAiJBIewqjLBpw1HNHgXCT3jzdwGxfFWntP_SY_R4Ve4MR7ioybA8HuNKthEt7Q2Y1dULWFhCpaPL3hZsDYDFg4 Oct 11 07:11:07.548272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Oct 11 07:11:07.548272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Oct 11 07:11:07.548272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Oct 11 07:11:07.548272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Oct 11 07:11:07.548272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Oct 11 07:11:07.548272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Oct 11 07:11:07.548272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Id: bf094dc7d5f1453ba9112d1a1d3f0d9c Oct 11 07:11:07.548272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-AttachVolumeTestJSON-1051491043 Oct 11 07:11:07.548272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Role: reader,member Oct 11 07:11:07.548272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Oct 11 07:11:07.549961 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bf094dc7d5f1453ba9112d1a1d3f0d9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf094dc7d5f1453ba9112d1a1d3f0d9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf094dc7d5f1453ba9112d1a1d3f0d9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bf094dc7d5f1453ba9112d1a1d3f0d9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 07:11:07.549961 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-AttachVolumeTestJSON-1051491043 Oct 11 07:11:07.549961 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Id: bf094dc7d5f1453ba9112d1a1d3f0d9c Oct 11 07:11:07.549961 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1051491043 Oct 11 07:11:07.549961 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User: tempest-AttachVolumeTestJSON-1051491043-project Oct 11 07:11:07.549961 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Oct 11 07:11:07.549961 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Oct 11 07:11:07.549961 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Id: 1c602e0f9e0e4e479a6a3c32febdb14b Oct 11 07:11:07.549961 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-AttachVolumeTestJSON-1051491043-project Oct 11 07:11:07.549961 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: method: > Oct 11 07:11:07.549961 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: exception: Instance 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 could not be found. Oct 11 07:11:07.549961 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: action_args: {'id': '4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8'} Oct 11 07:11:07.551153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 07:11:07.551153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:11:07.551153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 07:11:07.551153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 07:11:07.551153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 07:11:07.551153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 07:11:07.551153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 07:11:07.551153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 07:11:07.551153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 07:11:07.551153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 07:11:07.551153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 could not be found. Oct 11 07:11:07.551153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:11:07.551153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:11:07.551153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:11:07.551153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:11:07.551153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:11:07.551153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:11:07.551153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 07:11:07.551153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 07:11:07.551153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 07:11:07.552933 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 07:11:07.552933 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 07:11:07.552933 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 07:11:07.552933 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 07:11:07.552933 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 07:11:07.552933 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 07:11:07.552933 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 07:11:07.552933 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 could not be found. Oct 11 07:11:07.552933 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:11:07.552933 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:11:07.552933 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:11:07.552933 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:11:07.552933 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:11:07.552933 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:11:07.552933 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 07:11:07.552933 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 07:11:07.552933 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 could not be found. Oct 11 07:11:07.552933 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:11:07.554373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-37f574a3-aa21-441a-9cf5-5bcff76347ae tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Returning 404 to user: Instance 4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 07:11:07.554373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-37f574a3-aa21-441a-9cf5-5bcff76347ae tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8" status: 404 len: 111 microversion: 2.1 time: 0.029942 Oct 11 07:11:07.554373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1634/3272] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:11:07 2022] GET /compute/v2.1/servers/4eebf7eb-ae44-4a4c-b49c-9e5b79d18fd8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 07:11:18.877547 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-91901ae1-8ec0-4077-a7f4-81482c497a44 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:18.878028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-91901ae1-8ec0-4077-a7f4-81482c497a44 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: edea36de-eaed-4410-81f5-b9a3643849c2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:18.880598 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:11:18.881417 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:11:18.888255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-91901ae1-8ec0-4077-a7f4-81482c497a44 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:18.888729 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-91901ae1-8ec0-4077-a7f4-81482c497a44 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:18.889153 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-91901ae1-8ec0-4077-a7f4-81482c497a44 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:18.889838 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-91901ae1-8ec0-4077-a7f4-81482c497a44 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:18.890282 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-91901ae1-8ec0-4077-a7f4-81482c497a44 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:18.890689 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-91901ae1-8ec0-4077-a7f4-81482c497a44 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:18.929934 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ddae6759-0ddf-4caf-8f4c-977f4447edb3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:18.930587 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ddae6759-0ddf-4caf-8f4c-977f4447edb3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: f26806d8-9180-4109-b3df-cadb68b7a0f2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:18.932694 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:11:18.933338 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=14 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:11:18.935642 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-91901ae1-8ec0-4077-a7f4-81482c497a44 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: edea36de-eaed-4410-81f5-b9a3643849c2] Going to try to terminate instance {{(pid=125266) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 07:11:18.947514 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ddae6759-0ddf-4caf-8f4c-977f4447edb3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:18.948532 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ddae6759-0ddf-4caf-8f4c-977f4447edb3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:18.949140 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ddae6759-0ddf-4caf-8f4c-977f4447edb3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:18.950008 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ddae6759-0ddf-4caf-8f4c-977f4447edb3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:18.950624 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ddae6759-0ddf-4caf-8f4c-977f4447edb3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:18.951226 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ddae6759-0ddf-4caf-8f4c-977f4447edb3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:18.978217 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ddae6759-0ddf-4caf-8f4c-977f4447edb3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: f26806d8-9180-4109-b3df-cadb68b7a0f2] Going to try to terminate instance {{(pid=125267) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 07:11:19.031119 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-91901ae1-8ec0-4077-a7f4-81482c497a44 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "DELETE /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2" status: 204 len: 0 microversion: 2.1 time: 0.157426 Oct 11 07:11:19.031881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1639/3273] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Oct 11 07:11:18 2022] DELETE /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 07:11:19.037478 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2909221c-4590-473c-bcc8-38af2d1ec378 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:19.038085 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2909221c-4590-473c-bcc8-38af2d1ec378 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:19.051193 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2909221c-4590-473c-bcc8-38af2d1ec378 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:19.051886 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2909221c-4590-473c-bcc8-38af2d1ec378 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:19.052526 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2909221c-4590-473c-bcc8-38af2d1ec378 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:19.053457 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2909221c-4590-473c-bcc8-38af2d1ec378 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:19.053898 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2909221c-4590-473c-bcc8-38af2d1ec378 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:19.054319 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2909221c-4590-473c-bcc8-38af2d1ec378 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:19.079557 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ddae6759-0ddf-4caf-8f4c-977f4447edb3 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2" status: 204 len: 0 microversion: 2.20 time: 0.154038 Oct 11 07:11:19.080785 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1635/3274] 10.222.0.39 () {60 vars in 1280 bytes} [Tue Oct 11 07:11:18 2022] DELETE /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 07:11:19.088255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2909221c-4590-473c-bcc8-38af2d1ec378 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Going to try to terminate instance {{(pid=125266) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 07:11:19.093529 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e27d2f4d-de0b-4840-8464-fd45be22ba7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:19.094581 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e27d2f4d-de0b-4840-8464-fd45be22ba7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: edea36de-eaed-4410-81f5-b9a3643849c2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:19.104060 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e27d2f4d-de0b-4840-8464-fd45be22ba7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:19.104611 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e27d2f4d-de0b-4840-8464-fd45be22ba7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:19.105301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e27d2f4d-de0b-4840-8464-fd45be22ba7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:19.106221 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e27d2f4d-de0b-4840-8464-fd45be22ba7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:19.106952 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e27d2f4d-de0b-4840-8464-fd45be22ba7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:19.107682 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e27d2f4d-de0b-4840-8464-fd45be22ba7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:19.175578 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2909221c-4590-473c-bcc8-38af2d1ec378 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "DELETE /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 204 len: 0 microversion: 2.1 time: 0.141680 Oct 11 07:11:19.176100 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1640/3275] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Oct 11 07:11:19 2022] DELETE /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 07:11:19.182418 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7c98ebda-ee68-47ec-8ccb-82be3ca87070 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:19.183261 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7c98ebda-ee68-47ec-8ccb-82be3ca87070 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: f26806d8-9180-4109-b3df-cadb68b7a0f2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:19.189096 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7c98ebda-ee68-47ec-8ccb-82be3ca87070 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:19.189568 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7c98ebda-ee68-47ec-8ccb-82be3ca87070 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:19.189992 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7c98ebda-ee68-47ec-8ccb-82be3ca87070 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:19.190682 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7c98ebda-ee68-47ec-8ccb-82be3ca87070 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:19.191123 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7c98ebda-ee68-47ec-8ccb-82be3ca87070 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:19.191569 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7c98ebda-ee68-47ec-8ccb-82be3ca87070 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:19.245279 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e27d2f4d-de0b-4840-8464-fd45be22ba7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:11:19.253280 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e27d2f4d-de0b-4840-8464-fd45be22ba7c tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2" status: 200 len: 1681 microversion: 2.1 time: 0.171301 Oct 11 07:11:19.253825 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1636/3276] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:11:19 2022] GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:11:19.259938 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-013023ab-fb99-4c34-aed5-cef24bd8f54a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:19.260544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-013023ab-fb99-4c34-aed5-cef24bd8f54a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:19.266687 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-013023ab-fb99-4c34-aed5-cef24bd8f54a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:19.267182 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-013023ab-fb99-4c34-aed5-cef24bd8f54a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:19.267650 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-013023ab-fb99-4c34-aed5-cef24bd8f54a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:19.268473 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-013023ab-fb99-4c34-aed5-cef24bd8f54a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:19.268936 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-013023ab-fb99-4c34-aed5-cef24bd8f54a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:19.269364 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-013023ab-fb99-4c34-aed5-cef24bd8f54a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:19.334728 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7c98ebda-ee68-47ec-8ccb-82be3ca87070 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:11:19.342801 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7c98ebda-ee68-47ec-8ccb-82be3ca87070 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:11:19.344243 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7c98ebda-ee68-47ec-8ccb-82be3ca87070 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:11:19.345378 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7c98ebda-ee68-47ec-8ccb-82be3ca87070 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2" status: 200 len: 1721 microversion: 2.20 time: 0.168033 Oct 11 07:11:19.345923 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1641/3277] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:11:19 2022] GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:11:19.405567 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-013023ab-fb99-4c34-aed5-cef24bd8f54a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:11:19.413272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-013023ab-fb99-4c34-aed5-cef24bd8f54a tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1507 microversion: 2.1 time: 0.157496 Oct 11 07:11:19.413833 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1637/3278] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:11:19 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:11:20.338770 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-88e637fb-27aa-441d-a8d5-b1e2e8c66606 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:20.339479 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-88e637fb-27aa-441d-a8d5-b1e2e8c66606 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: edea36de-eaed-4410-81f5-b9a3643849c2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:20.345911 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-88e637fb-27aa-441d-a8d5-b1e2e8c66606 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:20.346393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-88e637fb-27aa-441d-a8d5-b1e2e8c66606 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:20.346828 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-88e637fb-27aa-441d-a8d5-b1e2e8c66606 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:20.347552 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-88e637fb-27aa-441d-a8d5-b1e2e8c66606 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:20.348004 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-88e637fb-27aa-441d-a8d5-b1e2e8c66606 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:20.348426 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-88e637fb-27aa-441d-a8d5-b1e2e8c66606 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:20.371659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-77b6543c-0d04-438e-bc8b-8299a14f4a57 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:20.373038 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-77b6543c-0d04-438e-bc8b-8299a14f4a57 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: f26806d8-9180-4109-b3df-cadb68b7a0f2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:20.381669 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-77b6543c-0d04-438e-bc8b-8299a14f4a57 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:20.382661 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-77b6543c-0d04-438e-bc8b-8299a14f4a57 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:20.383366 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-77b6543c-0d04-438e-bc8b-8299a14f4a57 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:20.384988 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-77b6543c-0d04-438e-bc8b-8299a14f4a57 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:20.385570 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-77b6543c-0d04-438e-bc8b-8299a14f4a57 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:20.386101 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-77b6543c-0d04-438e-bc8b-8299a14f4a57 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:20.625859 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-77b6543c-0d04-438e-bc8b-8299a14f4a57 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:11:20.634990 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-77b6543c-0d04-438e-bc8b-8299a14f4a57 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:11:20.636645 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-77b6543c-0d04-438e-bc8b-8299a14f4a57 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:11:20.637934 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-77b6543c-0d04-438e-bc8b-8299a14f4a57 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2" status: 200 len: 1721 microversion: 2.20 time: 0.271522 Oct 11 07:11:20.638832 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1638/3279] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:11:20 2022] GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2 => generated 1721 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:11:20.657982 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-fd5d07ee-f06d-4c95-9551-83a20cb5971f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:20.658807 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-fd5d07ee-f06d-4c95-9551-83a20cb5971f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:20.666601 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fd5d07ee-f06d-4c95-9551-83a20cb5971f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:20.667353 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fd5d07ee-f06d-4c95-9551-83a20cb5971f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:20.667819 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fd5d07ee-f06d-4c95-9551-83a20cb5971f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:20.668645 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fd5d07ee-f06d-4c95-9551-83a20cb5971f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:20.669341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fd5d07ee-f06d-4c95-9551-83a20cb5971f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:20.669840 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fd5d07ee-f06d-4c95-9551-83a20cb5971f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:20.680074 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-88e637fb-27aa-441d-a8d5-b1e2e8c66606 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:11:20.694742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-88e637fb-27aa-441d-a8d5-b1e2e8c66606 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2" status: 200 len: 1681 microversion: 2.1 time: 0.360200 Oct 11 07:11:20.702389 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1642/3280] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:11:20 2022] GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2 => generated 1681 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:11:20.865441 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-fd5d07ee-f06d-4c95-9551-83a20cb5971f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:11:20.875564 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-fd5d07ee-f06d-4c95-9551-83a20cb5971f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 200 len: 1507 microversion: 2.1 time: 0.224069 Oct 11 07:11:20.879614 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1639/3281] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:11:20 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 1507 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:11:21.092648 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-02334c1b-ce3e-4134-b6fc-9d4f983d7c23 req-4693086e-97de-44d5-b09b-5900fb3064c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63ee206c-410a-4d60-89ab-e6d6319e64b6", "name": "network-vif-deleted", "tag": "f00aa092-378a-4b0d-9b6e-c605b2ca8c2c"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:11:21.103301 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-02334c1b-ce3e-4134-b6fc-9d4f983d7c23 req-4693086e-97de-44d5-b09b-5900fb3064c0 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:21.103970 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-02334c1b-ce3e-4134-b6fc-9d4f983d7c23 req-4693086e-97de-44d5-b09b-5900fb3064c0 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:21.104414 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-02334c1b-ce3e-4134-b6fc-9d4f983d7c23 req-4693086e-97de-44d5-b09b-5900fb3064c0 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:21.116485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-02334c1b-ce3e-4134-b6fc-9d4f983d7c23 req-4693086e-97de-44d5-b09b-5900fb3064c0 service nova] Creating event network-vif-deleted:f00aa092-378a-4b0d-9b6e-c605b2ca8c2c for instance 63ee206c-410a-4d60-89ab-e6d6319e64b6 on hv-cinder-85495 Oct 11 07:11:21.122091 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-02334c1b-ce3e-4134-b6fc-9d4f983d7c23 req-4693086e-97de-44d5-b09b-5900fb3064c0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103615 Oct 11 07:11:21.122980 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1643/3282] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:11:21.664082 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e482c77e-d70d-4b7a-8fa1-6fa62481bef5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:21.665619 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e482c77e-d70d-4b7a-8fa1-6fa62481bef5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: f26806d8-9180-4109-b3df-cadb68b7a0f2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:21.672412 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e482c77e-d70d-4b7a-8fa1-6fa62481bef5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:21.673055 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e482c77e-d70d-4b7a-8fa1-6fa62481bef5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:21.673567 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e482c77e-d70d-4b7a-8fa1-6fa62481bef5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:21.674391 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e482c77e-d70d-4b7a-8fa1-6fa62481bef5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:21.674923 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e482c77e-d70d-4b7a-8fa1-6fa62481bef5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:21.675678 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e482c77e-d70d-4b7a-8fa1-6fa62481bef5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:21.721367 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3bf45dd6-a1e0-4c60-94a5-39b6803cb807 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:21.722219 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3bf45dd6-a1e0-4c60-94a5-39b6803cb807 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: edea36de-eaed-4410-81f5-b9a3643849c2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:21.729959 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3bf45dd6-a1e0-4c60-94a5-39b6803cb807 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:21.730746 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3bf45dd6-a1e0-4c60-94a5-39b6803cb807 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:21.731362 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3bf45dd6-a1e0-4c60-94a5-39b6803cb807 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:21.735484 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3bf45dd6-a1e0-4c60-94a5-39b6803cb807 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:21.739483 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3bf45dd6-a1e0-4c60-94a5-39b6803cb807 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:21.745726 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3bf45dd6-a1e0-4c60-94a5-39b6803cb807 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:21.798732 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e482c77e-d70d-4b7a-8fa1-6fa62481bef5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:11:21.821886 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e482c77e-d70d-4b7a-8fa1-6fa62481bef5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:11:21.827819 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e482c77e-d70d-4b7a-8fa1-6fa62481bef5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:11:21.830014 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e482c77e-d70d-4b7a-8fa1-6fa62481bef5 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2" status: 200 len: 1654 microversion: 2.20 time: 0.169576 Oct 11 07:11:21.831088 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1640/3283] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:11:21 2022] GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2 => generated 1654 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:11:21.900973 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5519cf96-d9ee-43e5-824d-6d3b63ffb60f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:21.901595 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5519cf96-d9ee-43e5-824d-6d3b63ffb60f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 63ee206c-410a-4d60-89ab-e6d6319e64b6] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:21.910814 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5519cf96-d9ee-43e5-824d-6d3b63ffb60f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:21.911316 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5519cf96-d9ee-43e5-824d-6d3b63ffb60f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:21.911728 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3bf45dd6-a1e0-4c60-94a5-39b6803cb807 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:11:21.913161 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5519cf96-d9ee-43e5-824d-6d3b63ffb60f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:21.913895 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5519cf96-d9ee-43e5-824d-6d3b63ffb60f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:21.914361 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5519cf96-d9ee-43e5-824d-6d3b63ffb60f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:21.914859 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5519cf96-d9ee-43e5-824d-6d3b63ffb60f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:21.922856 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3bf45dd6-a1e0-4c60-94a5-39b6803cb807 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2" status: 200 len: 1614 microversion: 2.1 time: 0.207695 Oct 11 07:11:21.932165 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1644/3284] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:11:21 2022] GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2 => generated 1614 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:11:21.946554 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-5519cf96-d9ee-43e5-824d-6d3b63ffb60f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] HTTP exception thrown: Instance 63ee206c-410a-4d60-89ab-e6d6319e64b6 could not be found. Oct 11 07:11:21.948420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5519cf96-d9ee-43e5-824d-6d3b63ffb60f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Request method failure captured: Oct 11 07:11:21.948420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: request: GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 HTTP/1.1 Oct 11 07:11:21.948420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept: application/json Oct 11 07:11:21.948420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Oct 11 07:11:21.948420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Connection: close Oct 11 07:11:21.948420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Length: 0 Oct 11 07:11:21.948420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Type: application/json Oct 11 07:11:21.948420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Host: 10.222.0.39 Oct 11 07:11:21.948420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Oct 11 07:11:21.948420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.12 Oct 11 07:11:21.948420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABjRRA0sVn3Y2hIF2KCTCm6FXTNfoGEy5FuwV9mGajfsKjzDTa2W9Zn9PNZ0bsNvHSl7YobIBptw1Er7VvGW1igZFTxkJHhoVOBLb1gJR4eRkspU0WbBpAL8LWZ9CfxGCRrXHXjyx2ZUoY97BLJ7CRdrgZs2_r5gQvEJLtS1fIO-euoHMg Oct 11 07:11:21.948420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Oct 11 07:11:21.948420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Oct 11 07:11:21.948420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Oct 11 07:11:21.948420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Oct 11 07:11:21.948420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Oct 11 07:11:21.948420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Oct 11 07:11:21.948420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Id: 0e4e977dc2e84b08a4fbaf7fd2fac42f Oct 11 07:11:21.948420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1829742552 Oct 11 07:11:21.948420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Role: reader,member Oct 11 07:11:21.948420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Oct 11 07:11:21.950064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0e4e977dc2e84b08a4fbaf7fd2fac42f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0e4e977dc2e84b08a4fbaf7fd2fac42f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0e4e977dc2e84b08a4fbaf7fd2fac42f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0e4e977dc2e84b08a4fbaf7fd2fac42f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 07:11:21.950064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1829742552 Oct 11 07:11:21.950064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 0e4e977dc2e84b08a4fbaf7fd2fac42f Oct 11 07:11:21.950064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1829742552 Oct 11 07:11:21.950064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User: tempest-ServerRescueNegativeTestJSON-1829742552-project Oct 11 07:11:21.950064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Oct 11 07:11:21.950064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Oct 11 07:11:21.950064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Id: 3d57230baeb24e8a8a511a0c6417077e Oct 11 07:11:21.950064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1829742552-project Oct 11 07:11:21.950064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: method: > Oct 11 07:11:21.950064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: exception: Instance 63ee206c-410a-4d60-89ab-e6d6319e64b6 could not be found. Oct 11 07:11:21.950064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: action_args: {'id': '63ee206c-410a-4d60-89ab-e6d6319e64b6'} Oct 11 07:11:21.950957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 07:11:21.950957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:11:21.950957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 07:11:21.950957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 07:11:21.950957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 07:11:21.950957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 07:11:21.950957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 07:11:21.950957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 07:11:21.950957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 07:11:21.950957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 07:11:21.950957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63ee206c-410a-4d60-89ab-e6d6319e64b6 could not be found. Oct 11 07:11:21.950957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:11:21.950957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:11:21.950957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:11:21.950957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:11:21.950957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:11:21.950957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:11:21.950957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 07:11:21.950957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 07:11:21.950957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 07:11:21.952511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 07:11:21.952511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 07:11:21.952511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 07:11:21.952511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 07:11:21.952511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 07:11:21.952511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 07:11:21.952511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 07:11:21.952511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63ee206c-410a-4d60-89ab-e6d6319e64b6 could not be found. Oct 11 07:11:21.952511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:11:21.952511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:11:21.952511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:11:21.952511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:11:21.952511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:11:21.952511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:11:21.952511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 07:11:21.952511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 07:11:21.952511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63ee206c-410a-4d60-89ab-e6d6319e64b6 could not be found. Oct 11 07:11:21.952511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:11:21.953853 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5519cf96-d9ee-43e5-824d-6d3b63ffb60f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Returning 404 to user: Instance 63ee206c-410a-4d60-89ab-e6d6319e64b6 could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 07:11:21.953853 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5519cf96-d9ee-43e5-824d-6d3b63ffb60f tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6" status: 404 len: 111 microversion: 2.1 time: 0.054949 Oct 11 07:11:21.953853 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1641/3285] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:11:21 2022] GET /compute/v2.1/servers/63ee206c-410a-4d60-89ab-e6d6319e64b6 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 07:11:21.958544 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-426f2d56-3a52-484b-9084-b0333fc9f4d5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:21.959049 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-426f2d56-3a52-484b-9084-b0333fc9f4d5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:21.966149 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-426f2d56-3a52-484b-9084-b0333fc9f4d5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:21.966634 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-426f2d56-3a52-484b-9084-b0333fc9f4d5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:21.967076 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-426f2d56-3a52-484b-9084-b0333fc9f4d5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:21.967813 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-426f2d56-3a52-484b-9084-b0333fc9f4d5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:21.968487 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-426f2d56-3a52-484b-9084-b0333fc9f4d5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:21.968924 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-426f2d56-3a52-484b-9084-b0333fc9f4d5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:22.000445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-426f2d56-3a52-484b-9084-b0333fc9f4d5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Going to try to terminate instance {{(pid=125266) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 07:11:22.154852 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-ed4a5134-7a43-4f87-956a-222d41f1a314 req-9ab0d525-c96b-43fc-93a7-64d0cbb12af4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edea36de-eaed-4410-81f5-b9a3643849c2", "name": "network-vif-deleted", "tag": "23bd824c-911b-4ca8-a97f-28c788b0eca8"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:11:22.158582 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-426f2d56-3a52-484b-9084-b0333fc9f4d5 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "DELETE /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 204 len: 0 microversion: 2.1 time: 0.203557 Oct 11 07:11:22.160989 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1645/3286] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Oct 11 07:11:21 2022] DELETE /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 07:11:22.169716 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cd52ddfb-168a-4964-b268-1f7101ec5c22 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:22.175122 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cd52ddfb-168a-4964-b268-1f7101ec5c22 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:22.175368 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-ed4a5134-7a43-4f87-956a-222d41f1a314 req-9ab0d525-c96b-43fc-93a7-64d0cbb12af4 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:22.177746 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-ed4a5134-7a43-4f87-956a-222d41f1a314 req-9ab0d525-c96b-43fc-93a7-64d0cbb12af4 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:22.178186 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-ed4a5134-7a43-4f87-956a-222d41f1a314 req-9ab0d525-c96b-43fc-93a7-64d0cbb12af4 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:22.187879 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cd52ddfb-168a-4964-b268-1f7101ec5c22 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:22.192321 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cd52ddfb-168a-4964-b268-1f7101ec5c22 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:22.195675 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cd52ddfb-168a-4964-b268-1f7101ec5c22 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:22.198353 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cd52ddfb-168a-4964-b268-1f7101ec5c22 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:22.199003 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cd52ddfb-168a-4964-b268-1f7101ec5c22 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:22.199630 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cd52ddfb-168a-4964-b268-1f7101ec5c22 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:22.202155 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-ed4a5134-7a43-4f87-956a-222d41f1a314 req-9ab0d525-c96b-43fc-93a7-64d0cbb12af4 service nova] Creating event network-vif-deleted:23bd824c-911b-4ca8-a97f-28c788b0eca8 for instance edea36de-eaed-4410-81f5-b9a3643849c2 on hv-cinder-85495 Oct 11 07:11:22.230817 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-ed4a5134-7a43-4f87-956a-222d41f1a314 req-9ab0d525-c96b-43fc-93a7-64d0cbb12af4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079691 Oct 11 07:11:22.231818 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1642/3287] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 07:11:22.404137 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cd52ddfb-168a-4964-b268-1f7101ec5c22 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:11:22.423118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cd52ddfb-168a-4964-b268-1f7101ec5c22 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1521 microversion: 2.1 time: 0.257610 Oct 11 07:11:22.423881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1646/3288] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:11:22 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:11:22.860732 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b644f993-6adb-4363-a909-aa03fba3ac13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:22.867367 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b644f993-6adb-4363-a909-aa03fba3ac13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: f26806d8-9180-4109-b3df-cadb68b7a0f2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:22.883569 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b644f993-6adb-4363-a909-aa03fba3ac13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:22.885468 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b644f993-6adb-4363-a909-aa03fba3ac13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:22.886074 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b644f993-6adb-4363-a909-aa03fba3ac13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:22.887715 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b644f993-6adb-4363-a909-aa03fba3ac13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:22.889615 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b644f993-6adb-4363-a909-aa03fba3ac13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:22.890692 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b644f993-6adb-4363-a909-aa03fba3ac13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:22.948666 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b660b225-734c-406d-945d-8d33b734726f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:22.950553 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b660b225-734c-406d-945d-8d33b734726f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: edea36de-eaed-4410-81f5-b9a3643849c2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:22.965424 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b660b225-734c-406d-945d-8d33b734726f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:22.965654 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b644f993-6adb-4363-a909-aa03fba3ac13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:22.965993 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b644f993-6adb-4363-a909-aa03fba3ac13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:22.966581 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b660b225-734c-406d-945d-8d33b734726f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:22.966831 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b644f993-6adb-4363-a909-aa03fba3ac13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:22.967026 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b660b225-734c-406d-945d-8d33b734726f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:22.967654 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-b644f993-6adb-4363-a909-aa03fba3ac13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lazy-loading 'fault' on Instance uuid f26806d8-9180-4109-b3df-cadb68b7a0f2 {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 07:11:22.967800 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b660b225-734c-406d-945d-8d33b734726f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:22.968214 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b660b225-734c-406d-945d-8d33b734726f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:22.969134 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b660b225-734c-406d-945d-8d33b734726f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:23.024621 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b660b225-734c-406d-945d-8d33b734726f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:23.025357 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b660b225-734c-406d-945d-8d33b734726f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:23.025989 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b660b225-734c-406d-945d-8d33b734726f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:23.026616 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.objects.instance [None req-b660b225-734c-406d-945d-8d33b734726f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lazy-loading 'fault' on Instance uuid edea36de-eaed-4410-81f5-b9a3643849c2 {{(pid=125266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 07:11:23.035067 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b644f993-6adb-4363-a909-aa03fba3ac13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:11:23.045245 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b644f993-6adb-4363-a909-aa03fba3ac13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:11:23.046728 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b644f993-6adb-4363-a909-aa03fba3ac13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f95c1cd09e1042abbb5725f241ce147d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a4c53c1c744688b3bf91e806286bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:11:23.047939 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b644f993-6adb-4363-a909-aa03fba3ac13 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2" status: 200 len: 1370 microversion: 2.20 time: 0.194446 Oct 11 07:11:23.048487 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1643/3289] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:11:22 2022] GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2 => generated 1370 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 07:11:23.088777 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b660b225-734c-406d-945d-8d33b734726f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:11:23.097669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b660b225-734c-406d-945d-8d33b734726f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2" status: 200 len: 1331 microversion: 2.1 time: 0.153991 Oct 11 07:11:23.111447 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1647/3290] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:11:22 2022] GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2 => generated 1331 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:11:23.450069 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f1d9d6e3-9e00-4764-ad0c-aecf078e4cb2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:23.450661 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f1d9d6e3-9e00-4764-ad0c-aecf078e4cb2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:23.457401 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f1d9d6e3-9e00-4764-ad0c-aecf078e4cb2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:23.459569 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f1d9d6e3-9e00-4764-ad0c-aecf078e4cb2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:23.460845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f1d9d6e3-9e00-4764-ad0c-aecf078e4cb2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:23.463062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f1d9d6e3-9e00-4764-ad0c-aecf078e4cb2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:23.464135 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f1d9d6e3-9e00-4764-ad0c-aecf078e4cb2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:23.465228 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f1d9d6e3-9e00-4764-ad0c-aecf078e4cb2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:23.518489 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f1d9d6e3-9e00-4764-ad0c-aecf078e4cb2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:23.518999 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f1d9d6e3-9e00-4764-ad0c-aecf078e4cb2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:23.519638 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f1d9d6e3-9e00-4764-ad0c-aecf078e4cb2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:23.519912 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-f1d9d6e3-9e00-4764-ad0c-aecf078e4cb2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lazy-loading 'fault' on Instance uuid 03687593-229b-46bf-b79a-f09a1db51ac2 {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 07:11:23.564031 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f1d9d6e3-9e00-4764-ad0c-aecf078e4cb2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d57230baeb24e8a8a511a0c6417077e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4e977dc2e84b08a4fbaf7fd2fac42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:11:23.572633 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f1d9d6e3-9e00-4764-ad0c-aecf078e4cb2 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 200 len: 1312 microversion: 2.1 time: 0.130235 Oct 11 07:11:23.573203 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1644/3291] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:11:23 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 1312 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:11:24.073007 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b7bcb471-7d1c-475a-9b4e-207413569280 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:24.073727 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b7bcb471-7d1c-475a-9b4e-207413569280 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: f26806d8-9180-4109-b3df-cadb68b7a0f2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:24.080296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b7bcb471-7d1c-475a-9b4e-207413569280 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:24.080765 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b7bcb471-7d1c-475a-9b4e-207413569280 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:24.081188 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b7bcb471-7d1c-475a-9b4e-207413569280 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:24.081859 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b7bcb471-7d1c-475a-9b4e-207413569280 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:24.082296 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b7bcb471-7d1c-475a-9b4e-207413569280 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:24.082708 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b7bcb471-7d1c-475a-9b4e-207413569280 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:24.097873 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-b7bcb471-7d1c-475a-9b4e-207413569280 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] HTTP exception thrown: Instance f26806d8-9180-4109-b3df-cadb68b7a0f2 could not be found. Oct 11 07:11:24.099445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b7bcb471-7d1c-475a-9b4e-207413569280 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Request method failure captured: Oct 11 07:11:24.099445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: request: GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2 HTTP/1.1 Oct 11 07:11:24.099445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept: application/json Oct 11 07:11:24.099445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Oct 11 07:11:24.099445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Connection: close Oct 11 07:11:24.099445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Length: 0 Oct 11 07:11:24.099445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Type: application/json Oct 11 07:11:24.099445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Host: 10.222.0.39 Oct 11 07:11:24.099445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Oct 11 07:11:24.099445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.12 Oct 11 07:11:24.099445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABjRRAwy9lJUTfwPNtlFgEhb-dAJQkr8kItl0eplWqHVmUEQOi91EP03uqskZs2F09OCrDxhZNVyWfwqkdTdBHntnSvaxgsnlvuvl6nwjywGfWIyT1kcJB9AmqFWPBHqNA32UcnItu0uRvzmSEnGi9zthg1R0ixsgpLwpYUj0FVoqY22sA Oct 11 07:11:24.099445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Oct 11 07:11:24.099445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Oct 11 07:11:24.099445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Oct 11 07:11:24.099445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Oct 11 07:11:24.099445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 07:11:24.099445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Oct 11 07:11:24.099445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Oct 11 07:11:24.099445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Id: ec4a4c53c1c744688b3bf91e806286bf Oct 11 07:11:24.099445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-262463267 Oct 11 07:11:24.099445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Role: reader,member Oct 11 07:11:24.099445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Oct 11 07:11:24.101287 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ec4a4c53c1c744688b3bf91e806286bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ec4a4c53c1c744688b3bf91e806286bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ec4a4c53c1c744688b3bf91e806286bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ec4a4c53c1c744688b3bf91e806286bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 07:11:24.101287 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-AttachVolumeShelveTestJSON-262463267 Oct 11 07:11:24.101287 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Id: ec4a4c53c1c744688b3bf91e806286bf Oct 11 07:11:24.101287 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-262463267 Oct 11 07:11:24.101287 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User: tempest-AttachVolumeShelveTestJSON-262463267-project Oct 11 07:11:24.101287 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Oct 11 07:11:24.101287 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Oct 11 07:11:24.101287 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Id: f95c1cd09e1042abbb5725f241ce147d Oct 11 07:11:24.101287 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-AttachVolumeShelveTestJSON-262463267-project Oct 11 07:11:24.101287 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: method: > Oct 11 07:11:24.101287 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: exception: Instance f26806d8-9180-4109-b3df-cadb68b7a0f2 could not be found. Oct 11 07:11:24.101287 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: action_args: {'id': 'f26806d8-9180-4109-b3df-cadb68b7a0f2'} Oct 11 07:11:24.103033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 07:11:24.103033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:11:24.103033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 07:11:24.103033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 07:11:24.103033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 07:11:24.103033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 07:11:24.103033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 07:11:24.103033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 07:11:24.103033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 07:11:24.103033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 07:11:24.103033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f26806d8-9180-4109-b3df-cadb68b7a0f2 could not be found. Oct 11 07:11:24.103033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:11:24.103033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:11:24.103033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:11:24.103033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:11:24.103033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:11:24.103033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:11:24.103033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 07:11:24.103033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 07:11:24.103033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 07:11:24.104674 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 07:11:24.104674 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 07:11:24.104674 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 07:11:24.104674 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 07:11:24.104674 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 07:11:24.104674 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 07:11:24.104674 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 07:11:24.104674 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f26806d8-9180-4109-b3df-cadb68b7a0f2 could not be found. Oct 11 07:11:24.104674 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:11:24.104674 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:11:24.104674 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:11:24.104674 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:11:24.104674 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:11:24.104674 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:11:24.104674 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 07:11:24.104674 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 07:11:24.104674 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f26806d8-9180-4109-b3df-cadb68b7a0f2 could not be found. Oct 11 07:11:24.104674 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:11:24.106453 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b7bcb471-7d1c-475a-9b4e-207413569280 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Returning 404 to user: Instance f26806d8-9180-4109-b3df-cadb68b7a0f2 could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 07:11:24.106453 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b7bcb471-7d1c-475a-9b4e-207413569280 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2" status: 404 len: 111 microversion: 2.20 time: 0.031911 Oct 11 07:11:24.106453 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1648/3292] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:11:24 2022] GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 07:11:24.109853 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-46f3b582-3c7d-4be6-bef8-e9c9771eaf33 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '.version_select at 0x7f8e26d6f8b0>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:24.125782 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-03b3d527-6a05-4a8e-9baa-c9547f4ff59b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:24.126668 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-03b3d527-6a05-4a8e-9baa-c9547f4ff59b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: edea36de-eaed-4410-81f5-b9a3643849c2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:24.130517 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-46f3b582-3c7d-4be6-bef8-e9c9771eaf33 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-523764400" status: 204 len: 0 microversion: 2.20 time: 0.024332 Oct 11 07:11:24.131240 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1645/3293] 10.222.0.39 () {60 vars in 1259 bytes} [Tue Oct 11 07:11:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-523764400 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 11 07:11:24.133140 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-03b3d527-6a05-4a8e-9baa-c9547f4ff59b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:24.133609 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-03b3d527-6a05-4a8e-9baa-c9547f4ff59b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:24.134035 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-03b3d527-6a05-4a8e-9baa-c9547f4ff59b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:24.135212 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-03b3d527-6a05-4a8e-9baa-c9547f4ff59b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:24.135341 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-03b3d527-6a05-4a8e-9baa-c9547f4ff59b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:24.135675 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-03b3d527-6a05-4a8e-9baa-c9547f4ff59b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:24.149240 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-03b3d527-6a05-4a8e-9baa-c9547f4ff59b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] HTTP exception thrown: Instance edea36de-eaed-4410-81f5-b9a3643849c2 could not be found. Oct 11 07:11:24.150753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-03b3d527-6a05-4a8e-9baa-c9547f4ff59b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Request method failure captured: Oct 11 07:11:24.150753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: request: GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2 HTTP/1.1 Oct 11 07:11:24.150753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept: application/json Oct 11 07:11:24.150753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Oct 11 07:11:24.150753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Connection: close Oct 11 07:11:24.150753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Length: 0 Oct 11 07:11:24.150753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Type: application/json Oct 11 07:11:24.150753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Host: 10.222.0.39 Oct 11 07:11:24.150753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Oct 11 07:11:24.150753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.12 Oct 11 07:11:24.150753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABjRRAxy4G3-Dozw6PdtI-WxnLtOJo2tV5OYxcxBy_217a4UmcYLPs6ReKc-RB_X0BHPCFHNcEeuRkAY-tzsCezmhAkP9Vj61rIl09eudAdIM1Me8KUnbI8OUgzhSO-abAb7LBVYvrD1IB-9qK1fM9G-MUZhv8Y32eWPbrO9FZ3pwby7Y8 Oct 11 07:11:24.150753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Oct 11 07:11:24.150753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Oct 11 07:11:24.150753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Oct 11 07:11:24.150753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Oct 11 07:11:24.150753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Oct 11 07:11:24.150753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Oct 11 07:11:24.150753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Id: 5af47e2321de4d299ff3a7fb3d3d9e3c Oct 11 07:11:24.150753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-AttachVolumeNegativeTest-1386971692 Oct 11 07:11:24.150753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Role: reader,member Oct 11 07:11:24.150753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Oct 11 07:11:24.152497 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 07:11:24.152497 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-AttachVolumeNegativeTest-1386971692 Oct 11 07:11:24.152497 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 5af47e2321de4d299ff3a7fb3d3d9e3c Oct 11 07:11:24.152497 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1386971692 Oct 11 07:11:24.152497 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User: tempest-AttachVolumeNegativeTest-1386971692-project Oct 11 07:11:24.152497 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Oct 11 07:11:24.152497 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Oct 11 07:11:24.152497 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Id: 2e63c3f83f3d41018e6330f26ed7b8a0 Oct 11 07:11:24.152497 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-AttachVolumeNegativeTest-1386971692-project Oct 11 07:11:24.152497 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: method: > Oct 11 07:11:24.152497 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: exception: Instance edea36de-eaed-4410-81f5-b9a3643849c2 could not be found. Oct 11 07:11:24.152497 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: action_args: {'id': 'edea36de-eaed-4410-81f5-b9a3643849c2'} Oct 11 07:11:24.153506 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 07:11:24.153506 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:11:24.153506 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 07:11:24.153506 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 07:11:24.153506 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 07:11:24.153506 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 07:11:24.153506 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 07:11:24.153506 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 07:11:24.153506 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 07:11:24.153506 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 07:11:24.153506 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edea36de-eaed-4410-81f5-b9a3643849c2 could not be found. Oct 11 07:11:24.153506 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:11:24.153506 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:11:24.153506 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:11:24.153506 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:11:24.153506 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:11:24.153506 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:11:24.153506 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 07:11:24.153506 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 07:11:24.153506 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 07:11:24.155327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 07:11:24.155327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 07:11:24.155327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 07:11:24.155327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 07:11:24.155327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 07:11:24.155327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 07:11:24.155327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 07:11:24.155327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edea36de-eaed-4410-81f5-b9a3643849c2 could not be found. Oct 11 07:11:24.155327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:11:24.155327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:11:24.155327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:11:24.155327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:11:24.155327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:11:24.155327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:11:24.155327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 07:11:24.155327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 07:11:24.155327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edea36de-eaed-4410-81f5-b9a3643849c2 could not be found. Oct 11 07:11:24.155327 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:11:24.156861 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-03b3d527-6a05-4a8e-9baa-c9547f4ff59b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Returning 404 to user: Instance edea36de-eaed-4410-81f5-b9a3643849c2 could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 07:11:24.156861 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-03b3d527-6a05-4a8e-9baa-c9547f4ff59b tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2" status: 404 len: 111 microversion: 2.1 time: 0.030156 Oct 11 07:11:24.156861 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1649/3294] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:11:24 2022] GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 07:11:24.161621 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-91021006-52ef-436f-ba81-4071ba467f7a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '.version_select at 0x7f8e2a4ffc10>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:24.184517 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-91021006-52ef-436f-ba81-4071ba467f7a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-448344022" status: 202 len: 0 microversion: 2.1 time: 0.026552 Oct 11 07:11:24.185130 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1646/3295] 10.222.0.39 () {58 vars in 1218 bytes} [Tue Oct 11 07:11:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-448344022 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 07:11:24.247057 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-1ff3d87a-8dcb-482c-9dce-52a6b4c389e6 req-4d7e657f-c348-4bba-bef5-5981f4b0cb88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f26806d8-9180-4109-b3df-cadb68b7a0f2", "name": "network-vif-deleted", "tag": "f5d88c2f-f487-48c3-afda-5249683216f6"}, {"server_uuid": "03687593-229b-46bf-b79a-f09a1db51ac2", "name": "network-vif-deleted", "tag": "9782d4cc-0e17-4e19-8fc0-23bc73899c9a"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:11:24.260196 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-1ff3d87a-8dcb-482c-9dce-52a6b4c389e6 req-4d7e657f-c348-4bba-bef5-5981f4b0cb88 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:24.260781 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-1ff3d87a-8dcb-482c-9dce-52a6b4c389e6 req-4d7e657f-c348-4bba-bef5-5981f4b0cb88 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:24.261275 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-1ff3d87a-8dcb-482c-9dce-52a6b4c389e6 req-4d7e657f-c348-4bba-bef5-5981f4b0cb88 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:24.275049 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-1ff3d87a-8dcb-482c-9dce-52a6b4c389e6 req-4d7e657f-c348-4bba-bef5-5981f4b0cb88 service nova] Creating event network-vif-deleted:f5d88c2f-f487-48c3-afda-5249683216f6 for instance f26806d8-9180-4109-b3df-cadb68b7a0f2 on hv-cinder-85495 Oct 11 07:11:24.275594 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-1ff3d87a-8dcb-482c-9dce-52a6b4c389e6 req-4d7e657f-c348-4bba-bef5-5981f4b0cb88 service nova] Creating event network-vif-deleted:9782d4cc-0e17-4e19-8fc0-23bc73899c9a for instance 03687593-229b-46bf-b79a-f09a1db51ac2 on hv-cinder-85495 Oct 11 07:11:24.281849 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-1ff3d87a-8dcb-482c-9dce-52a6b4c389e6 req-4d7e657f-c348-4bba-bef5-5981f4b0cb88 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039302 Oct 11 07:11:24.282790 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1650/3296] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:11:24.597147 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-266aa026-7a24-42e8-80b5-def21eb8c782 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:24.597870 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-266aa026-7a24-42e8-80b5-def21eb8c782 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] [instance: 03687593-229b-46bf-b79a-f09a1db51ac2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:24.605798 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-266aa026-7a24-42e8-80b5-def21eb8c782 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:24.606406 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-266aa026-7a24-42e8-80b5-def21eb8c782 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:24.607099 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-266aa026-7a24-42e8-80b5-def21eb8c782 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:24.607916 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-266aa026-7a24-42e8-80b5-def21eb8c782 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:24.608477 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-266aa026-7a24-42e8-80b5-def21eb8c782 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:24.608977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-266aa026-7a24-42e8-80b5-def21eb8c782 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:24.623202 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-266aa026-7a24-42e8-80b5-def21eb8c782 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] HTTP exception thrown: Instance 03687593-229b-46bf-b79a-f09a1db51ac2 could not be found. Oct 11 07:11:24.624977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-266aa026-7a24-42e8-80b5-def21eb8c782 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Request method failure captured: Oct 11 07:11:24.624977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: request: GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 HTTP/1.1 Oct 11 07:11:24.624977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept: application/json Oct 11 07:11:24.624977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Oct 11 07:11:24.624977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Connection: close Oct 11 07:11:24.624977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Length: 0 Oct 11 07:11:24.624977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Type: application/json Oct 11 07:11:24.624977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Host: 10.222.0.39 Oct 11 07:11:24.624977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Oct 11 07:11:24.624977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.12 Oct 11 07:11:24.624977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABjRRA0sVn3Y2hIF2KCTCm6FXTNfoGEy5FuwV9mGajfsKjzDTa2W9Zn9PNZ0bsNvHSl7YobIBptw1Er7VvGW1igZFTxkJHhoVOBLb1gJR4eRkspU0WbBpAL8LWZ9CfxGCRrXHXjyx2ZUoY97BLJ7CRdrgZs2_r5gQvEJLtS1fIO-euoHMg Oct 11 07:11:24.624977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Oct 11 07:11:24.624977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Oct 11 07:11:24.624977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Oct 11 07:11:24.624977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Oct 11 07:11:24.624977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Oct 11 07:11:24.624977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Oct 11 07:11:24.624977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Id: 0e4e977dc2e84b08a4fbaf7fd2fac42f Oct 11 07:11:24.624977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1829742552 Oct 11 07:11:24.624977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Role: reader,member Oct 11 07:11:24.624977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Oct 11 07:11:24.627117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0e4e977dc2e84b08a4fbaf7fd2fac42f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0e4e977dc2e84b08a4fbaf7fd2fac42f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0e4e977dc2e84b08a4fbaf7fd2fac42f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0e4e977dc2e84b08a4fbaf7fd2fac42f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 07:11:24.627117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1829742552 Oct 11 07:11:24.627117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 0e4e977dc2e84b08a4fbaf7fd2fac42f Oct 11 07:11:24.627117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1829742552 Oct 11 07:11:24.627117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User: tempest-ServerRescueNegativeTestJSON-1829742552-project Oct 11 07:11:24.627117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Oct 11 07:11:24.627117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Oct 11 07:11:24.627117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Id: 3d57230baeb24e8a8a511a0c6417077e Oct 11 07:11:24.627117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1829742552-project Oct 11 07:11:24.627117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: method: > Oct 11 07:11:24.627117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: exception: Instance 03687593-229b-46bf-b79a-f09a1db51ac2 could not be found. Oct 11 07:11:24.627117 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: action_args: {'id': '03687593-229b-46bf-b79a-f09a1db51ac2'} Oct 11 07:11:24.628190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 07:11:24.628190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:11:24.628190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 07:11:24.628190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 07:11:24.628190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 07:11:24.628190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 07:11:24.628190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 07:11:24.628190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 07:11:24.628190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 07:11:24.628190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 07:11:24.628190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03687593-229b-46bf-b79a-f09a1db51ac2 could not be found. Oct 11 07:11:24.628190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:11:24.628190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:11:24.628190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:11:24.628190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:11:24.628190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:11:24.628190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:11:24.628190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 07:11:24.628190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 07:11:24.628190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 07:11:24.629956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 07:11:24.629956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 07:11:24.629956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 07:11:24.629956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 07:11:24.629956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 07:11:24.629956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 07:11:24.629956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 07:11:24.629956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03687593-229b-46bf-b79a-f09a1db51ac2 could not be found. Oct 11 07:11:24.629956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:11:24.629956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:11:24.629956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:11:24.629956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:11:24.629956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:11:24.629956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:11:24.629956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 07:11:24.629956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 07:11:24.629956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03687593-229b-46bf-b79a-f09a1db51ac2 could not be found. Oct 11 07:11:24.629956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:11:24.632078 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-266aa026-7a24-42e8-80b5-def21eb8c782 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] Returning 404 to user: Instance 03687593-229b-46bf-b79a-f09a1db51ac2 could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 07:11:24.632078 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-266aa026-7a24-42e8-80b5-def21eb8c782 tempest-ServerRescueNegativeTestJSON-1829742552 tempest-ServerRescueNegativeTestJSON-1829742552-project] 10.222.0.39 "GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2" status: 404 len: 111 microversion: 2.1 time: 0.036201 Oct 11 07:11:24.635054 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1647/3297] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:11:24 2022] GET /compute/v2.1/servers/03687593-229b-46bf-b79a-f09a1db51ac2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 07:11:25.087821 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d0156c07-575b-4cab-a780-ef41359f594f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Action: 'create', calling method: .version_select at 0x7f8e2a4dfca0>, body: {"keypair": {"name": "tempest-keypair-975660079", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILwbKwTyMQwJm31c7biD494rWxMwJqXGl/DryMHQ/1VDIgmlb1I57ONC/KZWwYq1hIjyJn2jBSa2zVt/pJG4oN131FWYAQVFmHcwc9qaHYPpNAaI8HUablLoIHfFSeblA=="}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:11:25.103455 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-d0156c07-575b-4cab-a780-ef41359f594f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Getting quotas for project 5af47e2321de4d299ff3a7fb3d3d9e3c. Resources: {'key_pairs'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 07:11:25.107387 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-d0156c07-575b-4cab-a780-ef41359f594f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Getting quotas for user 2e63c3f83f3d41018e6330f26ed7b8a0 and project 5af47e2321de4d299ff3a7fb3d3d9e3c. Resources: {'key_pairs'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 07:11:25.128815 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d0156c07-575b-4cab-a780-ef41359f594f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046518 Oct 11 07:11:25.129396 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1651/3298] 10.222.0.39 () {60 vars in 1159 bytes} [Tue Oct 11 07:11:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:11:26.419316 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-678ce8b0-bdec-451c-be8e-16678d77c953 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1898685130", "imageRef": "2303551c-410e-4a2b-8eeb-dea686876901", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21c482a1-7bc7-4511-a714-740a34b4b762"}], "security_groups": [{"name": "tempest-securitygroup--596536394"}], "key_name": "tempest-keypair-975660079", "user_data": "}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:11:26.584182 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.network.neutron [None req-678ce8b0-bdec-451c-be8e-16678d77c953 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] validate_networks() for [('21c482a1-7bc7-4511-a714-740a34b4b762', None, None, None, None, None)] {{(pid=125267) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 07:11:27.048721 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-678ce8b0-bdec-451c-be8e-16678d77c953 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Flavor limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 07:11:27.050524 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-678ce8b0-bdec-451c-be8e-16678d77c953 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Image limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 07:11:27.051016 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-678ce8b0-bdec-451c-be8e-16678d77c953 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Flavor pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 07:11:27.051440 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-678ce8b0-bdec-451c-be8e-16678d77c953 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Image pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 07:11:27.051882 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-678ce8b0-bdec-451c-be8e-16678d77c953 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 07:11:27.062496 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-678ce8b0-bdec-451c-be8e-16678d77c953 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:27.062985 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-678ce8b0-bdec-451c-be8e-16678d77c953 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:27.063443 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-678ce8b0-bdec-451c-be8e-16678d77c953 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:27.064796 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-678ce8b0-bdec-451c-be8e-16678d77c953 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:27.065252 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-678ce8b0-bdec-451c-be8e-16678d77c953 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:27.065916 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-678ce8b0-bdec-451c-be8e-16678d77c953 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:27.091539 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-678ce8b0-bdec-451c-be8e-16678d77c953 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Getting quotas for project 5af47e2321de4d299ff3a7fb3d3d9e3c. Resources: {'cores', 'ram', 'instances'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 07:11:27.095438 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-678ce8b0-bdec-451c-be8e-16678d77c953 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Getting quotas for user 2e63c3f83f3d41018e6330f26ed7b8a0 and project 5af47e2321de4d299ff3a7fb3d3d9e3c. Resources: {'cores', 'ram', 'instances'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 07:11:27.106732 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-678ce8b0-bdec-451c-be8e-16678d77c953 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Going to run 1 instances... {{(pid=125267) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 07:11:27.109240 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-678ce8b0-bdec-451c-be8e-16678d77c953 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: c2fae85c-5d40-467b-92b3-94e702f54a7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2303551c-410e-4a2b-8eeb-dea686876901',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 07:11:27.165836 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-678ce8b0-bdec-451c-be8e-16678d77c953 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.751100 Oct 11 07:11:27.166771 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1648/3299] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Oct 11 07:11:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 07:11:27.177340 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c2b39af3-d7a2-45b0-9df4-d3e5472f09e8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:27.178058 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c2b39af3-d7a2-45b0-9df4-d3e5472f09e8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: c2fae85c-5d40-467b-92b3-94e702f54a7f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:27.257817 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c2b39af3-d7a2-45b0-9df4-d3e5472f09e8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:11:27.267159 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c2b39af3-d7a2-45b0-9df4-d3e5472f09e8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f" status: 200 len: 1241 microversion: 2.1 time: 0.093494 Oct 11 07:11:27.275772 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1652/3300] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:11:27 2022] GET /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f => generated 1241 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:11:28.291506 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8e01d065-070e-4f43-ab84-6a102bb80fed tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:28.292129 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8e01d065-070e-4f43-ab84-6a102bb80fed tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: c2fae85c-5d40-467b-92b3-94e702f54a7f] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:28.313048 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e01d065-070e-4f43-ab84-6a102bb80fed tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:28.316951 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e01d065-070e-4f43-ab84-6a102bb80fed tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:28.317648 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e01d065-070e-4f43-ab84-6a102bb80fed tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:28.318781 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e01d065-070e-4f43-ab84-6a102bb80fed tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:28.319694 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e01d065-070e-4f43-ab84-6a102bb80fed tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:28.320465 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8e01d065-070e-4f43-ab84-6a102bb80fed tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:28.410278 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8e01d065-070e-4f43-ab84-6a102bb80fed tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:11:28.427898 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8e01d065-070e-4f43-ab84-6a102bb80fed tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f" status: 200 len: 1293 microversion: 2.1 time: 0.141383 Oct 11 07:11:28.428803 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1649/3301] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:11:28 2022] GET /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f => generated 1293 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:11:29.450703 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9b330b5a-1d68-4b97-97c8-19695dd0cb5f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:29.451482 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9b330b5a-1d68-4b97-97c8-19695dd0cb5f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: c2fae85c-5d40-467b-92b3-94e702f54a7f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:29.458150 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9b330b5a-1d68-4b97-97c8-19695dd0cb5f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:29.458699 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9b330b5a-1d68-4b97-97c8-19695dd0cb5f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:29.459211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9b330b5a-1d68-4b97-97c8-19695dd0cb5f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:29.460198 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9b330b5a-1d68-4b97-97c8-19695dd0cb5f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:29.460938 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9b330b5a-1d68-4b97-97c8-19695dd0cb5f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:29.461618 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9b330b5a-1d68-4b97-97c8-19695dd0cb5f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:29.692323 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9b330b5a-1d68-4b97-97c8-19695dd0cb5f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:11:29.702223 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9b330b5a-1d68-4b97-97c8-19695dd0cb5f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f" status: 200 len: 1366 microversion: 2.1 time: 0.255197 Oct 11 07:11:29.703401 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1653/3302] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:11:29 2022] GET /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:11:30.364269 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-730755d0-fc70-46d1-871b-177256657c76 req-ed89eacf-dbe2-497a-9904-4c18eb52e9e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2fae85c-5d40-467b-92b3-94e702f54a7f", "tag": "94fe53f9-c55d-406f-9e07-822d6cb889f1"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:11:30.375164 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-730755d0-fc70-46d1-871b-177256657c76 req-ed89eacf-dbe2-497a-9904-4c18eb52e9e3 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:30.375657 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-730755d0-fc70-46d1-871b-177256657c76 req-ed89eacf-dbe2-497a-9904-4c18eb52e9e3 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:30.376391 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-730755d0-fc70-46d1-871b-177256657c76 req-ed89eacf-dbe2-497a-9904-4c18eb52e9e3 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:30.388151 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-730755d0-fc70-46d1-871b-177256657c76 req-ed89eacf-dbe2-497a-9904-4c18eb52e9e3 service nova] Creating event network-changed:94fe53f9-c55d-406f-9e07-822d6cb889f1 for instance c2fae85c-5d40-467b-92b3-94e702f54a7f on hv-cinder-85495 Oct 11 07:11:30.392934 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-730755d0-fc70-46d1-871b-177256657c76 req-ed89eacf-dbe2-497a-9904-4c18eb52e9e3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032320 Oct 11 07:11:30.393503 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1650/3303] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:11:30.726116 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-511a5e75-95bd-4020-b149-4fe3791a4920 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:30.726765 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-511a5e75-95bd-4020-b149-4fe3791a4920 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: c2fae85c-5d40-467b-92b3-94e702f54a7f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:30.732881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-511a5e75-95bd-4020-b149-4fe3791a4920 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:30.733354 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-511a5e75-95bd-4020-b149-4fe3791a4920 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:30.733774 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-511a5e75-95bd-4020-b149-4fe3791a4920 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:30.734449 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-511a5e75-95bd-4020-b149-4fe3791a4920 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:30.734887 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-511a5e75-95bd-4020-b149-4fe3791a4920 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:30.735302 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-511a5e75-95bd-4020-b149-4fe3791a4920 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:30.877151 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-511a5e75-95bd-4020-b149-4fe3791a4920 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:11:30.880707 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:11:30.886504 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-511a5e75-95bd-4020-b149-4fe3791a4920 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f" status: 200 len: 1366 microversion: 2.1 time: 0.164208 Oct 11 07:11:30.887058 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1654/3304] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:11:30 2022] GET /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:11:31.911068 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7f07f8a3-45bf-40fc-a9cb-67d1d65f087a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:31.911807 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7f07f8a3-45bf-40fc-a9cb-67d1d65f087a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: c2fae85c-5d40-467b-92b3-94e702f54a7f] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:31.918514 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7f07f8a3-45bf-40fc-a9cb-67d1d65f087a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:31.918995 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7f07f8a3-45bf-40fc-a9cb-67d1d65f087a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:31.919448 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7f07f8a3-45bf-40fc-a9cb-67d1d65f087a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:31.920144 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7f07f8a3-45bf-40fc-a9cb-67d1d65f087a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:31.920595 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7f07f8a3-45bf-40fc-a9cb-67d1d65f087a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:31.921020 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7f07f8a3-45bf-40fc-a9cb-67d1d65f087a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:32.049153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7f07f8a3-45bf-40fc-a9cb-67d1d65f087a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:11:32.057409 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7f07f8a3-45bf-40fc-a9cb-67d1d65f087a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f" status: 200 len: 1366 microversion: 2.1 time: 0.150997 Oct 11 07:11:32.057974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1651/3305] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:11:31 2022] GET /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:11:33.079957 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e7a6223f-33a2-473c-97d2-1de0895bd8cb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:33.080544 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e7a6223f-33a2-473c-97d2-1de0895bd8cb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: c2fae85c-5d40-467b-92b3-94e702f54a7f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:33.089569 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7a6223f-33a2-473c-97d2-1de0895bd8cb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:33.090047 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7a6223f-33a2-473c-97d2-1de0895bd8cb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:33.090475 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7a6223f-33a2-473c-97d2-1de0895bd8cb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:33.091155 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7a6223f-33a2-473c-97d2-1de0895bd8cb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:33.091631 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7a6223f-33a2-473c-97d2-1de0895bd8cb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:33.092047 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e7a6223f-33a2-473c-97d2-1de0895bd8cb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:33.216883 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e7a6223f-33a2-473c-97d2-1de0895bd8cb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:11:33.224434 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e7a6223f-33a2-473c-97d2-1de0895bd8cb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f" status: 200 len: 1366 microversion: 2.1 time: 0.148329 Oct 11 07:11:33.224987 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1655/3306] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:11:33 2022] GET /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:11:34.246883 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cfe37b12-a33a-4db6-b022-8b7ab484fd58 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:34.247510 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cfe37b12-a33a-4db6-b022-8b7ab484fd58 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: c2fae85c-5d40-467b-92b3-94e702f54a7f] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:34.254180 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cfe37b12-a33a-4db6-b022-8b7ab484fd58 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:34.254655 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cfe37b12-a33a-4db6-b022-8b7ab484fd58 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:34.255079 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cfe37b12-a33a-4db6-b022-8b7ab484fd58 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:34.256313 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cfe37b12-a33a-4db6-b022-8b7ab484fd58 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:34.256313 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cfe37b12-a33a-4db6-b022-8b7ab484fd58 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:34.256685 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cfe37b12-a33a-4db6-b022-8b7ab484fd58 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:34.386368 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cfe37b12-a33a-4db6-b022-8b7ab484fd58 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:11:34.393914 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cfe37b12-a33a-4db6-b022-8b7ab484fd58 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f" status: 200 len: 1366 microversion: 2.1 time: 0.150929 Oct 11 07:11:34.394460 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1652/3307] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:11:34 2022] GET /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:11:35.417528 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ae3447fd-f593-4711-a042-e58d734fabf7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:35.418147 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ae3447fd-f593-4711-a042-e58d734fabf7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: c2fae85c-5d40-467b-92b3-94e702f54a7f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:35.424256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ae3447fd-f593-4711-a042-e58d734fabf7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:35.424724 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ae3447fd-f593-4711-a042-e58d734fabf7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:35.425143 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ae3447fd-f593-4711-a042-e58d734fabf7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:35.425818 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ae3447fd-f593-4711-a042-e58d734fabf7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:35.426262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ae3447fd-f593-4711-a042-e58d734fabf7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:35.426665 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ae3447fd-f593-4711-a042-e58d734fabf7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:35.549403 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ae3447fd-f593-4711-a042-e58d734fabf7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:11:35.557561 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ae3447fd-f593-4711-a042-e58d734fabf7 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f" status: 200 len: 1366 microversion: 2.1 time: 0.144447 Oct 11 07:11:35.558110 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1656/3308] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:11:35 2022] GET /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:11:35.906159 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-70820115-ea5f-4a4a-8d2f-03ac24ba0290 req-6cec461d-e044-4b9a-a202-ad3e23fb87eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2fae85c-5d40-467b-92b3-94e702f54a7f", "name": "network-vif-plugged", "status": "completed", "tag": "94fe53f9-c55d-406f-9e07-822d6cb889f1"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:11:35.916562 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-70820115-ea5f-4a4a-8d2f-03ac24ba0290 req-6cec461d-e044-4b9a-a202-ad3e23fb87eb service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:35.917037 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-70820115-ea5f-4a4a-8d2f-03ac24ba0290 req-6cec461d-e044-4b9a-a202-ad3e23fb87eb service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:35.917462 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-70820115-ea5f-4a4a-8d2f-03ac24ba0290 req-6cec461d-e044-4b9a-a202-ad3e23fb87eb service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:35.930471 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-70820115-ea5f-4a4a-8d2f-03ac24ba0290 req-6cec461d-e044-4b9a-a202-ad3e23fb87eb service nova] Creating event network-vif-plugged:94fe53f9-c55d-406f-9e07-822d6cb889f1 for instance c2fae85c-5d40-467b-92b3-94e702f54a7f on hv-cinder-85495 Oct 11 07:11:35.935297 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-70820115-ea5f-4a4a-8d2f-03ac24ba0290 req-6cec461d-e044-4b9a-a202-ad3e23fb87eb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032978 Oct 11 07:11:35.935914 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1653/3309] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 07:11:36.580683 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d788728d-8818-45a1-a25a-04fb370928c2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:36.581243 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d788728d-8818-45a1-a25a-04fb370928c2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: c2fae85c-5d40-467b-92b3-94e702f54a7f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:36.588114 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d788728d-8818-45a1-a25a-04fb370928c2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:36.588584 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d788728d-8818-45a1-a25a-04fb370928c2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:36.589011 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d788728d-8818-45a1-a25a-04fb370928c2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:36.589689 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d788728d-8818-45a1-a25a-04fb370928c2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:36.590134 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d788728d-8818-45a1-a25a-04fb370928c2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:36.590576 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d788728d-8818-45a1-a25a-04fb370928c2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:36.716723 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d788728d-8818-45a1-a25a-04fb370928c2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:11:36.724267 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d788728d-8818-45a1-a25a-04fb370928c2 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f" status: 200 len: 1366 microversion: 2.1 time: 0.147999 Oct 11 07:11:36.724815 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1657/3310] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:11:36 2022] GET /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:11:37.745216 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=2 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:11:37.745994 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=6 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:11:37.749968 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c010d285-939f-4d2a-ab76-4313cad7acb0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:37.750923 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c010d285-939f-4d2a-ab76-4313cad7acb0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: c2fae85c-5d40-467b-92b3-94e702f54a7f] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:37.757955 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c010d285-939f-4d2a-ab76-4313cad7acb0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:37.758428 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c010d285-939f-4d2a-ab76-4313cad7acb0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:37.758858 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c010d285-939f-4d2a-ab76-4313cad7acb0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:37.759594 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c010d285-939f-4d2a-ab76-4313cad7acb0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:37.760051 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c010d285-939f-4d2a-ab76-4313cad7acb0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:37.760468 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c010d285-939f-4d2a-ab76-4313cad7acb0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:37.892053 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c010d285-939f-4d2a-ab76-4313cad7acb0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:11:37.900257 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c010d285-939f-4d2a-ab76-4313cad7acb0 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f" status: 200 len: 1555 microversion: 2.1 time: 0.156429 Oct 11 07:11:37.900816 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1654/3311] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:11:37 2022] GET /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:11:37.922912 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5e8f2651-211e-4728-a1bf-61dbfb655630 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:11:37.923615 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5e8f2651-211e-4728-a1bf-61dbfb655630 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: c2fae85c-5d40-467b-92b3-94e702f54a7f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:11:37.925256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=6 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:11:37.931264 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5e8f2651-211e-4728-a1bf-61dbfb655630 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:37.931772 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5e8f2651-211e-4728-a1bf-61dbfb655630 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:37.932192 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5e8f2651-211e-4728-a1bf-61dbfb655630 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:37.932864 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5e8f2651-211e-4728-a1bf-61dbfb655630 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:37.933305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5e8f2651-211e-4728-a1bf-61dbfb655630 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:37.933719 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5e8f2651-211e-4728-a1bf-61dbfb655630 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:38.012546 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5e8f2651-211e-4728-a1bf-61dbfb655630 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093620 Oct 11 07:11:38.013133 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1658/3312] 10.222.0.39 () {58 vars in 1275 bytes} [Tue Oct 11 07:11:37 2022] GET /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:11:38.916471 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-32ffbd27-5d40-45f6-8837-9cbb45303777 req-ee8f3315-002a-4ef1-80a1-886956f996e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2fae85c-5d40-467b-92b3-94e702f54a7f", "tag": "94fe53f9-c55d-406f-9e07-822d6cb889f1"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:11:38.926036 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-32ffbd27-5d40-45f6-8837-9cbb45303777 req-ee8f3315-002a-4ef1-80a1-886956f996e5 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:11:38.926509 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-32ffbd27-5d40-45f6-8837-9cbb45303777 req-ee8f3315-002a-4ef1-80a1-886956f996e5 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:11:38.926969 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-32ffbd27-5d40-45f6-8837-9cbb45303777 req-ee8f3315-002a-4ef1-80a1-886956f996e5 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:11:38.931191 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:11:38.938898 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-32ffbd27-5d40-45f6-8837-9cbb45303777 req-ee8f3315-002a-4ef1-80a1-886956f996e5 service nova] Creating event network-changed:94fe53f9-c55d-406f-9e07-822d6cb889f1 for instance c2fae85c-5d40-467b-92b3-94e702f54a7f on hv-cinder-85495 Oct 11 07:11:38.943975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-32ffbd27-5d40-45f6-8837-9cbb45303777 req-ee8f3315-002a-4ef1-80a1-886956f996e5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031556 Oct 11 07:11:38.944639 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1655/3313] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:12:08.445532 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:12:08.446329 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=22 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:12:08.450121 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c00eb485-df2e-478e-b251-56b35f6200e8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:12:08.450608 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c00eb485-df2e-478e-b251-56b35f6200e8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: c2fae85c-5d40-467b-92b3-94e702f54a7f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:12:08.457923 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c00eb485-df2e-478e-b251-56b35f6200e8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:12:08.458394 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c00eb485-df2e-478e-b251-56b35f6200e8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:12:08.458824 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c00eb485-df2e-478e-b251-56b35f6200e8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:12:08.459532 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c00eb485-df2e-478e-b251-56b35f6200e8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:12:08.459980 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c00eb485-df2e-478e-b251-56b35f6200e8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:12:08.460399 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c00eb485-df2e-478e-b251-56b35f6200e8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:12:08.485416 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c00eb485-df2e-478e-b251-56b35f6200e8 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f/ips" status: 200 len: 149 microversion: 2.1 time: 0.041281 Oct 11 07:12:08.485965 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1659/3314] 10.222.0.39 () {58 vars in 1248 bytes} [Tue Oct 11 07:12:08 2022] GET /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:13:08.559447 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR oslo.messaging._drivers.impl_rabbit [-] [92613af7-10ed-4c06-aa65-fe5066d8c47f] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 07:13:08.560071 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:13:08.774481 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-07bd56a2-ceaa-491c-bde8-4c2786ec789a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:13:08.775069 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-07bd56a2-ceaa-491c-bde8-4c2786ec789a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: c2fae85c-5d40-467b-92b3-94e702f54a7f] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:13:08.781288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-07bd56a2-ceaa-491c-bde8-4c2786ec789a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:13:08.781769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-07bd56a2-ceaa-491c-bde8-4c2786ec789a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:13:08.782205 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-07bd56a2-ceaa-491c-bde8-4c2786ec789a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:13:08.782894 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-07bd56a2-ceaa-491c-bde8-4c2786ec789a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:13:08.783346 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-07bd56a2-ceaa-491c-bde8-4c2786ec789a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:13:08.783795 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-07bd56a2-ceaa-491c-bde8-4c2786ec789a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:13:08.808446 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-07bd56a2-ceaa-491c-bde8-4c2786ec789a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: c2fae85c-5d40-467b-92b3-94e702f54a7f] Going to try to terminate instance {{(pid=125267) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 07:13:08.882938 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-07bd56a2-ceaa-491c-bde8-4c2786ec789a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f" status: 204 len: 0 microversion: 2.1 time: 0.324966 Oct 11 07:13:08.883925 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1656/3315] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Oct 11 07:13:08 2022] DELETE /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 07:13:08.890036 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:13:08.890763 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=4 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:13:08.891914 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 07:13:08.892079 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Tue Oct 11 07:13:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f (ip 10.222.0.39) !!! Oct 11 07:13:08.896443 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-15eab63e-21de-420b-8a19-a13b9ac39337 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:13:08.897046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-15eab63e-21de-420b-8a19-a13b9ac39337 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: c2fae85c-5d40-467b-92b3-94e702f54a7f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:13:08.905290 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-15eab63e-21de-420b-8a19-a13b9ac39337 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:13:08.905767 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-15eab63e-21de-420b-8a19-a13b9ac39337 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:13:08.906195 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-15eab63e-21de-420b-8a19-a13b9ac39337 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:13:08.906876 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-15eab63e-21de-420b-8a19-a13b9ac39337 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:13:08.907336 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-15eab63e-21de-420b-8a19-a13b9ac39337 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:13:08.907780 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-15eab63e-21de-420b-8a19-a13b9ac39337 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:13:09.132565 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-15eab63e-21de-420b-8a19-a13b9ac39337 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:13:09.140144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-15eab63e-21de-420b-8a19-a13b9ac39337 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f" status: 200 len: 1680 microversion: 2.1 time: 0.251737 Oct 11 07:13:09.140706 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1660/3316] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:13:08 2022] GET /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f => generated 1680 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:13:10.164216 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a6d29ae9-6e2e-4148-ae06-ffb71e6b1d08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:13:10.164938 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a6d29ae9-6e2e-4148-ae06-ffb71e6b1d08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: c2fae85c-5d40-467b-92b3-94e702f54a7f] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:13:10.172018 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6d29ae9-6e2e-4148-ae06-ffb71e6b1d08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:13:10.172490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6d29ae9-6e2e-4148-ae06-ffb71e6b1d08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:13:10.172915 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6d29ae9-6e2e-4148-ae06-ffb71e6b1d08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:13:10.173598 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6d29ae9-6e2e-4148-ae06-ffb71e6b1d08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:13:10.174043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6d29ae9-6e2e-4148-ae06-ffb71e6b1d08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:13:10.174459 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a6d29ae9-6e2e-4148-ae06-ffb71e6b1d08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:13:10.190835 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [-] [92613af7-10ed-4c06-aa65-fe5066d8c47f] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 48710. Oct 11 07:13:10.353001 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a6d29ae9-6e2e-4148-ae06-ffb71e6b1d08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:13:10.360575 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a6d29ae9-6e2e-4148-ae06-ffb71e6b1d08 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f" status: 200 len: 1680 microversion: 2.1 time: 0.200575 Oct 11 07:13:10.361136 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1657/3317] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:13:10 2022] GET /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f => generated 1680 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:13:11.175778 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-ef2e4de7-ae1d-451d-8289-4be5cbe3aec3 req-88d55051-8deb-436f-999c-70de285b6146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2fae85c-5d40-467b-92b3-94e702f54a7f", "name": "network-vif-deleted", "tag": "94fe53f9-c55d-406f-9e07-822d6cb889f1"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:13:11.186047 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-ef2e4de7-ae1d-451d-8289-4be5cbe3aec3 req-88d55051-8deb-436f-999c-70de285b6146 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:13:11.186633 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-ef2e4de7-ae1d-451d-8289-4be5cbe3aec3 req-88d55051-8deb-436f-999c-70de285b6146 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:13:11.187235 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-ef2e4de7-ae1d-451d-8289-4be5cbe3aec3 req-88d55051-8deb-436f-999c-70de285b6146 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:13:11.199952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-ef2e4de7-ae1d-451d-8289-4be5cbe3aec3 req-88d55051-8deb-436f-999c-70de285b6146 service nova] Creating event network-vif-deleted:94fe53f9-c55d-406f-9e07-822d6cb889f1 for instance c2fae85c-5d40-467b-92b3-94e702f54a7f on hv-cinder-85495 Oct 11 07:13:11.215097 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-ef2e4de7-ae1d-451d-8289-4be5cbe3aec3 req-88d55051-8deb-436f-999c-70de285b6146 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042937 Oct 11 07:13:11.215716 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1661/3318] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:13:11.385027 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-62abeb09-2b8c-4510-99a6-89c64325d222 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:13:11.385643 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-62abeb09-2b8c-4510-99a6-89c64325d222 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: c2fae85c-5d40-467b-92b3-94e702f54a7f] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:13:11.392133 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62abeb09-2b8c-4510-99a6-89c64325d222 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:13:11.392618 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62abeb09-2b8c-4510-99a6-89c64325d222 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:13:11.393046 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62abeb09-2b8c-4510-99a6-89c64325d222 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:13:11.393735 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62abeb09-2b8c-4510-99a6-89c64325d222 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:13:11.394201 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62abeb09-2b8c-4510-99a6-89c64325d222 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:13:11.394612 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62abeb09-2b8c-4510-99a6-89c64325d222 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:13:11.432112 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62abeb09-2b8c-4510-99a6-89c64325d222 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:13:11.432600 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62abeb09-2b8c-4510-99a6-89c64325d222 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:13:11.433038 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62abeb09-2b8c-4510-99a6-89c64325d222 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:13:11.433491 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-62abeb09-2b8c-4510-99a6-89c64325d222 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lazy-loading 'fault' on Instance uuid c2fae85c-5d40-467b-92b3-94e702f54a7f {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 07:13:11.473320 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-62abeb09-2b8c-4510-99a6-89c64325d222 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e63c3f83f3d41018e6330f26ed7b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af47e2321de4d299ff3a7fb3d3d9e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:13:11.481154 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-62abeb09-2b8c-4510-99a6-89c64325d222 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f" status: 200 len: 1331 microversion: 2.1 time: 0.100909 Oct 11 07:13:11.481662 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1658/3319] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:13:11 2022] GET /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:13:12.505925 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ef05dc6d-ce5a-44e7-bdea-f0d5d05ca52a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:13:12.506684 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ef05dc6d-ce5a-44e7-bdea-f0d5d05ca52a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: c2fae85c-5d40-467b-92b3-94e702f54a7f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:13:12.512844 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef05dc6d-ce5a-44e7-bdea-f0d5d05ca52a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:13:12.513315 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef05dc6d-ce5a-44e7-bdea-f0d5d05ca52a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:13:12.513743 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef05dc6d-ce5a-44e7-bdea-f0d5d05ca52a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:13:12.514422 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef05dc6d-ce5a-44e7-bdea-f0d5d05ca52a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:13:12.514870 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef05dc6d-ce5a-44e7-bdea-f0d5d05ca52a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:13:12.515456 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ef05dc6d-ce5a-44e7-bdea-f0d5d05ca52a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:13:12.529062 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-ef05dc6d-ce5a-44e7-bdea-f0d5d05ca52a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] HTTP exception thrown: Instance c2fae85c-5d40-467b-92b3-94e702f54a7f could not be found. Oct 11 07:13:12.530663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ef05dc6d-ce5a-44e7-bdea-f0d5d05ca52a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Request method failure captured: Oct 11 07:13:12.530663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: request: GET /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f HTTP/1.1 Oct 11 07:13:12.530663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept: application/json Oct 11 07:13:12.530663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Oct 11 07:13:12.530663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Connection: close Oct 11 07:13:12.530663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Length: 0 Oct 11 07:13:12.530663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Type: application/json Oct 11 07:13:12.530663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Host: 10.222.0.39 Oct 11 07:13:12.530663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Oct 11 07:13:12.530663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.12 Oct 11 07:13:12.530663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABjRRAxy4G3-Dozw6PdtI-WxnLtOJo2tV5OYxcxBy_217a4UmcYLPs6ReKc-RB_X0BHPCFHNcEeuRkAY-tzsCezmhAkP9Vj61rIl09eudAdIM1Me8KUnbI8OUgzhSO-abAb7LBVYvrD1IB-9qK1fM9G-MUZhv8Y32eWPbrO9FZ3pwby7Y8 Oct 11 07:13:12.530663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Oct 11 07:13:12.530663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Oct 11 07:13:12.530663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Oct 11 07:13:12.530663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Oct 11 07:13:12.530663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Oct 11 07:13:12.530663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Oct 11 07:13:12.530663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Id: 5af47e2321de4d299ff3a7fb3d3d9e3c Oct 11 07:13:12.530663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-AttachVolumeNegativeTest-1386971692 Oct 11 07:13:12.530663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Role: reader,member Oct 11 07:13:12.530663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Oct 11 07:13:12.531753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 07:13:12.531753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-AttachVolumeNegativeTest-1386971692 Oct 11 07:13:12.531753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 5af47e2321de4d299ff3a7fb3d3d9e3c Oct 11 07:13:12.531753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1386971692 Oct 11 07:13:12.531753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User: tempest-AttachVolumeNegativeTest-1386971692-project Oct 11 07:13:12.531753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Oct 11 07:13:12.531753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Oct 11 07:13:12.531753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Id: 2e63c3f83f3d41018e6330f26ed7b8a0 Oct 11 07:13:12.531753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-AttachVolumeNegativeTest-1386971692-project Oct 11 07:13:12.531753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: method: > Oct 11 07:13:12.531753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: exception: Instance c2fae85c-5d40-467b-92b3-94e702f54a7f could not be found. Oct 11 07:13:12.531753 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: action_args: {'id': 'c2fae85c-5d40-467b-92b3-94e702f54a7f'} Oct 11 07:13:12.532305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 07:13:12.532305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:13:12.532305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 07:13:12.532305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 07:13:12.532305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 07:13:12.532305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 07:13:12.532305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 07:13:12.532305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 07:13:12.532305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 07:13:12.532305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 07:13:12.532305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2fae85c-5d40-467b-92b3-94e702f54a7f could not be found. Oct 11 07:13:12.532305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:13:12.532305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:13:12.532305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:13:12.532305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:13:12.532305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:13:12.532305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:13:12.532305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 07:13:12.532305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 07:13:12.532305 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 07:13:12.533259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 07:13:12.533259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 07:13:12.533259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 07:13:12.533259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 07:13:12.533259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 07:13:12.533259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 07:13:12.533259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 07:13:12.533259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2fae85c-5d40-467b-92b3-94e702f54a7f could not be found. Oct 11 07:13:12.533259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:13:12.533259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:13:12.533259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:13:12.533259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:13:12.533259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:13:12.533259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:13:12.533259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 07:13:12.533259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 07:13:12.533259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2fae85c-5d40-467b-92b3-94e702f54a7f could not be found. Oct 11 07:13:12.533259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:13:12.534211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ef05dc6d-ce5a-44e7-bdea-f0d5d05ca52a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Returning 404 to user: Instance c2fae85c-5d40-467b-92b3-94e702f54a7f could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 07:13:12.534211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ef05dc6d-ce5a-44e7-bdea-f0d5d05ca52a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f" status: 404 len: 111 microversion: 2.1 time: 0.030876 Oct 11 07:13:12.534211 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1662/3320] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:13:12 2022] GET /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 07:13:12.541373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-24d3d379-e9cc-4bc7-8f36-f60447cb0828 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '.version_select at 0x7f8e26d76c10>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:13:12.559301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-24d3d379-e9cc-4bc7-8f36-f60447cb0828 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-975660079" status: 202 len: 0 microversion: 2.1 time: 0.022361 Oct 11 07:13:12.559866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1659/3321] 10.222.0.39 () {58 vars in 1218 bytes} [Tue Oct 11 07:13:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-975660079 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 07:13:13.415760 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-66561a76-09d5-4826-a14a-ca765df3ce0d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:13:13.416346 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-66561a76-09d5-4826-a14a-ca765df3ce0d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: c2fae85c-5d40-467b-92b3-94e702f54a7f] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:13:13.422316 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-66561a76-09d5-4826-a14a-ca765df3ce0d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:13:13.422791 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-66561a76-09d5-4826-a14a-ca765df3ce0d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:13:13.423221 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-66561a76-09d5-4826-a14a-ca765df3ce0d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:13:13.423928 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-66561a76-09d5-4826-a14a-ca765df3ce0d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:13:13.424375 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-66561a76-09d5-4826-a14a-ca765df3ce0d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:13:13.424823 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-66561a76-09d5-4826-a14a-ca765df3ce0d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:13:13.438490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-66561a76-09d5-4826-a14a-ca765df3ce0d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] HTTP exception thrown: Instance c2fae85c-5d40-467b-92b3-94e702f54a7f could not be found. Oct 11 07:13:13.440046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-66561a76-09d5-4826-a14a-ca765df3ce0d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Request method failure captured: Oct 11 07:13:13.440046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: request: DELETE /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f HTTP/1.1 Oct 11 07:13:13.440046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept: application/json Oct 11 07:13:13.440046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Oct 11 07:13:13.440046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Connection: close Oct 11 07:13:13.440046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Length: 0 Oct 11 07:13:13.440046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Type: application/json Oct 11 07:13:13.440046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Host: 10.222.0.39 Oct 11 07:13:13.440046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Oct 11 07:13:13.440046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.12 Oct 11 07:13:13.440046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABjRRAxy4G3-Dozw6PdtI-WxnLtOJo2tV5OYxcxBy_217a4UmcYLPs6ReKc-RB_X0BHPCFHNcEeuRkAY-tzsCezmhAkP9Vj61rIl09eudAdIM1Me8KUnbI8OUgzhSO-abAb7LBVYvrD1IB-9qK1fM9G-MUZhv8Y32eWPbrO9FZ3pwby7Y8 Oct 11 07:13:13.440046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Oct 11 07:13:13.440046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Oct 11 07:13:13.440046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Oct 11 07:13:13.440046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Oct 11 07:13:13.440046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Oct 11 07:13:13.440046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Oct 11 07:13:13.440046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Id: 5af47e2321de4d299ff3a7fb3d3d9e3c Oct 11 07:13:13.440046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-AttachVolumeNegativeTest-1386971692 Oct 11 07:13:13.440046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Role: reader,member Oct 11 07:13:13.440046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Oct 11 07:13:13.441237 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 07:13:13.441237 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-AttachVolumeNegativeTest-1386971692 Oct 11 07:13:13.441237 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 5af47e2321de4d299ff3a7fb3d3d9e3c Oct 11 07:13:13.441237 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1386971692 Oct 11 07:13:13.441237 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User: tempest-AttachVolumeNegativeTest-1386971692-project Oct 11 07:13:13.441237 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Oct 11 07:13:13.441237 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Oct 11 07:13:13.441237 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Id: 2e63c3f83f3d41018e6330f26ed7b8a0 Oct 11 07:13:13.441237 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-AttachVolumeNegativeTest-1386971692-project Oct 11 07:13:13.441237 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: method: > Oct 11 07:13:13.441237 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: exception: Instance c2fae85c-5d40-467b-92b3-94e702f54a7f could not be found. Oct 11 07:13:13.441237 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: action_args: {'id': 'c2fae85c-5d40-467b-92b3-94e702f54a7f'} Oct 11 07:13:13.441878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 07:13:13.441878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:13:13.441878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 07:13:13.441878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 07:13:13.441878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 07:13:13.441878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 07:13:13.441878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 07:13:13.441878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 07:13:13.441878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 07:13:13.441878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 07:13:13.441878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2fae85c-5d40-467b-92b3-94e702f54a7f could not be found. Oct 11 07:13:13.441878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:13:13.441878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:13:13.441878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:13:13.441878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:13:13.441878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:13:13.441878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:13:13.441878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 07:13:13.441878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 07:13:13.441878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 07:13:13.442729 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 07:13:13.442729 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 07:13:13.442729 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 07:13:13.442729 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 07:13:13.442729 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 07:13:13.442729 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 07:13:13.442729 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 07:13:13.442729 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 07:13:13.442729 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 07:13:13.442729 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2fae85c-5d40-467b-92b3-94e702f54a7f could not be found. Oct 11 07:13:13.442729 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:13:13.442729 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:13:13.442729 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:13:13.442729 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:13:13.442729 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:13:13.442729 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:13:13.442729 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 07:13:13.442729 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 07:13:13.442729 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2fae85c-5d40-467b-92b3-94e702f54a7f could not be found. Oct 11 07:13:13.442729 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:13:13.443650 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-66561a76-09d5-4826-a14a-ca765df3ce0d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Returning 404 to user: Instance c2fae85c-5d40-467b-92b3-94e702f54a7f could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 07:13:13.443650 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-66561a76-09d5-4826-a14a-ca765df3ce0d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f" status: 404 len: 111 microversion: 2.1 time: 0.030078 Oct 11 07:13:13.443650 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1663/3322] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Oct 11 07:13:13 2022] DELETE /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 07:13:13.450000 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-089e77aa-688a-498f-89ee-148388814415 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:13:13.450635 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-089e77aa-688a-498f-89ee-148388814415 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: c2fae85c-5d40-467b-92b3-94e702f54a7f] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:13:13.456563 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-089e77aa-688a-498f-89ee-148388814415 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:13:13.457032 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-089e77aa-688a-498f-89ee-148388814415 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:13:13.457465 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-089e77aa-688a-498f-89ee-148388814415 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:13:13.458144 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-089e77aa-688a-498f-89ee-148388814415 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:13:13.458584 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-089e77aa-688a-498f-89ee-148388814415 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:13:13.458997 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-089e77aa-688a-498f-89ee-148388814415 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:13:13.471802 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-089e77aa-688a-498f-89ee-148388814415 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] HTTP exception thrown: Instance c2fae85c-5d40-467b-92b3-94e702f54a7f could not be found. Oct 11 07:13:13.473433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-089e77aa-688a-498f-89ee-148388814415 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Request method failure captured: Oct 11 07:13:13.473433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: request: GET /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f HTTP/1.1 Oct 11 07:13:13.473433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept: application/json Oct 11 07:13:13.473433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Oct 11 07:13:13.473433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Connection: close Oct 11 07:13:13.473433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Length: 0 Oct 11 07:13:13.473433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Type: application/json Oct 11 07:13:13.473433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Host: 10.222.0.39 Oct 11 07:13:13.473433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Oct 11 07:13:13.473433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.12 Oct 11 07:13:13.473433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABjRRAxy4G3-Dozw6PdtI-WxnLtOJo2tV5OYxcxBy_217a4UmcYLPs6ReKc-RB_X0BHPCFHNcEeuRkAY-tzsCezmhAkP9Vj61rIl09eudAdIM1Me8KUnbI8OUgzhSO-abAb7LBVYvrD1IB-9qK1fM9G-MUZhv8Y32eWPbrO9FZ3pwby7Y8 Oct 11 07:13:13.473433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Oct 11 07:13:13.473433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Oct 11 07:13:13.473433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Oct 11 07:13:13.473433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Oct 11 07:13:13.473433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Oct 11 07:13:13.473433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Oct 11 07:13:13.473433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Id: 5af47e2321de4d299ff3a7fb3d3d9e3c Oct 11 07:13:13.473433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-AttachVolumeNegativeTest-1386971692 Oct 11 07:13:13.473433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Role: reader,member Oct 11 07:13:13.473433 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Oct 11 07:13:13.474599 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 07:13:13.474599 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-AttachVolumeNegativeTest-1386971692 Oct 11 07:13:13.474599 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 5af47e2321de4d299ff3a7fb3d3d9e3c Oct 11 07:13:13.474599 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1386971692 Oct 11 07:13:13.474599 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User: tempest-AttachVolumeNegativeTest-1386971692-project Oct 11 07:13:13.474599 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Oct 11 07:13:13.474599 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Oct 11 07:13:13.474599 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Id: 2e63c3f83f3d41018e6330f26ed7b8a0 Oct 11 07:13:13.474599 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-AttachVolumeNegativeTest-1386971692-project Oct 11 07:13:13.474599 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: method: > Oct 11 07:13:13.474599 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: exception: Instance c2fae85c-5d40-467b-92b3-94e702f54a7f could not be found. Oct 11 07:13:13.474599 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: action_args: {'id': 'c2fae85c-5d40-467b-92b3-94e702f54a7f'} Oct 11 07:13:13.475845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 07:13:13.475845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:13:13.475845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 07:13:13.475845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 07:13:13.475845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 07:13:13.475845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 07:13:13.475845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 07:13:13.475845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 07:13:13.475845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 07:13:13.475845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 07:13:13.475845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2fae85c-5d40-467b-92b3-94e702f54a7f could not be found. Oct 11 07:13:13.475845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:13:13.475845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:13:13.475845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:13:13.475845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:13:13.475845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:13:13.475845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:13:13.475845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 07:13:13.475845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 07:13:13.475845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 07:13:13.476974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 07:13:13.476974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 07:13:13.476974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 07:13:13.476974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 07:13:13.476974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 07:13:13.476974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 07:13:13.476974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 07:13:13.476974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2fae85c-5d40-467b-92b3-94e702f54a7f could not be found. Oct 11 07:13:13.476974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:13:13.476974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:13:13.476974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:13:13.476974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:13:13.476974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:13:13.476974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:13:13.476974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 07:13:13.476974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 07:13:13.476974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2fae85c-5d40-467b-92b3-94e702f54a7f could not be found. Oct 11 07:13:13.476974 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:13:13.477961 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-089e77aa-688a-498f-89ee-148388814415 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Returning 404 to user: Instance c2fae85c-5d40-467b-92b3-94e702f54a7f could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 07:13:13.477961 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-089e77aa-688a-498f-89ee-148388814415 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f" status: 404 len: 111 microversion: 2.1 time: 0.028634 Oct 11 07:13:13.477961 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1660/3323] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:13:13 2022] GET /compute/v2.1/servers/c2fae85c-5d40-467b-92b3-94e702f54a7f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 07:16:14.312853 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b8316774-68c4-4fba-8a9e-5fff1b8a392c] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 11 07:16:14.313375 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=8 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:16:14.314071 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=12 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:16:14.314941 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 07:16:14.315116 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Tue Oct 11 07:16:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.39) !!! Oct 11 07:16:14.318258 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 07:16:14.318474 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Tue Oct 11 07:16:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.39) !!! Oct 11 07:16:14.320195 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 07:16:14.320356 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Tue Oct 11 07:16:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.39) !!! Oct 11 07:16:14.418110 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-387cee5f-6cbf-4643-94bc-17fedb2813e2 req-5f9a062e-2dad-4ea0-b77f-6b07c416d61e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43d48211-8dab-4abd-8c95-e850b83382ff", "name": "network-vif-deleted", "tag": "f963366d-bbf2-4aff-84d1-f61c69977089"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:16:14.429950 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-387cee5f-6cbf-4643-94bc-17fedb2813e2 req-5f9a062e-2dad-4ea0-b77f-6b07c416d61e service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:16:14.430380 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-387cee5f-6cbf-4643-94bc-17fedb2813e2 req-5f9a062e-2dad-4ea0-b77f-6b07c416d61e service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:16:14.430974 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-387cee5f-6cbf-4643-94bc-17fedb2813e2 req-5f9a062e-2dad-4ea0-b77f-6b07c416d61e service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:16:14.445582 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-387cee5f-6cbf-4643-94bc-17fedb2813e2 req-5f9a062e-2dad-4ea0-b77f-6b07c416d61e service nova] Creating event network-vif-deleted:f963366d-bbf2-4aff-84d1-f61c69977089 for instance 43d48211-8dab-4abd-8c95-e850b83382ff on hv-cinder-85495 Oct 11 07:16:14.459221 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-387cee5f-6cbf-4643-94bc-17fedb2813e2 req-5f9a062e-2dad-4ea0-b77f-6b07c416d61e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148316 Oct 11 07:16:14.459842 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1664/3324] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:16:16.473144 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR oslo.messaging._drivers.impl_rabbit [-] [92613af7-10ed-4c06-aa65-fe5066d8c47f] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 11 07:16:16.474011 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:16:16.474822 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:16:16.476241 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 07:16:16.476368 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Tue Oct 11 07:16:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.39) !!! Oct 11 07:16:16.478670 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 07:16:16.478787 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Tue Oct 11 07:16:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.39) !!! Oct 11 07:16:16.480398 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 07:16:16.480540 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Tue Oct 11 07:16:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.39) !!! Oct 11 07:16:16.485384 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-b17bb339-155c-45d1-9152-0e81a43ef775 req-56125c5b-df21-4675-bf46-cf9b7ebd15ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0240e39b-9517-4a93-9789-705cd357e01c", "name": "network-vif-deleted", "tag": "152b8dff-5676-4b2d-b774-671775bfbc7d"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:16:16.509218 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-b17bb339-155c-45d1-9152-0e81a43ef775 req-56125c5b-df21-4675-bf46-cf9b7ebd15ba service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:16:16.509794 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-b17bb339-155c-45d1-9152-0e81a43ef775 req-56125c5b-df21-4675-bf46-cf9b7ebd15ba service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:16:16.510292 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-b17bb339-155c-45d1-9152-0e81a43ef775 req-56125c5b-df21-4675-bf46-cf9b7ebd15ba service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:16:16.522625 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-b17bb339-155c-45d1-9152-0e81a43ef775 req-56125c5b-df21-4675-bf46-cf9b7ebd15ba service nova] Creating event network-vif-deleted:152b8dff-5676-4b2d-b774-671775bfbc7d for instance 0240e39b-9517-4a93-9789-705cd357e01c on hv-cinder-85495 Oct 11 07:16:16.535458 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-b17bb339-155c-45d1-9152-0e81a43ef775 req-56125c5b-df21-4675-bf46-cf9b7ebd15ba service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063996 Oct 11 07:16:16.536050 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1661/3325] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:16:28.919443 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:16:28.920196 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:16:28.938609 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO oslo.messaging._drivers.impl_rabbit [-] [b8316774-68c4-4fba-8a9e-5fff1b8a392c] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 49234. Oct 11 07:16:29.102405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8aaf667c-7695-4b88-83cf-7d70b39ca577 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Action: 'create', calling method: .version_select at 0x7f8e2a4b0550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-999822900", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYASCEfsNUbMX777MNp835t65TvrTOY0gkZaZda52gTmxsgHGopJEvQ5RrR5t2XzNhgTpiGJ9w+Y2hsh9ktoyd/Ih9v1CtV5dkO9P752xhGTi9czYscGAVW1Lu55d4S1A=="}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:16:29.120265 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-8aaf667c-7695-4b88-83cf-7d70b39ca577 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Getting quotas for project 60dd1d4ab8434282b5f57d6547f8d3e9. Resources: {'key_pairs'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 07:16:29.124441 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-8aaf667c-7695-4b88-83cf-7d70b39ca577 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Getting quotas for user 52173fbead6e4b499a99a6979c9a9898 and project 60dd1d4ab8434282b5f57d6547f8d3e9. Resources: {'key_pairs'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 07:16:29.151181 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8aaf667c-7695-4b88-83cf-7d70b39ca577 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.233265 Oct 11 07:16:29.153376 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1665/3326] 10.222.0.39 () {60 vars in 1159 bytes} [Tue Oct 11 07:16:28 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:16:46.630502 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=2 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:16:46.631270 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=2 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:16:46.635967 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f25acd2d-ab03-4b70-9605-dc5f8df71118 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1699125241", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-999822900", "security_groups": [{"name": "tempest-secgroup-smoke-1808634596"}], "block_device_mapping_v2": [{"uuid": "f15b6693-610b-438e-9c88-e57f7c1f6b28", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9a53f628-4e9e-4385-a02c-283640135d82"}]}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:16:46.664261 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [-] [92613af7-10ed-4c06-aa65-fe5066d8c47f] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 49576. Oct 11 07:16:46.756346 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.network.neutron [None req-f25acd2d-ab03-4b70-9605-dc5f8df71118 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] validate_networks() for [('9a53f628-4e9e-4385-a02c-283640135d82', None, None, None, None, None)] {{(pid=125267) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 07:16:47.241733 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-f25acd2d-ab03-4b70-9605-dc5f8df71118 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Flavor limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 07:16:47.242555 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-f25acd2d-ab03-4b70-9605-dc5f8df71118 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Image limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 07:16:47.242983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-f25acd2d-ab03-4b70-9605-dc5f8df71118 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Flavor pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 07:16:47.243402 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-f25acd2d-ab03-4b70-9605-dc5f8df71118 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Image pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 07:16:47.243821 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-f25acd2d-ab03-4b70-9605-dc5f8df71118 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 07:16:47.252666 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f25acd2d-ab03-4b70-9605-dc5f8df71118 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:16:47.253146 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f25acd2d-ab03-4b70-9605-dc5f8df71118 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:16:47.253567 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f25acd2d-ab03-4b70-9605-dc5f8df71118 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:16:47.254282 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f25acd2d-ab03-4b70-9605-dc5f8df71118 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:16:47.254730 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f25acd2d-ab03-4b70-9605-dc5f8df71118 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:16:47.255147 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f25acd2d-ab03-4b70-9605-dc5f8df71118 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:16:47.271841 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-f25acd2d-ab03-4b70-9605-dc5f8df71118 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Getting quotas for project 60dd1d4ab8434282b5f57d6547f8d3e9. Resources: {'cores', 'ram', 'instances'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 07:16:47.275769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-f25acd2d-ab03-4b70-9605-dc5f8df71118 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Getting quotas for user 52173fbead6e4b499a99a6979c9a9898 and project 60dd1d4ab8434282b5f57d6547f8d3e9. Resources: {'cores', 'ram', 'instances'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 07:16:47.335384 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f25acd2d-ab03-4b70-9605-dc5f8df71118 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Going to run 1 instances... {{(pid=125267) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 07:16:47.337723 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f25acd2d-ab03-4b70-9605-dc5f8df71118 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 0bb04c29-c281-4fe5-8196-947a769f6e41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f15b6693-610b-438e-9c88-e57f7c1f6b28',volume_size=None,volume_type=None)] {{(pid=125267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 07:16:47.476733 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f25acd2d-ab03-4b70-9605-dc5f8df71118 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.849018 Oct 11 07:16:47.483460 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1662/3327] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Oct 11 07:16:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 07:16:47.489780 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-74068413-0198-4c1d-8f32-c4f935216843 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:16:47.490504 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-74068413-0198-4c1d-8f32-c4f935216843 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 0bb04c29-c281-4fe5-8196-947a769f6e41] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:16:47.493276 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=4 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:16:47.493917 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:16:47.564839 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-74068413-0198-4c1d-8f32-c4f935216843 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:16:47.573186 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-74068413-0198-4c1d-8f32-c4f935216843 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41" status: 200 len: 1094 microversion: 2.1 time: 0.087791 Oct 11 07:16:47.574431 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1666/3328] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:16:47 2022] GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41 => generated 1094 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:16:48.596787 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5b6d0c10-b973-434b-8b7b-29dccd99a5e5 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:16:48.597921 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5b6d0c10-b973-434b-8b7b-29dccd99a5e5 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 0bb04c29-c281-4fe5-8196-947a769f6e41] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:16:48.606338 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b6d0c10-b973-434b-8b7b-29dccd99a5e5 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:16:48.607276 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b6d0c10-b973-434b-8b7b-29dccd99a5e5 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:16:48.607828 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b6d0c10-b973-434b-8b7b-29dccd99a5e5 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:16:48.608799 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b6d0c10-b973-434b-8b7b-29dccd99a5e5 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:16:48.609439 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b6d0c10-b973-434b-8b7b-29dccd99a5e5 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:16:48.610020 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5b6d0c10-b973-434b-8b7b-29dccd99a5e5 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:16:48.677125 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5b6d0c10-b973-434b-8b7b-29dccd99a5e5 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:16:48.685180 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5b6d0c10-b973-434b-8b7b-29dccd99a5e5 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41" status: 200 len: 1192 microversion: 2.1 time: 0.093354 Oct 11 07:16:48.687605 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1663/3329] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:16:48 2022] GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41 => generated 1192 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:16:49.720694 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8f1c037c-ad9f-45fe-a652-0c744e3c7456 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:16:49.722485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8f1c037c-ad9f-45fe-a652-0c744e3c7456 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 0bb04c29-c281-4fe5-8196-947a769f6e41] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:16:49.735512 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f1c037c-ad9f-45fe-a652-0c744e3c7456 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:16:49.738544 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f1c037c-ad9f-45fe-a652-0c744e3c7456 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:16:49.739741 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f1c037c-ad9f-45fe-a652-0c744e3c7456 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:16:49.741191 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f1c037c-ad9f-45fe-a652-0c744e3c7456 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:16:49.743830 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f1c037c-ad9f-45fe-a652-0c744e3c7456 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:16:49.744099 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8f1c037c-ad9f-45fe-a652-0c744e3c7456 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:16:50.002114 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8f1c037c-ad9f-45fe-a652-0c744e3c7456 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:16:50.009769 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8f1c037c-ad9f-45fe-a652-0c744e3c7456 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41" status: 200 len: 1278 microversion: 2.1 time: 0.301184 Oct 11 07:16:50.010339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1667/3330] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:16:49 2022] GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41 => generated 1278 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:16:50.530269 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-07342666-bdfb-49ef-a4ea-0e1c519fc73e req-544607a1-fe79-4b54-af24-759b37f3084b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bb04c29-c281-4fe5-8196-947a769f6e41", "tag": "82a323a0-be48-423a-acce-b7003095cfc4"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:16:50.542000 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-07342666-bdfb-49ef-a4ea-0e1c519fc73e req-544607a1-fe79-4b54-af24-759b37f3084b service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:16:50.542476 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-07342666-bdfb-49ef-a4ea-0e1c519fc73e req-544607a1-fe79-4b54-af24-759b37f3084b service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:16:50.542949 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-07342666-bdfb-49ef-a4ea-0e1c519fc73e req-544607a1-fe79-4b54-af24-759b37f3084b service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:16:50.554312 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-07342666-bdfb-49ef-a4ea-0e1c519fc73e req-544607a1-fe79-4b54-af24-759b37f3084b service nova] Creating event network-changed:82a323a0-be48-423a-acce-b7003095cfc4 for instance 0bb04c29-c281-4fe5-8196-947a769f6e41 on hv-cinder-85495 Oct 11 07:16:50.559390 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-07342666-bdfb-49ef-a4ea-0e1c519fc73e req-544607a1-fe79-4b54-af24-759b37f3084b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032834 Oct 11 07:16:50.559939 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1664/3331] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:16:51.033090 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-39b97c21-8e81-4912-a8bb-3705bdb0c69e tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:16:51.033703 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-39b97c21-8e81-4912-a8bb-3705bdb0c69e tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 0bb04c29-c281-4fe5-8196-947a769f6e41] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:16:51.040646 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-39b97c21-8e81-4912-a8bb-3705bdb0c69e tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:16:51.041126 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-39b97c21-8e81-4912-a8bb-3705bdb0c69e tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:16:51.041556 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-39b97c21-8e81-4912-a8bb-3705bdb0c69e tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:16:51.042247 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-39b97c21-8e81-4912-a8bb-3705bdb0c69e tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:16:51.042692 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-39b97c21-8e81-4912-a8bb-3705bdb0c69e tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:16:51.043112 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-39b97c21-8e81-4912-a8bb-3705bdb0c69e tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:16:51.177443 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-39b97c21-8e81-4912-a8bb-3705bdb0c69e tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:16:51.185097 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-39b97c21-8e81-4912-a8bb-3705bdb0c69e tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41" status: 200 len: 1266 microversion: 2.1 time: 0.155861 Oct 11 07:16:51.185647 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1668/3332] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:16:51 2022] GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:16:52.207943 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1ebd0c47-38a9-4c20-8350-c82b2e45ed29 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:16:52.208575 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1ebd0c47-38a9-4c20-8350-c82b2e45ed29 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 0bb04c29-c281-4fe5-8196-947a769f6e41] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:16:52.214674 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1ebd0c47-38a9-4c20-8350-c82b2e45ed29 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:16:52.215158 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1ebd0c47-38a9-4c20-8350-c82b2e45ed29 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:16:52.215624 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1ebd0c47-38a9-4c20-8350-c82b2e45ed29 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:16:52.216314 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1ebd0c47-38a9-4c20-8350-c82b2e45ed29 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:16:52.216766 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1ebd0c47-38a9-4c20-8350-c82b2e45ed29 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:16:52.217189 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1ebd0c47-38a9-4c20-8350-c82b2e45ed29 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:16:52.344720 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1ebd0c47-38a9-4c20-8350-c82b2e45ed29 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:16:52.352424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1ebd0c47-38a9-4c20-8350-c82b2e45ed29 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41" status: 200 len: 1266 microversion: 2.1 time: 0.149312 Oct 11 07:16:52.352980 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1665/3333] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:16:52 2022] GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:16:53.376223 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ff0169ed-095b-4e6e-be24-39cbf9f3c906 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:16:53.376834 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ff0169ed-095b-4e6e-be24-39cbf9f3c906 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 0bb04c29-c281-4fe5-8196-947a769f6e41] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:16:53.384621 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff0169ed-095b-4e6e-be24-39cbf9f3c906 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:16:53.385154 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff0169ed-095b-4e6e-be24-39cbf9f3c906 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:16:53.385580 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff0169ed-095b-4e6e-be24-39cbf9f3c906 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:16:53.386255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff0169ed-095b-4e6e-be24-39cbf9f3c906 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:16:53.386695 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff0169ed-095b-4e6e-be24-39cbf9f3c906 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:16:53.387110 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff0169ed-095b-4e6e-be24-39cbf9f3c906 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:16:53.517346 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ff0169ed-095b-4e6e-be24-39cbf9f3c906 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:16:53.525412 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ff0169ed-095b-4e6e-be24-39cbf9f3c906 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41" status: 200 len: 1266 microversion: 2.1 time: 0.153000 Oct 11 07:16:53.525956 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1669/3334] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:16:53 2022] GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:16:54.547663 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8d33a699-64a5-4405-baca-7cb408b413aa tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:16:54.548263 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-8d33a699-64a5-4405-baca-7cb408b413aa tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 0bb04c29-c281-4fe5-8196-947a769f6e41] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:16:54.554605 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d33a699-64a5-4405-baca-7cb408b413aa tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:16:54.555086 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d33a699-64a5-4405-baca-7cb408b413aa tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:16:54.555549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d33a699-64a5-4405-baca-7cb408b413aa tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:16:54.556235 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d33a699-64a5-4405-baca-7cb408b413aa tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:16:54.556685 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d33a699-64a5-4405-baca-7cb408b413aa tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:16:54.557104 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-8d33a699-64a5-4405-baca-7cb408b413aa tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:16:54.689340 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-8d33a699-64a5-4405-baca-7cb408b413aa tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:16:54.697701 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8d33a699-64a5-4405-baca-7cb408b413aa tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41" status: 200 len: 1266 microversion: 2.1 time: 0.153916 Oct 11 07:16:54.698305 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1666/3335] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:16:54 2022] GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:16:55.720562 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4f08057d-be51-4f70-ad98-2b90be359cd3 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:16:55.721165 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4f08057d-be51-4f70-ad98-2b90be359cd3 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 0bb04c29-c281-4fe5-8196-947a769f6e41] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:16:55.728130 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f08057d-be51-4f70-ad98-2b90be359cd3 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:16:55.728596 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f08057d-be51-4f70-ad98-2b90be359cd3 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:16:55.729024 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f08057d-be51-4f70-ad98-2b90be359cd3 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:16:55.729703 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f08057d-be51-4f70-ad98-2b90be359cd3 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:16:55.730144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f08057d-be51-4f70-ad98-2b90be359cd3 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:16:55.730559 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4f08057d-be51-4f70-ad98-2b90be359cd3 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:16:55.866140 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4f08057d-be51-4f70-ad98-2b90be359cd3 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:16:55.875000 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4f08057d-be51-4f70-ad98-2b90be359cd3 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41" status: 200 len: 1266 microversion: 2.1 time: 0.158255 Oct 11 07:16:55.875586 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1670/3336] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:16:55 2022] GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:16:56.898000 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3badeade-8fab-4cc1-98a7-73e3dcdc3b85 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:16:56.898625 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3badeade-8fab-4cc1-98a7-73e3dcdc3b85 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 0bb04c29-c281-4fe5-8196-947a769f6e41] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:16:56.905835 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3badeade-8fab-4cc1-98a7-73e3dcdc3b85 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:16:56.906317 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3badeade-8fab-4cc1-98a7-73e3dcdc3b85 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:16:56.906904 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3badeade-8fab-4cc1-98a7-73e3dcdc3b85 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:16:56.907646 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3badeade-8fab-4cc1-98a7-73e3dcdc3b85 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:16:56.908098 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3badeade-8fab-4cc1-98a7-73e3dcdc3b85 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:16:56.908525 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3badeade-8fab-4cc1-98a7-73e3dcdc3b85 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:16:57.052262 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3badeade-8fab-4cc1-98a7-73e3dcdc3b85 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:16:57.061017 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3badeade-8fab-4cc1-98a7-73e3dcdc3b85 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41" status: 200 len: 1266 microversion: 2.1 time: 0.166757 Oct 11 07:16:57.071265 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1667/3337] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:16:56 2022] GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:16:58.084343 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4c2eed60-9372-49bc-a648-fc12d5bca20b tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:16:58.085075 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4c2eed60-9372-49bc-a648-fc12d5bca20b tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 0bb04c29-c281-4fe5-8196-947a769f6e41] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:16:58.087379 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:16:58.092341 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4c2eed60-9372-49bc-a648-fc12d5bca20b tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:16:58.092822 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4c2eed60-9372-49bc-a648-fc12d5bca20b tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:16:58.093252 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4c2eed60-9372-49bc-a648-fc12d5bca20b tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:16:58.094082 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4c2eed60-9372-49bc-a648-fc12d5bca20b tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:16:58.094538 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4c2eed60-9372-49bc-a648-fc12d5bca20b tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:16:58.094959 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4c2eed60-9372-49bc-a648-fc12d5bca20b tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:16:58.235618 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4c2eed60-9372-49bc-a648-fc12d5bca20b tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:16:58.244201 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4c2eed60-9372-49bc-a648-fc12d5bca20b tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41" status: 200 len: 1266 microversion: 2.1 time: 0.164351 Oct 11 07:16:58.244775 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1671/3338] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:16:58 2022] GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:16:59.267020 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0c48488d-c894-4e85-afc9-320cc6a7210a tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:16:59.267659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0c48488d-c894-4e85-afc9-320cc6a7210a tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 0bb04c29-c281-4fe5-8196-947a769f6e41] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:16:59.270206 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=2 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:16:59.270862 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=6 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:16:59.277014 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0c48488d-c894-4e85-afc9-320cc6a7210a tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:16:59.277489 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0c48488d-c894-4e85-afc9-320cc6a7210a tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:16:59.277914 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0c48488d-c894-4e85-afc9-320cc6a7210a tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:16:59.278598 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0c48488d-c894-4e85-afc9-320cc6a7210a tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:16:59.279042 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0c48488d-c894-4e85-afc9-320cc6a7210a tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:16:59.279488 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0c48488d-c894-4e85-afc9-320cc6a7210a tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:16:59.410574 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-0c48488d-c894-4e85-afc9-320cc6a7210a tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:16:59.418849 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0c48488d-c894-4e85-afc9-320cc6a7210a tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41" status: 200 len: 1266 microversion: 2.1 time: 0.155690 Oct 11 07:16:59.419406 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1668/3339] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:16:59 2022] GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:17:00.440830 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-732f6b3b-b8b5-4a5b-9af3-9f469b935d8a tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:17:00.441431 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-732f6b3b-b8b5-4a5b-9af3-9f469b935d8a tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 0bb04c29-c281-4fe5-8196-947a769f6e41] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:17:00.447401 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-732f6b3b-b8b5-4a5b-9af3-9f469b935d8a tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:17:00.447914 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-732f6b3b-b8b5-4a5b-9af3-9f469b935d8a tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:17:00.448344 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-732f6b3b-b8b5-4a5b-9af3-9f469b935d8a tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:17:00.449034 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-732f6b3b-b8b5-4a5b-9af3-9f469b935d8a tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:17:00.449512 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-732f6b3b-b8b5-4a5b-9af3-9f469b935d8a tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:17:00.449932 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-732f6b3b-b8b5-4a5b-9af3-9f469b935d8a tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:17:00.577814 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-732f6b3b-b8b5-4a5b-9af3-9f469b935d8a tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:17:00.585917 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-732f6b3b-b8b5-4a5b-9af3-9f469b935d8a tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41" status: 200 len: 1266 microversion: 2.1 time: 0.149067 Oct 11 07:17:00.586469 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1672/3340] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:17:00 2022] GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:17:01.608476 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d0059caf-f552-45b8-bd3c-f13ede4c7f83 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:17:01.609078 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d0059caf-f552-45b8-bd3c-f13ede4c7f83 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 0bb04c29-c281-4fe5-8196-947a769f6e41] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:17:01.616076 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0059caf-f552-45b8-bd3c-f13ede4c7f83 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:17:01.616545 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0059caf-f552-45b8-bd3c-f13ede4c7f83 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:17:01.617225 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0059caf-f552-45b8-bd3c-f13ede4c7f83 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:17:01.617894 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0059caf-f552-45b8-bd3c-f13ede4c7f83 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:17:01.618331 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0059caf-f552-45b8-bd3c-f13ede4c7f83 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:17:01.618740 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0059caf-f552-45b8-bd3c-f13ede4c7f83 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:17:01.748985 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d0059caf-f552-45b8-bd3c-f13ede4c7f83 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:17:01.756646 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d0059caf-f552-45b8-bd3c-f13ede4c7f83 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41" status: 200 len: 1266 microversion: 2.1 time: 0.152053 Oct 11 07:17:01.757208 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1669/3341] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:17:01 2022] GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:17:02.779186 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-52346e4d-9d16-4c69-8847-a6d5431ebd1f tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:17:02.779764 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-52346e4d-9d16-4c69-8847-a6d5431ebd1f tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 0bb04c29-c281-4fe5-8196-947a769f6e41] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:17:02.786240 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-52346e4d-9d16-4c69-8847-a6d5431ebd1f tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:17:02.786714 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-52346e4d-9d16-4c69-8847-a6d5431ebd1f tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:17:02.787145 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-52346e4d-9d16-4c69-8847-a6d5431ebd1f tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:17:02.787872 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-52346e4d-9d16-4c69-8847-a6d5431ebd1f tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:17:02.788304 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-52346e4d-9d16-4c69-8847-a6d5431ebd1f tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:17:02.788724 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-52346e4d-9d16-4c69-8847-a6d5431ebd1f tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:17:02.922287 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-52346e4d-9d16-4c69-8847-a6d5431ebd1f tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:17:02.930558 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-52346e4d-9d16-4c69-8847-a6d5431ebd1f tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41" status: 200 len: 1266 microversion: 2.1 time: 0.155305 Oct 11 07:17:02.931116 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1673/3342] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:17:02 2022] GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:17:03.354873 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-03892155-58cd-488a-ac7d-205e2eee08f3 req-f03dfbf7-e18b-4e41-a107-45a289645aee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bb04c29-c281-4fe5-8196-947a769f6e41", "name": "network-vif-plugged", "status": "completed", "tag": "82a323a0-be48-423a-acce-b7003095cfc4"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:17:03.365708 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-03892155-58cd-488a-ac7d-205e2eee08f3 req-f03dfbf7-e18b-4e41-a107-45a289645aee service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:17:03.366214 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-03892155-58cd-488a-ac7d-205e2eee08f3 req-f03dfbf7-e18b-4e41-a107-45a289645aee service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:17:03.366968 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-03892155-58cd-488a-ac7d-205e2eee08f3 req-f03dfbf7-e18b-4e41-a107-45a289645aee service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:17:03.378043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-03892155-58cd-488a-ac7d-205e2eee08f3 req-f03dfbf7-e18b-4e41-a107-45a289645aee service nova] Creating event network-vif-plugged:82a323a0-be48-423a-acce-b7003095cfc4 for instance 0bb04c29-c281-4fe5-8196-947a769f6e41 on hv-cinder-85495 Oct 11 07:17:03.383194 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-03892155-58cd-488a-ac7d-205e2eee08f3 req-f03dfbf7-e18b-4e41-a107-45a289645aee service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164789 Oct 11 07:17:03.383829 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1670/3343] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:17:03.952633 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7f075519-73e1-4047-9542-ee679a326ab1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:17:03.953241 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7f075519-73e1-4047-9542-ee679a326ab1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 0bb04c29-c281-4fe5-8196-947a769f6e41] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:17:03.960263 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7f075519-73e1-4047-9542-ee679a326ab1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:17:03.960743 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7f075519-73e1-4047-9542-ee679a326ab1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:17:03.961169 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7f075519-73e1-4047-9542-ee679a326ab1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:17:03.961841 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7f075519-73e1-4047-9542-ee679a326ab1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:17:03.962279 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7f075519-73e1-4047-9542-ee679a326ab1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:17:03.962693 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7f075519-73e1-4047-9542-ee679a326ab1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:17:04.087716 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7f075519-73e1-4047-9542-ee679a326ab1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:17:04.095367 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7f075519-73e1-4047-9542-ee679a326ab1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41" status: 200 len: 1266 microversion: 2.1 time: 0.146637 Oct 11 07:17:04.095961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1674/3344] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:17:03 2022] GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:17:05.119611 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b374099f-741f-4424-a634-7109ac88bed3 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:17:05.120316 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b374099f-741f-4424-a634-7109ac88bed3 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 0bb04c29-c281-4fe5-8196-947a769f6e41] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:17:05.126409 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b374099f-741f-4424-a634-7109ac88bed3 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:17:05.126890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b374099f-741f-4424-a634-7109ac88bed3 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:17:05.127325 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b374099f-741f-4424-a634-7109ac88bed3 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:17:05.128038 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b374099f-741f-4424-a634-7109ac88bed3 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:17:05.128492 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b374099f-741f-4424-a634-7109ac88bed3 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:17:05.128915 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b374099f-741f-4424-a634-7109ac88bed3 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:17:05.257264 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b374099f-741f-4424-a634-7109ac88bed3 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:17:05.265126 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b374099f-741f-4424-a634-7109ac88bed3 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41" status: 200 len: 1452 microversion: 2.1 time: 0.150512 Oct 11 07:17:05.265680 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1671/3345] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:17:05 2022] GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:17:05.287532 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bb131f41-2c3c-4c71-a6a7-fb4bfe38f6e2 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:17:05.288372 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bb131f41-2c3c-4c71-a6a7-fb4bfe38f6e2 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 0bb04c29-c281-4fe5-8196-947a769f6e41] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:17:05.295352 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bb131f41-2c3c-4c71-a6a7-fb4bfe38f6e2 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:17:05.295864 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bb131f41-2c3c-4c71-a6a7-fb4bfe38f6e2 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:17:05.296289 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bb131f41-2c3c-4c71-a6a7-fb4bfe38f6e2 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:17:05.296982 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bb131f41-2c3c-4c71-a6a7-fb4bfe38f6e2 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:17:05.297423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bb131f41-2c3c-4c71-a6a7-fb4bfe38f6e2 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:17:05.297837 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bb131f41-2c3c-4c71-a6a7-fb4bfe38f6e2 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:17:05.441074 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bb131f41-2c3c-4c71-a6a7-fb4bfe38f6e2 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:17:05.448669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bb131f41-2c3c-4c71-a6a7-fb4bfe38f6e2 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41" status: 200 len: 1452 microversion: 2.1 time: 0.165124 Oct 11 07:17:05.449217 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1675/3346] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:17:05 2022] GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41 => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:17:07.417061 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-642e2529-2a31-45d0-8613-0e86f8763cb0 req-bbe0fe8e-d128-464a-bda7-b4e06df62b90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bb04c29-c281-4fe5-8196-947a769f6e41", "tag": "82a323a0-be48-423a-acce-b7003095cfc4"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:17:07.435922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-642e2529-2a31-45d0-8613-0e86f8763cb0 req-bbe0fe8e-d128-464a-bda7-b4e06df62b90 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:17:07.436402 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-642e2529-2a31-45d0-8613-0e86f8763cb0 req-bbe0fe8e-d128-464a-bda7-b4e06df62b90 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:17:07.436835 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-642e2529-2a31-45d0-8613-0e86f8763cb0 req-bbe0fe8e-d128-464a-bda7-b4e06df62b90 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:17:07.455828 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-642e2529-2a31-45d0-8613-0e86f8763cb0 req-bbe0fe8e-d128-464a-bda7-b4e06df62b90 service nova] Creating event network-changed:82a323a0-be48-423a-acce-b7003095cfc4 for instance 0bb04c29-c281-4fe5-8196-947a769f6e41 on hv-cinder-85495 Oct 11 07:17:07.470153 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-642e2529-2a31-45d0-8613-0e86f8763cb0 req-bbe0fe8e-d128-464a-bda7-b4e06df62b90 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.282429 Oct 11 07:17:07.475126 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1672/3347] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 07:17:19.360837 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8bc687f5-b4e1-4bc3-8c3a-02506b2adc28 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:17:19.361386 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8bc687f5-b4e1-4bc3-8c3a-02506b2adc28 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:17:19.364387 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=22 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:17:19.365038 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=54 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:17:19.370619 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8bc687f5-b4e1-4bc3-8c3a-02506b2adc28 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:17:19.371085 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8bc687f5-b4e1-4bc3-8c3a-02506b2adc28 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:17:19.371540 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8bc687f5-b4e1-4bc3-8c3a-02506b2adc28 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:17:19.372214 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8bc687f5-b4e1-4bc3-8c3a-02506b2adc28 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:17:19.372663 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8bc687f5-b4e1-4bc3-8c3a-02506b2adc28 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:17:19.373091 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8bc687f5-b4e1-4bc3-8c3a-02506b2adc28 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:17:19.386864 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-8bc687f5-b4e1-4bc3-8c3a-02506b2adc28 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] HTTP exception thrown: Instance 9c76b29e-08a3-4b53-9b36-82980a19493d could not be found. Oct 11 07:17:19.388535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8bc687f5-b4e1-4bc3-8c3a-02506b2adc28 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Request method failure captured: Oct 11 07:17:19.388535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: request: DELETE /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d HTTP/1.1 Oct 11 07:17:19.388535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept: application/json Oct 11 07:17:19.388535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Oct 11 07:17:19.388535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Connection: close Oct 11 07:17:19.388535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Length: 0 Oct 11 07:17:19.388535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Type: application/json Oct 11 07:17:19.388535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Host: 10.222.0.39 Oct 11 07:17:19.388535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Oct 11 07:17:19.388535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.12 Oct 11 07:17:19.388535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABjRRAsC5gjwxv0YF7d4yPHrvtCndUqSE4LUuVmgbQpA7FGH61SHGQtjkUc9VgoV4UMikth54p4pdy4qWYFrQKk1XtGzAiJBIewqjLBpw1HNHgXCT3jzdwGxfFWntP_SY_R4Ve4MR7ioybA8HuNKthEt7Q2Y1dULWFhCpaPL3hZsDYDFg4 Oct 11 07:17:19.388535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Oct 11 07:17:19.388535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Oct 11 07:17:19.388535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Oct 11 07:17:19.388535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Oct 11 07:17:19.388535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Oct 11 07:17:19.388535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Oct 11 07:17:19.388535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Id: bf094dc7d5f1453ba9112d1a1d3f0d9c Oct 11 07:17:19.388535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-AttachVolumeTestJSON-1051491043 Oct 11 07:17:19.388535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Role: reader,member Oct 11 07:17:19.388535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Oct 11 07:17:19.389713 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bf094dc7d5f1453ba9112d1a1d3f0d9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf094dc7d5f1453ba9112d1a1d3f0d9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf094dc7d5f1453ba9112d1a1d3f0d9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bf094dc7d5f1453ba9112d1a1d3f0d9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 07:17:19.389713 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-AttachVolumeTestJSON-1051491043 Oct 11 07:17:19.389713 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Id: bf094dc7d5f1453ba9112d1a1d3f0d9c Oct 11 07:17:19.389713 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1051491043 Oct 11 07:17:19.389713 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User: tempest-AttachVolumeTestJSON-1051491043-project Oct 11 07:17:19.389713 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Oct 11 07:17:19.389713 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Oct 11 07:17:19.389713 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Id: 1c602e0f9e0e4e479a6a3c32febdb14b Oct 11 07:17:19.389713 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-AttachVolumeTestJSON-1051491043-project Oct 11 07:17:19.389713 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: method: > Oct 11 07:17:19.389713 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: exception: Instance 9c76b29e-08a3-4b53-9b36-82980a19493d could not be found. Oct 11 07:17:19.389713 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: action_args: {'id': '9c76b29e-08a3-4b53-9b36-82980a19493d'} Oct 11 07:17:19.390402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 07:17:19.390402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:17:19.390402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 07:17:19.390402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 07:17:19.390402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 07:17:19.390402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 07:17:19.390402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 07:17:19.390402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 07:17:19.390402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 07:17:19.390402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 07:17:19.390402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c76b29e-08a3-4b53-9b36-82980a19493d could not be found. Oct 11 07:17:19.390402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:17:19.390402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:17:19.390402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:17:19.390402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:17:19.390402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:17:19.390402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:17:19.390402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 07:17:19.390402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 07:17:19.390402 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 07:17:19.391485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 07:17:19.391485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 07:17:19.391485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 07:17:19.391485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 07:17:19.391485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 07:17:19.391485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 07:17:19.391485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 07:17:19.391485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 07:17:19.391485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 07:17:19.391485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c76b29e-08a3-4b53-9b36-82980a19493d could not be found. Oct 11 07:17:19.391485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:17:19.391485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:17:19.391485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:17:19.391485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:17:19.391485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:17:19.391485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:17:19.391485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 07:17:19.391485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 07:17:19.391485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c76b29e-08a3-4b53-9b36-82980a19493d could not be found. Oct 11 07:17:19.391485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:17:19.392513 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8bc687f5-b4e1-4bc3-8c3a-02506b2adc28 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Returning 404 to user: Instance 9c76b29e-08a3-4b53-9b36-82980a19493d could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 07:17:19.392513 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8bc687f5-b4e1-4bc3-8c3a-02506b2adc28 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 404 len: 111 microversion: 2.1 time: 0.032945 Oct 11 07:17:19.392513 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1676/3348] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Oct 11 07:17:19 2022] DELETE /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 07:17:19.396360 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:17:19.397115 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=50 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:17:19.401047 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-79289f85-d6d6-442f-a641-70a2c64f0d97 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:17:19.401748 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-79289f85-d6d6-442f-a641-70a2c64f0d97 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] [instance: 9c76b29e-08a3-4b53-9b36-82980a19493d] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:17:19.408997 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-79289f85-d6d6-442f-a641-70a2c64f0d97 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:17:19.409485 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-79289f85-d6d6-442f-a641-70a2c64f0d97 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:17:19.409916 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-79289f85-d6d6-442f-a641-70a2c64f0d97 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:17:19.411147 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-79289f85-d6d6-442f-a641-70a2c64f0d97 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:17:19.411642 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-79289f85-d6d6-442f-a641-70a2c64f0d97 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:17:19.412064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-79289f85-d6d6-442f-a641-70a2c64f0d97 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:17:19.425473 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-79289f85-d6d6-442f-a641-70a2c64f0d97 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] HTTP exception thrown: Instance 9c76b29e-08a3-4b53-9b36-82980a19493d could not be found. Oct 11 07:17:19.427706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-79289f85-d6d6-442f-a641-70a2c64f0d97 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Request method failure captured: Oct 11 07:17:19.427706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: request: GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d HTTP/1.1 Oct 11 07:17:19.427706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept: application/json Oct 11 07:17:19.427706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Oct 11 07:17:19.427706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Connection: close Oct 11 07:17:19.427706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Length: 0 Oct 11 07:17:19.427706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Type: application/json Oct 11 07:17:19.427706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Host: 10.222.0.39 Oct 11 07:17:19.427706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Oct 11 07:17:19.427706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.12 Oct 11 07:17:19.427706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABjRRAsC5gjwxv0YF7d4yPHrvtCndUqSE4LUuVmgbQpA7FGH61SHGQtjkUc9VgoV4UMikth54p4pdy4qWYFrQKk1XtGzAiJBIewqjLBpw1HNHgXCT3jzdwGxfFWntP_SY_R4Ve4MR7ioybA8HuNKthEt7Q2Y1dULWFhCpaPL3hZsDYDFg4 Oct 11 07:17:19.427706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Oct 11 07:17:19.427706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Oct 11 07:17:19.427706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Oct 11 07:17:19.427706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Oct 11 07:17:19.427706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Oct 11 07:17:19.427706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Oct 11 07:17:19.427706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Id: bf094dc7d5f1453ba9112d1a1d3f0d9c Oct 11 07:17:19.427706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-AttachVolumeTestJSON-1051491043 Oct 11 07:17:19.427706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Role: reader,member Oct 11 07:17:19.427706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Oct 11 07:17:19.429041 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bf094dc7d5f1453ba9112d1a1d3f0d9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf094dc7d5f1453ba9112d1a1d3f0d9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf094dc7d5f1453ba9112d1a1d3f0d9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bf094dc7d5f1453ba9112d1a1d3f0d9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 07:17:19.429041 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-AttachVolumeTestJSON-1051491043 Oct 11 07:17:19.429041 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Id: bf094dc7d5f1453ba9112d1a1d3f0d9c Oct 11 07:17:19.429041 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1051491043 Oct 11 07:17:19.429041 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User: tempest-AttachVolumeTestJSON-1051491043-project Oct 11 07:17:19.429041 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Oct 11 07:17:19.429041 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Oct 11 07:17:19.429041 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Id: 1c602e0f9e0e4e479a6a3c32febdb14b Oct 11 07:17:19.429041 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-AttachVolumeTestJSON-1051491043-project Oct 11 07:17:19.429041 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: method: > Oct 11 07:17:19.429041 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: exception: Instance 9c76b29e-08a3-4b53-9b36-82980a19493d could not be found. Oct 11 07:17:19.429041 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: action_args: {'id': '9c76b29e-08a3-4b53-9b36-82980a19493d'} Oct 11 07:17:19.433983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 07:17:19.433983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:17:19.433983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 07:17:19.433983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 07:17:19.433983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 07:17:19.433983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 07:17:19.433983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 07:17:19.433983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 07:17:19.433983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 07:17:19.433983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 07:17:19.433983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c76b29e-08a3-4b53-9b36-82980a19493d could not be found. Oct 11 07:17:19.433983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:17:19.433983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:17:19.433983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:17:19.433983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:17:19.433983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:17:19.433983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:17:19.433983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 07:17:19.433983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 07:17:19.433983 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 07:17:19.435043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 07:17:19.435043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 07:17:19.435043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 07:17:19.435043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 07:17:19.435043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 07:17:19.435043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 07:17:19.435043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 07:17:19.435043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c76b29e-08a3-4b53-9b36-82980a19493d could not be found. Oct 11 07:17:19.435043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:17:19.435043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:17:19.435043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:17:19.435043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:17:19.435043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:17:19.435043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:17:19.435043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 07:17:19.435043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 07:17:19.435043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c76b29e-08a3-4b53-9b36-82980a19493d could not be found. Oct 11 07:17:19.435043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:17:19.436544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-79289f85-d6d6-442f-a641-70a2c64f0d97 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] Returning 404 to user: Instance 9c76b29e-08a3-4b53-9b36-82980a19493d could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 07:17:19.436544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-79289f85-d6d6-442f-a641-70a2c64f0d97 tempest-AttachVolumeTestJSON-1051491043 tempest-AttachVolumeTestJSON-1051491043-project] 10.222.0.39 "GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d" status: 404 len: 111 microversion: 2.1 time: 0.034380 Oct 11 07:17:19.436544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1673/3349] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:17:19 2022] GET /compute/v2.1/servers/9c76b29e-08a3-4b53-9b36-82980a19493d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 07:17:58.681652 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:17:58.682374 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:17:58.861378 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bec0eb63-7d27-4233-af92-7ed6cffae681 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Action: 'create', calling method: .version_select at 0x7f8e2a4ae700>, body: {"keypair": {"name": "tempest-TestShelveInstance-865132752", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsvJUTKKabvNbm1gBizK1d3o+qLfAyiO6GTd/8nwYYEDO73jIfS80i7i+LU0noIIS8VrTOEeVgWV2IvUaTfnlsIMGrbgJ//Ntq2ooYEuq2EyJAPxuekJ7P7gkqdwfZFQA=="}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:17:58.878265 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-bec0eb63-7d27-4233-af92-7ed6cffae681 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Getting quotas for project 0fa103dda8c34135af4c1a3913ccb564. Resources: {'key_pairs'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 07:17:58.882326 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-bec0eb63-7d27-4233-af92-7ed6cffae681 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Getting quotas for user 211be7ccf81649db928d8efd0a91426f and project 0fa103dda8c34135af4c1a3913ccb564. Resources: {'key_pairs'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 07:17:58.907653 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bec0eb63-7d27-4233-af92-7ed6cffae681 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.231059 Oct 11 07:17:58.908243 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1677/3350] 10.222.0.39 () {60 vars in 1159 bytes} [Tue Oct 11 07:17:58 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:18:17.226491 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-134cb58a-87b5-4812-b490-d27df0178583 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1066913744", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-865132752", "security_groups": [{"name": "tempest-secgroup-smoke-1484700518"}], "networks": [{"uuid": "af720892-3000-4c56-ae7c-61dcb6189df6"}], "block_device_mapping_v2": [{"uuid": "e4557137-aefe-46eb-9c21-56708cb4da97", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:18:17.236550 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=2 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:18:17.237373 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=2 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:18:17.393267 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.network.neutron [None req-134cb58a-87b5-4812-b490-d27df0178583 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] validate_networks() for [('af720892-3000-4c56-ae7c-61dcb6189df6', None, None, None, None, None)] {{(pid=125267) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 07:18:17.760271 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-134cb58a-87b5-4812-b490-d27df0178583 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Flavor limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 07:18:17.760749 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-134cb58a-87b5-4812-b490-d27df0178583 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Image limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 07:18:17.761237 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-134cb58a-87b5-4812-b490-d27df0178583 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Flavor pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 07:18:17.761645 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-134cb58a-87b5-4812-b490-d27df0178583 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Image pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 07:18:17.762141 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-134cb58a-87b5-4812-b490-d27df0178583 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 07:18:17.770957 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-134cb58a-87b5-4812-b490-d27df0178583 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:18:17.771456 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-134cb58a-87b5-4812-b490-d27df0178583 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:18:17.771895 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-134cb58a-87b5-4812-b490-d27df0178583 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:18:17.772638 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-134cb58a-87b5-4812-b490-d27df0178583 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:18:17.773078 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-134cb58a-87b5-4812-b490-d27df0178583 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:18:17.773500 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-134cb58a-87b5-4812-b490-d27df0178583 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:18:17.789907 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-134cb58a-87b5-4812-b490-d27df0178583 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Getting quotas for project 0fa103dda8c34135af4c1a3913ccb564. Resources: {'cores', 'ram', 'instances'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 07:18:17.793886 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-134cb58a-87b5-4812-b490-d27df0178583 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Getting quotas for user 211be7ccf81649db928d8efd0a91426f and project 0fa103dda8c34135af4c1a3913ccb564. Resources: {'cores', 'ram', 'instances'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 07:18:17.850150 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-134cb58a-87b5-4812-b490-d27df0178583 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Going to run 1 instances... {{(pid=125267) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 07:18:17.852403 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-134cb58a-87b5-4812-b490-d27df0178583 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e4557137-aefe-46eb-9c21-56708cb4da97',volume_size=None,volume_type=None)] {{(pid=125267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 07:18:17.980783 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-134cb58a-87b5-4812-b490-d27df0178583 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.757768 Oct 11 07:18:17.981458 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1674/3351] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Oct 11 07:18:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 07:18:17.991231 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=4 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:18:17.992089 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:18:17.996229 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5e5065b2-553d-4669-b381-4505f5fb0a2f tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:18:17.996880 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5e5065b2-553d-4669-b381-4505f5fb0a2f tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:18:18.155244 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5e5065b2-553d-4669-b381-4505f5fb0a2f tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:18:18.163272 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5e5065b2-553d-4669-b381-4505f5fb0a2f tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1088 microversion: 2.1 time: 0.174647 Oct 11 07:18:18.165780 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1678/3352] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:18:17 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1088 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:18:19.188004 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e24d74a2-2082-4b23-9daf-0fd120d47f88 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:18:19.188621 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e24d74a2-2082-4b23-9daf-0fd120d47f88 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:18:19.195845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e24d74a2-2082-4b23-9daf-0fd120d47f88 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:18:19.196335 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e24d74a2-2082-4b23-9daf-0fd120d47f88 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:18:19.196782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e24d74a2-2082-4b23-9daf-0fd120d47f88 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:18:19.197490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e24d74a2-2082-4b23-9daf-0fd120d47f88 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:18:19.197947 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e24d74a2-2082-4b23-9daf-0fd120d47f88 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:18:19.198400 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e24d74a2-2082-4b23-9daf-0fd120d47f88 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:18:19.261330 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e24d74a2-2082-4b23-9daf-0fd120d47f88 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:18:19.269042 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e24d74a2-2082-4b23-9daf-0fd120d47f88 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1204 microversion: 2.1 time: 0.084825 Oct 11 07:18:19.270832 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1675/3353] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:18:19 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1204 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:18:20.293204 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7764cd6d-a8e0-485b-859d-d637e3c2f8e1 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:18:20.293993 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7764cd6d-a8e0-485b-859d-d637e3c2f8e1 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:18:20.300920 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7764cd6d-a8e0-485b-859d-d637e3c2f8e1 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:18:20.301617 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7764cd6d-a8e0-485b-859d-d637e3c2f8e1 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:18:20.303085 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7764cd6d-a8e0-485b-859d-d637e3c2f8e1 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:18:20.303888 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7764cd6d-a8e0-485b-859d-d637e3c2f8e1 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:18:20.304436 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7764cd6d-a8e0-485b-859d-d637e3c2f8e1 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:18:20.305024 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7764cd6d-a8e0-485b-859d-d637e3c2f8e1 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:18:20.648552 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7764cd6d-a8e0-485b-859d-d637e3c2f8e1 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:18:20.657815 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7764cd6d-a8e0-485b-859d-d637e3c2f8e1 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1260 microversion: 2.1 time: 0.368247 Oct 11 07:18:20.658407 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1679/3354] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:18:20 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1260 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:18:21.277158 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-f1aefb64-dfdd-45fd-92e7-a6d10885524d req-65f117f5-0ec6-4030-a6d5-82de033892bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c70b9e3f-05fe-4127-a536-02801eb865a2", "tag": "112615ed-3ec4-49cb-aa0b-c8d23ae96ae5"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:18:21.288718 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-f1aefb64-dfdd-45fd-92e7-a6d10885524d req-65f117f5-0ec6-4030-a6d5-82de033892bc service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:18:21.289545 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-f1aefb64-dfdd-45fd-92e7-a6d10885524d req-65f117f5-0ec6-4030-a6d5-82de033892bc service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:18:21.289977 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-f1aefb64-dfdd-45fd-92e7-a6d10885524d req-65f117f5-0ec6-4030-a6d5-82de033892bc service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:18:21.301263 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-f1aefb64-dfdd-45fd-92e7-a6d10885524d req-65f117f5-0ec6-4030-a6d5-82de033892bc service nova] Creating event network-changed:112615ed-3ec4-49cb-aa0b-c8d23ae96ae5 for instance c70b9e3f-05fe-4127-a536-02801eb865a2 on hv-cinder-85495 Oct 11 07:18:21.306111 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-f1aefb64-dfdd-45fd-92e7-a6d10885524d req-65f117f5-0ec6-4030-a6d5-82de033892bc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032991 Oct 11 07:18:21.307054 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1676/3355] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 07:18:21.681794 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-60d905c9-0ae4-4dbb-bd22-991a878a15b5 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:18:21.682411 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-60d905c9-0ae4-4dbb-bd22-991a878a15b5 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:18:21.688775 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-60d905c9-0ae4-4dbb-bd22-991a878a15b5 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:18:21.689255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-60d905c9-0ae4-4dbb-bd22-991a878a15b5 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:18:21.689705 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-60d905c9-0ae4-4dbb-bd22-991a878a15b5 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:18:21.690381 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-60d905c9-0ae4-4dbb-bd22-991a878a15b5 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:18:21.690827 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-60d905c9-0ae4-4dbb-bd22-991a878a15b5 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:18:21.691253 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-60d905c9-0ae4-4dbb-bd22-991a878a15b5 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:18:21.822241 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-60d905c9-0ae4-4dbb-bd22-991a878a15b5 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:18:21.829826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-60d905c9-0ae4-4dbb-bd22-991a878a15b5 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1260 microversion: 2.1 time: 0.151856 Oct 11 07:18:21.830387 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1680/3356] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:18:21 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:18:22.853283 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cd3a298f-1fba-499a-85ce-e026be5c55d9 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:18:22.853976 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cd3a298f-1fba-499a-85ce-e026be5c55d9 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:18:22.860252 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cd3a298f-1fba-499a-85ce-e026be5c55d9 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:18:22.860728 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cd3a298f-1fba-499a-85ce-e026be5c55d9 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:18:22.861165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cd3a298f-1fba-499a-85ce-e026be5c55d9 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:18:22.861845 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cd3a298f-1fba-499a-85ce-e026be5c55d9 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:18:22.862290 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cd3a298f-1fba-499a-85ce-e026be5c55d9 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:18:22.862706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cd3a298f-1fba-499a-85ce-e026be5c55d9 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:18:22.996173 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cd3a298f-1fba-499a-85ce-e026be5c55d9 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:18:23.003863 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cd3a298f-1fba-499a-85ce-e026be5c55d9 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1260 microversion: 2.1 time: 0.155138 Oct 11 07:18:23.004415 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1677/3357] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:18:22 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:18:24.026348 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1e23ea1e-98a4-4934-8dfe-b11a060054ea tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:18:24.026882 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1e23ea1e-98a4-4934-8dfe-b11a060054ea tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:18:24.033197 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1e23ea1e-98a4-4934-8dfe-b11a060054ea tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:18:24.033667 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1e23ea1e-98a4-4934-8dfe-b11a060054ea tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:18:24.034091 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1e23ea1e-98a4-4934-8dfe-b11a060054ea tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:18:24.034763 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1e23ea1e-98a4-4934-8dfe-b11a060054ea tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:18:24.035202 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1e23ea1e-98a4-4934-8dfe-b11a060054ea tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:18:24.035655 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1e23ea1e-98a4-4934-8dfe-b11a060054ea tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:18:24.162039 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1e23ea1e-98a4-4934-8dfe-b11a060054ea tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:18:24.169665 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1e23ea1e-98a4-4934-8dfe-b11a060054ea tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1260 microversion: 2.1 time: 0.147137 Oct 11 07:18:24.170217 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1681/3358] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:18:24 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:18:25.192120 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bda6bc0d-67d0-436f-bb2d-9b631407afa4 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:18:25.192728 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bda6bc0d-67d0-436f-bb2d-9b631407afa4 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:18:25.199080 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bda6bc0d-67d0-436f-bb2d-9b631407afa4 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:18:25.199583 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bda6bc0d-67d0-436f-bb2d-9b631407afa4 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:18:25.200011 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bda6bc0d-67d0-436f-bb2d-9b631407afa4 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:18:25.200687 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bda6bc0d-67d0-436f-bb2d-9b631407afa4 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:18:25.201131 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bda6bc0d-67d0-436f-bb2d-9b631407afa4 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:18:25.201542 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bda6bc0d-67d0-436f-bb2d-9b631407afa4 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:18:25.340438 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-bda6bc0d-67d0-436f-bb2d-9b631407afa4 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:18:25.347963 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bda6bc0d-67d0-436f-bb2d-9b631407afa4 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1260 microversion: 2.1 time: 0.159627 Oct 11 07:18:25.348518 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1678/3359] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:18:25 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:18:26.371016 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-eeeb3a07-1b27-4b23-9ed9-a0885e4646ca tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:18:26.371650 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-eeeb3a07-1b27-4b23-9ed9-a0885e4646ca tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:18:26.378033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eeeb3a07-1b27-4b23-9ed9-a0885e4646ca tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:18:26.378507 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eeeb3a07-1b27-4b23-9ed9-a0885e4646ca tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:18:26.378936 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eeeb3a07-1b27-4b23-9ed9-a0885e4646ca tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:18:26.379683 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eeeb3a07-1b27-4b23-9ed9-a0885e4646ca tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:18:26.380125 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eeeb3a07-1b27-4b23-9ed9-a0885e4646ca tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:18:26.380541 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-eeeb3a07-1b27-4b23-9ed9-a0885e4646ca tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:18:26.511543 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-eeeb3a07-1b27-4b23-9ed9-a0885e4646ca tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:18:26.519241 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-eeeb3a07-1b27-4b23-9ed9-a0885e4646ca tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1260 microversion: 2.1 time: 0.152069 Oct 11 07:18:26.519825 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1682/3360] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:18:26 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:18:27.544115 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4b11169f-610e-4295-8e1f-e1525b15242c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:18:27.544889 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4b11169f-610e-4295-8e1f-e1525b15242c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:18:27.552480 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b11169f-610e-4295-8e1f-e1525b15242c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:18:27.553659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b11169f-610e-4295-8e1f-e1525b15242c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:18:27.554238 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b11169f-610e-4295-8e1f-e1525b15242c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:18:27.555114 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b11169f-610e-4295-8e1f-e1525b15242c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:18:27.555701 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b11169f-610e-4295-8e1f-e1525b15242c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:18:27.556246 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4b11169f-610e-4295-8e1f-e1525b15242c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:18:27.688499 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4b11169f-610e-4295-8e1f-e1525b15242c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:18:27.696672 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4b11169f-610e-4295-8e1f-e1525b15242c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1260 microversion: 2.1 time: 0.157441 Oct 11 07:18:27.698070 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1679/3361] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:18:27 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:18:28.719830 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-689a8b7d-bbb7-433e-bf33-686cb574b025 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:18:28.720434 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-689a8b7d-bbb7-433e-bf33-686cb574b025 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:18:28.722796 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:18:28.729530 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-689a8b7d-bbb7-433e-bf33-686cb574b025 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:18:28.730019 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-689a8b7d-bbb7-433e-bf33-686cb574b025 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:18:28.730454 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-689a8b7d-bbb7-433e-bf33-686cb574b025 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:18:28.731150 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-689a8b7d-bbb7-433e-bf33-686cb574b025 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:18:28.731655 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-689a8b7d-bbb7-433e-bf33-686cb574b025 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:18:28.732079 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-689a8b7d-bbb7-433e-bf33-686cb574b025 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:18:28.863020 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-689a8b7d-bbb7-433e-bf33-686cb574b025 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:18:28.871609 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-689a8b7d-bbb7-433e-bf33-686cb574b025 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1260 microversion: 2.1 time: 0.155581 Oct 11 07:18:28.872154 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1683/3362] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:18:28 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:18:29.895125 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-fdfdf403-d898-48fa-8c38-5aefc57059f0 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:18:29.895956 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-fdfdf403-d898-48fa-8c38-5aefc57059f0 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:18:29.898077 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=2 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:18:29.898740 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=6 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:18:29.905429 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fdfdf403-d898-48fa-8c38-5aefc57059f0 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:18:29.906171 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fdfdf403-d898-48fa-8c38-5aefc57059f0 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:18:29.906330 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fdfdf403-d898-48fa-8c38-5aefc57059f0 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:18:29.907034 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fdfdf403-d898-48fa-8c38-5aefc57059f0 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:18:29.907513 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fdfdf403-d898-48fa-8c38-5aefc57059f0 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:18:29.907933 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-fdfdf403-d898-48fa-8c38-5aefc57059f0 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:18:30.040745 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-fdfdf403-d898-48fa-8c38-5aefc57059f0 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:18:30.048716 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-fdfdf403-d898-48fa-8c38-5aefc57059f0 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1260 microversion: 2.1 time: 0.158349 Oct 11 07:18:30.049282 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1680/3363] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:18:29 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:18:31.071354 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c5693e7e-d197-431a-ae41-f0ed65699a0c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:18:31.071910 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c5693e7e-d197-431a-ae41-f0ed65699a0c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:18:31.078052 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c5693e7e-d197-431a-ae41-f0ed65699a0c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:18:31.078533 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c5693e7e-d197-431a-ae41-f0ed65699a0c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:18:31.078958 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c5693e7e-d197-431a-ae41-f0ed65699a0c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:18:31.079669 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c5693e7e-d197-431a-ae41-f0ed65699a0c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:18:31.080113 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c5693e7e-d197-431a-ae41-f0ed65699a0c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:18:31.080527 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c5693e7e-d197-431a-ae41-f0ed65699a0c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:18:31.364680 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c5693e7e-d197-431a-ae41-f0ed65699a0c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:18:31.372804 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c5693e7e-d197-431a-ae41-f0ed65699a0c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1260 microversion: 2.1 time: 0.305240 Oct 11 07:18:31.373653 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1684/3364] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:18:31 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1260 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:18:31.522488 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-2ac5a543-3522-4cd1-b13e-f2ec2cb8236f req-c5510172-18c4-45f5-9adf-49a97c8aaeca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c70b9e3f-05fe-4127-a536-02801eb865a2", "name": "network-vif-plugged", "status": "completed", "tag": "112615ed-3ec4-49cb-aa0b-c8d23ae96ae5"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:18:31.532691 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-2ac5a543-3522-4cd1-b13e-f2ec2cb8236f req-c5510172-18c4-45f5-9adf-49a97c8aaeca service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:18:31.533166 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-2ac5a543-3522-4cd1-b13e-f2ec2cb8236f req-c5510172-18c4-45f5-9adf-49a97c8aaeca service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:18:31.533744 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-2ac5a543-3522-4cd1-b13e-f2ec2cb8236f req-c5510172-18c4-45f5-9adf-49a97c8aaeca service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:18:31.544802 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-2ac5a543-3522-4cd1-b13e-f2ec2cb8236f req-c5510172-18c4-45f5-9adf-49a97c8aaeca service nova] Creating event network-vif-plugged:112615ed-3ec4-49cb-aa0b-c8d23ae96ae5 for instance c70b9e3f-05fe-4127-a536-02801eb865a2 on hv-cinder-85495 Oct 11 07:18:31.550299 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-2ac5a543-3522-4cd1-b13e-f2ec2cb8236f req-c5510172-18c4-45f5-9adf-49a97c8aaeca service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032031 Oct 11 07:18:31.550883 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1681/3365] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:18:32.395615 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1596aff6-8ef7-4d2f-9cc2-684dff487764 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:18:32.396722 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1596aff6-8ef7-4d2f-9cc2-684dff487764 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:18:32.406085 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1596aff6-8ef7-4d2f-9cc2-684dff487764 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:18:32.406085 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1596aff6-8ef7-4d2f-9cc2-684dff487764 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:18:32.406085 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1596aff6-8ef7-4d2f-9cc2-684dff487764 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:18:32.406085 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1596aff6-8ef7-4d2f-9cc2-684dff487764 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:18:32.406391 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1596aff6-8ef7-4d2f-9cc2-684dff487764 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:18:32.406391 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1596aff6-8ef7-4d2f-9cc2-684dff487764 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:18:32.535267 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1596aff6-8ef7-4d2f-9cc2-684dff487764 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:18:32.543498 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1596aff6-8ef7-4d2f-9cc2-684dff487764 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1260 microversion: 2.1 time: 0.151611 Oct 11 07:18:32.543974 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1685/3366] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:18:32 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:18:33.566945 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bdf69a4b-0c33-40cf-87ba-c1634e8d7274 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:18:33.567677 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bdf69a4b-0c33-40cf-87ba-c1634e8d7274 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:18:33.573750 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bdf69a4b-0c33-40cf-87ba-c1634e8d7274 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:18:33.574254 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bdf69a4b-0c33-40cf-87ba-c1634e8d7274 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:18:33.574684 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bdf69a4b-0c33-40cf-87ba-c1634e8d7274 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:18:33.575368 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bdf69a4b-0c33-40cf-87ba-c1634e8d7274 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:18:33.575835 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bdf69a4b-0c33-40cf-87ba-c1634e8d7274 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:18:33.576252 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bdf69a4b-0c33-40cf-87ba-c1634e8d7274 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:18:33.707687 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-bdf69a4b-0c33-40cf-87ba-c1634e8d7274 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:18:33.715273 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bdf69a4b-0c33-40cf-87ba-c1634e8d7274 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1444 microversion: 2.1 time: 0.153007 Oct 11 07:18:33.715865 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1682/3367] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:18:33 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:18:33.737195 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-83745712-d600-4788-a806-2fc1038fed88 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:18:33.737929 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-83745712-d600-4788-a806-2fc1038fed88 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:18:33.745952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-83745712-d600-4788-a806-2fc1038fed88 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:18:33.746593 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-83745712-d600-4788-a806-2fc1038fed88 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:18:33.747047 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-83745712-d600-4788-a806-2fc1038fed88 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:18:33.747789 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-83745712-d600-4788-a806-2fc1038fed88 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:18:33.748234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-83745712-d600-4788-a806-2fc1038fed88 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:18:33.748658 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-83745712-d600-4788-a806-2fc1038fed88 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:18:33.875610 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-83745712-d600-4788-a806-2fc1038fed88 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:18:33.884342 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-83745712-d600-4788-a806-2fc1038fed88 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1444 microversion: 2.1 time: 0.150850 Oct 11 07:18:33.884888 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1686/3368] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:18:33 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:18:35.454975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-efbd176f-4a0c-4921-a767-1313aa117e99 req-9f3640df-1abc-4726-a6d8-11c6dff5052c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c70b9e3f-05fe-4127-a536-02801eb865a2", "tag": "112615ed-3ec4-49cb-aa0b-c8d23ae96ae5"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:18:35.465588 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-efbd176f-4a0c-4921-a767-1313aa117e99 req-9f3640df-1abc-4726-a6d8-11c6dff5052c service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:18:35.466141 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-efbd176f-4a0c-4921-a767-1313aa117e99 req-9f3640df-1abc-4726-a6d8-11c6dff5052c service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:18:35.466635 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-efbd176f-4a0c-4921-a767-1313aa117e99 req-9f3640df-1abc-4726-a6d8-11c6dff5052c service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:18:35.478006 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-efbd176f-4a0c-4921-a767-1313aa117e99 req-9f3640df-1abc-4726-a6d8-11c6dff5052c service nova] Creating event network-changed:112615ed-3ec4-49cb-aa0b-c8d23ae96ae5 for instance c70b9e3f-05fe-4127-a536-02801eb865a2 on hv-cinder-85495 Oct 11 07:18:35.483021 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-efbd176f-4a0c-4921-a767-1313aa117e99 req-9f3640df-1abc-4726-a6d8-11c6dff5052c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031917 Oct 11 07:18:35.483916 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1683/3369] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:19:04.669921 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5188c279-c342-463b-be2c-257e442f7a48 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:04.670444 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5188c279-c342-463b-be2c-257e442f7a48 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 0bb04c29-c281-4fe5-8196-947a769f6e41] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:19:04.672567 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=20 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:19:04.673218 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=48 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:19:04.679102 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5188c279-c342-463b-be2c-257e442f7a48 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:04.679612 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5188c279-c342-463b-be2c-257e442f7a48 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:04.680046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5188c279-c342-463b-be2c-257e442f7a48 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:04.680733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5188c279-c342-463b-be2c-257e442f7a48 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:04.681184 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5188c279-c342-463b-be2c-257e442f7a48 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:04.681602 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5188c279-c342-463b-be2c-257e442f7a48 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:04.706625 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5188c279-c342-463b-be2c-257e442f7a48 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 0bb04c29-c281-4fe5-8196-947a769f6e41] Going to try to terminate instance {{(pid=125266) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 07:19:04.781386 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5188c279-c342-463b-be2c-257e442f7a48 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41" status: 204 len: 0 microversion: 2.1 time: 0.115025 Oct 11 07:19:04.782166 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1687/3370] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Oct 11 07:19:04 2022] DELETE /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 07:19:04.789186 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:19:04.790126 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=44 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:19:04.794549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3ce48c62-d041-4db1-9e01-7598811a6763 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:04.795363 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3ce48c62-d041-4db1-9e01-7598811a6763 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 0bb04c29-c281-4fe5-8196-947a769f6e41] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:19:04.803138 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3ce48c62-d041-4db1-9e01-7598811a6763 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:04.803660 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3ce48c62-d041-4db1-9e01-7598811a6763 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:04.804096 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3ce48c62-d041-4db1-9e01-7598811a6763 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:04.804895 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3ce48c62-d041-4db1-9e01-7598811a6763 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:04.805370 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3ce48c62-d041-4db1-9e01-7598811a6763 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:04.805795 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3ce48c62-d041-4db1-9e01-7598811a6763 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:04.940976 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3ce48c62-d041-4db1-9e01-7598811a6763 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:19:04.948846 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3ce48c62-d041-4db1-9e01-7598811a6763 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41" status: 200 len: 1577 microversion: 2.1 time: 0.161867 Oct 11 07:19:04.949637 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1684/3371] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:19:04 2022] GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:19:05.973390 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b1304395-16f4-4aa0-8e3a-cceb4a15759d tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:05.973758 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b1304395-16f4-4aa0-8e3a-cceb4a15759d tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 0bb04c29-c281-4fe5-8196-947a769f6e41] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:19:05.980526 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b1304395-16f4-4aa0-8e3a-cceb4a15759d tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:05.980997 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b1304395-16f4-4aa0-8e3a-cceb4a15759d tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:05.981423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b1304395-16f4-4aa0-8e3a-cceb4a15759d tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:05.982100 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b1304395-16f4-4aa0-8e3a-cceb4a15759d tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:05.982540 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b1304395-16f4-4aa0-8e3a-cceb4a15759d tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:05.982955 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b1304395-16f4-4aa0-8e3a-cceb4a15759d tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:06.112364 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b1304395-16f4-4aa0-8e3a-cceb4a15759d tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:19:06.120368 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b1304395-16f4-4aa0-8e3a-cceb4a15759d tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41" status: 200 len: 1577 microversion: 2.1 time: 0.151751 Oct 11 07:19:06.120912 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1688/3372] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:19:05 2022] GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:19:07.142562 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-13d4148d-109a-4c03-85b3-dbf0ab12d012 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:07.143306 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-13d4148d-109a-4c03-85b3-dbf0ab12d012 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 0bb04c29-c281-4fe5-8196-947a769f6e41] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:19:07.152661 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13d4148d-109a-4c03-85b3-dbf0ab12d012 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:07.153192 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13d4148d-109a-4c03-85b3-dbf0ab12d012 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:07.153624 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13d4148d-109a-4c03-85b3-dbf0ab12d012 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:07.154314 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13d4148d-109a-4c03-85b3-dbf0ab12d012 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:07.155206 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13d4148d-109a-4c03-85b3-dbf0ab12d012 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:07.155663 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13d4148d-109a-4c03-85b3-dbf0ab12d012 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:07.222670 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-13d4148d-109a-4c03-85b3-dbf0ab12d012 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:19:07.230877 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-13d4148d-109a-4c03-85b3-dbf0ab12d012 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41" status: 200 len: 1509 microversion: 2.1 time: 0.092649 Oct 11 07:19:07.231450 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1685/3373] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:19:07 2022] GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41 => generated 1509 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:19:07.397180 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-43174f3f-94a9-4326-a2f2-a7dd63f38c0a req-c8027f7c-62cb-4727-bba0-8ee5f96c8388 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bb04c29-c281-4fe5-8196-947a769f6e41", "name": "network-vif-deleted", "tag": "82a323a0-be48-423a-acce-b7003095cfc4"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:19:07.407456 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-43174f3f-94a9-4326-a2f2-a7dd63f38c0a req-c8027f7c-62cb-4727-bba0-8ee5f96c8388 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:07.408382 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-43174f3f-94a9-4326-a2f2-a7dd63f38c0a req-c8027f7c-62cb-4727-bba0-8ee5f96c8388 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:07.408382 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-43174f3f-94a9-4326-a2f2-a7dd63f38c0a req-c8027f7c-62cb-4727-bba0-8ee5f96c8388 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:07.420502 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-43174f3f-94a9-4326-a2f2-a7dd63f38c0a req-c8027f7c-62cb-4727-bba0-8ee5f96c8388 service nova] Creating event network-vif-deleted:82a323a0-be48-423a-acce-b7003095cfc4 for instance 0bb04c29-c281-4fe5-8196-947a769f6e41 on hv-cinder-85495 Oct 11 07:19:07.425618 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-43174f3f-94a9-4326-a2f2-a7dd63f38c0a req-c8027f7c-62cb-4727-bba0-8ee5f96c8388 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032100 Oct 11 07:19:07.427615 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1689/3374] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:19:08.254649 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1c152326-963e-47fc-a2d0-8767d039fa60 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:08.255271 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1c152326-963e-47fc-a2d0-8767d039fa60 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 0bb04c29-c281-4fe5-8196-947a769f6e41] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:19:08.263270 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c152326-963e-47fc-a2d0-8767d039fa60 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:08.263792 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c152326-963e-47fc-a2d0-8767d039fa60 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:08.264225 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c152326-963e-47fc-a2d0-8767d039fa60 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:08.264930 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c152326-963e-47fc-a2d0-8767d039fa60 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:08.265418 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c152326-963e-47fc-a2d0-8767d039fa60 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:08.266005 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c152326-963e-47fc-a2d0-8767d039fa60 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:08.301744 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c152326-963e-47fc-a2d0-8767d039fa60 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:08.302236 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c152326-963e-47fc-a2d0-8767d039fa60 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:08.302709 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1c152326-963e-47fc-a2d0-8767d039fa60 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:08.303168 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-1c152326-963e-47fc-a2d0-8767d039fa60 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lazy-loading 'fault' on Instance uuid 0bb04c29-c281-4fe5-8196-947a769f6e41 {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 07:19:08.351656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1c152326-963e-47fc-a2d0-8767d039fa60 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:19:08.361066 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1c152326-963e-47fc-a2d0-8767d039fa60 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41" status: 200 len: 1184 microversion: 2.1 time: 0.110339 Oct 11 07:19:08.371898 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1686/3375] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:19:08 2022] GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41 => generated 1184 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:19:09.386514 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-023a00cf-f7b2-4ecc-9eaf-077512f7043b tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:09.387281 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-023a00cf-f7b2-4ecc-9eaf-077512f7043b tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 0bb04c29-c281-4fe5-8196-947a769f6e41] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:19:09.393334 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-023a00cf-f7b2-4ecc-9eaf-077512f7043b tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:09.393807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-023a00cf-f7b2-4ecc-9eaf-077512f7043b tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:09.394240 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-023a00cf-f7b2-4ecc-9eaf-077512f7043b tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:09.394913 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-023a00cf-f7b2-4ecc-9eaf-077512f7043b tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:09.395355 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-023a00cf-f7b2-4ecc-9eaf-077512f7043b tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:09.395797 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-023a00cf-f7b2-4ecc-9eaf-077512f7043b tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:09.412684 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-023a00cf-f7b2-4ecc-9eaf-077512f7043b tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] HTTP exception thrown: Instance 0bb04c29-c281-4fe5-8196-947a769f6e41 could not be found. Oct 11 07:19:09.414347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-023a00cf-f7b2-4ecc-9eaf-077512f7043b tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Request method failure captured: Oct 11 07:19:09.414347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: request: GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41 HTTP/1.1 Oct 11 07:19:09.414347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept: application/json Oct 11 07:19:09.414347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Oct 11 07:19:09.414347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Connection: close Oct 11 07:19:09.414347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Length: 0 Oct 11 07:19:09.414347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Type: application/json Oct 11 07:19:09.414347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Host: 10.222.0.39 Oct 11 07:19:09.414347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Oct 11 07:19:09.414347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.12 Oct 11 07:19:09.414347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABjRRhHnYNIMKyF2tfqS42y71aTWXn3HKRZaYma0JrclXbKW7PAmGIzZ8OFbOkRLVnBKVTy8aEhXHboOolvsN6gFpFtVyCquR07OqnN6zdAK8MUFvVOzQo_3n6CYhYB1dMg4F5xnmnEN_1Km08DDHcP04R5D7meiMXCaWr-mHX9cGVX_mc Oct 11 07:19:09.414347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Oct 11 07:19:09.414347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Oct 11 07:19:09.414347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Oct 11 07:19:09.414347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Oct 11 07:19:09.414347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Oct 11 07:19:09.414347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Oct 11 07:19:09.414347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Id: 60dd1d4ab8434282b5f57d6547f8d3e9 Oct 11 07:19:09.414347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-TestVolumeBootPattern-1740065613 Oct 11 07:19:09.414347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Role: reader,member Oct 11 07:19:09.414347 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Oct 11 07:19:09.415595 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_60dd1d4ab8434282b5f57d6547f8d3e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/60dd1d4ab8434282b5f57d6547f8d3e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/60dd1d4ab8434282b5f57d6547f8d3e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/60dd1d4ab8434282b5f57d6547f8d3e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 07:19:09.415595 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-TestVolumeBootPattern-1740065613 Oct 11 07:19:09.415595 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 60dd1d4ab8434282b5f57d6547f8d3e9 Oct 11 07:19:09.415595 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-TestVolumeBootPattern-1740065613 Oct 11 07:19:09.415595 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User: tempest-TestVolumeBootPattern-1740065613-project Oct 11 07:19:09.415595 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Oct 11 07:19:09.415595 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Oct 11 07:19:09.415595 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Id: 52173fbead6e4b499a99a6979c9a9898 Oct 11 07:19:09.415595 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-TestVolumeBootPattern-1740065613-project Oct 11 07:19:09.415595 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: method: > Oct 11 07:19:09.415595 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: exception: Instance 0bb04c29-c281-4fe5-8196-947a769f6e41 could not be found. Oct 11 07:19:09.415595 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: action_args: {'id': '0bb04c29-c281-4fe5-8196-947a769f6e41'} Oct 11 07:19:09.416393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 07:19:09.416393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:09.416393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 07:19:09.416393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 07:19:09.416393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 07:19:09.416393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 07:19:09.416393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 07:19:09.416393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 07:19:09.416393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 07:19:09.416393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 07:19:09.416393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bb04c29-c281-4fe5-8196-947a769f6e41 could not be found. Oct 11 07:19:09.416393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:09.416393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:19:09.416393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:09.416393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:09.416393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:19:09.416393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:19:09.416393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 07:19:09.416393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 07:19:09.416393 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 07:19:09.417445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 07:19:09.417445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 07:19:09.417445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 07:19:09.417445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 07:19:09.417445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 07:19:09.417445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 07:19:09.417445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 07:19:09.417445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bb04c29-c281-4fe5-8196-947a769f6e41 could not be found. Oct 11 07:19:09.417445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:09.417445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:19:09.417445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:09.417445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:09.417445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:19:09.417445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:19:09.417445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 07:19:09.417445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 07:19:09.417445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bb04c29-c281-4fe5-8196-947a769f6e41 could not be found. Oct 11 07:19:09.417445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:09.418556 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-023a00cf-f7b2-4ecc-9eaf-077512f7043b tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Returning 404 to user: Instance 0bb04c29-c281-4fe5-8196-947a769f6e41 could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 07:19:09.418556 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-023a00cf-f7b2-4ecc-9eaf-077512f7043b tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41" status: 404 len: 111 microversion: 2.1 time: 0.034138 Oct 11 07:19:09.418556 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1690/3376] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:19:09 2022] GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 07:19:09.512565 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-123aa0d4-4dff-4d3b-b438-3127c3544a43 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-313751838", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-999822900", "security_groups": [{"name": "tempest-secgroup-smoke-1808634596"}], "block_device_mapping_v2": [{"uuid": "f15b6693-610b-438e-9c88-e57f7c1f6b28", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9a53f628-4e9e-4385-a02c-283640135d82"}]}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:19:09.624409 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.network.neutron [None req-123aa0d4-4dff-4d3b-b438-3127c3544a43 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] validate_networks() for [('9a53f628-4e9e-4385-a02c-283640135d82', None, None, None, None, None)] {{(pid=125267) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 07:19:09.982634 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-123aa0d4-4dff-4d3b-b438-3127c3544a43 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Flavor limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 07:19:09.983059 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-123aa0d4-4dff-4d3b-b438-3127c3544a43 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Image limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 07:19:09.983600 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-123aa0d4-4dff-4d3b-b438-3127c3544a43 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Flavor pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 07:19:09.984013 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-123aa0d4-4dff-4d3b-b438-3127c3544a43 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Image pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 07:19:09.984448 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-123aa0d4-4dff-4d3b-b438-3127c3544a43 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 07:19:09.993890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-123aa0d4-4dff-4d3b-b438-3127c3544a43 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:09.994372 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-123aa0d4-4dff-4d3b-b438-3127c3544a43 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:09.994806 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-123aa0d4-4dff-4d3b-b438-3127c3544a43 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:09.995575 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-123aa0d4-4dff-4d3b-b438-3127c3544a43 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:09.996034 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-123aa0d4-4dff-4d3b-b438-3127c3544a43 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:09.996455 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-123aa0d4-4dff-4d3b-b438-3127c3544a43 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:10.013397 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-123aa0d4-4dff-4d3b-b438-3127c3544a43 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Getting quotas for project 60dd1d4ab8434282b5f57d6547f8d3e9. Resources: {'cores', 'ram', 'instances'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 07:19:10.017369 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-123aa0d4-4dff-4d3b-b438-3127c3544a43 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Getting quotas for user 52173fbead6e4b499a99a6979c9a9898 and project 60dd1d4ab8434282b5f57d6547f8d3e9. Resources: {'cores', 'ram', 'instances'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 07:19:10.072837 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-123aa0d4-4dff-4d3b-b438-3127c3544a43 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Going to run 1 instances... {{(pid=125267) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 07:19:10.074925 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-123aa0d4-4dff-4d3b-b438-3127c3544a43 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 5fde741d-e09c-4bfb-93de-7554e07ae0a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f15b6693-610b-438e-9c88-e57f7c1f6b28',volume_size=None,volume_type=None)] {{(pid=125267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 07:19:10.200122 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-123aa0d4-4dff-4d3b-b438-3127c3544a43 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.691323 Oct 11 07:19:10.200936 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1687/3377] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Oct 11 07:19:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 07:19:10.212499 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-372161cd-7805-4094-bd53-de856494366a tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:10.213154 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-372161cd-7805-4094-bd53-de856494366a tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 5fde741d-e09c-4bfb-93de-7554e07ae0a5] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:19:10.267968 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-372161cd-7805-4094-bd53-de856494366a tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:19:10.274691 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-372161cd-7805-4094-bd53-de856494366a tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5" status: 200 len: 1093 microversion: 2.1 time: 0.066113 Oct 11 07:19:10.275245 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1691/3378] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:19:10 2022] GET /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5 => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:19:11.297404 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2c965d43-adca-4c3b-aacf-8b7ce1239dc9 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:11.297946 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2c965d43-adca-4c3b-aacf-8b7ce1239dc9 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 5fde741d-e09c-4bfb-93de-7554e07ae0a5] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:19:11.304402 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2c965d43-adca-4c3b-aacf-8b7ce1239dc9 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:11.304879 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2c965d43-adca-4c3b-aacf-8b7ce1239dc9 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:11.305306 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2c965d43-adca-4c3b-aacf-8b7ce1239dc9 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:11.305996 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2c965d43-adca-4c3b-aacf-8b7ce1239dc9 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:11.306440 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2c965d43-adca-4c3b-aacf-8b7ce1239dc9 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:11.306857 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2c965d43-adca-4c3b-aacf-8b7ce1239dc9 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:11.374862 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2c965d43-adca-4c3b-aacf-8b7ce1239dc9 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:19:11.384677 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2c965d43-adca-4c3b-aacf-8b7ce1239dc9 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5" status: 200 len: 1209 microversion: 2.1 time: 0.091082 Oct 11 07:19:11.385219 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1688/3379] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:19:11 2022] GET /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5 => generated 1209 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:19:12.408169 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-390d24cd-3fa8-42c4-84d3-3729a8f26b88 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:12.409107 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-390d24cd-3fa8-42c4-84d3-3729a8f26b88 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 5fde741d-e09c-4bfb-93de-7554e07ae0a5] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:19:12.422565 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-390d24cd-3fa8-42c4-84d3-3729a8f26b88 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:12.423262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-390d24cd-3fa8-42c4-84d3-3729a8f26b88 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:12.423840 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-390d24cd-3fa8-42c4-84d3-3729a8f26b88 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:12.424589 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-390d24cd-3fa8-42c4-84d3-3729a8f26b88 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:12.425360 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-390d24cd-3fa8-42c4-84d3-3729a8f26b88 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:12.425980 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-390d24cd-3fa8-42c4-84d3-3729a8f26b88 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:12.614706 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-390d24cd-3fa8-42c4-84d3-3729a8f26b88 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:19:12.622406 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-390d24cd-3fa8-42c4-84d3-3729a8f26b88 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5" status: 200 len: 1265 microversion: 2.1 time: 0.218571 Oct 11 07:19:12.622959 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1692/3380] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:19:12 2022] GET /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:19:12.713463 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-cf6fb666-b4e5-4fd2-836c-adcd0f3bc103 req-21f07ed2-e83d-4e0b-9f14-f55f2d7603d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fde741d-e09c-4bfb-93de-7554e07ae0a5", "tag": "71634763-1cc7-402d-b94e-dc4268009170"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:19:12.724682 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-cf6fb666-b4e5-4fd2-836c-adcd0f3bc103 req-21f07ed2-e83d-4e0b-9f14-f55f2d7603d6 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:12.725155 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-cf6fb666-b4e5-4fd2-836c-adcd0f3bc103 req-21f07ed2-e83d-4e0b-9f14-f55f2d7603d6 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:12.725578 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-cf6fb666-b4e5-4fd2-836c-adcd0f3bc103 req-21f07ed2-e83d-4e0b-9f14-f55f2d7603d6 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:12.736200 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-cf6fb666-b4e5-4fd2-836c-adcd0f3bc103 req-21f07ed2-e83d-4e0b-9f14-f55f2d7603d6 service nova] Creating event network-changed:71634763-1cc7-402d-b94e-dc4268009170 for instance 5fde741d-e09c-4bfb-93de-7554e07ae0a5 on hv-cinder-85495 Oct 11 07:19:12.741194 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-cf6fb666-b4e5-4fd2-836c-adcd0f3bc103 req-21f07ed2-e83d-4e0b-9f14-f55f2d7603d6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032168 Oct 11 07:19:12.742077 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1689/3381] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:19:13.645640 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-aeff0ac5-16ca-4ad4-b555-5d84fe428262 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:13.646951 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-aeff0ac5-16ca-4ad4-b555-5d84fe428262 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 5fde741d-e09c-4bfb-93de-7554e07ae0a5] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:19:13.653826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aeff0ac5-16ca-4ad4-b555-5d84fe428262 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:13.654317 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aeff0ac5-16ca-4ad4-b555-5d84fe428262 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:13.654749 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aeff0ac5-16ca-4ad4-b555-5d84fe428262 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:13.655474 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aeff0ac5-16ca-4ad4-b555-5d84fe428262 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:13.655952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aeff0ac5-16ca-4ad4-b555-5d84fe428262 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:13.656376 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-aeff0ac5-16ca-4ad4-b555-5d84fe428262 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:13.877014 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-aeff0ac5-16ca-4ad4-b555-5d84fe428262 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:19:13.884582 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-aeff0ac5-16ca-4ad4-b555-5d84fe428262 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5" status: 200 len: 1265 microversion: 2.1 time: 0.242866 Oct 11 07:19:13.885195 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1693/3382] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:19:13 2022] GET /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5 => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:19:14.908604 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-48bb0ad5-2062-435a-b6a1-47ee65ce4c66 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:14.909294 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-48bb0ad5-2062-435a-b6a1-47ee65ce4c66 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 5fde741d-e09c-4bfb-93de-7554e07ae0a5] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:19:14.917417 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-48bb0ad5-2062-435a-b6a1-47ee65ce4c66 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:14.917981 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-48bb0ad5-2062-435a-b6a1-47ee65ce4c66 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:14.918716 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-48bb0ad5-2062-435a-b6a1-47ee65ce4c66 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:14.919688 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-48bb0ad5-2062-435a-b6a1-47ee65ce4c66 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:14.920142 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-48bb0ad5-2062-435a-b6a1-47ee65ce4c66 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:14.920569 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-48bb0ad5-2062-435a-b6a1-47ee65ce4c66 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:15.051877 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-48bb0ad5-2062-435a-b6a1-47ee65ce4c66 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:19:15.059925 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-48bb0ad5-2062-435a-b6a1-47ee65ce4c66 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5" status: 200 len: 1265 microversion: 2.1 time: 0.155990 Oct 11 07:19:15.060480 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1690/3383] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:19:14 2022] GET /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:19:16.082138 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2ad5dd21-9e22-46b7-b05d-fb6a11f0742f tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:16.082739 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2ad5dd21-9e22-46b7-b05d-fb6a11f0742f tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 5fde741d-e09c-4bfb-93de-7554e07ae0a5] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:19:16.089158 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ad5dd21-9e22-46b7-b05d-fb6a11f0742f tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:16.089629 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ad5dd21-9e22-46b7-b05d-fb6a11f0742f tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:16.090056 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ad5dd21-9e22-46b7-b05d-fb6a11f0742f tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:16.090732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ad5dd21-9e22-46b7-b05d-fb6a11f0742f tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:16.091174 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ad5dd21-9e22-46b7-b05d-fb6a11f0742f tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:16.091619 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ad5dd21-9e22-46b7-b05d-fb6a11f0742f tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:16.217844 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2ad5dd21-9e22-46b7-b05d-fb6a11f0742f tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:19:16.226039 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2ad5dd21-9e22-46b7-b05d-fb6a11f0742f tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5" status: 200 len: 1265 microversion: 2.1 time: 0.147675 Oct 11 07:19:16.226587 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1694/3384] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:19:16 2022] GET /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:19:17.249052 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6d16e4cd-c515-42b3-8e67-89d4970a01be tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:17.249667 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6d16e4cd-c515-42b3-8e67-89d4970a01be tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 5fde741d-e09c-4bfb-93de-7554e07ae0a5] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:19:17.255699 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6d16e4cd-c515-42b3-8e67-89d4970a01be tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:17.256742 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6d16e4cd-c515-42b3-8e67-89d4970a01be tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:17.257175 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6d16e4cd-c515-42b3-8e67-89d4970a01be tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:17.257862 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6d16e4cd-c515-42b3-8e67-89d4970a01be tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:17.258317 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6d16e4cd-c515-42b3-8e67-89d4970a01be tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:17.258742 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6d16e4cd-c515-42b3-8e67-89d4970a01be tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:17.390237 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6d16e4cd-c515-42b3-8e67-89d4970a01be tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:19:17.397848 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6d16e4cd-c515-42b3-8e67-89d4970a01be tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5" status: 200 len: 1265 microversion: 2.1 time: 0.152849 Oct 11 07:19:17.398396 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1691/3385] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:19:17 2022] GET /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:19:18.420403 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2ce09df2-158c-4542-af2b-88305eaf1e54 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:18.421144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2ce09df2-158c-4542-af2b-88305eaf1e54 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 5fde741d-e09c-4bfb-93de-7554e07ae0a5] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:19:18.427604 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ce09df2-158c-4542-af2b-88305eaf1e54 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:18.428085 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ce09df2-158c-4542-af2b-88305eaf1e54 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:18.428518 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ce09df2-158c-4542-af2b-88305eaf1e54 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:18.429207 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ce09df2-158c-4542-af2b-88305eaf1e54 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:18.429659 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ce09df2-158c-4542-af2b-88305eaf1e54 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:18.430082 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2ce09df2-158c-4542-af2b-88305eaf1e54 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:18.557542 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2ce09df2-158c-4542-af2b-88305eaf1e54 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:19:18.565084 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2ce09df2-158c-4542-af2b-88305eaf1e54 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5" status: 200 len: 1265 microversion: 2.1 time: 0.148582 Oct 11 07:19:18.565640 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1695/3386] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:19:18 2022] GET /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:19:19.589807 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-6ede89bf-db3c-4fdc-a9f6-ee8bee3787f1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:19.590414 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-6ede89bf-db3c-4fdc-a9f6-ee8bee3787f1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 5fde741d-e09c-4bfb-93de-7554e07ae0a5] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:19:19.596832 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ede89bf-db3c-4fdc-a9f6-ee8bee3787f1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:19.597305 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ede89bf-db3c-4fdc-a9f6-ee8bee3787f1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:19.597762 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ede89bf-db3c-4fdc-a9f6-ee8bee3787f1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:19.598444 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ede89bf-db3c-4fdc-a9f6-ee8bee3787f1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:19.598892 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ede89bf-db3c-4fdc-a9f6-ee8bee3787f1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:19.599357 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-6ede89bf-db3c-4fdc-a9f6-ee8bee3787f1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:19.730609 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-6ede89bf-db3c-4fdc-a9f6-ee8bee3787f1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:19:19.738510 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-6ede89bf-db3c-4fdc-a9f6-ee8bee3787f1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5" status: 200 len: 1265 microversion: 2.1 time: 0.153584 Oct 11 07:19:19.739077 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1692/3387] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:19:19 2022] GET /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:19:20.484875 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cc405a37-b7e9-4c3d-8a7c-d05badd4d79e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:20.485391 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cc405a37-b7e9-4c3d-8a7c-d05badd4d79e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: f26806d8-9180-4109-b3df-cadb68b7a0f2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:19:20.488352 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:19:20.493710 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc405a37-b7e9-4c3d-8a7c-d05badd4d79e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:20.494189 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc405a37-b7e9-4c3d-8a7c-d05badd4d79e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:20.494624 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc405a37-b7e9-4c3d-8a7c-d05badd4d79e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:20.495312 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc405a37-b7e9-4c3d-8a7c-d05badd4d79e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:20.495790 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc405a37-b7e9-4c3d-8a7c-d05badd4d79e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:20.496214 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cc405a37-b7e9-4c3d-8a7c-d05badd4d79e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:20.509389 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-cc405a37-b7e9-4c3d-8a7c-d05badd4d79e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] HTTP exception thrown: Instance f26806d8-9180-4109-b3df-cadb68b7a0f2 could not be found. Oct 11 07:19:20.510942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cc405a37-b7e9-4c3d-8a7c-d05badd4d79e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Request method failure captured: Oct 11 07:19:20.510942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: request: DELETE /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2 HTTP/1.1 Oct 11 07:19:20.510942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept: application/json Oct 11 07:19:20.510942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Oct 11 07:19:20.510942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Connection: close Oct 11 07:19:20.510942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Length: 0 Oct 11 07:19:20.510942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Type: application/json Oct 11 07:19:20.510942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Host: 10.222.0.39 Oct 11 07:19:20.510942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Oct 11 07:19:20.510942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.12 Oct 11 07:19:20.510942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABjRRAwy9lJUTfwPNtlFgEhb-dAJQkr8kItl0eplWqHVmUEQOi91EP03uqskZs2F09OCrDxhZNVyWfwqkdTdBHntnSvaxgsnlvuvl6nwjywGfWIyT1kcJB9AmqFWPBHqNA32UcnItu0uRvzmSEnGi9zthg1R0ixsgpLwpYUj0FVoqY22sA Oct 11 07:19:20.510942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Oct 11 07:19:20.510942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Oct 11 07:19:20.510942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Oct 11 07:19:20.510942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Oct 11 07:19:20.510942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 07:19:20.510942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Oct 11 07:19:20.510942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Oct 11 07:19:20.510942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Id: ec4a4c53c1c744688b3bf91e806286bf Oct 11 07:19:20.510942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-262463267 Oct 11 07:19:20.510942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Role: reader,member Oct 11 07:19:20.510942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Oct 11 07:19:20.512479 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ec4a4c53c1c744688b3bf91e806286bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ec4a4c53c1c744688b3bf91e806286bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ec4a4c53c1c744688b3bf91e806286bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ec4a4c53c1c744688b3bf91e806286bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 07:19:20.512479 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-AttachVolumeShelveTestJSON-262463267 Oct 11 07:19:20.512479 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Id: ec4a4c53c1c744688b3bf91e806286bf Oct 11 07:19:20.512479 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-262463267 Oct 11 07:19:20.512479 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User: tempest-AttachVolumeShelveTestJSON-262463267-project Oct 11 07:19:20.512479 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Oct 11 07:19:20.512479 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Oct 11 07:19:20.512479 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Id: f95c1cd09e1042abbb5725f241ce147d Oct 11 07:19:20.512479 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-AttachVolumeShelveTestJSON-262463267-project Oct 11 07:19:20.512479 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: method: > Oct 11 07:19:20.512479 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: exception: Instance f26806d8-9180-4109-b3df-cadb68b7a0f2 could not be found. Oct 11 07:19:20.512479 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: action_args: {'id': 'f26806d8-9180-4109-b3df-cadb68b7a0f2'} Oct 11 07:19:20.513339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 07:19:20.513339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:20.513339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 07:19:20.513339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 07:19:20.513339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 07:19:20.513339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 07:19:20.513339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 07:19:20.513339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 07:19:20.513339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 07:19:20.513339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 07:19:20.513339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f26806d8-9180-4109-b3df-cadb68b7a0f2 could not be found. Oct 11 07:19:20.513339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:20.513339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:19:20.513339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:20.513339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:20.513339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:19:20.513339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:19:20.513339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 07:19:20.513339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 07:19:20.513339 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 07:19:20.514721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 07:19:20.514721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 07:19:20.514721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 07:19:20.514721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 07:19:20.514721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 07:19:20.514721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 07:19:20.514721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 07:19:20.514721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 07:19:20.514721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 07:19:20.514721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f26806d8-9180-4109-b3df-cadb68b7a0f2 could not be found. Oct 11 07:19:20.514721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:20.514721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:19:20.514721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:20.514721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:20.514721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:19:20.514721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:19:20.514721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 07:19:20.514721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 07:19:20.514721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f26806d8-9180-4109-b3df-cadb68b7a0f2 could not be found. Oct 11 07:19:20.514721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:20.516189 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cc405a37-b7e9-4c3d-8a7c-d05badd4d79e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Returning 404 to user: Instance f26806d8-9180-4109-b3df-cadb68b7a0f2 could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 07:19:20.516189 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cc405a37-b7e9-4c3d-8a7c-d05badd4d79e tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2" status: 404 len: 111 microversion: 2.20 time: 0.031353 Oct 11 07:19:20.516189 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1696/3388] 10.222.0.39 () {60 vars in 1280 bytes} [Tue Oct 11 07:19:20 2022] DELETE /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 07:19:20.520776 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-20a215a8-f924-40a0-87c5-53b0bd5ec064 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:20.521835 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-20a215a8-f924-40a0-87c5-53b0bd5ec064 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: f26806d8-9180-4109-b3df-cadb68b7a0f2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:19:20.523884 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=2 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:19:20.524644 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=6 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:19:20.530298 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20a215a8-f924-40a0-87c5-53b0bd5ec064 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:20.530768 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20a215a8-f924-40a0-87c5-53b0bd5ec064 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:20.531190 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20a215a8-f924-40a0-87c5-53b0bd5ec064 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:20.531901 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20a215a8-f924-40a0-87c5-53b0bd5ec064 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:20.532345 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20a215a8-f924-40a0-87c5-53b0bd5ec064 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:20.532756 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-20a215a8-f924-40a0-87c5-53b0bd5ec064 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:20.546774 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-20a215a8-f924-40a0-87c5-53b0bd5ec064 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] HTTP exception thrown: Instance f26806d8-9180-4109-b3df-cadb68b7a0f2 could not be found. Oct 11 07:19:20.548484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-20a215a8-f924-40a0-87c5-53b0bd5ec064 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Request method failure captured: Oct 11 07:19:20.548484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: request: GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2 HTTP/1.1 Oct 11 07:19:20.548484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept: application/json Oct 11 07:19:20.548484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Oct 11 07:19:20.548484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Connection: close Oct 11 07:19:20.548484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Length: 0 Oct 11 07:19:20.548484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Type: application/json Oct 11 07:19:20.548484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Host: 10.222.0.39 Oct 11 07:19:20.548484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Oct 11 07:19:20.548484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.12 Oct 11 07:19:20.548484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABjRRAwy9lJUTfwPNtlFgEhb-dAJQkr8kItl0eplWqHVmUEQOi91EP03uqskZs2F09OCrDxhZNVyWfwqkdTdBHntnSvaxgsnlvuvl6nwjywGfWIyT1kcJB9AmqFWPBHqNA32UcnItu0uRvzmSEnGi9zthg1R0ixsgpLwpYUj0FVoqY22sA Oct 11 07:19:20.548484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Oct 11 07:19:20.548484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Oct 11 07:19:20.548484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Oct 11 07:19:20.548484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Oct 11 07:19:20.548484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 07:19:20.548484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Oct 11 07:19:20.548484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Oct 11 07:19:20.548484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Id: ec4a4c53c1c744688b3bf91e806286bf Oct 11 07:19:20.548484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-262463267 Oct 11 07:19:20.548484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Role: reader,member Oct 11 07:19:20.548484 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Oct 11 07:19:20.549975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ec4a4c53c1c744688b3bf91e806286bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ec4a4c53c1c744688b3bf91e806286bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ec4a4c53c1c744688b3bf91e806286bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ec4a4c53c1c744688b3bf91e806286bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 07:19:20.549975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-AttachVolumeShelveTestJSON-262463267 Oct 11 07:19:20.549975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Id: ec4a4c53c1c744688b3bf91e806286bf Oct 11 07:19:20.549975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-262463267 Oct 11 07:19:20.549975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User: tempest-AttachVolumeShelveTestJSON-262463267-project Oct 11 07:19:20.549975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Oct 11 07:19:20.549975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Oct 11 07:19:20.549975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Id: f95c1cd09e1042abbb5725f241ce147d Oct 11 07:19:20.549975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-AttachVolumeShelveTestJSON-262463267-project Oct 11 07:19:20.549975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: method: > Oct 11 07:19:20.549975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: exception: Instance f26806d8-9180-4109-b3df-cadb68b7a0f2 could not be found. Oct 11 07:19:20.549975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: action_args: {'id': 'f26806d8-9180-4109-b3df-cadb68b7a0f2'} Oct 11 07:19:20.550769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 07:19:20.550769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:20.550769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 07:19:20.550769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 07:19:20.550769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 07:19:20.550769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 07:19:20.550769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 07:19:20.550769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 07:19:20.550769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 07:19:20.550769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 07:19:20.550769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f26806d8-9180-4109-b3df-cadb68b7a0f2 could not be found. Oct 11 07:19:20.550769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:20.550769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:19:20.550769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:20.550769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:20.550769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:19:20.550769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:19:20.550769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 07:19:20.550769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 07:19:20.550769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 07:19:20.552064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 07:19:20.552064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 07:19:20.552064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 07:19:20.552064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 07:19:20.552064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 07:19:20.552064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 07:19:20.552064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 07:19:20.552064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f26806d8-9180-4109-b3df-cadb68b7a0f2 could not be found. Oct 11 07:19:20.552064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:20.552064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:19:20.552064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:20.552064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:20.552064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:19:20.552064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:19:20.552064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 07:19:20.552064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 07:19:20.552064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f26806d8-9180-4109-b3df-cadb68b7a0f2 could not be found. Oct 11 07:19:20.552064 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:20.553198 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-20a215a8-f924-40a0-87c5-53b0bd5ec064 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Returning 404 to user: Instance f26806d8-9180-4109-b3df-cadb68b7a0f2 could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 07:19:20.553198 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-20a215a8-f924-40a0-87c5-53b0bd5ec064 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2" status: 404 len: 111 microversion: 2.20 time: 0.032986 Oct 11 07:19:20.553198 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1693/3389] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:19:20 2022] GET /compute/v2.1/servers/f26806d8-9180-4109-b3df-cadb68b7a0f2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 11 07:19:20.762479 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1cbe388c-d3b7-48ae-8a02-b4171f95f9c1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:20.763092 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1cbe388c-d3b7-48ae-8a02-b4171f95f9c1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 5fde741d-e09c-4bfb-93de-7554e07ae0a5] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:19:20.769186 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1cbe388c-d3b7-48ae-8a02-b4171f95f9c1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:20.769667 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1cbe388c-d3b7-48ae-8a02-b4171f95f9c1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:20.770132 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1cbe388c-d3b7-48ae-8a02-b4171f95f9c1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:20.770867 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1cbe388c-d3b7-48ae-8a02-b4171f95f9c1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:20.771841 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1cbe388c-d3b7-48ae-8a02-b4171f95f9c1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:20.772277 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1cbe388c-d3b7-48ae-8a02-b4171f95f9c1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:20.906948 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1cbe388c-d3b7-48ae-8a02-b4171f95f9c1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:19:20.910756 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-31a51bd7-bbc7-4a43-b6a5-52022cab2e0a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:20.911233 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-31a51bd7-bbc7-4a43-b6a5-52022cab2e0a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: edea36de-eaed-4410-81f5-b9a3643849c2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:19:20.914874 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1cbe388c-d3b7-48ae-8a02-b4171f95f9c1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5" status: 200 len: 1265 microversion: 2.1 time: 0.156294 Oct 11 07:19:20.915462 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1697/3390] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:19:20 2022] GET /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:19:20.918184 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-31a51bd7-bbc7-4a43-b6a5-52022cab2e0a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:20.918658 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-31a51bd7-bbc7-4a43-b6a5-52022cab2e0a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:20.919082 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-31a51bd7-bbc7-4a43-b6a5-52022cab2e0a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:20.919801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-31a51bd7-bbc7-4a43-b6a5-52022cab2e0a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:20.920289 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-31a51bd7-bbc7-4a43-b6a5-52022cab2e0a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:20.920705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-31a51bd7-bbc7-4a43-b6a5-52022cab2e0a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:20.936523 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-31a51bd7-bbc7-4a43-b6a5-52022cab2e0a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] HTTP exception thrown: Instance edea36de-eaed-4410-81f5-b9a3643849c2 could not be found. Oct 11 07:19:20.939152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-31a51bd7-bbc7-4a43-b6a5-52022cab2e0a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Request method failure captured: Oct 11 07:19:20.939152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: request: DELETE /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2 HTTP/1.1 Oct 11 07:19:20.939152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept: application/json Oct 11 07:19:20.939152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Oct 11 07:19:20.939152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Connection: close Oct 11 07:19:20.939152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Length: 0 Oct 11 07:19:20.939152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Type: application/json Oct 11 07:19:20.939152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Host: 10.222.0.39 Oct 11 07:19:20.939152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Oct 11 07:19:20.939152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.12 Oct 11 07:19:20.939152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABjRRAxy4G3-Dozw6PdtI-WxnLtOJo2tV5OYxcxBy_217a4UmcYLPs6ReKc-RB_X0BHPCFHNcEeuRkAY-tzsCezmhAkP9Vj61rIl09eudAdIM1Me8KUnbI8OUgzhSO-abAb7LBVYvrD1IB-9qK1fM9G-MUZhv8Y32eWPbrO9FZ3pwby7Y8 Oct 11 07:19:20.939152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Oct 11 07:19:20.939152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Oct 11 07:19:20.939152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Oct 11 07:19:20.939152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Oct 11 07:19:20.939152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Oct 11 07:19:20.939152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Oct 11 07:19:20.939152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Id: 5af47e2321de4d299ff3a7fb3d3d9e3c Oct 11 07:19:20.939152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-AttachVolumeNegativeTest-1386971692 Oct 11 07:19:20.939152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Role: reader,member Oct 11 07:19:20.939152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Oct 11 07:19:20.940519 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 07:19:20.940519 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-AttachVolumeNegativeTest-1386971692 Oct 11 07:19:20.940519 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 5af47e2321de4d299ff3a7fb3d3d9e3c Oct 11 07:19:20.940519 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1386971692 Oct 11 07:19:20.940519 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User: tempest-AttachVolumeNegativeTest-1386971692-project Oct 11 07:19:20.940519 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Oct 11 07:19:20.940519 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Oct 11 07:19:20.940519 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Id: 2e63c3f83f3d41018e6330f26ed7b8a0 Oct 11 07:19:20.940519 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-AttachVolumeNegativeTest-1386971692-project Oct 11 07:19:20.940519 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: method: > Oct 11 07:19:20.940519 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: exception: Instance edea36de-eaed-4410-81f5-b9a3643849c2 could not be found. Oct 11 07:19:20.940519 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: action_args: {'id': 'edea36de-eaed-4410-81f5-b9a3643849c2'} Oct 11 07:19:20.941277 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 07:19:20.941277 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:20.941277 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 07:19:20.941277 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 07:19:20.941277 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 07:19:20.941277 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 07:19:20.941277 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 07:19:20.941277 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 07:19:20.941277 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 07:19:20.941277 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 07:19:20.941277 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edea36de-eaed-4410-81f5-b9a3643849c2 could not be found. Oct 11 07:19:20.941277 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:20.941277 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:19:20.941277 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:20.941277 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:20.941277 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:19:20.941277 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:19:20.941277 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 07:19:20.941277 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 07:19:20.941277 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 07:19:20.942788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 07:19:20.942788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 07:19:20.942788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 07:19:20.942788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 07:19:20.942788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 07:19:20.942788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 07:19:20.942788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 07:19:20.942788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 07:19:20.942788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 07:19:20.942788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edea36de-eaed-4410-81f5-b9a3643849c2 could not be found. Oct 11 07:19:20.942788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:20.942788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:19:20.942788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:20.942788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:20.942788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:19:20.942788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:19:20.942788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 07:19:20.942788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 07:19:20.942788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edea36de-eaed-4410-81f5-b9a3643849c2 could not be found. Oct 11 07:19:20.942788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:20.944775 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-31a51bd7-bbc7-4a43-b6a5-52022cab2e0a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Returning 404 to user: Instance edea36de-eaed-4410-81f5-b9a3643849c2 could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 07:19:20.944775 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-31a51bd7-bbc7-4a43-b6a5-52022cab2e0a tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "DELETE /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2" status: 404 len: 111 microversion: 2.1 time: 0.034166 Oct 11 07:19:20.944775 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1694/3391] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Oct 11 07:19:20 2022] DELETE /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 07:19:20.950375 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7261fbd9-a7e0-458e-a731-22832613ee42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:20.951135 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7261fbd9-a7e0-458e-a731-22832613ee42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: edea36de-eaed-4410-81f5-b9a3643849c2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:19:20.957141 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7261fbd9-a7e0-458e-a731-22832613ee42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:20.957615 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7261fbd9-a7e0-458e-a731-22832613ee42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:20.958044 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7261fbd9-a7e0-458e-a731-22832613ee42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:20.959276 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7261fbd9-a7e0-458e-a731-22832613ee42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:20.959759 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7261fbd9-a7e0-458e-a731-22832613ee42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:20.961133 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7261fbd9-a7e0-458e-a731-22832613ee42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:20.977015 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-7261fbd9-a7e0-458e-a731-22832613ee42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] HTTP exception thrown: Instance edea36de-eaed-4410-81f5-b9a3643849c2 could not be found. Oct 11 07:19:20.978961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7261fbd9-a7e0-458e-a731-22832613ee42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Request method failure captured: Oct 11 07:19:20.978961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: request: GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2 HTTP/1.1 Oct 11 07:19:20.978961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept: application/json Oct 11 07:19:20.978961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Oct 11 07:19:20.978961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Connection: close Oct 11 07:19:20.978961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Length: 0 Oct 11 07:19:20.978961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Type: application/json Oct 11 07:19:20.978961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Host: 10.222.0.39 Oct 11 07:19:20.978961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Oct 11 07:19:20.978961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.12 Oct 11 07:19:20.978961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABjRRAxy4G3-Dozw6PdtI-WxnLtOJo2tV5OYxcxBy_217a4UmcYLPs6ReKc-RB_X0BHPCFHNcEeuRkAY-tzsCezmhAkP9Vj61rIl09eudAdIM1Me8KUnbI8OUgzhSO-abAb7LBVYvrD1IB-9qK1fM9G-MUZhv8Y32eWPbrO9FZ3pwby7Y8 Oct 11 07:19:20.978961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Oct 11 07:19:20.978961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Oct 11 07:19:20.978961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Oct 11 07:19:20.978961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Oct 11 07:19:20.978961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Oct 11 07:19:20.978961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Oct 11 07:19:20.978961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Id: 5af47e2321de4d299ff3a7fb3d3d9e3c Oct 11 07:19:20.978961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-AttachVolumeNegativeTest-1386971692 Oct 11 07:19:20.978961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Role: reader,member Oct 11 07:19:20.978961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Oct 11 07:19:20.980385 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 07:19:20.980385 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-AttachVolumeNegativeTest-1386971692 Oct 11 07:19:20.980385 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 5af47e2321de4d299ff3a7fb3d3d9e3c Oct 11 07:19:20.980385 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1386971692 Oct 11 07:19:20.980385 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User: tempest-AttachVolumeNegativeTest-1386971692-project Oct 11 07:19:20.980385 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Oct 11 07:19:20.980385 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Oct 11 07:19:20.980385 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Id: 2e63c3f83f3d41018e6330f26ed7b8a0 Oct 11 07:19:20.980385 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-AttachVolumeNegativeTest-1386971692-project Oct 11 07:19:20.980385 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: method: > Oct 11 07:19:20.980385 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: exception: Instance edea36de-eaed-4410-81f5-b9a3643849c2 could not be found. Oct 11 07:19:20.980385 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: action_args: {'id': 'edea36de-eaed-4410-81f5-b9a3643849c2'} Oct 11 07:19:20.981048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 07:19:20.981048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:20.981048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 07:19:20.981048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 07:19:20.981048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 07:19:20.981048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 07:19:20.981048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 07:19:20.981048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 07:19:20.981048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 07:19:20.981048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 07:19:20.981048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edea36de-eaed-4410-81f5-b9a3643849c2 could not be found. Oct 11 07:19:20.981048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:20.981048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:19:20.981048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:20.981048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:20.981048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:19:20.981048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:19:20.981048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 07:19:20.981048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 07:19:20.981048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 07:19:20.982083 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 07:19:20.982083 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 07:19:20.982083 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 07:19:20.982083 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 07:19:20.982083 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 07:19:20.982083 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 07:19:20.982083 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 07:19:20.982083 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edea36de-eaed-4410-81f5-b9a3643849c2 could not be found. Oct 11 07:19:20.982083 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:20.982083 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:19:20.982083 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:20.982083 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:20.982083 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:19:20.982083 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:19:20.982083 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 07:19:20.982083 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 07:19:20.982083 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edea36de-eaed-4410-81f5-b9a3643849c2 could not be found. Oct 11 07:19:20.982083 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:20.983042 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7261fbd9-a7e0-458e-a731-22832613ee42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Returning 404 to user: Instance edea36de-eaed-4410-81f5-b9a3643849c2 could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 07:19:20.983042 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7261fbd9-a7e0-458e-a731-22832613ee42 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2" status: 404 len: 111 microversion: 2.1 time: 0.034042 Oct 11 07:19:20.983042 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1698/3392] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:19:20 2022] GET /compute/v2.1/servers/edea36de-eaed-4410-81f5-b9a3643849c2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 07:19:20.988958 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4e3aae62-9d35-45ff-8e36-6e21c354754f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:20.989455 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4e3aae62-9d35-45ff-8e36-6e21c354754f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: fe4c25ff-9873-41dc-8396-d4af6cecd1f8] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:19:20.995733 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4e3aae62-9d35-45ff-8e36-6e21c354754f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:20.996220 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4e3aae62-9d35-45ff-8e36-6e21c354754f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:20.996653 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4e3aae62-9d35-45ff-8e36-6e21c354754f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:20.997340 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4e3aae62-9d35-45ff-8e36-6e21c354754f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:20.997793 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4e3aae62-9d35-45ff-8e36-6e21c354754f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:20.998213 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4e3aae62-9d35-45ff-8e36-6e21c354754f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:21.011789 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-4e3aae62-9d35-45ff-8e36-6e21c354754f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] HTTP exception thrown: Instance fe4c25ff-9873-41dc-8396-d4af6cecd1f8 could not be found. Oct 11 07:19:21.013308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4e3aae62-9d35-45ff-8e36-6e21c354754f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Request method failure captured: Oct 11 07:19:21.013308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: request: DELETE /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8 HTTP/1.1 Oct 11 07:19:21.013308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept: application/json Oct 11 07:19:21.013308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Oct 11 07:19:21.013308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Connection: close Oct 11 07:19:21.013308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Length: 0 Oct 11 07:19:21.013308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Type: application/json Oct 11 07:19:21.013308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Host: 10.222.0.39 Oct 11 07:19:21.013308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Oct 11 07:19:21.013308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.12 Oct 11 07:19:21.013308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABjRRAxy4G3-Dozw6PdtI-WxnLtOJo2tV5OYxcxBy_217a4UmcYLPs6ReKc-RB_X0BHPCFHNcEeuRkAY-tzsCezmhAkP9Vj61rIl09eudAdIM1Me8KUnbI8OUgzhSO-abAb7LBVYvrD1IB-9qK1fM9G-MUZhv8Y32eWPbrO9FZ3pwby7Y8 Oct 11 07:19:21.013308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Oct 11 07:19:21.013308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Oct 11 07:19:21.013308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Oct 11 07:19:21.013308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Oct 11 07:19:21.013308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Oct 11 07:19:21.013308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Oct 11 07:19:21.013308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Id: 5af47e2321de4d299ff3a7fb3d3d9e3c Oct 11 07:19:21.013308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-AttachVolumeNegativeTest-1386971692 Oct 11 07:19:21.013308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Role: reader,member Oct 11 07:19:21.013308 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Oct 11 07:19:21.014672 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 07:19:21.014672 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-AttachVolumeNegativeTest-1386971692 Oct 11 07:19:21.014672 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 5af47e2321de4d299ff3a7fb3d3d9e3c Oct 11 07:19:21.014672 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1386971692 Oct 11 07:19:21.014672 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User: tempest-AttachVolumeNegativeTest-1386971692-project Oct 11 07:19:21.014672 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Oct 11 07:19:21.014672 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Oct 11 07:19:21.014672 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Id: 2e63c3f83f3d41018e6330f26ed7b8a0 Oct 11 07:19:21.014672 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-AttachVolumeNegativeTest-1386971692-project Oct 11 07:19:21.014672 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: method: > Oct 11 07:19:21.014672 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: exception: Instance fe4c25ff-9873-41dc-8396-d4af6cecd1f8 could not be found. Oct 11 07:19:21.014672 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: action_args: {'id': 'fe4c25ff-9873-41dc-8396-d4af6cecd1f8'} Oct 11 07:19:21.015392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 07:19:21.015392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:21.015392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 07:19:21.015392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 07:19:21.015392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 07:19:21.015392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 07:19:21.015392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 07:19:21.015392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 07:19:21.015392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 07:19:21.015392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 07:19:21.015392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe4c25ff-9873-41dc-8396-d4af6cecd1f8 could not be found. Oct 11 07:19:21.015392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:21.015392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:19:21.015392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:21.015392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:21.015392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:19:21.015392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:19:21.015392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 07:19:21.015392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 07:19:21.015392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 07:19:21.016544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 07:19:21.016544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 07:19:21.016544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 07:19:21.016544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 07:19:21.016544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 07:19:21.016544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 07:19:21.016544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 07:19:21.016544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 07:19:21.016544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 07:19:21.016544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe4c25ff-9873-41dc-8396-d4af6cecd1f8 could not be found. Oct 11 07:19:21.016544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:21.016544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:19:21.016544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:21.016544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:21.016544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:19:21.016544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:19:21.016544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 07:19:21.016544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 07:19:21.016544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe4c25ff-9873-41dc-8396-d4af6cecd1f8 could not be found. Oct 11 07:19:21.016544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:21.017660 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4e3aae62-9d35-45ff-8e36-6e21c354754f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Returning 404 to user: Instance fe4c25ff-9873-41dc-8396-d4af6cecd1f8 could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 07:19:21.017660 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4e3aae62-9d35-45ff-8e36-6e21c354754f tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "DELETE /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8" status: 404 len: 111 microversion: 2.1 time: 0.029777 Oct 11 07:19:21.017660 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1695/3393] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Oct 11 07:19:20 2022] DELETE /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 07:19:21.023667 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5e664695-9b72-4634-9616-7d0d4ceb11b6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:21.024219 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5e664695-9b72-4634-9616-7d0d4ceb11b6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: fe4c25ff-9873-41dc-8396-d4af6cecd1f8] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:19:21.030023 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5e664695-9b72-4634-9616-7d0d4ceb11b6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:21.030499 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5e664695-9b72-4634-9616-7d0d4ceb11b6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:21.030932 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5e664695-9b72-4634-9616-7d0d4ceb11b6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:21.031655 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5e664695-9b72-4634-9616-7d0d4ceb11b6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:21.032103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5e664695-9b72-4634-9616-7d0d4ceb11b6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:21.032524 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5e664695-9b72-4634-9616-7d0d4ceb11b6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:21.047258 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-5e664695-9b72-4634-9616-7d0d4ceb11b6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] HTTP exception thrown: Instance fe4c25ff-9873-41dc-8396-d4af6cecd1f8 could not be found. Oct 11 07:19:21.048807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5e664695-9b72-4634-9616-7d0d4ceb11b6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Request method failure captured: Oct 11 07:19:21.048807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: request: GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8 HTTP/1.1 Oct 11 07:19:21.048807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept: application/json Oct 11 07:19:21.048807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Oct 11 07:19:21.048807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Connection: close Oct 11 07:19:21.048807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Length: 0 Oct 11 07:19:21.048807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Type: application/json Oct 11 07:19:21.048807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Host: 10.222.0.39 Oct 11 07:19:21.048807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Oct 11 07:19:21.048807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.12 Oct 11 07:19:21.048807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABjRRAxy4G3-Dozw6PdtI-WxnLtOJo2tV5OYxcxBy_217a4UmcYLPs6ReKc-RB_X0BHPCFHNcEeuRkAY-tzsCezmhAkP9Vj61rIl09eudAdIM1Me8KUnbI8OUgzhSO-abAb7LBVYvrD1IB-9qK1fM9G-MUZhv8Y32eWPbrO9FZ3pwby7Y8 Oct 11 07:19:21.048807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Oct 11 07:19:21.048807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Oct 11 07:19:21.048807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Oct 11 07:19:21.048807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Oct 11 07:19:21.048807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Oct 11 07:19:21.048807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Oct 11 07:19:21.048807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Id: 5af47e2321de4d299ff3a7fb3d3d9e3c Oct 11 07:19:21.048807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-AttachVolumeNegativeTest-1386971692 Oct 11 07:19:21.048807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Role: reader,member Oct 11 07:19:21.048807 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Oct 11 07:19:21.050072 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 07:19:21.050072 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-AttachVolumeNegativeTest-1386971692 Oct 11 07:19:21.050072 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 5af47e2321de4d299ff3a7fb3d3d9e3c Oct 11 07:19:21.050072 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1386971692 Oct 11 07:19:21.050072 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User: tempest-AttachVolumeNegativeTest-1386971692-project Oct 11 07:19:21.050072 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Oct 11 07:19:21.050072 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Oct 11 07:19:21.050072 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Id: 2e63c3f83f3d41018e6330f26ed7b8a0 Oct 11 07:19:21.050072 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-AttachVolumeNegativeTest-1386971692-project Oct 11 07:19:21.050072 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: method: > Oct 11 07:19:21.050072 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: exception: Instance fe4c25ff-9873-41dc-8396-d4af6cecd1f8 could not be found. Oct 11 07:19:21.050072 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: action_args: {'id': 'fe4c25ff-9873-41dc-8396-d4af6cecd1f8'} Oct 11 07:19:21.050686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 07:19:21.050686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:21.050686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 07:19:21.050686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 07:19:21.050686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 07:19:21.050686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 07:19:21.050686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 07:19:21.050686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 07:19:21.050686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 07:19:21.050686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 07:19:21.050686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe4c25ff-9873-41dc-8396-d4af6cecd1f8 could not be found. Oct 11 07:19:21.050686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:21.050686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:19:21.050686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:21.050686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:21.050686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:19:21.050686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:19:21.050686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 07:19:21.050686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 07:19:21.050686 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 07:19:21.052068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 07:19:21.052068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 07:19:21.052068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 07:19:21.052068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 07:19:21.052068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 07:19:21.052068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 07:19:21.052068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 07:19:21.052068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe4c25ff-9873-41dc-8396-d4af6cecd1f8 could not be found. Oct 11 07:19:21.052068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:21.052068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:19:21.052068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:21.052068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:21.052068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:19:21.052068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:19:21.052068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 07:19:21.052068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 07:19:21.052068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe4c25ff-9873-41dc-8396-d4af6cecd1f8 could not be found. Oct 11 07:19:21.052068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:21.053279 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5e664695-9b72-4634-9616-7d0d4ceb11b6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Returning 404 to user: Instance fe4c25ff-9873-41dc-8396-d4af6cecd1f8 could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 07:19:21.053279 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5e664695-9b72-4634-9616-7d0d4ceb11b6 tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8" status: 404 len: 111 microversion: 2.1 time: 0.031068 Oct 11 07:19:21.053279 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1699/3394] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:19:21 2022] GET /compute/v2.1/servers/fe4c25ff-9873-41dc-8396-d4af6cecd1f8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 07:19:21.689197 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-30f0ef92-aae8-4fc4-914d-6f6811c4a88f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:21.689976 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-30f0ef92-aae8-4fc4-914d-6f6811c4a88f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:19:21.696848 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30f0ef92-aae8-4fc4-914d-6f6811c4a88f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:21.698369 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30f0ef92-aae8-4fc4-914d-6f6811c4a88f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:21.698945 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30f0ef92-aae8-4fc4-914d-6f6811c4a88f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:21.699780 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30f0ef92-aae8-4fc4-914d-6f6811c4a88f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:21.700702 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30f0ef92-aae8-4fc4-914d-6f6811c4a88f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:21.701229 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30f0ef92-aae8-4fc4-914d-6f6811c4a88f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:21.715846 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-30f0ef92-aae8-4fc4-914d-6f6811c4a88f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] HTTP exception thrown: Instance 43d48211-8dab-4abd-8c95-e850b83382ff could not be found. Oct 11 07:19:21.717856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-30f0ef92-aae8-4fc4-914d-6f6811c4a88f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Request method failure captured: Oct 11 07:19:21.717856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: request: DELETE /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff HTTP/1.1 Oct 11 07:19:21.717856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept: application/json Oct 11 07:19:21.717856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Oct 11 07:19:21.717856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Connection: close Oct 11 07:19:21.717856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Length: 0 Oct 11 07:19:21.717856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Type: application/json Oct 11 07:19:21.717856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Host: 10.222.0.39 Oct 11 07:19:21.717856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Oct 11 07:19:21.717856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.12 Oct 11 07:19:21.717856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABjRRAwy9lJUTfwPNtlFgEhb-dAJQkr8kItl0eplWqHVmUEQOi91EP03uqskZs2F09OCrDxhZNVyWfwqkdTdBHntnSvaxgsnlvuvl6nwjywGfWIyT1kcJB9AmqFWPBHqNA32UcnItu0uRvzmSEnGi9zthg1R0ixsgpLwpYUj0FVoqY22sA Oct 11 07:19:21.717856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Oct 11 07:19:21.717856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Oct 11 07:19:21.717856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Oct 11 07:19:21.717856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Oct 11 07:19:21.717856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 07:19:21.717856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Oct 11 07:19:21.717856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Oct 11 07:19:21.717856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Id: ec4a4c53c1c744688b3bf91e806286bf Oct 11 07:19:21.717856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-262463267 Oct 11 07:19:21.717856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Role: reader,member Oct 11 07:19:21.717856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Oct 11 07:19:21.719301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ec4a4c53c1c744688b3bf91e806286bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ec4a4c53c1c744688b3bf91e806286bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ec4a4c53c1c744688b3bf91e806286bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ec4a4c53c1c744688b3bf91e806286bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 07:19:21.719301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-AttachVolumeShelveTestJSON-262463267 Oct 11 07:19:21.719301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Id: ec4a4c53c1c744688b3bf91e806286bf Oct 11 07:19:21.719301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-262463267 Oct 11 07:19:21.719301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User: tempest-AttachVolumeShelveTestJSON-262463267-project Oct 11 07:19:21.719301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Oct 11 07:19:21.719301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Oct 11 07:19:21.719301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Id: f95c1cd09e1042abbb5725f241ce147d Oct 11 07:19:21.719301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-AttachVolumeShelveTestJSON-262463267-project Oct 11 07:19:21.719301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: method: > Oct 11 07:19:21.719301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: exception: Instance 43d48211-8dab-4abd-8c95-e850b83382ff could not be found. Oct 11 07:19:21.719301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: action_args: {'id': '43d48211-8dab-4abd-8c95-e850b83382ff'} Oct 11 07:19:21.720656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 07:19:21.720656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:21.720656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 07:19:21.720656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 07:19:21.720656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 07:19:21.720656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 07:19:21.720656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 07:19:21.720656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 07:19:21.720656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 07:19:21.720656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 07:19:21.720656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43d48211-8dab-4abd-8c95-e850b83382ff could not be found. Oct 11 07:19:21.720656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:21.720656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:19:21.720656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:21.720656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:21.720656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:19:21.720656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:19:21.720656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 07:19:21.720656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 07:19:21.720656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 07:19:21.721801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 07:19:21.721801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 07:19:21.721801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 07:19:21.721801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 07:19:21.721801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 07:19:21.721801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 07:19:21.721801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 07:19:21.721801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 07:19:21.721801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 07:19:21.721801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43d48211-8dab-4abd-8c95-e850b83382ff could not be found. Oct 11 07:19:21.721801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:21.721801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:19:21.721801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:21.721801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:21.721801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:19:21.721801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:19:21.721801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 07:19:21.721801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 07:19:21.721801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43d48211-8dab-4abd-8c95-e850b83382ff could not be found. Oct 11 07:19:21.721801 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:21.722970 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-30f0ef92-aae8-4fc4-914d-6f6811c4a88f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Returning 404 to user: Instance 43d48211-8dab-4abd-8c95-e850b83382ff could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 07:19:21.722970 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-30f0ef92-aae8-4fc4-914d-6f6811c4a88f tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "DELETE /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 404 len: 111 microversion: 2.20 time: 0.035672 Oct 11 07:19:21.722970 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1696/3395] 10.222.0.39 () {60 vars in 1280 bytes} [Tue Oct 11 07:19:21 2022] DELETE /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 07:19:21.729874 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-14793bb7-dad9-4b2f-87c5-baedc5103f39 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:21.730488 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-14793bb7-dad9-4b2f-87c5-baedc5103f39 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] [instance: 43d48211-8dab-4abd-8c95-e850b83382ff] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:19:21.737304 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-14793bb7-dad9-4b2f-87c5-baedc5103f39 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:21.738058 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-14793bb7-dad9-4b2f-87c5-baedc5103f39 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:21.738492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-14793bb7-dad9-4b2f-87c5-baedc5103f39 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:21.739187 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-14793bb7-dad9-4b2f-87c5-baedc5103f39 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:21.739680 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-14793bb7-dad9-4b2f-87c5-baedc5103f39 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:21.740724 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-14793bb7-dad9-4b2f-87c5-baedc5103f39 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:21.755461 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-14793bb7-dad9-4b2f-87c5-baedc5103f39 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] HTTP exception thrown: Instance 43d48211-8dab-4abd-8c95-e850b83382ff could not be found. Oct 11 07:19:21.757664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-14793bb7-dad9-4b2f-87c5-baedc5103f39 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Request method failure captured: Oct 11 07:19:21.757664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: request: GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff HTTP/1.1 Oct 11 07:19:21.757664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept: application/json Oct 11 07:19:21.757664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Oct 11 07:19:21.757664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Connection: close Oct 11 07:19:21.757664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Length: 0 Oct 11 07:19:21.757664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Type: application/json Oct 11 07:19:21.757664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Host: 10.222.0.39 Oct 11 07:19:21.757664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Oct 11 07:19:21.757664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.12 Oct 11 07:19:21.757664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABjRRAwy9lJUTfwPNtlFgEhb-dAJQkr8kItl0eplWqHVmUEQOi91EP03uqskZs2F09OCrDxhZNVyWfwqkdTdBHntnSvaxgsnlvuvl6nwjywGfWIyT1kcJB9AmqFWPBHqNA32UcnItu0uRvzmSEnGi9zthg1R0ixsgpLwpYUj0FVoqY22sA Oct 11 07:19:21.757664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Oct 11 07:19:21.757664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Oct 11 07:19:21.757664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Oct 11 07:19:21.757664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Oct 11 07:19:21.757664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 07:19:21.757664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Oct 11 07:19:21.757664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Oct 11 07:19:21.757664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Id: ec4a4c53c1c744688b3bf91e806286bf Oct 11 07:19:21.757664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-262463267 Oct 11 07:19:21.757664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Role: reader,member Oct 11 07:19:21.757664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Oct 11 07:19:21.759172 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ec4a4c53c1c744688b3bf91e806286bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ec4a4c53c1c744688b3bf91e806286bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ec4a4c53c1c744688b3bf91e806286bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ec4a4c53c1c744688b3bf91e806286bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 07:19:21.759172 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-AttachVolumeShelveTestJSON-262463267 Oct 11 07:19:21.759172 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Id: ec4a4c53c1c744688b3bf91e806286bf Oct 11 07:19:21.759172 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-262463267 Oct 11 07:19:21.759172 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User: tempest-AttachVolumeShelveTestJSON-262463267-project Oct 11 07:19:21.759172 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Oct 11 07:19:21.759172 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Oct 11 07:19:21.759172 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Id: f95c1cd09e1042abbb5725f241ce147d Oct 11 07:19:21.759172 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-AttachVolumeShelveTestJSON-262463267-project Oct 11 07:19:21.759172 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: method: > Oct 11 07:19:21.759172 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: exception: Instance 43d48211-8dab-4abd-8c95-e850b83382ff could not be found. Oct 11 07:19:21.759172 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: action_args: {'id': '43d48211-8dab-4abd-8c95-e850b83382ff'} Oct 11 07:19:21.759892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 07:19:21.759892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:21.759892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 07:19:21.759892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 07:19:21.759892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 07:19:21.759892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 07:19:21.759892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 07:19:21.759892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 07:19:21.759892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 07:19:21.759892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 07:19:21.759892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43d48211-8dab-4abd-8c95-e850b83382ff could not be found. Oct 11 07:19:21.759892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:21.759892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:19:21.759892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:21.759892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:21.759892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:19:21.759892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:19:21.759892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 07:19:21.759892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 07:19:21.759892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 07:19:21.761170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 07:19:21.761170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 07:19:21.761170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 07:19:21.761170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 07:19:21.761170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 07:19:21.761170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 07:19:21.761170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 07:19:21.761170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43d48211-8dab-4abd-8c95-e850b83382ff could not be found. Oct 11 07:19:21.761170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:21.761170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:19:21.761170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:21.761170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:21.761170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:19:21.761170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:19:21.761170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 07:19:21.761170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 07:19:21.761170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43d48211-8dab-4abd-8c95-e850b83382ff could not be found. Oct 11 07:19:21.761170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:21.762354 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-14793bb7-dad9-4b2f-87c5-baedc5103f39 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] Returning 404 to user: Instance 43d48211-8dab-4abd-8c95-e850b83382ff could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 07:19:21.762354 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-14793bb7-dad9-4b2f-87c5-baedc5103f39 tempest-AttachVolumeShelveTestJSON-262463267 tempest-AttachVolumeShelveTestJSON-262463267-project] 10.222.0.39 "GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff" status: 404 len: 111 microversion: 2.20 time: 0.033050 Oct 11 07:19:21.762354 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1700/3396] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Oct 11 07:19:21 2022] GET /compute/v2.1/servers/43d48211-8dab-4abd-8c95-e850b83382ff => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 11 07:19:21.810729 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-6db04e56-8707-4b7c-ba76-847f5349167a req-1154226b-7b49-46c3-b3d2-358b345d8395 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fde741d-e09c-4bfb-93de-7554e07ae0a5", "name": "network-vif-plugged", "status": "completed", "tag": "71634763-1cc7-402d-b94e-dc4268009170"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:19:21.824468 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-6db04e56-8707-4b7c-ba76-847f5349167a req-1154226b-7b49-46c3-b3d2-358b345d8395 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:21.835690 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-6db04e56-8707-4b7c-ba76-847f5349167a req-1154226b-7b49-46c3-b3d2-358b345d8395 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:21.836267 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-6db04e56-8707-4b7c-ba76-847f5349167a req-1154226b-7b49-46c3-b3d2-358b345d8395 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:21.848292 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-6db04e56-8707-4b7c-ba76-847f5349167a req-1154226b-7b49-46c3-b3d2-358b345d8395 service nova] Creating event network-vif-plugged:71634763-1cc7-402d-b94e-dc4268009170 for instance 5fde741d-e09c-4bfb-93de-7554e07ae0a5 on hv-cinder-85495 Oct 11 07:19:21.853637 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-6db04e56-8707-4b7c-ba76-847f5349167a req-1154226b-7b49-46c3-b3d2-358b345d8395 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051223 Oct 11 07:19:21.854608 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1697/3397] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:19:21.937771 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ba537113-c6f0-46dd-b264-6a9a0af9ac79 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:21.938322 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ba537113-c6f0-46dd-b264-6a9a0af9ac79 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 5fde741d-e09c-4bfb-93de-7554e07ae0a5] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:19:21.944808 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ba537113-c6f0-46dd-b264-6a9a0af9ac79 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:21.945281 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ba537113-c6f0-46dd-b264-6a9a0af9ac79 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:21.945716 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ba537113-c6f0-46dd-b264-6a9a0af9ac79 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:21.946409 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ba537113-c6f0-46dd-b264-6a9a0af9ac79 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:21.946856 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ba537113-c6f0-46dd-b264-6a9a0af9ac79 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:21.947277 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ba537113-c6f0-46dd-b264-6a9a0af9ac79 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:22.190619 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f1247f3b-c223-4a67-8c7a-d94623f9c56d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:22.191767 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f1247f3b-c223-4a67-8c7a-d94623f9c56d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:19:22.199094 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f1247f3b-c223-4a67-8c7a-d94623f9c56d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:22.199774 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f1247f3b-c223-4a67-8c7a-d94623f9c56d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:22.200210 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f1247f3b-c223-4a67-8c7a-d94623f9c56d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:22.200948 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f1247f3b-c223-4a67-8c7a-d94623f9c56d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:22.201401 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f1247f3b-c223-4a67-8c7a-d94623f9c56d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:22.201830 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f1247f3b-c223-4a67-8c7a-d94623f9c56d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:22.215954 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-f1247f3b-c223-4a67-8c7a-d94623f9c56d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] HTTP exception thrown: Instance a2ce136a-30ab-4986-931e-5af38b37875e could not be found. Oct 11 07:19:22.217671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f1247f3b-c223-4a67-8c7a-d94623f9c56d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Request method failure captured: Oct 11 07:19:22.217671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: request: DELETE /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e HTTP/1.1 Oct 11 07:19:22.217671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept: application/json Oct 11 07:19:22.217671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Oct 11 07:19:22.217671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Connection: close Oct 11 07:19:22.217671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Length: 0 Oct 11 07:19:22.217671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Type: application/json Oct 11 07:19:22.217671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Host: 10.222.0.39 Oct 11 07:19:22.217671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Oct 11 07:19:22.217671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.12 Oct 11 07:19:22.217671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABjRRAxy4G3-Dozw6PdtI-WxnLtOJo2tV5OYxcxBy_217a4UmcYLPs6ReKc-RB_X0BHPCFHNcEeuRkAY-tzsCezmhAkP9Vj61rIl09eudAdIM1Me8KUnbI8OUgzhSO-abAb7LBVYvrD1IB-9qK1fM9G-MUZhv8Y32eWPbrO9FZ3pwby7Y8 Oct 11 07:19:22.217671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Oct 11 07:19:22.217671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Oct 11 07:19:22.217671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Oct 11 07:19:22.217671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Oct 11 07:19:22.217671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Oct 11 07:19:22.217671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Oct 11 07:19:22.217671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Id: 5af47e2321de4d299ff3a7fb3d3d9e3c Oct 11 07:19:22.217671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-AttachVolumeNegativeTest-1386971692 Oct 11 07:19:22.217671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Role: reader,member Oct 11 07:19:22.217671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Oct 11 07:19:22.219126 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 07:19:22.219126 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-AttachVolumeNegativeTest-1386971692 Oct 11 07:19:22.219126 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 5af47e2321de4d299ff3a7fb3d3d9e3c Oct 11 07:19:22.219126 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1386971692 Oct 11 07:19:22.219126 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User: tempest-AttachVolumeNegativeTest-1386971692-project Oct 11 07:19:22.219126 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Oct 11 07:19:22.219126 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Oct 11 07:19:22.219126 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Id: 2e63c3f83f3d41018e6330f26ed7b8a0 Oct 11 07:19:22.219126 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-AttachVolumeNegativeTest-1386971692-project Oct 11 07:19:22.219126 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: method: > Oct 11 07:19:22.219126 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: exception: Instance a2ce136a-30ab-4986-931e-5af38b37875e could not be found. Oct 11 07:19:22.219126 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: action_args: {'id': 'a2ce136a-30ab-4986-931e-5af38b37875e'} Oct 11 07:19:22.219890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 07:19:22.219890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:22.219890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 07:19:22.219890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 07:19:22.219890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 07:19:22.219890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 07:19:22.219890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 07:19:22.219890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 07:19:22.219890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 07:19:22.219890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 07:19:22.219890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2ce136a-30ab-4986-931e-5af38b37875e could not be found. Oct 11 07:19:22.219890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:22.219890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:19:22.219890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:22.219890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:22.219890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:19:22.219890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:19:22.219890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 07:19:22.219890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 07:19:22.219890 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 07:19:22.220922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 07:19:22.220922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 07:19:22.220922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 07:19:22.220922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 07:19:22.220922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 07:19:22.220922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 07:19:22.220922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 07:19:22.220922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 07:19:22.220922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 07:19:22.220922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2ce136a-30ab-4986-931e-5af38b37875e could not be found. Oct 11 07:19:22.220922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:22.220922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:19:22.220922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:22.220922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:22.220922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:19:22.220922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:19:22.220922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 07:19:22.220922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 07:19:22.220922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2ce136a-30ab-4986-931e-5af38b37875e could not be found. Oct 11 07:19:22.220922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:22.221936 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f1247f3b-c223-4a67-8c7a-d94623f9c56d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Returning 404 to user: Instance a2ce136a-30ab-4986-931e-5af38b37875e could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 07:19:22.221936 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f1247f3b-c223-4a67-8c7a-d94623f9c56d tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 404 len: 111 microversion: 2.1 time: 0.033325 Oct 11 07:19:22.221936 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1698/3398] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Oct 11 07:19:22 2022] DELETE /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 07:19:22.227776 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-30157572-910c-4268-8912-0d994f2f41fb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:22.228382 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-30157572-910c-4268-8912-0d994f2f41fb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] [instance: a2ce136a-30ab-4986-931e-5af38b37875e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:19:22.234409 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30157572-910c-4268-8912-0d994f2f41fb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:22.234883 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30157572-910c-4268-8912-0d994f2f41fb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:22.235311 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30157572-910c-4268-8912-0d994f2f41fb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:22.236094 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30157572-910c-4268-8912-0d994f2f41fb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:22.236546 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30157572-910c-4268-8912-0d994f2f41fb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:22.236962 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30157572-910c-4268-8912-0d994f2f41fb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:22.251843 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-30157572-910c-4268-8912-0d994f2f41fb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] HTTP exception thrown: Instance a2ce136a-30ab-4986-931e-5af38b37875e could not be found. Oct 11 07:19:22.253395 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-30157572-910c-4268-8912-0d994f2f41fb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Request method failure captured: Oct 11 07:19:22.253395 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: request: GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e HTTP/1.1 Oct 11 07:19:22.253395 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept: application/json Oct 11 07:19:22.253395 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Oct 11 07:19:22.253395 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Connection: close Oct 11 07:19:22.253395 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Length: 0 Oct 11 07:19:22.253395 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Type: application/json Oct 11 07:19:22.253395 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Host: 10.222.0.39 Oct 11 07:19:22.253395 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Oct 11 07:19:22.253395 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.12 Oct 11 07:19:22.253395 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABjRRAxy4G3-Dozw6PdtI-WxnLtOJo2tV5OYxcxBy_217a4UmcYLPs6ReKc-RB_X0BHPCFHNcEeuRkAY-tzsCezmhAkP9Vj61rIl09eudAdIM1Me8KUnbI8OUgzhSO-abAb7LBVYvrD1IB-9qK1fM9G-MUZhv8Y32eWPbrO9FZ3pwby7Y8 Oct 11 07:19:22.253395 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Oct 11 07:19:22.253395 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Oct 11 07:19:22.253395 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Oct 11 07:19:22.253395 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Oct 11 07:19:22.253395 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Oct 11 07:19:22.253395 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Oct 11 07:19:22.253395 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Id: 5af47e2321de4d299ff3a7fb3d3d9e3c Oct 11 07:19:22.253395 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-AttachVolumeNegativeTest-1386971692 Oct 11 07:19:22.253395 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Role: reader,member Oct 11 07:19:22.253395 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Oct 11 07:19:22.254750 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5af47e2321de4d299ff3a7fb3d3d9e3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 07:19:22.254750 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-AttachVolumeNegativeTest-1386971692 Oct 11 07:19:22.254750 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 5af47e2321de4d299ff3a7fb3d3d9e3c Oct 11 07:19:22.254750 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1386971692 Oct 11 07:19:22.254750 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User: tempest-AttachVolumeNegativeTest-1386971692-project Oct 11 07:19:22.254750 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Oct 11 07:19:22.254750 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Oct 11 07:19:22.254750 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Id: 2e63c3f83f3d41018e6330f26ed7b8a0 Oct 11 07:19:22.254750 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-AttachVolumeNegativeTest-1386971692-project Oct 11 07:19:22.254750 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: method: > Oct 11 07:19:22.254750 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: exception: Instance a2ce136a-30ab-4986-931e-5af38b37875e could not be found. Oct 11 07:19:22.254750 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: action_args: {'id': 'a2ce136a-30ab-4986-931e-5af38b37875e'} Oct 11 07:19:22.255561 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 07:19:22.255561 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:22.255561 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 07:19:22.255561 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 07:19:22.255561 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 07:19:22.255561 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 07:19:22.255561 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 07:19:22.255561 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 07:19:22.255561 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 07:19:22.255561 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 07:19:22.255561 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2ce136a-30ab-4986-931e-5af38b37875e could not be found. Oct 11 07:19:22.255561 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:22.255561 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:19:22.255561 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:22.255561 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:22.255561 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:19:22.255561 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:19:22.255561 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 07:19:22.255561 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 07:19:22.255561 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 07:19:22.256854 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 07:19:22.256854 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 07:19:22.256854 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 07:19:22.256854 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 07:19:22.256854 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 07:19:22.256854 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 07:19:22.256854 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 07:19:22.256854 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2ce136a-30ab-4986-931e-5af38b37875e could not be found. Oct 11 07:19:22.256854 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:22.256854 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:19:22.256854 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:22.256854 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:22.256854 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:19:22.256854 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:19:22.256854 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 07:19:22.256854 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 07:19:22.256854 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2ce136a-30ab-4986-931e-5af38b37875e could not be found. Oct 11 07:19:22.256854 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:22.258089 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-30157572-910c-4268-8912-0d994f2f41fb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] Returning 404 to user: Instance a2ce136a-30ab-4986-931e-5af38b37875e could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 07:19:22.258089 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-30157572-910c-4268-8912-0d994f2f41fb tempest-AttachVolumeNegativeTest-1386971692 tempest-AttachVolumeNegativeTest-1386971692-project] 10.222.0.39 "GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e" status: 404 len: 111 microversion: 2.1 time: 0.031233 Oct 11 07:19:22.259354 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1699/3399] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:19:22 2022] GET /compute/v2.1/servers/a2ce136a-30ab-4986-931e-5af38b37875e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 07:19:22.626655 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ba537113-c6f0-46dd-b264-6a9a0af9ac79 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:19:22.634701 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ba537113-c6f0-46dd-b264-6a9a0af9ac79 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5" status: 200 len: 1265 microversion: 2.1 time: 0.701631 Oct 11 07:19:22.635253 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1701/3400] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:19:21 2022] GET /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5 => generated 1265 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:19:23.657729 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-5856f7df-7a26-4eaf-91f6-d30a5284efdb tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:23.658339 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-5856f7df-7a26-4eaf-91f6-d30a5284efdb tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 5fde741d-e09c-4bfb-93de-7554e07ae0a5] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:19:23.665733 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5856f7df-7a26-4eaf-91f6-d30a5284efdb tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:23.665958 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5856f7df-7a26-4eaf-91f6-d30a5284efdb tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:23.666578 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5856f7df-7a26-4eaf-91f6-d30a5284efdb tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:23.668733 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5856f7df-7a26-4eaf-91f6-d30a5284efdb tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:23.669374 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5856f7df-7a26-4eaf-91f6-d30a5284efdb tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:23.670122 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-5856f7df-7a26-4eaf-91f6-d30a5284efdb tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:23.919988 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-5856f7df-7a26-4eaf-91f6-d30a5284efdb tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:19:23.931339 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-5856f7df-7a26-4eaf-91f6-d30a5284efdb tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5" status: 200 len: 1452 microversion: 2.1 time: 0.277413 Oct 11 07:19:23.943205 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1700/3401] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:19:23 2022] GET /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5 => generated 1452 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:19:23.961892 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b47f77af-aade-4602-a4a3-fb4ae45f55ac tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:23.962875 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b47f77af-aade-4602-a4a3-fb4ae45f55ac tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 5fde741d-e09c-4bfb-93de-7554e07ae0a5] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:19:23.979167 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b47f77af-aade-4602-a4a3-fb4ae45f55ac tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:23.980848 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b47f77af-aade-4602-a4a3-fb4ae45f55ac tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:23.981306 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b47f77af-aade-4602-a4a3-fb4ae45f55ac tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:23.982225 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b47f77af-aade-4602-a4a3-fb4ae45f55ac tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:23.982678 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b47f77af-aade-4602-a4a3-fb4ae45f55ac tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:23.983106 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b47f77af-aade-4602-a4a3-fb4ae45f55ac tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:24.290131 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-b47f77af-aade-4602-a4a3-fb4ae45f55ac tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:19:24.301306 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b47f77af-aade-4602-a4a3-fb4ae45f55ac tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5" status: 200 len: 1452 microversion: 2.1 time: 0.350194 Oct 11 07:19:24.314481 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1702/3402] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:19:23 2022] GET /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5 => generated 1452 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:19:27.641799 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-55fc85a8-2cbb-46e8-8e36-c80e6e06ff8c req-6dba0bab-84d0-4281-bc1a-f8db7fdaef0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fde741d-e09c-4bfb-93de-7554e07ae0a5", "tag": "71634763-1cc7-402d-b94e-dc4268009170"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:19:27.652905 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-55fc85a8-2cbb-46e8-8e36-c80e6e06ff8c req-6dba0bab-84d0-4281-bc1a-f8db7fdaef0c service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:19:27.653384 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-55fc85a8-2cbb-46e8-8e36-c80e6e06ff8c req-6dba0bab-84d0-4281-bc1a-f8db7fdaef0c service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:19:27.653813 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-55fc85a8-2cbb-46e8-8e36-c80e6e06ff8c req-6dba0bab-84d0-4281-bc1a-f8db7fdaef0c service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:19:27.670075 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-55fc85a8-2cbb-46e8-8e36-c80e6e06ff8c req-6dba0bab-84d0-4281-bc1a-f8db7fdaef0c service nova] Creating event network-changed:71634763-1cc7-402d-b94e-dc4268009170 for instance 5fde741d-e09c-4bfb-93de-7554e07ae0a5 on hv-cinder-85495 Oct 11 07:19:27.675302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-55fc85a8-2cbb-46e8-8e36-c80e6e06ff8c req-6dba0bab-84d0-4281-bc1a-f8db7fdaef0c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037297 Oct 11 07:19:27.676302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1701/3403] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:19:28.962262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-875eb81c-c6f2-4714-aafc-6bdf537e16d6 tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] Action: 'create', calling method: .version_select at 0x7f8e2a482a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-852823383"}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:19:29.249726 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-875eb81c-c6f2-4714-aafc-6bdf537e16d6 tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.425157 Oct 11 07:19:29.250365 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1703/3404] 10.222.0.39 () {60 vars in 1155 bytes} [Tue Oct 11 07:19:28 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 427 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 11 07:19:29.264088 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c030b5ee-8e96-4737-9f9a-7b19ff842c12 tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] Calling method '.version_select at 0x7f8e2a48ab80>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:29.314279 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c030b5ee-8e96-4737-9f9a-7b19ff842c12 tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/37878bfc-f188-4806-bda8-07b64a68f352" status: 200 len: 344 microversion: 2.1 time: 0.054695 Oct 11 07:19:29.314849 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1702/3405] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Oct 11 07:19:29 2022] GET /compute/v2.1/os-volumes/37878bfc-f188-4806-bda8-07b64a68f352 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:19:30.329265 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-37b0c49e-ee8c-4ff5-87cb-3a80cc0794bc tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] Calling method '.version_select at 0x7f8e2a42b670>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:30.376914 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-37b0c49e-ee8c-4ff5-87cb-3a80cc0794bc tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/37878bfc-f188-4806-bda8-07b64a68f352" status: 200 len: 345 microversion: 2.1 time: 0.051738 Oct 11 07:19:30.377561 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1704/3406] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Oct 11 07:19:30 2022] GET /compute/v2.1/os-volumes/37878bfc-f188-4806-bda8-07b64a68f352 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:19:30.390656 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ca4efa7d-7aff-4a06-9566-d96a5406319d tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] Action: 'create', calling method: .version_select at 0x7f8e2a4e73a0>, body: {"snapshot": {"volume_id": "37878bfc-f188-4806-bda8-07b64a68f352", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1215230293"}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:19:30.557534 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ca4efa7d-7aff-4a06-9566-d96a5406319d tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] 10.222.0.39 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.170990 Oct 11 07:19:30.558051 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1703/3407] 10.222.0.39 () {60 vars in 1162 bytes} [Tue Oct 11 07:19:30 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:19:30.569463 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-947107a3-d2c4-443f-8ddd-14d142ddccc8 tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] Calling method '.version_select at 0x7f8e2a572160>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:30.601080 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-947107a3-d2c4-443f-8ddd-14d142ddccc8 tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/f687ec63-ad68-49c2-b36a-483ffededc76" status: 200 len: 287 microversion: 2.1 time: 0.035656 Oct 11 07:19:30.601688 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1705/3408] 10.222.0.39 () {58 vars in 1251 bytes} [Tue Oct 11 07:19:30 2022] GET /compute/v2.1/os-snapshots/f687ec63-ad68-49c2-b36a-483ffededc76 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:19:30.613536 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f262e2c7-6d31-44e2-8aa8-affbfb03c690 tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] Calling method '.version_select at 0x7f8e2a4e7940>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:30.644516 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f262e2c7-6d31-44e2-8aa8-affbfb03c690 tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.035912 Oct 11 07:19:30.645068 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1704/3409] 10.222.0.39 () {58 vars in 1140 bytes} [Tue Oct 11 07:19:30 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:19:30.656038 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c391c4f8-33c3-42c1-b96b-16a4a44cb7c4 tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] Calling method '.version_select at 0x7f8e2a482b80>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:30.685603 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c391c4f8-33c3-42c1-b96b-16a4a44cb7c4 tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/f687ec63-ad68-49c2-b36a-483ffededc76" status: 200 len: 287 microversion: 2.1 time: 0.033342 Oct 11 07:19:30.686150 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1706/3410] 10.222.0.39 () {58 vars in 1251 bytes} [Tue Oct 11 07:19:30 2022] GET /compute/v2.1/os-snapshots/f687ec63-ad68-49c2-b36a-483ffededc76 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:19:31.698909 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-11054310-3cec-4a8d-8df6-61d4177aa65b tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] Calling method '.version_select at 0x7f8e2a478790>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:31.729176 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-11054310-3cec-4a8d-8df6-61d4177aa65b tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/f687ec63-ad68-49c2-b36a-483ffededc76" status: 200 len: 287 microversion: 2.1 time: 0.034373 Oct 11 07:19:31.729738 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1705/3411] 10.222.0.39 () {58 vars in 1251 bytes} [Tue Oct 11 07:19:31 2022] GET /compute/v2.1/os-snapshots/f687ec63-ad68-49c2-b36a-483ffededc76 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:19:32.744331 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-be115c0d-86d0-4f64-ab70-f89d6ae2de6b tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] Calling method '.version_select at 0x7f8e2a4b00d0>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:32.778909 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-be115c0d-86d0-4f64-ab70-f89d6ae2de6b tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/f687ec63-ad68-49c2-b36a-483ffededc76" status: 200 len: 287 microversion: 2.1 time: 0.040257 Oct 11 07:19:32.779921 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1707/3412] 10.222.0.39 () {58 vars in 1251 bytes} [Tue Oct 11 07:19:32 2022] GET /compute/v2.1/os-snapshots/f687ec63-ad68-49c2-b36a-483ffededc76 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:19:33.792018 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8575eaf6-2ed2-49a7-a451-b7fa424e5bf4 tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] Calling method '.version_select at 0x7f8e26d165e0>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:33.826149 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8575eaf6-2ed2-49a7-a451-b7fa424e5bf4 tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/f687ec63-ad68-49c2-b36a-483ffededc76" status: 200 len: 288 microversion: 2.1 time: 0.038439 Oct 11 07:19:33.826710 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1706/3413] 10.222.0.39 () {58 vars in 1251 bytes} [Tue Oct 11 07:19:33 2022] GET /compute/v2.1/os-snapshots/f687ec63-ad68-49c2-b36a-483ffededc76 => generated 288 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:19:33.837908 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ac9bdbd6-454a-44d8-aed2-c4a500a03470 tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] Calling method '.version_select at 0x7f8e2a482e50>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:33.897831 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ac9bdbd6-454a-44d8-aed2-c4a500a03470 tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] 10.222.0.39 "DELETE /compute/v2.1/os-snapshots/f687ec63-ad68-49c2-b36a-483ffededc76" status: 202 len: 0 microversion: 2.1 time: 0.064020 Oct 11 07:19:33.898419 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1708/3414] 10.222.0.39 () {58 vars in 1254 bytes} [Tue Oct 11 07:19:33 2022] DELETE /compute/v2.1/os-snapshots/f687ec63-ad68-49c2-b36a-483ffededc76 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 07:19:33.906663 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-682f442c-6975-4eb7-93c5-4071afc772b6 tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] Calling method '.version_select at 0x7f8e2a478670>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:33.936280 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-682f442c-6975-4eb7-93c5-4071afc772b6 tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/f687ec63-ad68-49c2-b36a-483ffededc76" status: 200 len: 287 microversion: 2.1 time: 0.033313 Oct 11 07:19:33.936871 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1707/3415] 10.222.0.39 () {58 vars in 1251 bytes} [Tue Oct 11 07:19:33 2022] GET /compute/v2.1/os-snapshots/f687ec63-ad68-49c2-b36a-483ffededc76 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:19:34.946169 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:19:34.947123 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:19:34.952122 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-abd9f034-a8dd-46f4-8368-8deac5e7d418 tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] Calling method '.version_select at 0x7f8e2a4db280>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:34.981794 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-abd9f034-a8dd-46f4-8368-8deac5e7d418 tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] HTTP exception thrown: Snapshot f687ec63-ad68-49c2-b36a-483ffededc76 could not be found. Oct 11 07:19:34.984423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-abd9f034-a8dd-46f4-8368-8deac5e7d418 tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] Request method failure captured: Oct 11 07:19:34.984423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: request: GET /compute/v2.1/os-snapshots/f687ec63-ad68-49c2-b36a-483ffededc76 HTTP/1.1 Oct 11 07:19:34.984423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept: application/json Oct 11 07:19:34.984423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Oct 11 07:19:34.984423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Connection: close Oct 11 07:19:34.984423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Length: 0 Oct 11 07:19:34.984423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Type: application/json Oct 11 07:19:34.984423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Host: 10.222.0.39 Oct 11 07:19:34.984423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Oct 11 07:19:34.984423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.12 Oct 11 07:19:34.984423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABjRRkAy8MxvxmMFbf1h44t5rXQX5eteO5w4EQ6-YsFlGbzsEcl9E1avfdB9jRttFFc0FpJvG9suB3coH7OD08mb257J0oJGS806inKwqd2FUNEiJwUtiXeLs4Y0isnQHH_LZeKxpDpelxzbCCK1Zdi4hTX1KNmxnawz0Fuwra5zgKmynQ Oct 11 07:19:34.984423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Oct 11 07:19:34.984423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Oct 11 07:19:34.984423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Oct 11 07:19:34.984423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Oct 11 07:19:34.984423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Oct 11 07:19:34.984423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Oct 11 07:19:34.984423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Id: 2445c31c35bb442493befe50f68724bf Oct 11 07:19:34.984423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1324442222 Oct 11 07:19:34.984423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Role: reader,member Oct 11 07:19:34.984423 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Oct 11 07:19:34.985826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2445c31c35bb442493befe50f68724bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2445c31c35bb442493befe50f68724bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2445c31c35bb442493befe50f68724bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2445c31c35bb442493befe50f68724bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 07:19:34.985826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1324442222 Oct 11 07:19:34.985826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 2445c31c35bb442493befe50f68724bf Oct 11 07:19:34.985826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1324442222 Oct 11 07:19:34.985826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User: tempest-VolumesSnapshotsTestJSON-1324442222-project Oct 11 07:19:34.985826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Oct 11 07:19:34.985826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Oct 11 07:19:34.985826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Id: b1a04fc5bdf6407580c598b494a68d6f Oct 11 07:19:34.985826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1324442222-project Oct 11 07:19:34.985826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: method: Oct 11 07:19:34.985826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: exception: Snapshot f687ec63-ad68-49c2-b36a-483ffededc76 could not be found. Oct 11 07:19:34.985826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: action_args: {'id': 'f687ec63-ad68-49c2-b36a-483ffededc76'} Oct 11 07:19:34.985826 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 07:19:34.986715 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:34.986715 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 11 07:19:34.986715 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 11 07:19:34.986715 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 11 07:19:34.986715 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 11 07:19:34.986715 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 11 07:19:34.986715 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 11 07:19:34.986715 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 07:19:34.986715 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 07:19:34.986715 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 07:19:34.986715 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 07:19:34.986715 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 07:19:34.986715 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 07:19:34.986715 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 07:19:34.986715 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 07:19:34.986715 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f687ec63-ad68-49c2-b36a-483ffededc76 could not be found. (HTTP 404) (Request-ID: req-4e542b98-17de-4130-9bed-828be05a6441) Oct 11 07:19:34.986715 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:34.986715 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:19:34.988234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:34.988234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:34.988234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 11 07:19:34.988234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 11 07:19:34.988234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 07:19:34.988234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 07:19:34.988234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 11 07:19:34.988234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 11 07:19:34.988234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 07:19:34.988234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 07:19:34.988234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 11 07:19:34.988234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 11 07:19:34.988234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 11 07:19:34.988234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 11 07:19:34.988234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 11 07:19:34.988234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 11 07:19:34.988234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 07:19:34.988234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 07:19:34.988234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 07:19:34.990067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 07:19:34.990067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 07:19:34.990067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 07:19:34.990067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 07:19:34.990067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 07:19:34.990067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f687ec63-ad68-49c2-b36a-483ffededc76 could not be found. Oct 11 07:19:34.990067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:34.990067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:19:34.990067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:34.990067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:34.990067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:19:34.990067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:19:34.990067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 07:19:34.990067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 07:19:34.990067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 07:19:34.990067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 07:19:34.990067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 07:19:34.990067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 07:19:34.990067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 11 07:19:34.990067 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 07:19:34.991374 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f687ec63-ad68-49c2-b36a-483ffededc76 could not be found. Oct 11 07:19:34.991374 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:34.991374 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:19:34.991374 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:34.991374 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:34.991374 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:19:34.991374 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:19:34.991374 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 07:19:34.991374 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 07:19:34.991374 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f687ec63-ad68-49c2-b36a-483ffededc76 could not be found. Oct 11 07:19:34.991374 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:34.991374 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-abd9f034-a8dd-46f4-8368-8deac5e7d418 tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] Returning 404 to user: Snapshot f687ec63-ad68-49c2-b36a-483ffededc76 could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 07:19:34.991374 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-abd9f034-a8dd-46f4-8368-8deac5e7d418 tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/f687ec63-ad68-49c2-b36a-483ffededc76" status: 404 len: 111 microversion: 2.1 time: 0.040054 Oct 11 07:19:34.992362 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1709/3416] 10.222.0.39 () {58 vars in 1251 bytes} [Tue Oct 11 07:19:34 2022] GET /compute/v2.1/os-snapshots/f687ec63-ad68-49c2-b36a-483ffededc76 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 07:19:34.994871 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cfc3544d-92a9-4886-ac86-751b5bea6575 tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] Calling method '.version_select at 0x7f8e2a48a0d0>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:35.059671 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cfc3544d-92a9-4886-ac86-751b5bea6575 tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/37878bfc-f188-4806-bda8-07b64a68f352" status: 202 len: 0 microversion: 2.1 time: 0.068877 Oct 11 07:19:35.060234 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1708/3417] 10.222.0.39 () {58 vars in 1248 bytes} [Tue Oct 11 07:19:34 2022] DELETE /compute/v2.1/os-volumes/37878bfc-f188-4806-bda8-07b64a68f352 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 07:19:35.068894 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b235b6ac-9496-42d1-9f5f-f9ac11b6b67c tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] Calling method '.version_select at 0x7f8e2a482430>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:35.120297 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b235b6ac-9496-42d1-9f5f-f9ac11b6b67c tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/37878bfc-f188-4806-bda8-07b64a68f352" status: 200 len: 344 microversion: 2.1 time: 0.055745 Oct 11 07:19:35.120854 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1710/3418] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Oct 11 07:19:35 2022] GET /compute/v2.1/os-volumes/37878bfc-f188-4806-bda8-07b64a68f352 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:19:36.134267 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8a7e83dd-95a0-487a-8add-1ce8a7950ee8 tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] Calling method '.version_select at 0x7f8e2a4e7280>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:36.164084 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-8a7e83dd-95a0-487a-8add-1ce8a7950ee8 tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] HTTP exception thrown: Volume 37878bfc-f188-4806-bda8-07b64a68f352 could not be found. Oct 11 07:19:36.166165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8a7e83dd-95a0-487a-8add-1ce8a7950ee8 tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] Request method failure captured: Oct 11 07:19:36.166165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: request: GET /compute/v2.1/os-volumes/37878bfc-f188-4806-bda8-07b64a68f352 HTTP/1.1 Oct 11 07:19:36.166165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept: application/json Oct 11 07:19:36.166165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Oct 11 07:19:36.166165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Connection: close Oct 11 07:19:36.166165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Length: 0 Oct 11 07:19:36.166165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Type: application/json Oct 11 07:19:36.166165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Host: 10.222.0.39 Oct 11 07:19:36.166165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Oct 11 07:19:36.166165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.12 Oct 11 07:19:36.166165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABjRRkAy8MxvxmMFbf1h44t5rXQX5eteO5w4EQ6-YsFlGbzsEcl9E1avfdB9jRttFFc0FpJvG9suB3coH7OD08mb257J0oJGS806inKwqd2FUNEiJwUtiXeLs4Y0isnQHH_LZeKxpDpelxzbCCK1Zdi4hTX1KNmxnawz0Fuwra5zgKmynQ Oct 11 07:19:36.166165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Oct 11 07:19:36.166165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Oct 11 07:19:36.166165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Oct 11 07:19:36.166165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Oct 11 07:19:36.166165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Oct 11 07:19:36.166165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Oct 11 07:19:36.166165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Id: 2445c31c35bb442493befe50f68724bf Oct 11 07:19:36.166165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1324442222 Oct 11 07:19:36.166165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Role: reader,member Oct 11 07:19:36.166165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Oct 11 07:19:36.167490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2445c31c35bb442493befe50f68724bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2445c31c35bb442493befe50f68724bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2445c31c35bb442493befe50f68724bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2445c31c35bb442493befe50f68724bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 07:19:36.167490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1324442222 Oct 11 07:19:36.167490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 2445c31c35bb442493befe50f68724bf Oct 11 07:19:36.167490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1324442222 Oct 11 07:19:36.167490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User: tempest-VolumesSnapshotsTestJSON-1324442222-project Oct 11 07:19:36.167490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Oct 11 07:19:36.167490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Oct 11 07:19:36.167490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Id: b1a04fc5bdf6407580c598b494a68d6f Oct 11 07:19:36.167490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1324442222-project Oct 11 07:19:36.167490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: method: Oct 11 07:19:36.167490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: exception: Volume 37878bfc-f188-4806-bda8-07b64a68f352 could not be found. Oct 11 07:19:36.167490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: action_args: {'id': '37878bfc-f188-4806-bda8-07b64a68f352'} Oct 11 07:19:36.167490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 07:19:36.168462 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:36.168462 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 07:19:36.168462 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 07:19:36.168462 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 07:19:36.168462 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 07:19:36.168462 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 07:19:36.168462 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 07:19:36.168462 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 07:19:36.168462 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 07:19:36.168462 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 07:19:36.168462 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 07:19:36.168462 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 07:19:36.168462 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 07:19:36.168462 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 07:19:36.168462 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 07:19:36.168462 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 37878bfc-f188-4806-bda8-07b64a68f352 could not be found. (HTTP 404) (Request-ID: req-31d3a3e7-3172-46ba-85f8-6021738a233f) Oct 11 07:19:36.168462 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:36.168462 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:19:36.168462 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:36.169893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:36.169893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 11 07:19:36.169893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 11 07:19:36.169893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 07:19:36.169893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 07:19:36.169893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 07:19:36.169893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 07:19:36.169893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 07:19:36.169893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 07:19:36.169893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 07:19:36.169893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 07:19:36.169893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 07:19:36.169893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 07:19:36.169893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 07:19:36.169893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 07:19:36.169893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 07:19:36.169893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 07:19:36.169893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 07:19:36.169893 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 07:19:36.171620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 07:19:36.171620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 07:19:36.171620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 07:19:36.171620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 07:19:36.171620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 37878bfc-f188-4806-bda8-07b64a68f352 could not be found. Oct 11 07:19:36.171620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:36.171620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:19:36.171620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:36.171620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:36.171620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:19:36.171620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:19:36.171620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 07:19:36.171620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 07:19:36.171620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 07:19:36.171620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 07:19:36.171620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 07:19:36.171620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 07:19:36.171620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 11 07:19:36.171620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 07:19:36.173534 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 37878bfc-f188-4806-bda8-07b64a68f352 could not be found. Oct 11 07:19:36.173534 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:36.173534 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:19:36.173534 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:36.173534 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:36.173534 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:19:36.173534 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:19:36.173534 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 07:19:36.173534 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 07:19:36.173534 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 37878bfc-f188-4806-bda8-07b64a68f352 could not be found. Oct 11 07:19:36.173534 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:36.173534 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-8a7e83dd-95a0-487a-8add-1ce8a7950ee8 tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] Returning 404 to user: Volume 37878bfc-f188-4806-bda8-07b64a68f352 could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 07:19:36.173534 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-8a7e83dd-95a0-487a-8add-1ce8a7950ee8 tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/37878bfc-f188-4806-bda8-07b64a68f352" status: 404 len: 109 microversion: 2.1 time: 0.037585 Oct 11 07:19:36.173534 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1709/3419] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Oct 11 07:19:36 2022] GET /compute/v2.1/os-volumes/37878bfc-f188-4806-bda8-07b64a68f352 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 07:19:36.181980 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6d9c45c9-a460-4c07-a867-89bd19bcb35f tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] Calling method '.version_select at 0x7f8e2a42ba60>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:36.211841 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-6d9c45c9-a460-4c07-a867-89bd19bcb35f tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] HTTP exception thrown: Volume 37878bfc-f188-4806-bda8-07b64a68f352 could not be found. Oct 11 07:19:36.213855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6d9c45c9-a460-4c07-a867-89bd19bcb35f tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] Request method failure captured: Oct 11 07:19:36.213855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: request: DELETE /compute/v2.1/os-volumes/37878bfc-f188-4806-bda8-07b64a68f352 HTTP/1.1 Oct 11 07:19:36.213855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept: application/json Oct 11 07:19:36.213855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Oct 11 07:19:36.213855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Connection: close Oct 11 07:19:36.213855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Length: 0 Oct 11 07:19:36.213855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Type: application/json Oct 11 07:19:36.213855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Host: 10.222.0.39 Oct 11 07:19:36.213855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Oct 11 07:19:36.213855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.12 Oct 11 07:19:36.213855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABjRRkAy8MxvxmMFbf1h44t5rXQX5eteO5w4EQ6-YsFlGbzsEcl9E1avfdB9jRttFFc0FpJvG9suB3coH7OD08mb257J0oJGS806inKwqd2FUNEiJwUtiXeLs4Y0isnQHH_LZeKxpDpelxzbCCK1Zdi4hTX1KNmxnawz0Fuwra5zgKmynQ Oct 11 07:19:36.213855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Oct 11 07:19:36.213855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Oct 11 07:19:36.213855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Oct 11 07:19:36.213855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Oct 11 07:19:36.213855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Oct 11 07:19:36.213855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Oct 11 07:19:36.213855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Id: 2445c31c35bb442493befe50f68724bf Oct 11 07:19:36.213855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1324442222 Oct 11 07:19:36.213855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Role: reader,member Oct 11 07:19:36.213855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Oct 11 07:19:36.215066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2445c31c35bb442493befe50f68724bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2445c31c35bb442493befe50f68724bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2445c31c35bb442493befe50f68724bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2445c31c35bb442493befe50f68724bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 07:19:36.215066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1324442222 Oct 11 07:19:36.215066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 2445c31c35bb442493befe50f68724bf Oct 11 07:19:36.215066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1324442222 Oct 11 07:19:36.215066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User: tempest-VolumesSnapshotsTestJSON-1324442222-project Oct 11 07:19:36.215066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Oct 11 07:19:36.215066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Oct 11 07:19:36.215066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Id: b1a04fc5bdf6407580c598b494a68d6f Oct 11 07:19:36.215066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1324442222-project Oct 11 07:19:36.215066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: method: Oct 11 07:19:36.215066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: exception: Volume 37878bfc-f188-4806-bda8-07b64a68f352 could not be found. Oct 11 07:19:36.215066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: action_args: {'id': '37878bfc-f188-4806-bda8-07b64a68f352'} Oct 11 07:19:36.215066 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 07:19:36.215788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:36.215788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 07:19:36.215788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 07:19:36.215788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 07:19:36.215788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 07:19:36.215788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 07:19:36.215788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 07:19:36.215788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 07:19:36.215788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 07:19:36.215788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 07:19:36.215788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 07:19:36.215788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 07:19:36.215788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 07:19:36.215788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 07:19:36.215788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 07:19:36.215788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 37878bfc-f188-4806-bda8-07b64a68f352 could not be found. (HTTP 404) (Request-ID: req-c9d088d5-a353-4cea-a0ef-496dd3f57fab) Oct 11 07:19:36.215788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:36.215788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:19:36.215788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:36.217420 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:36.217420 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 11 07:19:36.217420 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 11 07:19:36.217420 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 07:19:36.217420 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 07:19:36.217420 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 07:19:36.217420 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 07:19:36.217420 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 07:19:36.217420 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 07:19:36.217420 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 07:19:36.217420 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 07:19:36.217420 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 07:19:36.217420 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 07:19:36.217420 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 07:19:36.217420 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 07:19:36.217420 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 07:19:36.217420 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 07:19:36.217420 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 07:19:36.217420 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 07:19:36.218783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 07:19:36.218783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 07:19:36.218783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 07:19:36.218783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 07:19:36.218783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 37878bfc-f188-4806-bda8-07b64a68f352 could not be found. Oct 11 07:19:36.218783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:36.218783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:19:36.218783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:36.218783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:36.218783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:19:36.218783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:19:36.218783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 07:19:36.218783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 07:19:36.218783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 07:19:36.218783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 07:19:36.218783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 07:19:36.218783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 07:19:36.218783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 11 07:19:36.218783 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 07:19:36.220004 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 37878bfc-f188-4806-bda8-07b64a68f352 could not be found. Oct 11 07:19:36.220004 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:36.220004 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:19:36.220004 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:36.220004 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:36.220004 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:19:36.220004 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:19:36.220004 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 07:19:36.220004 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 07:19:36.220004 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 37878bfc-f188-4806-bda8-07b64a68f352 could not be found. Oct 11 07:19:36.220004 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:19:36.220004 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6d9c45c9-a460-4c07-a867-89bd19bcb35f tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] Returning 404 to user: Volume 37878bfc-f188-4806-bda8-07b64a68f352 could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 07:19:36.220004 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6d9c45c9-a460-4c07-a867-89bd19bcb35f tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/37878bfc-f188-4806-bda8-07b64a68f352" status: 404 len: 109 microversion: 2.1 time: 0.037504 Oct 11 07:19:36.220926 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1711/3420] 10.222.0.39 () {58 vars in 1248 bytes} [Tue Oct 11 07:19:36 2022] DELETE /compute/v2.1/os-volumes/37878bfc-f188-4806-bda8-07b64a68f352 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 07:19:36.224141 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c1df043c-4387-42cf-82e5-451978989ee3 tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] Calling method '.version_select at 0x7f8e27a634c0>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:19:36.251591 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-c1df043c-4387-42cf-82e5-451978989ee3 tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] HTTP exception thrown: Volume 37878bfc-f188-4806-bda8-07b64a68f352 could not be found. Oct 11 07:19:36.253544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c1df043c-4387-42cf-82e5-451978989ee3 tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] Request method failure captured: Oct 11 07:19:36.253544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: request: GET /compute/v2.1/os-volumes/37878bfc-f188-4806-bda8-07b64a68f352 HTTP/1.1 Oct 11 07:19:36.253544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept: application/json Oct 11 07:19:36.253544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Oct 11 07:19:36.253544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Connection: close Oct 11 07:19:36.253544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Length: 0 Oct 11 07:19:36.253544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Type: application/json Oct 11 07:19:36.253544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Host: 10.222.0.39 Oct 11 07:19:36.253544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Oct 11 07:19:36.253544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.12 Oct 11 07:19:36.253544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABjRRkAy8MxvxmMFbf1h44t5rXQX5eteO5w4EQ6-YsFlGbzsEcl9E1avfdB9jRttFFc0FpJvG9suB3coH7OD08mb257J0oJGS806inKwqd2FUNEiJwUtiXeLs4Y0isnQHH_LZeKxpDpelxzbCCK1Zdi4hTX1KNmxnawz0Fuwra5zgKmynQ Oct 11 07:19:36.253544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Oct 11 07:19:36.253544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Oct 11 07:19:36.253544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Oct 11 07:19:36.253544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Oct 11 07:19:36.253544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Oct 11 07:19:36.253544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Oct 11 07:19:36.253544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Id: 2445c31c35bb442493befe50f68724bf Oct 11 07:19:36.253544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1324442222 Oct 11 07:19:36.253544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Role: reader,member Oct 11 07:19:36.253544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Oct 11 07:19:36.255130 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2445c31c35bb442493befe50f68724bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2445c31c35bb442493befe50f68724bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2445c31c35bb442493befe50f68724bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2445c31c35bb442493befe50f68724bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 07:19:36.255130 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1324442222 Oct 11 07:19:36.255130 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 2445c31c35bb442493befe50f68724bf Oct 11 07:19:36.255130 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1324442222 Oct 11 07:19:36.255130 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User: tempest-VolumesSnapshotsTestJSON-1324442222-project Oct 11 07:19:36.255130 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Oct 11 07:19:36.255130 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Oct 11 07:19:36.255130 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Id: b1a04fc5bdf6407580c598b494a68d6f Oct 11 07:19:36.255130 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1324442222-project Oct 11 07:19:36.255130 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: method: Oct 11 07:19:36.255130 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: exception: Volume 37878bfc-f188-4806-bda8-07b64a68f352 could not be found. Oct 11 07:19:36.255130 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: action_args: {'id': '37878bfc-f188-4806-bda8-07b64a68f352'} Oct 11 07:19:36.255130 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 07:19:36.256288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:36.256288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 07:19:36.256288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 07:19:36.256288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 07:19:36.256288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 07:19:36.256288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 07:19:36.256288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 07:19:36.256288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 07:19:36.256288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 07:19:36.256288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 07:19:36.256288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 07:19:36.256288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 07:19:36.256288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 07:19:36.256288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 07:19:36.256288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 07:19:36.256288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 37878bfc-f188-4806-bda8-07b64a68f352 could not be found. (HTTP 404) (Request-ID: req-e65e02e8-b377-4e74-8abf-7f194b0417ee) Oct 11 07:19:36.256288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:36.256288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:19:36.256288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:36.257627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:36.257627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 11 07:19:36.257627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 11 07:19:36.257627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 07:19:36.257627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 07:19:36.257627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 07:19:36.257627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 07:19:36.257627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 07:19:36.257627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 07:19:36.257627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 07:19:36.257627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 07:19:36.257627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 07:19:36.257627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 07:19:36.257627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 07:19:36.257627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 07:19:36.257627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 07:19:36.257627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 07:19:36.257627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 07:19:36.257627 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 07:19:36.259067 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 07:19:36.259067 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 07:19:36.259067 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 07:19:36.259067 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 07:19:36.259067 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 37878bfc-f188-4806-bda8-07b64a68f352 could not be found. Oct 11 07:19:36.259067 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:36.259067 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:19:36.259067 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:36.259067 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:36.259067 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:19:36.259067 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:19:36.259067 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 07:19:36.259067 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 07:19:36.259067 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 07:19:36.259067 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 07:19:36.259067 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 07:19:36.259067 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 07:19:36.259067 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 11 07:19:36.259067 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 07:19:36.260511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 37878bfc-f188-4806-bda8-07b64a68f352 could not be found. Oct 11 07:19:36.260511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:36.260511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:19:36.260511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:36.260511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:19:36.260511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:19:36.260511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:19:36.260511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 07:19:36.260511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 07:19:36.260511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 37878bfc-f188-4806-bda8-07b64a68f352 could not be found. Oct 11 07:19:36.260511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:19:36.260511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c1df043c-4387-42cf-82e5-451978989ee3 tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] Returning 404 to user: Volume 37878bfc-f188-4806-bda8-07b64a68f352 could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 07:19:36.260511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c1df043c-4387-42cf-82e5-451978989ee3 tempest-VolumesSnapshotsTestJSON-1324442222 tempest-VolumesSnapshotsTestJSON-1324442222-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/37878bfc-f188-4806-bda8-07b64a68f352" status: 404 len: 109 microversion: 2.1 time: 0.035022 Oct 11 07:19:36.260511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1710/3421] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Oct 11 07:19:36 2022] GET /compute/v2.1/os-volumes/37878bfc-f188-4806-bda8-07b64a68f352 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 07:20:30.644833 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 07:20:30.645515 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Tue Oct 11 07:20:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2/action (ip 10.222.0.39) !!! Oct 11 07:20:30.647031 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 07:20:30.647174 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Tue Oct 11 07:20:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2/action (ip 10.222.0.39) !!! Oct 11 07:20:30.654166 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c966d09d-4bd4-4e21-8645-3b04d257325e tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:20:30.654692 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c966d09d-4bd4-4e21-8645-3b04d257325e tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:20:30.663243 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c966d09d-4bd4-4e21-8645-3b04d257325e tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:30.663683 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c966d09d-4bd4-4e21-8645-3b04d257325e tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:30.664119 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c966d09d-4bd4-4e21-8645-3b04d257325e tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:30.664800 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c966d09d-4bd4-4e21-8645-3b04d257325e tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:30.665245 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c966d09d-4bd4-4e21-8645-3b04d257325e tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:30.665662 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c966d09d-4bd4-4e21-8645-3b04d257325e tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:30.689076 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.objects.instance [None req-c966d09d-4bd4-4e21-8645-3b04d257325e tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lazy-loading 'flavor' on Instance uuid c70b9e3f-05fe-4127-a536-02801eb865a2 {{(pid=125266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 07:20:30.762040 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c966d09d-4bd4-4e21-8645-3b04d257325e tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "POST /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2/action" status: 202 len: 0 microversion: 2.1 time: 0.118619 Oct 11 07:20:30.763250 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1712/3422] 10.222.0.39 () {60 vars in 1278 bytes} [Tue Oct 11 07:20:30 2022] POST /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 07:20:30.769727 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:20:30.770684 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=70 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:20:30.771841 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 07:20:30.772119 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Tue Oct 11 07:20:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 (ip 10.222.0.39) !!! Oct 11 07:20:30.776456 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f952970a-90e7-4d1e-9bc8-0cbf15cb1da2 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:20:30.777171 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f952970a-90e7-4d1e-9bc8-0cbf15cb1da2 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:20:30.786808 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f952970a-90e7-4d1e-9bc8-0cbf15cb1da2 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:30.787236 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f952970a-90e7-4d1e-9bc8-0cbf15cb1da2 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:30.787705 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f952970a-90e7-4d1e-9bc8-0cbf15cb1da2 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:30.788404 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f952970a-90e7-4d1e-9bc8-0cbf15cb1da2 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:30.788855 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f952970a-90e7-4d1e-9bc8-0cbf15cb1da2 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:30.789279 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f952970a-90e7-4d1e-9bc8-0cbf15cb1da2 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:30.916940 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f952970a-90e7-4d1e-9bc8-0cbf15cb1da2 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:20:30.925063 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f952970a-90e7-4d1e-9bc8-0cbf15cb1da2 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1569 microversion: 2.1 time: 0.157495 Oct 11 07:20:30.925615 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1711/3423] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:20:30 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:20:31.949407 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-7e635b5c-7236-4478-9edb-326e6e22bf7f tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:20:31.950195 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-7e635b5c-7236-4478-9edb-326e6e22bf7f tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:20:31.956579 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e635b5c-7236-4478-9edb-326e6e22bf7f tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:31.957056 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e635b5c-7236-4478-9edb-326e6e22bf7f tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:31.957482 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e635b5c-7236-4478-9edb-326e6e22bf7f tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:31.958173 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e635b5c-7236-4478-9edb-326e6e22bf7f tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:31.958623 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e635b5c-7236-4478-9edb-326e6e22bf7f tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:31.959048 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-7e635b5c-7236-4478-9edb-326e6e22bf7f tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:32.089122 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-7e635b5c-7236-4478-9edb-326e6e22bf7f tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:20:32.097207 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-7e635b5c-7236-4478-9edb-326e6e22bf7f tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1569 microversion: 2.1 time: 0.152714 Oct 11 07:20:32.097759 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1713/3424] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:20:31 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:20:33.120578 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-ee2c5680-8625-4f3e-aedb-26f0d8e76f52 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:20:33.121201 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-ee2c5680-8625-4f3e-aedb-26f0d8e76f52 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:20:33.128062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ee2c5680-8625-4f3e-aedb-26f0d8e76f52 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:33.128540 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ee2c5680-8625-4f3e-aedb-26f0d8e76f52 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:33.128980 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ee2c5680-8625-4f3e-aedb-26f0d8e76f52 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:33.129667 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ee2c5680-8625-4f3e-aedb-26f0d8e76f52 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:33.130128 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ee2c5680-8625-4f3e-aedb-26f0d8e76f52 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:33.130547 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-ee2c5680-8625-4f3e-aedb-26f0d8e76f52 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:33.263316 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-ee2c5680-8625-4f3e-aedb-26f0d8e76f52 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:20:33.270955 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-ee2c5680-8625-4f3e-aedb-26f0d8e76f52 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1569 microversion: 2.1 time: 0.154313 Oct 11 07:20:33.271540 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1712/3425] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:20:33 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:20:34.293860 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a60ccbc2-1f6d-44f8-a173-ad087035ef8f tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:20:34.294646 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a60ccbc2-1f6d-44f8-a173-ad087035ef8f tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:20:34.301267 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a60ccbc2-1f6d-44f8-a173-ad087035ef8f tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:34.301755 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a60ccbc2-1f6d-44f8-a173-ad087035ef8f tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:34.302189 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a60ccbc2-1f6d-44f8-a173-ad087035ef8f tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:34.302882 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a60ccbc2-1f6d-44f8-a173-ad087035ef8f tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:34.303529 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a60ccbc2-1f6d-44f8-a173-ad087035ef8f tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:34.303956 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a60ccbc2-1f6d-44f8-a173-ad087035ef8f tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:34.447106 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a60ccbc2-1f6d-44f8-a173-ad087035ef8f tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:20:34.455257 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a60ccbc2-1f6d-44f8-a173-ad087035ef8f tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1569 microversion: 2.1 time: 0.165585 Oct 11 07:20:34.455835 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1714/3426] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:20:34 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:20:35.478581 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4bbe87cf-f652-4e47-8f19-4152be6f3526 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:20:35.479764 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4bbe87cf-f652-4e47-8f19-4152be6f3526 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:20:35.486898 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4bbe87cf-f652-4e47-8f19-4152be6f3526 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:35.487677 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4bbe87cf-f652-4e47-8f19-4152be6f3526 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:35.488136 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4bbe87cf-f652-4e47-8f19-4152be6f3526 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:35.488826 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4bbe87cf-f652-4e47-8f19-4152be6f3526 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:35.489274 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4bbe87cf-f652-4e47-8f19-4152be6f3526 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:35.489689 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4bbe87cf-f652-4e47-8f19-4152be6f3526 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:35.639250 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4bbe87cf-f652-4e47-8f19-4152be6f3526 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:20:35.664469 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4bbe87cf-f652-4e47-8f19-4152be6f3526 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1569 microversion: 2.1 time: 0.190136 Oct 11 07:20:35.665061 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1713/3427] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:20:35 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1569 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:20:36.689172 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8452543f-778d-46bf-82e9-bf350f184d51 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:20:36.689778 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8452543f-778d-46bf-82e9-bf350f184d51 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:20:36.696169 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8452543f-778d-46bf-82e9-bf350f184d51 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:36.696639 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8452543f-778d-46bf-82e9-bf350f184d51 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:36.697064 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8452543f-778d-46bf-82e9-bf350f184d51 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:36.697738 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8452543f-778d-46bf-82e9-bf350f184d51 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:36.698180 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8452543f-778d-46bf-82e9-bf350f184d51 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:36.698597 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8452543f-778d-46bf-82e9-bf350f184d51 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:36.827773 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8452543f-778d-46bf-82e9-bf350f184d51 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:20:36.835613 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8452543f-778d-46bf-82e9-bf350f184d51 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1569 microversion: 2.1 time: 0.150223 Oct 11 07:20:36.836166 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1715/3428] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:20:36 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:20:37.858544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-edc9ee4f-6659-41b8-a4b0-339ee911d757 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:20:37.859157 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-edc9ee4f-6659-41b8-a4b0-339ee911d757 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:20:37.865815 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-edc9ee4f-6659-41b8-a4b0-339ee911d757 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:37.866293 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-edc9ee4f-6659-41b8-a4b0-339ee911d757 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:37.866721 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-edc9ee4f-6659-41b8-a4b0-339ee911d757 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:37.867408 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-edc9ee4f-6659-41b8-a4b0-339ee911d757 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:37.867882 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-edc9ee4f-6659-41b8-a4b0-339ee911d757 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:37.868305 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-edc9ee4f-6659-41b8-a4b0-339ee911d757 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:37.994557 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-edc9ee4f-6659-41b8-a4b0-339ee911d757 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:20:38.002917 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-edc9ee4f-6659-41b8-a4b0-339ee911d757 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1569 microversion: 2.1 time: 0.148792 Oct 11 07:20:38.003494 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1714/3429] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:20:37 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:20:39.025716 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-21fee668-ee00-4228-ae34-5309b9000f5c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:20:39.026252 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-21fee668-ee00-4228-ae34-5309b9000f5c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:20:39.032570 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21fee668-ee00-4228-ae34-5309b9000f5c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:39.033047 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21fee668-ee00-4228-ae34-5309b9000f5c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:39.033479 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21fee668-ee00-4228-ae34-5309b9000f5c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:39.034162 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21fee668-ee00-4228-ae34-5309b9000f5c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:39.034610 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21fee668-ee00-4228-ae34-5309b9000f5c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:39.035032 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-21fee668-ee00-4228-ae34-5309b9000f5c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:39.169077 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-21fee668-ee00-4228-ae34-5309b9000f5c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:20:39.177361 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-21fee668-ee00-4228-ae34-5309b9000f5c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1569 microversion: 2.1 time: 0.155730 Oct 11 07:20:39.177906 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1716/3430] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:20:39 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:20:40.199927 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-78b2de65-136b-44eb-9cfa-f0a3c7369a15 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:20:40.201001 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-78b2de65-136b-44eb-9cfa-f0a3c7369a15 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:20:40.207348 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78b2de65-136b-44eb-9cfa-f0a3c7369a15 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:40.207857 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78b2de65-136b-44eb-9cfa-f0a3c7369a15 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:40.208288 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78b2de65-136b-44eb-9cfa-f0a3c7369a15 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:40.208968 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78b2de65-136b-44eb-9cfa-f0a3c7369a15 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:40.209418 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78b2de65-136b-44eb-9cfa-f0a3c7369a15 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:40.209839 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-78b2de65-136b-44eb-9cfa-f0a3c7369a15 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:40.345090 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-78b2de65-136b-44eb-9cfa-f0a3c7369a15 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:20:40.352780 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-78b2de65-136b-44eb-9cfa-f0a3c7369a15 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1569 microversion: 2.1 time: 0.157105 Oct 11 07:20:40.353339 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1715/3431] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:20:40 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:20:41.375668 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a3c747b4-0394-44da-aad4-a8c5e6552e34 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:20:41.376292 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a3c747b4-0394-44da-aad4-a8c5e6552e34 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:20:41.382742 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a3c747b4-0394-44da-aad4-a8c5e6552e34 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:41.383213 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a3c747b4-0394-44da-aad4-a8c5e6552e34 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:41.383667 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a3c747b4-0394-44da-aad4-a8c5e6552e34 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:41.384348 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a3c747b4-0394-44da-aad4-a8c5e6552e34 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:41.384789 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a3c747b4-0394-44da-aad4-a8c5e6552e34 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:41.385201 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a3c747b4-0394-44da-aad4-a8c5e6552e34 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:41.512615 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a3c747b4-0394-44da-aad4-a8c5e6552e34 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:20:41.520721 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a3c747b4-0394-44da-aad4-a8c5e6552e34 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1569 microversion: 2.1 time: 0.149004 Oct 11 07:20:41.521268 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1717/3432] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:20:41 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:20:42.544073 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c4d52c06-462e-4c14-a296-436a574fafca tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:20:42.545232 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c4d52c06-462e-4c14-a296-436a574fafca tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:20:42.553742 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4d52c06-462e-4c14-a296-436a574fafca tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:42.554226 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4d52c06-462e-4c14-a296-436a574fafca tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:42.554650 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4d52c06-462e-4c14-a296-436a574fafca tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:42.555338 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4d52c06-462e-4c14-a296-436a574fafca tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:42.555816 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4d52c06-462e-4c14-a296-436a574fafca tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:42.556231 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c4d52c06-462e-4c14-a296-436a574fafca tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:42.689982 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c4d52c06-462e-4c14-a296-436a574fafca tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:20:42.698101 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c4d52c06-462e-4c14-a296-436a574fafca tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1569 microversion: 2.1 time: 0.157931 Oct 11 07:20:42.698670 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1716/3433] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:20:42 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:20:43.721357 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3f519b70-66e0-480f-9fde-1668a7f0453b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:20:43.722099 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3f519b70-66e0-480f-9fde-1668a7f0453b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:20:43.728579 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3f519b70-66e0-480f-9fde-1668a7f0453b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:43.729103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3f519b70-66e0-480f-9fde-1668a7f0453b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:43.729534 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3f519b70-66e0-480f-9fde-1668a7f0453b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:43.730242 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3f519b70-66e0-480f-9fde-1668a7f0453b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:43.730635 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3f519b70-66e0-480f-9fde-1668a7f0453b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:43.731059 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3f519b70-66e0-480f-9fde-1668a7f0453b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:43.873761 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3f519b70-66e0-480f-9fde-1668a7f0453b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:20:43.881613 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3f519b70-66e0-480f-9fde-1668a7f0453b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1569 microversion: 2.1 time: 0.164028 Oct 11 07:20:43.882166 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1718/3434] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:20:43 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:20:44.905804 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-36120eae-7adb-4263-823c-5bcb198685e7 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:20:44.906420 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-36120eae-7adb-4263-823c-5bcb198685e7 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:20:44.912940 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-36120eae-7adb-4263-823c-5bcb198685e7 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:44.913423 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-36120eae-7adb-4263-823c-5bcb198685e7 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:44.913862 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-36120eae-7adb-4263-823c-5bcb198685e7 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:44.914559 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-36120eae-7adb-4263-823c-5bcb198685e7 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:44.915043 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-36120eae-7adb-4263-823c-5bcb198685e7 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:44.915486 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-36120eae-7adb-4263-823c-5bcb198685e7 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:45.105505 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-36120eae-7adb-4263-823c-5bcb198685e7 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:20:45.115149 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-36120eae-7adb-4263-823c-5bcb198685e7 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1569 microversion: 2.1 time: 0.213576 Oct 11 07:20:45.116173 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1717/3435] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:20:44 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1569 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:20:46.138543 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5964e5b6-db09-4e9f-b97e-49fc18a16b8b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:20:46.139254 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5964e5b6-db09-4e9f-b97e-49fc18a16b8b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:20:46.146011 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5964e5b6-db09-4e9f-b97e-49fc18a16b8b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:46.146575 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5964e5b6-db09-4e9f-b97e-49fc18a16b8b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:46.147000 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5964e5b6-db09-4e9f-b97e-49fc18a16b8b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:46.147716 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5964e5b6-db09-4e9f-b97e-49fc18a16b8b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:46.148156 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5964e5b6-db09-4e9f-b97e-49fc18a16b8b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:46.148570 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5964e5b6-db09-4e9f-b97e-49fc18a16b8b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:46.279757 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5964e5b6-db09-4e9f-b97e-49fc18a16b8b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:20:46.287592 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5964e5b6-db09-4e9f-b97e-49fc18a16b8b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1569 microversion: 2.1 time: 0.153033 Oct 11 07:20:46.288144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1719/3436] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:20:46 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:20:47.311267 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a9e3e2c1-5e55-4eb4-b6ef-f77f4d053928 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:20:47.311834 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a9e3e2c1-5e55-4eb4-b6ef-f77f4d053928 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:20:47.317677 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a9e3e2c1-5e55-4eb4-b6ef-f77f4d053928 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:47.318173 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a9e3e2c1-5e55-4eb4-b6ef-f77f4d053928 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:47.318586 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a9e3e2c1-5e55-4eb4-b6ef-f77f4d053928 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:47.319270 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a9e3e2c1-5e55-4eb4-b6ef-f77f4d053928 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:47.319752 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a9e3e2c1-5e55-4eb4-b6ef-f77f4d053928 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:47.320171 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a9e3e2c1-5e55-4eb4-b6ef-f77f4d053928 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:47.459274 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a9e3e2c1-5e55-4eb4-b6ef-f77f4d053928 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:20:47.466975 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a9e3e2c1-5e55-4eb4-b6ef-f77f4d053928 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1569 microversion: 2.1 time: 0.160422 Oct 11 07:20:47.467557 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1718/3437] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:20:47 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:20:48.490261 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2bcb6bcd-aab6-49ca-9097-f6e077a23d30 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:20:48.490970 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2bcb6bcd-aab6-49ca-9097-f6e077a23d30 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:20:48.497596 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2bcb6bcd-aab6-49ca-9097-f6e077a23d30 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:48.498116 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2bcb6bcd-aab6-49ca-9097-f6e077a23d30 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:48.498562 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2bcb6bcd-aab6-49ca-9097-f6e077a23d30 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:48.499234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2bcb6bcd-aab6-49ca-9097-f6e077a23d30 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:48.499707 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2bcb6bcd-aab6-49ca-9097-f6e077a23d30 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:48.500130 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2bcb6bcd-aab6-49ca-9097-f6e077a23d30 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:48.666436 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-2bcb6bcd-aab6-49ca-9097-f6e077a23d30 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:20:48.674128 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2bcb6bcd-aab6-49ca-9097-f6e077a23d30 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1569 microversion: 2.1 time: 0.187899 Oct 11 07:20:48.674688 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1720/3438] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:20:48 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1569 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:20:49.698245 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-765f1309-38eb-426d-b117-880cc9d9f3c4 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:20:49.698846 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-765f1309-38eb-426d-b117-880cc9d9f3c4 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:20:49.706039 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-765f1309-38eb-426d-b117-880cc9d9f3c4 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:49.706572 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-765f1309-38eb-426d-b117-880cc9d9f3c4 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:49.707005 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-765f1309-38eb-426d-b117-880cc9d9f3c4 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:49.707780 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-765f1309-38eb-426d-b117-880cc9d9f3c4 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:49.708225 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-765f1309-38eb-426d-b117-880cc9d9f3c4 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:49.708641 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-765f1309-38eb-426d-b117-880cc9d9f3c4 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:49.848183 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-765f1309-38eb-426d-b117-880cc9d9f3c4 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:20:49.855892 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-765f1309-38eb-426d-b117-880cc9d9f3c4 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1569 microversion: 2.1 time: 0.161579 Oct 11 07:20:49.856490 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1719/3439] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:20:49 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:20:50.880702 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cb8024b1-cf5b-45b2-b92e-0d3f15bec784 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:20:50.882090 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cb8024b1-cf5b-45b2-b92e-0d3f15bec784 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:20:50.893809 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb8024b1-cf5b-45b2-b92e-0d3f15bec784 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:50.894294 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb8024b1-cf5b-45b2-b92e-0d3f15bec784 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:50.894856 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb8024b1-cf5b-45b2-b92e-0d3f15bec784 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:50.895815 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb8024b1-cf5b-45b2-b92e-0d3f15bec784 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:50.896546 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb8024b1-cf5b-45b2-b92e-0d3f15bec784 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:50.896977 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cb8024b1-cf5b-45b2-b92e-0d3f15bec784 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:51.444530 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cb8024b1-cf5b-45b2-b92e-0d3f15bec784 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:20:51.453270 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cb8024b1-cf5b-45b2-b92e-0d3f15bec784 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1569 microversion: 2.1 time: 0.578795 Oct 11 07:20:51.453925 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1721/3440] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:20:50 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1569 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:20:52.477027 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-38a24129-ba81-4592-8dd0-7ea5d14f9db9 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:20:52.477628 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-38a24129-ba81-4592-8dd0-7ea5d14f9db9 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:20:52.484716 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38a24129-ba81-4592-8dd0-7ea5d14f9db9 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:52.485457 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38a24129-ba81-4592-8dd0-7ea5d14f9db9 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:52.485879 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38a24129-ba81-4592-8dd0-7ea5d14f9db9 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:52.486773 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38a24129-ba81-4592-8dd0-7ea5d14f9db9 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:52.487223 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38a24129-ba81-4592-8dd0-7ea5d14f9db9 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:52.487662 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-38a24129-ba81-4592-8dd0-7ea5d14f9db9 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:52.620598 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-38a24129-ba81-4592-8dd0-7ea5d14f9db9 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:20:52.629654 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-38a24129-ba81-4592-8dd0-7ea5d14f9db9 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1569 microversion: 2.1 time: 0.156419 Oct 11 07:20:52.630352 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1720/3441] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:20:52 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:20:53.653460 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a9792f0b-eaf4-4d2a-b675-5d638e2fe028 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:20:53.654472 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a9792f0b-eaf4-4d2a-b675-5d638e2fe028 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:20:53.662633 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9792f0b-eaf4-4d2a-b675-5d638e2fe028 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:53.663171 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9792f0b-eaf4-4d2a-b675-5d638e2fe028 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:53.663857 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9792f0b-eaf4-4d2a-b675-5d638e2fe028 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:53.664985 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9792f0b-eaf4-4d2a-b675-5d638e2fe028 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:53.665670 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9792f0b-eaf4-4d2a-b675-5d638e2fe028 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:53.666286 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9792f0b-eaf4-4d2a-b675-5d638e2fe028 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:53.873218 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a9792f0b-eaf4-4d2a-b675-5d638e2fe028 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:20:53.881513 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a9792f0b-eaf4-4d2a-b675-5d638e2fe028 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1569 microversion: 2.1 time: 0.231820 Oct 11 07:20:53.882502 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1722/3442] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:20:53 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1569 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:20:54.905212 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d1df0a69-3190-46ff-a906-9f3114600ccf tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:20:54.905928 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d1df0a69-3190-46ff-a906-9f3114600ccf tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:20:54.912225 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d1df0a69-3190-46ff-a906-9f3114600ccf tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:54.912702 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d1df0a69-3190-46ff-a906-9f3114600ccf tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:54.913132 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d1df0a69-3190-46ff-a906-9f3114600ccf tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:54.913820 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d1df0a69-3190-46ff-a906-9f3114600ccf tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:54.914267 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d1df0a69-3190-46ff-a906-9f3114600ccf tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:54.914695 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d1df0a69-3190-46ff-a906-9f3114600ccf tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:55.067157 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d1df0a69-3190-46ff-a906-9f3114600ccf tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:20:55.075784 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d1df0a69-3190-46ff-a906-9f3114600ccf tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1510 microversion: 2.1 time: 0.175006 Oct 11 07:20:55.076488 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1721/3443] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:20:54 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:20:55.099173 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a9ae64f0-074c-46be-8d43-11b2edc6ff56 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:20:55.100416 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a9ae64f0-074c-46be-8d43-11b2edc6ff56 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:20:55.107084 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9ae64f0-074c-46be-8d43-11b2edc6ff56 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:55.107623 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9ae64f0-074c-46be-8d43-11b2edc6ff56 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:55.108089 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9ae64f0-074c-46be-8d43-11b2edc6ff56 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:55.108744 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9ae64f0-074c-46be-8d43-11b2edc6ff56 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:55.109361 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9ae64f0-074c-46be-8d43-11b2edc6ff56 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:55.110222 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a9ae64f0-074c-46be-8d43-11b2edc6ff56 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:55.627365 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a9ae64f0-074c-46be-8d43-11b2edc6ff56 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125266) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 11 07:20:55.713788 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a9ae64f0-074c-46be-8d43-11b2edc6ff56 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "POST /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2/action" status: 202 len: 0 microversion: 2.1 time: 0.618385 Oct 11 07:20:55.720675 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1723/3444] 10.222.0.39 () {60 vars in 1278 bytes} [Tue Oct 11 07:20:55 2022] POST /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2/action => generated 0 bytes in 626 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 07:20:55.726723 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d129f9d7-6f23-402d-8cd8-334f415c146b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:20:55.727463 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d129f9d7-6f23-402d-8cd8-334f415c146b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:20:55.741178 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d129f9d7-6f23-402d-8cd8-334f415c146b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:55.741804 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d129f9d7-6f23-402d-8cd8-334f415c146b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:55.742370 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d129f9d7-6f23-402d-8cd8-334f415c146b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:55.743764 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d129f9d7-6f23-402d-8cd8-334f415c146b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:55.744432 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d129f9d7-6f23-402d-8cd8-334f415c146b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:55.745338 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d129f9d7-6f23-402d-8cd8-334f415c146b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:55.921576 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d129f9d7-6f23-402d-8cd8-334f415c146b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:20:55.930136 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d129f9d7-6f23-402d-8cd8-334f415c146b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1518 microversion: 2.1 time: 0.208478 Oct 11 07:20:55.931589 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1722/3445] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:20:55 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1518 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:20:56.959822 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-52d88023-5034-4433-a294-fa7b130902c8 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:20:56.961000 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-52d88023-5034-4433-a294-fa7b130902c8 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:20:56.967879 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-52d88023-5034-4433-a294-fa7b130902c8 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:56.968536 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-52d88023-5034-4433-a294-fa7b130902c8 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:56.969157 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-52d88023-5034-4433-a294-fa7b130902c8 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:56.969993 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-52d88023-5034-4433-a294-fa7b130902c8 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:56.970446 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-52d88023-5034-4433-a294-fa7b130902c8 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:56.970868 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-52d88023-5034-4433-a294-fa7b130902c8 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:57.262773 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-52d88023-5034-4433-a294-fa7b130902c8 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:20:57.273112 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-52d88023-5034-4433-a294-fa7b130902c8 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1520 microversion: 2.1 time: 0.319377 Oct 11 07:20:57.274353 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1724/3446] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:20:56 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1520 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:20:58.308419 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cb0b2cd0-90bb-4f92-9742-17a6e2191f8e tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:20:58.309071 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cb0b2cd0-90bb-4f92-9742-17a6e2191f8e tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:20:58.318811 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb0b2cd0-90bb-4f92-9742-17a6e2191f8e tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:58.319679 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb0b2cd0-90bb-4f92-9742-17a6e2191f8e tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:58.320486 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb0b2cd0-90bb-4f92-9742-17a6e2191f8e tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:58.324399 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb0b2cd0-90bb-4f92-9742-17a6e2191f8e tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:58.325005 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb0b2cd0-90bb-4f92-9742-17a6e2191f8e tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:58.325544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cb0b2cd0-90bb-4f92-9742-17a6e2191f8e tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:58.528099 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cb0b2cd0-90bb-4f92-9742-17a6e2191f8e tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:20:58.537318 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cb0b2cd0-90bb-4f92-9742-17a6e2191f8e tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1576 microversion: 2.1 time: 0.240919 Oct 11 07:20:58.541737 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1723/3447] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:20:58 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1576 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:20:58.663770 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-43ba4643-b0cb-40ca-8368-9e0607894d9a req-10fc5eaa-c820-4e27-bfb2-0f0ae73d7b52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c70b9e3f-05fe-4127-a536-02801eb865a2", "name": "network-vif-unplugged", "status": "completed", "tag": "112615ed-3ec4-49cb-aa0b-c8d23ae96ae5"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:20:58.681127 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-43ba4643-b0cb-40ca-8368-9e0607894d9a req-10fc5eaa-c820-4e27-bfb2-0f0ae73d7b52 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:58.688003 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-43ba4643-b0cb-40ca-8368-9e0607894d9a req-10fc5eaa-c820-4e27-bfb2-0f0ae73d7b52 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:58.688446 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-43ba4643-b0cb-40ca-8368-9e0607894d9a req-10fc5eaa-c820-4e27-bfb2-0f0ae73d7b52 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:58.712476 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-43ba4643-b0cb-40ca-8368-9e0607894d9a req-10fc5eaa-c820-4e27-bfb2-0f0ae73d7b52 service nova] Creating event network-vif-unplugged:112615ed-3ec4-49cb-aa0b-c8d23ae96ae5 for instance c70b9e3f-05fe-4127-a536-02801eb865a2 on hv-cinder-85495 Oct 11 07:20:58.717680 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-43ba4643-b0cb-40ca-8368-9e0607894d9a req-10fc5eaa-c820-4e27-bfb2-0f0ae73d7b52 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057594 Oct 11 07:20:58.718337 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1725/3448] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:20:59.567020 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a2def433-1eb4-4426-ae2f-3104b3c66a3b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:20:59.567710 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a2def433-1eb4-4426-ae2f-3104b3c66a3b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:20:59.575852 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2def433-1eb4-4426-ae2f-3104b3c66a3b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:59.576589 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2def433-1eb4-4426-ae2f-3104b3c66a3b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:59.577215 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2def433-1eb4-4426-ae2f-3104b3c66a3b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:59.578084 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2def433-1eb4-4426-ae2f-3104b3c66a3b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:20:59.578694 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2def433-1eb4-4426-ae2f-3104b3c66a3b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:20:59.579277 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a2def433-1eb4-4426-ae2f-3104b3c66a3b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:20:59.780610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a2def433-1eb4-4426-ae2f-3104b3c66a3b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:20:59.790298 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a2def433-1eb4-4426-ae2f-3104b3c66a3b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1576 microversion: 2.1 time: 0.228896 Oct 11 07:20:59.791459 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1724/3449] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:20:59 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1576 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:00.815061 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ceb96f96-056f-4677-ace7-509c051759e1 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:00.818404 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ceb96f96-056f-4677-ace7-509c051759e1 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:00.827353 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:21:00.829649 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ceb96f96-056f-4677-ace7-509c051759e1 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:00.830128 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ceb96f96-056f-4677-ace7-509c051759e1 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:00.830556 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ceb96f96-056f-4677-ace7-509c051759e1 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:00.831260 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ceb96f96-056f-4677-ace7-509c051759e1 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:00.831720 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ceb96f96-056f-4677-ace7-509c051759e1 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:00.832441 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ceb96f96-056f-4677-ace7-509c051759e1 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:00.836234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:21:00.980041 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ceb96f96-056f-4677-ace7-509c051759e1 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:00.988352 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ceb96f96-056f-4677-ace7-509c051759e1 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1576 microversion: 2.1 time: 0.178840 Oct 11 07:21:00.990732 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1726/3450] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:00 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:02.015129 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d0591a68-2e24-441e-9283-e183bcfb7d52 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:02.016363 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d0591a68-2e24-441e-9283-e183bcfb7d52 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:02.022446 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=29 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:21:02.024645 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0591a68-2e24-441e-9283-e183bcfb7d52 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:02.025441 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0591a68-2e24-441e-9283-e183bcfb7d52 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:02.025882 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0591a68-2e24-441e-9283-e183bcfb7d52 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:02.026639 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0591a68-2e24-441e-9283-e183bcfb7d52 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:02.027530 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0591a68-2e24-441e-9283-e183bcfb7d52 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:02.028186 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d0591a68-2e24-441e-9283-e183bcfb7d52 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:02.035365 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=85 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:21:02.210466 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d0591a68-2e24-441e-9283-e183bcfb7d52 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:02.219204 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d0591a68-2e24-441e-9283-e183bcfb7d52 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1576 microversion: 2.1 time: 0.210412 Oct 11 07:21:02.220029 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1725/3451] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:02 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1576 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:03.242524 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-9eea0749-8b21-4d48-82af-c608391b67c3 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:03.243324 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-9eea0749-8b21-4d48-82af-c608391b67c3 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:03.250739 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9eea0749-8b21-4d48-82af-c608391b67c3 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:03.251361 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9eea0749-8b21-4d48-82af-c608391b67c3 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:03.251903 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9eea0749-8b21-4d48-82af-c608391b67c3 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:03.252702 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9eea0749-8b21-4d48-82af-c608391b67c3 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:03.253250 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9eea0749-8b21-4d48-82af-c608391b67c3 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:03.253730 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-9eea0749-8b21-4d48-82af-c608391b67c3 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:03.435166 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-9eea0749-8b21-4d48-82af-c608391b67c3 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:03.443724 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-9eea0749-8b21-4d48-82af-c608391b67c3 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1576 microversion: 2.1 time: 0.205177 Oct 11 07:21:03.444303 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1727/3452] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:03 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1576 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:04.468928 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-56a88bc0-d1fe-4d66-99f6-2689b0dc7a6c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:04.469534 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-56a88bc0-d1fe-4d66-99f6-2689b0dc7a6c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:04.476496 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-56a88bc0-d1fe-4d66-99f6-2689b0dc7a6c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:04.476980 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-56a88bc0-d1fe-4d66-99f6-2689b0dc7a6c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:04.477653 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-56a88bc0-d1fe-4d66-99f6-2689b0dc7a6c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:04.478352 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-56a88bc0-d1fe-4d66-99f6-2689b0dc7a6c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:04.479007 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-56a88bc0-d1fe-4d66-99f6-2689b0dc7a6c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:04.479447 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-56a88bc0-d1fe-4d66-99f6-2689b0dc7a6c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:04.632479 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-56a88bc0-d1fe-4d66-99f6-2689b0dc7a6c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:04.641367 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-56a88bc0-d1fe-4d66-99f6-2689b0dc7a6c tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1576 microversion: 2.1 time: 0.176232 Oct 11 07:21:04.642015 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1726/3453] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:04 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:05.664330 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4ef73557-4d40-4c2c-ba74-924540f2c47a tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:05.665727 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4ef73557-4d40-4c2c-ba74-924540f2c47a tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:05.674049 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ef73557-4d40-4c2c-ba74-924540f2c47a tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:05.674913 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ef73557-4d40-4c2c-ba74-924540f2c47a tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:05.675472 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ef73557-4d40-4c2c-ba74-924540f2c47a tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:05.676323 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ef73557-4d40-4c2c-ba74-924540f2c47a tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:05.676772 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ef73557-4d40-4c2c-ba74-924540f2c47a tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:05.677197 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ef73557-4d40-4c2c-ba74-924540f2c47a tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:05.823557 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4ef73557-4d40-4c2c-ba74-924540f2c47a tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:05.832632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4ef73557-4d40-4c2c-ba74-924540f2c47a tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1576 microversion: 2.1 time: 0.172589 Oct 11 07:21:05.835055 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1728/3454] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:05 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:06.857312 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-73585c53-dacc-4d31-86d5-974e22c10768 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:06.858094 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-73585c53-dacc-4d31-86d5-974e22c10768 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:06.866979 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-73585c53-dacc-4d31-86d5-974e22c10768 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:06.867785 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-73585c53-dacc-4d31-86d5-974e22c10768 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:06.868410 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-73585c53-dacc-4d31-86d5-974e22c10768 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:06.869316 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-73585c53-dacc-4d31-86d5-974e22c10768 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:06.869876 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-73585c53-dacc-4d31-86d5-974e22c10768 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:06.870394 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-73585c53-dacc-4d31-86d5-974e22c10768 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:07.273450 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-73585c53-dacc-4d31-86d5-974e22c10768 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:07.282525 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-73585c53-dacc-4d31-86d5-974e22c10768 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1576 microversion: 2.1 time: 0.429076 Oct 11 07:21:07.283370 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1727/3455] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:06 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1576 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:08.306822 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a0e40fae-0988-4345-acc5-8b30393dfec2 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:08.308342 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a0e40fae-0988-4345-acc5-8b30393dfec2 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:08.319625 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a0e40fae-0988-4345-acc5-8b30393dfec2 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:08.320592 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a0e40fae-0988-4345-acc5-8b30393dfec2 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:08.321258 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a0e40fae-0988-4345-acc5-8b30393dfec2 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:08.322168 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a0e40fae-0988-4345-acc5-8b30393dfec2 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:08.322843 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a0e40fae-0988-4345-acc5-8b30393dfec2 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:08.323494 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a0e40fae-0988-4345-acc5-8b30393dfec2 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:08.484876 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a0e40fae-0988-4345-acc5-8b30393dfec2 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:08.494144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a0e40fae-0988-4345-acc5-8b30393dfec2 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1576 microversion: 2.1 time: 0.192043 Oct 11 07:21:08.495603 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1729/3456] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:08 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1576 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:09.522479 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e12b40a5-e6c3-4344-9799-1516dacffab5 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:09.523067 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e12b40a5-e6c3-4344-9799-1516dacffab5 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:09.530171 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e12b40a5-e6c3-4344-9799-1516dacffab5 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:09.530658 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e12b40a5-e6c3-4344-9799-1516dacffab5 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:09.531088 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e12b40a5-e6c3-4344-9799-1516dacffab5 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:09.531816 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e12b40a5-e6c3-4344-9799-1516dacffab5 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:09.532266 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e12b40a5-e6c3-4344-9799-1516dacffab5 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:09.532679 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-e12b40a5-e6c3-4344-9799-1516dacffab5 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:09.634209 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cad4d4d1-f8ec-4f3d-be7d-197da558bd49 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Action: 'create', calling method: .version_select at 0x7f8e2a42be50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1172763278", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzGcmVAKQL3hbWxzd+sl4AkB4sBSx9tIGx9p91xrO+wczxDfTZmvQpa+WpIpmksS1tQu5/HTctHCxafLNFezIGgw2o9Os5A3qWVVz4u+SmuBD+hrjW9WESHk1iknKGlsw=="}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:21:09.651217 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-cad4d4d1-f8ec-4f3d-be7d-197da558bd49 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Getting quotas for project 709d4e3bf4de4bd6857171f2d5d77885. Resources: {'key_pairs'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 07:21:09.655852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-cad4d4d1-f8ec-4f3d-be7d-197da558bd49 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Getting quotas for user 96a69fa70c78405d805f8b70860f57bf and project 709d4e3bf4de4bd6857171f2d5d77885. Resources: {'key_pairs'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 07:21:09.674030 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e12b40a5-e6c3-4344-9799-1516dacffab5 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:09.682245 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e12b40a5-e6c3-4344-9799-1516dacffab5 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1563 microversion: 2.1 time: 0.163568 Oct 11 07:21:09.682816 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1728/3457] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:09 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1563 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:09.683886 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cad4d4d1-f8ec-4f3d-be7d-197da558bd49 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053152 Oct 11 07:21:09.684695 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1730/3458] 10.222.0.39 () {60 vars in 1159 bytes} [Tue Oct 11 07:21:09 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 07:21:09.753966 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-635ae3f5-5489-4e81-95bc-c73e837d677d tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1752348858", "imageRef": "ae5c0d79-0409-4e2f-b357-3daaa2242012", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1172763278", "networks": [{"uuid": "f9c879d2-9fad-4675-ba10-eb66a2a5e3a0"}]}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:21:09.806879 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.network.neutron [None req-635ae3f5-5489-4e81-95bc-c73e837d677d tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] validate_networks() for [('f9c879d2-9fad-4675-ba10-eb66a2a5e3a0', None, None, None, None, None)] {{(pid=125267) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 07:21:10.172201 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-635ae3f5-5489-4e81-95bc-c73e837d677d tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Flavor limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 07:21:10.172615 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-635ae3f5-5489-4e81-95bc-c73e837d677d tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Image limits 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 07:21:10.173079 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-635ae3f5-5489-4e81-95bc-c73e837d677d tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Flavor pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 07:21:10.173476 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-635ae3f5-5489-4e81-95bc-c73e837d677d tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Image pref 0:0:0 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 07:21:10.173878 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.virt.hardware [None req-635ae3f5-5489-4e81-95bc-c73e837d677d tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 07:21:10.183887 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-635ae3f5-5489-4e81-95bc-c73e837d677d tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:10.184305 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-635ae3f5-5489-4e81-95bc-c73e837d677d tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:10.184728 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-635ae3f5-5489-4e81-95bc-c73e837d677d tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:10.185444 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-635ae3f5-5489-4e81-95bc-c73e837d677d tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:10.185892 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-635ae3f5-5489-4e81-95bc-c73e837d677d tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:10.186307 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-635ae3f5-5489-4e81-95bc-c73e837d677d tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:10.202480 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-635ae3f5-5489-4e81-95bc-c73e837d677d tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Getting quotas for project 709d4e3bf4de4bd6857171f2d5d77885. Resources: {'cores', 'ram', 'instances'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 07:21:10.206334 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.quota [None req-635ae3f5-5489-4e81-95bc-c73e837d677d tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Getting quotas for user 96a69fa70c78405d805f8b70860f57bf and project 709d4e3bf4de4bd6857171f2d5d77885. Resources: {'cores', 'ram', 'instances'} {{(pid=125267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 07:21:10.217132 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-635ae3f5-5489-4e81-95bc-c73e837d677d tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Going to run 1 instances... {{(pid=125267) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 07:21:10.219357 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-635ae3f5-5489-4e81-95bc-c73e837d677d tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ae5c0d79-0409-4e2f-b357-3daaa2242012',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 07:21:10.267678 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-635ae3f5-5489-4e81-95bc-c73e837d677d tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.517335 Oct 11 07:21:10.268598 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1729/3459] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Oct 11 07:21:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 07:21:10.283208 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e00f2322-f511-403e-b8e1-1ff3a2c5fdd9 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:10.283860 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e00f2322-f511-403e-b8e1-1ff3a2c5fdd9 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:10.341200 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e00f2322-f511-403e-b8e1-1ff3a2c5fdd9 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a69fa70c78405d805f8b70860f57bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:10.349168 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e00f2322-f511-403e-b8e1-1ff3a2c5fdd9 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 200 len: 1259 microversion: 2.1 time: 0.073147 Oct 11 07:21:10.349950 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1731/3460] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:10 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 1259 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:21:11.372086 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b5eaec6e-5074-4712-ba25-ce08ec78e364 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:11.372700 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b5eaec6e-5074-4712-ba25-ce08ec78e364 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:11.379337 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b5eaec6e-5074-4712-ba25-ce08ec78e364 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:11.379862 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b5eaec6e-5074-4712-ba25-ce08ec78e364 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:11.380301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b5eaec6e-5074-4712-ba25-ce08ec78e364 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:11.380990 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b5eaec6e-5074-4712-ba25-ce08ec78e364 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:11.381445 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b5eaec6e-5074-4712-ba25-ce08ec78e364 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:11.381871 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b5eaec6e-5074-4712-ba25-ce08ec78e364 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:11.444003 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b5eaec6e-5074-4712-ba25-ce08ec78e364 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a69fa70c78405d805f8b70860f57bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:11.452140 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b5eaec6e-5074-4712-ba25-ce08ec78e364 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 200 len: 1311 microversion: 2.1 time: 0.083948 Oct 11 07:21:11.452701 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1730/3461] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:11 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 1311 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:12.138653 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a29138e1-0eb4-4c80-ae5c-58fdf818754e tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-498303229", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-999822900", "security_groups": [{"name": "tempest-secgroup-smoke-1808634596"}], "block_device_mapping_v2": [{"uuid": "9d1eabad-3759-4a11-9146-95fc21466234", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9a53f628-4e9e-4385-a02c-283640135d82"}]}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:21:12.430229 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.network.neutron [None req-a29138e1-0eb4-4c80-ae5c-58fdf818754e tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] validate_networks() for [('9a53f628-4e9e-4385-a02c-283640135d82', None, None, None, None, None)] {{(pid=125266) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 07:21:12.478682 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3b8cc713-2661-4231-a240-cf139e135df0 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:12.479304 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3b8cc713-2661-4231-a240-cf139e135df0 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:12.499306 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3b8cc713-2661-4231-a240-cf139e135df0 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:12.502758 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3b8cc713-2661-4231-a240-cf139e135df0 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:12.503207 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3b8cc713-2661-4231-a240-cf139e135df0 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:12.509076 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3b8cc713-2661-4231-a240-cf139e135df0 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:12.511473 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3b8cc713-2661-4231-a240-cf139e135df0 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:12.512284 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3b8cc713-2661-4231-a240-cf139e135df0 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:12.730463 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3b8cc713-2661-4231-a240-cf139e135df0 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a69fa70c78405d805f8b70860f57bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:12.739931 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3b8cc713-2661-4231-a240-cf139e135df0 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 200 len: 1359 microversion: 2.1 time: 0.267143 Oct 11 07:21:12.740857 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1731/3462] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:12 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 1359 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:12.745450 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-7d8d4dc3-30d6-4ecf-ab1b-189128b0df95 req-83cc6ec0-4749-4b23-86d1-daed0e5bc3ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c70b9e3f-05fe-4127-a536-02801eb865a2", "name": "network-vif-plugged", "status": "completed", "tag": "112615ed-3ec4-49cb-aa0b-c8d23ae96ae5"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:21:12.755075 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-7d8d4dc3-30d6-4ecf-ab1b-189128b0df95 req-83cc6ec0-4749-4b23-86d1-daed0e5bc3ff service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:12.755786 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-7d8d4dc3-30d6-4ecf-ab1b-189128b0df95 req-83cc6ec0-4749-4b23-86d1-daed0e5bc3ff service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:12.756384 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-7d8d4dc3-30d6-4ecf-ab1b-189128b0df95 req-83cc6ec0-4749-4b23-86d1-daed0e5bc3ff service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:12.768725 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-7d8d4dc3-30d6-4ecf-ab1b-189128b0df95 req-83cc6ec0-4749-4b23-86d1-daed0e5bc3ff service nova] Creating event network-vif-plugged:112615ed-3ec4-49cb-aa0b-c8d23ae96ae5 for instance c70b9e3f-05fe-4127-a536-02801eb865a2 on hv-cinder-85495 Oct 11 07:21:12.775742 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-7d8d4dc3-30d6-4ecf-ab1b-189128b0df95 req-83cc6ec0-4749-4b23-86d1-daed0e5bc3ff service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033557 Oct 11 07:21:12.777169 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1732/3463] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:21:13.232307 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-a29138e1-0eb4-4c80-ae5c-58fdf818754e tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Flavor limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 07:21:13.232852 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-a29138e1-0eb4-4c80-ae5c-58fdf818754e tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Image limits 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 07:21:13.233181 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-a29138e1-0eb4-4c80-ae5c-58fdf818754e tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Flavor pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 07:21:13.233579 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-a29138e1-0eb4-4c80-ae5c-58fdf818754e tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Image pref 0:0:0 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 07:21:13.233987 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.virt.hardware [None req-a29138e1-0eb4-4c80-ae5c-58fdf818754e tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 07:21:13.253226 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a29138e1-0eb4-4c80-ae5c-58fdf818754e tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:13.253961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a29138e1-0eb4-4c80-ae5c-58fdf818754e tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:13.254585 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a29138e1-0eb4-4c80-ae5c-58fdf818754e tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:13.255503 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a29138e1-0eb4-4c80-ae5c-58fdf818754e tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:13.256121 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a29138e1-0eb4-4c80-ae5c-58fdf818754e tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:13.256696 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a29138e1-0eb4-4c80-ae5c-58fdf818754e tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:13.276404 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-a29138e1-0eb4-4c80-ae5c-58fdf818754e tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Getting quotas for project 60dd1d4ab8434282b5f57d6547f8d3e9. Resources: {'cores', 'ram', 'instances'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 07:21:13.281617 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.quota [None req-a29138e1-0eb4-4c80-ae5c-58fdf818754e tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Getting quotas for user 52173fbead6e4b499a99a6979c9a9898 and project 60dd1d4ab8434282b5f57d6547f8d3e9. Resources: {'cores', 'ram', 'instances'} {{(pid=125266) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 07:21:13.345411 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a29138e1-0eb4-4c80-ae5c-58fdf818754e tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Going to run 1 instances... {{(pid=125266) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 07:21:13.347644 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a29138e1-0eb4-4c80-ae5c-58fdf818754e tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: de68987b-f150-41fb-9df8-e056b5f2e140] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9d1eabad-3759-4a11-9146-95fc21466234',volume_size=None,volume_type=None)] {{(pid=125266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 07:21:13.580730 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a29138e1-0eb4-4c80-ae5c-58fdf818754e tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.447369 Oct 11 07:21:13.588441 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1732/3464] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Oct 11 07:21:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 1456 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 07:21:13.595028 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-e284cbf7-c38f-4442-acbd-c1fbcc8b1d81 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:13.596622 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-e284cbf7-c38f-4442-acbd-c1fbcc8b1d81 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: de68987b-f150-41fb-9df8-e056b5f2e140] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:13.681481 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-e284cbf7-c38f-4442-acbd-c1fbcc8b1d81 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:13.691922 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-e284cbf7-c38f-4442-acbd-c1fbcc8b1d81 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140" status: 200 len: 1093 microversion: 2.1 time: 0.102291 Oct 11 07:21:13.708230 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1733/3465] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:13 2022] GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140 => generated 1093 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:21:13.725725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-2a7fec4a-1f02-4b1d-b591-109114b316f0 req-7cf022b8-e40a-494d-9407-48adc6c9a70f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efae89e3-9121-4a31-ba5b-040087bb8b3e", "tag": "7f80cdc8-459e-4ac3-a549-1418688400ff"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:21:13.744397 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-2a7fec4a-1f02-4b1d-b591-109114b316f0 req-7cf022b8-e40a-494d-9407-48adc6c9a70f service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:13.744881 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-2a7fec4a-1f02-4b1d-b591-109114b316f0 req-7cf022b8-e40a-494d-9407-48adc6c9a70f service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:13.745964 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-2a7fec4a-1f02-4b1d-b591-109114b316f0 req-7cf022b8-e40a-494d-9407-48adc6c9a70f service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:13.766360 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c6f350a9-6d85-4470-a8f8-f8c26c254279 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:13.768934 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-c6f350a9-6d85-4470-a8f8-f8c26c254279 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:13.784227 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c6f350a9-6d85-4470-a8f8-f8c26c254279 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:13.793589 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c6f350a9-6d85-4470-a8f8-f8c26c254279 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:13.794235 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c6f350a9-6d85-4470-a8f8-f8c26c254279 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:13.795336 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-2a7fec4a-1f02-4b1d-b591-109114b316f0 req-7cf022b8-e40a-494d-9407-48adc6c9a70f service nova] Creating event network-changed:7f80cdc8-459e-4ac3-a549-1418688400ff for instance efae89e3-9121-4a31-ba5b-040087bb8b3e on hv-cinder-85495 Oct 11 07:21:13.798613 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c6f350a9-6d85-4470-a8f8-f8c26c254279 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:13.799271 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c6f350a9-6d85-4470-a8f8-f8c26c254279 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:13.799992 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-c6f350a9-6d85-4470-a8f8-f8c26c254279 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:13.802386 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-2a7fec4a-1f02-4b1d-b591-109114b316f0 req-7cf022b8-e40a-494d-9407-48adc6c9a70f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080769 Oct 11 07:21:13.802980 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1733/3466] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:21:14.090121 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-c6f350a9-6d85-4470-a8f8-f8c26c254279 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a69fa70c78405d805f8b70860f57bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:14.112085 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c6f350a9-6d85-4470-a8f8-f8c26c254279 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 200 len: 1359 microversion: 2.1 time: 0.349519 Oct 11 07:21:14.115504 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1734/3467] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:13 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 1359 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:14.717576 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d7a5a963-df47-4887-b7ff-55e5e376517c tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:14.718232 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d7a5a963-df47-4887-b7ff-55e5e376517c tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: de68987b-f150-41fb-9df8-e056b5f2e140] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:14.724623 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7a5a963-df47-4887-b7ff-55e5e376517c tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:14.725108 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7a5a963-df47-4887-b7ff-55e5e376517c tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:14.725547 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7a5a963-df47-4887-b7ff-55e5e376517c tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:14.726250 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7a5a963-df47-4887-b7ff-55e5e376517c tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:14.726706 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7a5a963-df47-4887-b7ff-55e5e376517c tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:14.727133 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d7a5a963-df47-4887-b7ff-55e5e376517c tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:14.798907 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d7a5a963-df47-4887-b7ff-55e5e376517c tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:14.806716 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d7a5a963-df47-4887-b7ff-55e5e376517c tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140" status: 200 len: 1143 microversion: 2.1 time: 0.094545 Oct 11 07:21:14.807583 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1734/3468] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:14 2022] GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140 => generated 1143 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:15.140179 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-f59b304a-2ab2-40d5-aabf-3c32d3f09fbf tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:15.140930 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-f59b304a-2ab2-40d5-aabf-3c32d3f09fbf tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:15.147768 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f59b304a-2ab2-40d5-aabf-3c32d3f09fbf tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:15.148492 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f59b304a-2ab2-40d5-aabf-3c32d3f09fbf tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:15.149100 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f59b304a-2ab2-40d5-aabf-3c32d3f09fbf tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:15.149979 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f59b304a-2ab2-40d5-aabf-3c32d3f09fbf tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:15.150587 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f59b304a-2ab2-40d5-aabf-3c32d3f09fbf tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:15.151302 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-f59b304a-2ab2-40d5-aabf-3c32d3f09fbf tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:15.302886 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-f59b304a-2ab2-40d5-aabf-3c32d3f09fbf tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a69fa70c78405d805f8b70860f57bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:15.311387 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-f59b304a-2ab2-40d5-aabf-3c32d3f09fbf tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 200 len: 1359 microversion: 2.1 time: 0.175093 Oct 11 07:21:15.327468 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1735/3469] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:15 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:15.839320 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-8ba837b2-c5e9-428a-9884-d991e9e59114 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:15.840118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-8ba837b2-c5e9-428a-9884-d991e9e59114 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: de68987b-f150-41fb-9df8-e056b5f2e140] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:15.847152 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ba837b2-c5e9-428a-9884-d991e9e59114 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:15.847978 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ba837b2-c5e9-428a-9884-d991e9e59114 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:15.848491 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ba837b2-c5e9-428a-9884-d991e9e59114 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:15.849256 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ba837b2-c5e9-428a-9884-d991e9e59114 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:15.849811 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ba837b2-c5e9-428a-9884-d991e9e59114 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:15.850298 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-8ba837b2-c5e9-428a-9884-d991e9e59114 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:15.912215 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-8ba837b2-c5e9-428a-9884-d991e9e59114 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:15.920450 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-8ba837b2-c5e9-428a-9884-d991e9e59114 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140" status: 200 len: 1143 microversion: 2.1 time: 0.086606 Oct 11 07:21:15.921001 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1735/3470] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:15 2022] GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140 => generated 1143 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:16.334119 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-67cfb76c-37eb-4f1d-a944-ef6490b3c8f4 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:16.335721 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-67cfb76c-37eb-4f1d-a944-ef6490b3c8f4 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:16.343041 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-67cfb76c-37eb-4f1d-a944-ef6490b3c8f4 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:16.343814 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-67cfb76c-37eb-4f1d-a944-ef6490b3c8f4 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:16.344471 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-67cfb76c-37eb-4f1d-a944-ef6490b3c8f4 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:16.345708 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-67cfb76c-37eb-4f1d-a944-ef6490b3c8f4 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:16.346345 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-67cfb76c-37eb-4f1d-a944-ef6490b3c8f4 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:16.346970 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-67cfb76c-37eb-4f1d-a944-ef6490b3c8f4 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:16.507230 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-67cfb76c-37eb-4f1d-a944-ef6490b3c8f4 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a69fa70c78405d805f8b70860f57bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:16.515655 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-67cfb76c-37eb-4f1d-a944-ef6490b3c8f4 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 200 len: 1359 microversion: 2.1 time: 0.185272 Oct 11 07:21:16.530712 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1736/3471] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:16 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:21:16.942016 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d8056661-61ec-4a6a-9427-98cf179bab03 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:16.942665 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d8056661-61ec-4a6a-9427-98cf179bab03 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: de68987b-f150-41fb-9df8-e056b5f2e140] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:16.949047 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8056661-61ec-4a6a-9427-98cf179bab03 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:16.949735 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8056661-61ec-4a6a-9427-98cf179bab03 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:16.950356 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8056661-61ec-4a6a-9427-98cf179bab03 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:16.951758 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8056661-61ec-4a6a-9427-98cf179bab03 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:16.952200 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8056661-61ec-4a6a-9427-98cf179bab03 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:16.952617 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d8056661-61ec-4a6a-9427-98cf179bab03 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:17.012919 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d8056661-61ec-4a6a-9427-98cf179bab03 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:17.021118 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d8056661-61ec-4a6a-9427-98cf179bab03 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140" status: 200 len: 1143 microversion: 2.1 time: 0.082894 Oct 11 07:21:17.021656 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1736/3472] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:16 2022] GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140 => generated 1143 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:21:17.538716 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-1fe0376e-6a2a-4f25-bccf-9af999aba5f4 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:17.539452 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-1fe0376e-6a2a-4f25-bccf-9af999aba5f4 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:17.546360 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fe0376e-6a2a-4f25-bccf-9af999aba5f4 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:17.546841 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fe0376e-6a2a-4f25-bccf-9af999aba5f4 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:17.547270 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fe0376e-6a2a-4f25-bccf-9af999aba5f4 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:17.548000 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fe0376e-6a2a-4f25-bccf-9af999aba5f4 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:17.548449 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fe0376e-6a2a-4f25-bccf-9af999aba5f4 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:17.548867 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-1fe0376e-6a2a-4f25-bccf-9af999aba5f4 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:17.694050 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-1fe0376e-6a2a-4f25-bccf-9af999aba5f4 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a69fa70c78405d805f8b70860f57bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:17.707504 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-1fe0376e-6a2a-4f25-bccf-9af999aba5f4 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 200 len: 1359 microversion: 2.1 time: 0.168493 Oct 11 07:21:17.712874 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1737/3473] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:17 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:18.044373 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c6310450-8725-40c7-8a37-5f1fdc7425b1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:18.046212 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c6310450-8725-40c7-8a37-5f1fdc7425b1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: de68987b-f150-41fb-9df8-e056b5f2e140] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:18.053451 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c6310450-8725-40c7-8a37-5f1fdc7425b1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:18.053942 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c6310450-8725-40c7-8a37-5f1fdc7425b1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:18.054371 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c6310450-8725-40c7-8a37-5f1fdc7425b1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:18.055071 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c6310450-8725-40c7-8a37-5f1fdc7425b1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:18.055547 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c6310450-8725-40c7-8a37-5f1fdc7425b1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:18.056080 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c6310450-8725-40c7-8a37-5f1fdc7425b1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:18.119513 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c6310450-8725-40c7-8a37-5f1fdc7425b1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:18.128545 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c6310450-8725-40c7-8a37-5f1fdc7425b1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140" status: 200 len: 1143 microversion: 2.1 time: 0.088138 Oct 11 07:21:18.129181 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1737/3474] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:18 2022] GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140 => generated 1143 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:18.729646 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-09fc0c2a-c247-4d2b-a581-86631235c474 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:18.730487 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-09fc0c2a-c247-4d2b-a581-86631235c474 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:18.741756 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-09fc0c2a-c247-4d2b-a581-86631235c474 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:18.742889 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-09fc0c2a-c247-4d2b-a581-86631235c474 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:18.743532 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-09fc0c2a-c247-4d2b-a581-86631235c474 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:18.744612 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-09fc0c2a-c247-4d2b-a581-86631235c474 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:18.745472 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-09fc0c2a-c247-4d2b-a581-86631235c474 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:18.745909 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-09fc0c2a-c247-4d2b-a581-86631235c474 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:18.888899 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-09fc0c2a-c247-4d2b-a581-86631235c474 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a69fa70c78405d805f8b70860f57bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:18.896586 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-09fc0c2a-c247-4d2b-a581-86631235c474 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 200 len: 1359 microversion: 2.1 time: 0.172134 Oct 11 07:21:18.906912 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1738/3475] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:18 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:19.152716 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-01000a03-4c42-4ef2-82e5-1b244f4c26ba tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:19.153332 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-01000a03-4c42-4ef2-82e5-1b244f4c26ba tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: de68987b-f150-41fb-9df8-e056b5f2e140] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:19.160436 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-01000a03-4c42-4ef2-82e5-1b244f4c26ba tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:19.160912 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-01000a03-4c42-4ef2-82e5-1b244f4c26ba tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:19.161343 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-01000a03-4c42-4ef2-82e5-1b244f4c26ba tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:19.162027 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-01000a03-4c42-4ef2-82e5-1b244f4c26ba tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:19.162478 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-01000a03-4c42-4ef2-82e5-1b244f4c26ba tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:19.162901 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-01000a03-4c42-4ef2-82e5-1b244f4c26ba tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:19.226945 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-01000a03-4c42-4ef2-82e5-1b244f4c26ba tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:19.234939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-01000a03-4c42-4ef2-82e5-1b244f4c26ba tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140" status: 200 len: 1143 microversion: 2.1 time: 0.086015 Oct 11 07:21:19.235516 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1738/3476] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:19 2022] GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140 => generated 1143 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:19.919249 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b32e6662-ca5e-4ce2-b30f-77e105b5f6a6 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:19.920107 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b32e6662-ca5e-4ce2-b30f-77e105b5f6a6 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:19.926307 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b32e6662-ca5e-4ce2-b30f-77e105b5f6a6 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:19.926857 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b32e6662-ca5e-4ce2-b30f-77e105b5f6a6 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:19.927287 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b32e6662-ca5e-4ce2-b30f-77e105b5f6a6 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:19.927990 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b32e6662-ca5e-4ce2-b30f-77e105b5f6a6 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:19.928434 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b32e6662-ca5e-4ce2-b30f-77e105b5f6a6 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:19.928848 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b32e6662-ca5e-4ce2-b30f-77e105b5f6a6 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:20.053168 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b32e6662-ca5e-4ce2-b30f-77e105b5f6a6 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a69fa70c78405d805f8b70860f57bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:20.061073 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b32e6662-ca5e-4ce2-b30f-77e105b5f6a6 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 200 len: 1359 microversion: 2.1 time: 0.145640 Oct 11 07:21:20.061628 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1739/3477] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:19 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:20.257910 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d3f0a3dc-8e41-4701-bfbc-81000a2fe8a6 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:20.258489 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d3f0a3dc-8e41-4701-bfbc-81000a2fe8a6 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: de68987b-f150-41fb-9df8-e056b5f2e140] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:20.265581 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d3f0a3dc-8e41-4701-bfbc-81000a2fe8a6 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:20.266051 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d3f0a3dc-8e41-4701-bfbc-81000a2fe8a6 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:20.266474 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d3f0a3dc-8e41-4701-bfbc-81000a2fe8a6 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:20.267152 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d3f0a3dc-8e41-4701-bfbc-81000a2fe8a6 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:20.267626 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d3f0a3dc-8e41-4701-bfbc-81000a2fe8a6 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:20.268040 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d3f0a3dc-8e41-4701-bfbc-81000a2fe8a6 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:20.349157 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d3f0a3dc-8e41-4701-bfbc-81000a2fe8a6 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:20.356798 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d3f0a3dc-8e41-4701-bfbc-81000a2fe8a6 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140" status: 200 len: 1143 microversion: 2.1 time: 0.102766 Oct 11 07:21:20.357864 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1739/3478] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:20 2022] GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140 => generated 1143 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:21.084306 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-74d2a19f-4f22-4089-8c1a-e8409f767a3c tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:21.085108 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-74d2a19f-4f22-4089-8c1a-e8409f767a3c tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:21.087031 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=2 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:21:21.093725 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-74d2a19f-4f22-4089-8c1a-e8409f767a3c tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:21.094206 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-74d2a19f-4f22-4089-8c1a-e8409f767a3c tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:21.094638 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-74d2a19f-4f22-4089-8c1a-e8409f767a3c tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:21.095335 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-74d2a19f-4f22-4089-8c1a-e8409f767a3c tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:21.095842 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-74d2a19f-4f22-4089-8c1a-e8409f767a3c tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:21.096265 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-74d2a19f-4f22-4089-8c1a-e8409f767a3c tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:21.221236 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-74d2a19f-4f22-4089-8c1a-e8409f767a3c tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a69fa70c78405d805f8b70860f57bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:21.228850 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-74d2a19f-4f22-4089-8c1a-e8409f767a3c tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 200 len: 1359 microversion: 2.1 time: 0.148466 Oct 11 07:21:21.229400 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1740/3479] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:21 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:21.379593 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3f565653-0f71-44d0-9cb9-71ede9fc4c76 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:21.380283 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3f565653-0f71-44d0-9cb9-71ede9fc4c76 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: de68987b-f150-41fb-9df8-e056b5f2e140] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:21.386913 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3f565653-0f71-44d0-9cb9-71ede9fc4c76 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:21.387668 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3f565653-0f71-44d0-9cb9-71ede9fc4c76 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:21.388799 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3f565653-0f71-44d0-9cb9-71ede9fc4c76 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:21.389636 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3f565653-0f71-44d0-9cb9-71ede9fc4c76 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:21.390155 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3f565653-0f71-44d0-9cb9-71ede9fc4c76 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:21.390767 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3f565653-0f71-44d0-9cb9-71ede9fc4c76 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:21.505346 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3f565653-0f71-44d0-9cb9-71ede9fc4c76 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:21.514557 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3f565653-0f71-44d0-9cb9-71ede9fc4c76 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140" status: 200 len: 1191 microversion: 2.1 time: 0.138869 Oct 11 07:21:21.515545 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1740/3480] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:21 2022] GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140 => generated 1191 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:22.252328 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2e6423b0-942e-4438-be48-0927f06108f1 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:22.252937 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2e6423b0-942e-4438-be48-0927f06108f1 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:22.259328 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2e6423b0-942e-4438-be48-0927f06108f1 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:22.259834 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2e6423b0-942e-4438-be48-0927f06108f1 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:22.260264 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2e6423b0-942e-4438-be48-0927f06108f1 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:22.260947 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2e6423b0-942e-4438-be48-0927f06108f1 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:22.261396 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2e6423b0-942e-4438-be48-0927f06108f1 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:22.261815 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2e6423b0-942e-4438-be48-0927f06108f1 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:22.391149 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-2e6423b0-942e-4438-be48-0927f06108f1 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a69fa70c78405d805f8b70860f57bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:22.398870 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2e6423b0-942e-4438-be48-0927f06108f1 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 200 len: 1359 microversion: 2.1 time: 0.150412 Oct 11 07:21:22.399450 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1741/3481] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:22 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:22.537931 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4e8a97c3-c8b4-4059-80d9-b8f4eafe2e13 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:22.538527 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4e8a97c3-c8b4-4059-80d9-b8f4eafe2e13 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: de68987b-f150-41fb-9df8-e056b5f2e140] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:22.544824 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4e8a97c3-c8b4-4059-80d9-b8f4eafe2e13 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:22.545295 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4e8a97c3-c8b4-4059-80d9-b8f4eafe2e13 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:22.545722 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4e8a97c3-c8b4-4059-80d9-b8f4eafe2e13 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:22.546396 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4e8a97c3-c8b4-4059-80d9-b8f4eafe2e13 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:22.546839 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4e8a97c3-c8b4-4059-80d9-b8f4eafe2e13 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:22.547261 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4e8a97c3-c8b4-4059-80d9-b8f4eafe2e13 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:22.607761 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4e8a97c3-c8b4-4059-80d9-b8f4eafe2e13 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:22.615469 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4e8a97c3-c8b4-4059-80d9-b8f4eafe2e13 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140" status: 200 len: 1191 microversion: 2.1 time: 0.081291 Oct 11 07:21:22.616021 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1741/3482] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:22 2022] GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140 => generated 1191 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:23.421584 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-84acdfa2-4d48-41a1-ad2e-857ac9c6e36a tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:23.422407 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-84acdfa2-4d48-41a1-ad2e-857ac9c6e36a tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:23.429202 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-84acdfa2-4d48-41a1-ad2e-857ac9c6e36a tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:23.429716 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-84acdfa2-4d48-41a1-ad2e-857ac9c6e36a tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:23.430160 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-84acdfa2-4d48-41a1-ad2e-857ac9c6e36a tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:23.430878 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-84acdfa2-4d48-41a1-ad2e-857ac9c6e36a tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:23.431332 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-84acdfa2-4d48-41a1-ad2e-857ac9c6e36a tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:23.431782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-84acdfa2-4d48-41a1-ad2e-857ac9c6e36a tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:23.572459 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-84acdfa2-4d48-41a1-ad2e-857ac9c6e36a tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a69fa70c78405d805f8b70860f57bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:23.581222 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-84acdfa2-4d48-41a1-ad2e-857ac9c6e36a tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 200 len: 1359 microversion: 2.1 time: 0.163568 Oct 11 07:21:23.581806 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1742/3483] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:23 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:23.638385 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-044faa4c-0162-4621-9c95-6f26d82a2d54 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:23.639677 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-044faa4c-0162-4621-9c95-6f26d82a2d54 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: de68987b-f150-41fb-9df8-e056b5f2e140] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:23.641949 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=2 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:21:23.642685 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell0:SELECT=12 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:21:23.649374 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-044faa4c-0162-4621-9c95-6f26d82a2d54 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:23.649880 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-044faa4c-0162-4621-9c95-6f26d82a2d54 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:23.650316 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-044faa4c-0162-4621-9c95-6f26d82a2d54 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:23.651164 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-044faa4c-0162-4621-9c95-6f26d82a2d54 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:23.651656 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-044faa4c-0162-4621-9c95-6f26d82a2d54 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:23.652099 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-044faa4c-0162-4621-9c95-6f26d82a2d54 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:23.890175 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-044faa4c-0162-4621-9c95-6f26d82a2d54 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:23.899072 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-044faa4c-0162-4621-9c95-6f26d82a2d54 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140" status: 200 len: 1277 microversion: 2.1 time: 0.264591 Oct 11 07:21:23.899930 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1742/3484] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:23 2022] GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140 => generated 1277 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:24.605099 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-da8ce098-c7b0-4bcf-bcc7-a402e6439b3a tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:24.605717 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-da8ce098-c7b0-4bcf-bcc7-a402e6439b3a tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:24.607641 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=8 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:21:24.614479 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-da8ce098-c7b0-4bcf-bcc7-a402e6439b3a tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:24.615038 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-da8ce098-c7b0-4bcf-bcc7-a402e6439b3a tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:24.615504 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-da8ce098-c7b0-4bcf-bcc7-a402e6439b3a tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:24.616209 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-da8ce098-c7b0-4bcf-bcc7-a402e6439b3a tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:24.616663 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-da8ce098-c7b0-4bcf-bcc7-a402e6439b3a tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:24.617092 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-da8ce098-c7b0-4bcf-bcc7-a402e6439b3a tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:24.776830 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-da8ce098-c7b0-4bcf-bcc7-a402e6439b3a tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a69fa70c78405d805f8b70860f57bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:24.784818 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-da8ce098-c7b0-4bcf-bcc7-a402e6439b3a tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 200 len: 1359 microversion: 2.1 time: 0.183529 Oct 11 07:21:24.785501 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1743/3485] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:24 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:24.922691 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-d983235f-c9f6-4b7b-a7c2-15d660b25274 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:24.923292 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-d983235f-c9f6-4b7b-a7c2-15d660b25274 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: de68987b-f150-41fb-9df8-e056b5f2e140] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:24.930409 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d983235f-c9f6-4b7b-a7c2-15d660b25274 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:24.930890 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d983235f-c9f6-4b7b-a7c2-15d660b25274 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:24.931313 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d983235f-c9f6-4b7b-a7c2-15d660b25274 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:24.932025 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d983235f-c9f6-4b7b-a7c2-15d660b25274 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:24.932469 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d983235f-c9f6-4b7b-a7c2-15d660b25274 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:24.932885 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-d983235f-c9f6-4b7b-a7c2-15d660b25274 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:25.121991 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-d983235f-c9f6-4b7b-a7c2-15d660b25274 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:25.130204 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-d983235f-c9f6-4b7b-a7c2-15d660b25274 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140" status: 200 len: 1265 microversion: 2.1 time: 0.211868 Oct 11 07:21:25.130861 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1743/3486] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:24 2022] GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140 => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:21:25.212778 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-8b42b5f5-4557-4469-9887-e1986c02eda6 req-e43e17f8-fff9-49d1-8d9f-003112e6800b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de68987b-f150-41fb-9df8-e056b5f2e140", "tag": "62c41126-ec7e-4ed2-a83a-c9fddae2327b"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:21:25.222992 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-8b42b5f5-4557-4469-9887-e1986c02eda6 req-e43e17f8-fff9-49d1-8d9f-003112e6800b service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:25.223502 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-8b42b5f5-4557-4469-9887-e1986c02eda6 req-e43e17f8-fff9-49d1-8d9f-003112e6800b service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:25.223938 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-8b42b5f5-4557-4469-9887-e1986c02eda6 req-e43e17f8-fff9-49d1-8d9f-003112e6800b service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:25.227605 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=100 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:21:25.236389 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-8b42b5f5-4557-4469-9887-e1986c02eda6 req-e43e17f8-fff9-49d1-8d9f-003112e6800b service nova] Creating event network-changed:62c41126-ec7e-4ed2-a83a-c9fddae2327b for instance de68987b-f150-41fb-9df8-e056b5f2e140 on hv-cinder-85495 Oct 11 07:21:25.241759 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-8b42b5f5-4557-4469-9887-e1986c02eda6 req-e43e17f8-fff9-49d1-8d9f-003112e6800b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094433 Oct 11 07:21:25.242261 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1744/3487] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:21:25.806856 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5a15149a-c9b9-444c-ae4f-43a1f25a09df tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:25.807484 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5a15149a-c9b9-444c-ae4f-43a1f25a09df tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:25.813993 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5a15149a-c9b9-444c-ae4f-43a1f25a09df tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:25.814481 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5a15149a-c9b9-444c-ae4f-43a1f25a09df tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:25.814923 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5a15149a-c9b9-444c-ae4f-43a1f25a09df tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:25.815633 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5a15149a-c9b9-444c-ae4f-43a1f25a09df tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:25.816081 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5a15149a-c9b9-444c-ae4f-43a1f25a09df tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:25.816500 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5a15149a-c9b9-444c-ae4f-43a1f25a09df tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:25.948160 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5a15149a-c9b9-444c-ae4f-43a1f25a09df tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a69fa70c78405d805f8b70860f57bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:25.955699 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5a15149a-c9b9-444c-ae4f-43a1f25a09df tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 200 len: 1359 microversion: 2.1 time: 0.152611 Oct 11 07:21:25.956260 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1744/3488] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:25 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:26.153940 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b8057c56-0279-46b2-85d4-564aa13faade tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:26.155181 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b8057c56-0279-46b2-85d4-564aa13faade tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: de68987b-f150-41fb-9df8-e056b5f2e140] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:26.161920 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8057c56-0279-46b2-85d4-564aa13faade tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:26.162404 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8057c56-0279-46b2-85d4-564aa13faade tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:26.162837 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8057c56-0279-46b2-85d4-564aa13faade tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:26.163577 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8057c56-0279-46b2-85d4-564aa13faade tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:26.164007 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8057c56-0279-46b2-85d4-564aa13faade tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:26.164427 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b8057c56-0279-46b2-85d4-564aa13faade tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:26.301840 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b8057c56-0279-46b2-85d4-564aa13faade tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:26.311053 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b8057c56-0279-46b2-85d4-564aa13faade tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140" status: 200 len: 1265 microversion: 2.1 time: 0.161139 Oct 11 07:21:26.312028 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1745/3489] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:26 2022] GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:26.401746 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-cc6c6f3c-5e29-47f2-95fe-c91164acf09b req-7d5b8188-8f12-4ff7-a08b-8444a6ab5182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efae89e3-9121-4a31-ba5b-040087bb8b3e", "name": "network-vif-plugged", "status": "completed", "tag": "7f80cdc8-459e-4ac3-a549-1418688400ff"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:21:26.413098 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-cc6c6f3c-5e29-47f2-95fe-c91164acf09b req-7d5b8188-8f12-4ff7-a08b-8444a6ab5182 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:26.425707 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-cc6c6f3c-5e29-47f2-95fe-c91164acf09b req-7d5b8188-8f12-4ff7-a08b-8444a6ab5182 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:26.425707 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-cc6c6f3c-5e29-47f2-95fe-c91164acf09b req-7d5b8188-8f12-4ff7-a08b-8444a6ab5182 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:26.429647 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-cc6c6f3c-5e29-47f2-95fe-c91164acf09b req-7d5b8188-8f12-4ff7-a08b-8444a6ab5182 service nova] Creating event network-vif-plugged:7f80cdc8-459e-4ac3-a549-1418688400ff for instance efae89e3-9121-4a31-ba5b-040087bb8b3e on hv-cinder-85495 Oct 11 07:21:26.434677 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-cc6c6f3c-5e29-47f2-95fe-c91164acf09b req-7d5b8188-8f12-4ff7-a08b-8444a6ab5182 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038174 Oct 11 07:21:26.435386 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1745/3490] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:21:26.978356 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-95c87d4b-5b2f-473d-82ce-28aa69f0f2b2 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:26.978875 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-95c87d4b-5b2f-473d-82ce-28aa69f0f2b2 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:26.985041 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-95c87d4b-5b2f-473d-82ce-28aa69f0f2b2 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:26.985509 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-95c87d4b-5b2f-473d-82ce-28aa69f0f2b2 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:26.985932 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-95c87d4b-5b2f-473d-82ce-28aa69f0f2b2 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:26.986609 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-95c87d4b-5b2f-473d-82ce-28aa69f0f2b2 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:26.987055 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-95c87d4b-5b2f-473d-82ce-28aa69f0f2b2 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:26.987493 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-95c87d4b-5b2f-473d-82ce-28aa69f0f2b2 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:27.112631 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-95c87d4b-5b2f-473d-82ce-28aa69f0f2b2 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a69fa70c78405d805f8b70860f57bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:27.120277 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-95c87d4b-5b2f-473d-82ce-28aa69f0f2b2 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 200 len: 1359 microversion: 2.1 time: 0.145820 Oct 11 07:21:27.120833 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1746/3491] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:26 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:27.335109 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-873f63d1-09d5-43bb-81f7-2c960a891d03 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:27.335754 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-873f63d1-09d5-43bb-81f7-2c960a891d03 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: de68987b-f150-41fb-9df8-e056b5f2e140] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:27.342006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-873f63d1-09d5-43bb-81f7-2c960a891d03 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:27.342484 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-873f63d1-09d5-43bb-81f7-2c960a891d03 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:27.342919 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-873f63d1-09d5-43bb-81f7-2c960a891d03 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:27.343642 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-873f63d1-09d5-43bb-81f7-2c960a891d03 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:27.344095 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-873f63d1-09d5-43bb-81f7-2c960a891d03 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:27.344520 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-873f63d1-09d5-43bb-81f7-2c960a891d03 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:27.473028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-873f63d1-09d5-43bb-81f7-2c960a891d03 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:27.475369 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=100 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:21:27.482849 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-873f63d1-09d5-43bb-81f7-2c960a891d03 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140" status: 200 len: 1265 microversion: 2.1 time: 0.151956 Oct 11 07:21:27.483494 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1746/3492] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:27 2022] GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:28.144071 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-65b1f851-9b05-435d-bb31-42ba3ed6eb74 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:28.144691 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-65b1f851-9b05-435d-bb31-42ba3ed6eb74 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:28.151112 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65b1f851-9b05-435d-bb31-42ba3ed6eb74 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:28.151618 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65b1f851-9b05-435d-bb31-42ba3ed6eb74 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:28.152045 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65b1f851-9b05-435d-bb31-42ba3ed6eb74 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:28.152720 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65b1f851-9b05-435d-bb31-42ba3ed6eb74 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:28.153160 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65b1f851-9b05-435d-bb31-42ba3ed6eb74 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:28.153573 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-65b1f851-9b05-435d-bb31-42ba3ed6eb74 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:28.290784 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-65b1f851-9b05-435d-bb31-42ba3ed6eb74 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a69fa70c78405d805f8b70860f57bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:28.298620 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-65b1f851-9b05-435d-bb31-42ba3ed6eb74 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 200 len: 1359 microversion: 2.1 time: 0.158374 Oct 11 07:21:28.299173 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1747/3493] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:28 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:28.505716 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-cfdcb968-ac97-46e7-a46f-6f38ca584e83 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:28.506355 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-cfdcb968-ac97-46e7-a46f-6f38ca584e83 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: de68987b-f150-41fb-9df8-e056b5f2e140] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:28.512861 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cfdcb968-ac97-46e7-a46f-6f38ca584e83 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:28.514063 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cfdcb968-ac97-46e7-a46f-6f38ca584e83 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:28.514505 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cfdcb968-ac97-46e7-a46f-6f38ca584e83 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:28.515193 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cfdcb968-ac97-46e7-a46f-6f38ca584e83 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:28.515677 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cfdcb968-ac97-46e7-a46f-6f38ca584e83 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:28.516103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-cfdcb968-ac97-46e7-a46f-6f38ca584e83 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:28.646350 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-cfdcb968-ac97-46e7-a46f-6f38ca584e83 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:28.654162 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-cfdcb968-ac97-46e7-a46f-6f38ca584e83 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140" status: 200 len: 1265 microversion: 2.1 time: 0.152341 Oct 11 07:21:28.654755 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1747/3494] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:28 2022] GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:29.321220 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-a59dc0e8-26ea-4dd0-9791-7a942f1fbf31 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:29.321822 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-a59dc0e8-26ea-4dd0-9791-7a942f1fbf31 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:29.328809 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a59dc0e8-26ea-4dd0-9791-7a942f1fbf31 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:29.329279 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a59dc0e8-26ea-4dd0-9791-7a942f1fbf31 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:29.329703 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a59dc0e8-26ea-4dd0-9791-7a942f1fbf31 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:29.330380 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a59dc0e8-26ea-4dd0-9791-7a942f1fbf31 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:29.330823 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a59dc0e8-26ea-4dd0-9791-7a942f1fbf31 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:29.331239 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-a59dc0e8-26ea-4dd0-9791-7a942f1fbf31 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:29.458824 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-a59dc0e8-26ea-4dd0-9791-7a942f1fbf31 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a69fa70c78405d805f8b70860f57bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:29.466506 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-a59dc0e8-26ea-4dd0-9791-7a942f1fbf31 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 200 len: 1549 microversion: 2.1 time: 0.149120 Oct 11 07:21:29.467051 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1748/3495] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:29 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:29.489562 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-91d5dc3a-d3cb-4601-b20e-8c37b4f42bdb tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:29.490303 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-91d5dc3a-d3cb-4601-b20e-8c37b4f42bdb tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:29.496360 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-91d5dc3a-d3cb-4601-b20e-8c37b4f42bdb tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:29.496836 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-91d5dc3a-d3cb-4601-b20e-8c37b4f42bdb tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:29.497268 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-91d5dc3a-d3cb-4601-b20e-8c37b4f42bdb tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:29.498548 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-91d5dc3a-d3cb-4601-b20e-8c37b4f42bdb tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:29.498993 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-91d5dc3a-d3cb-4601-b20e-8c37b4f42bdb tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:29.499439 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-91d5dc3a-d3cb-4601-b20e-8c37b4f42bdb tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:29.625248 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-91d5dc3a-d3cb-4601-b20e-8c37b4f42bdb tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a69fa70c78405d805f8b70860f57bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:29.632961 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-91d5dc3a-d3cb-4601-b20e-8c37b4f42bdb tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 200 len: 1549 microversion: 2.1 time: 0.147261 Oct 11 07:21:29.633520 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1748/3496] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:29 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 1549 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:29.654217 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-668b423f-cd31-450e-a19e-262524a22d63 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:29.659127 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-668b423f-cd31-450e-a19e-262524a22d63 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '96a69fa70c78405d805f8b70860f57bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:29.659919 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-668b423f-cd31-450e-a19e-262524a22d63 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Searching by: {'deleted': False, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885'} {{(pid=125267) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 07:21:29.666441 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-668b423f-cd31-450e-a19e-262524a22d63 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:29.666913 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-668b423f-cd31-450e-a19e-262524a22d63 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:29.667345 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-668b423f-cd31-450e-a19e-262524a22d63 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:29.668096 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-668b423f-cd31-450e-a19e-262524a22d63 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:29.668545 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-668b423f-cd31-450e-a19e-262524a22d63 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:29.668965 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-668b423f-cd31-450e-a19e-262524a22d63 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:29.733593 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fbcf146e-bb76-445e-a69c-71180e2e9288 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:29.734549 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fbcf146e-bb76-445e-a69c-71180e2e9288 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: de68987b-f150-41fb-9df8-e056b5f2e140] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:29.740560 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fbcf146e-bb76-445e-a69c-71180e2e9288 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:29.741101 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fbcf146e-bb76-445e-a69c-71180e2e9288 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:29.741534 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fbcf146e-bb76-445e-a69c-71180e2e9288 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:29.742216 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fbcf146e-bb76-445e-a69c-71180e2e9288 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:29.742660 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fbcf146e-bb76-445e-a69c-71180e2e9288 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:29.743079 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fbcf146e-bb76-445e-a69c-71180e2e9288 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:29.759502 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.multi_cell_list [None req-668b423f-cd31-450e-a19e-262524a22d63 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125267) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 07:21:29.854487 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-668b423f-cd31-450e-a19e-262524a22d63 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.203909 Oct 11 07:21:29.855067 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1749/3497] 10.222.0.39 () {58 vars in 1125 bytes} [Tue Oct 11 07:21:29 2022] GET /compute/v2.1/servers => generated 343 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:21:29.867106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d9fd4745-25e6-4534-80fb-6ca67722b295 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:29.867742 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d9fd4745-25e6-4534-80fb-6ca67722b295 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:29.873575 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d9fd4745-25e6-4534-80fb-6ca67722b295 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:29.874048 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d9fd4745-25e6-4534-80fb-6ca67722b295 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:29.874472 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d9fd4745-25e6-4534-80fb-6ca67722b295 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:29.875155 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d9fd4745-25e6-4534-80fb-6ca67722b295 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:29.875333 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fbcf146e-bb76-445e-a69c-71180e2e9288 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:29.875631 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d9fd4745-25e6-4534-80fb-6ca67722b295 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:29.876046 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d9fd4745-25e6-4534-80fb-6ca67722b295 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:29.883008 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fbcf146e-bb76-445e-a69c-71180e2e9288 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140" status: 200 len: 1265 microversion: 2.1 time: 0.210120 Oct 11 07:21:29.883615 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1749/3498] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:29 2022] GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140 => generated 1265 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:21:30.003775 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d9fd4745-25e6-4534-80fb-6ca67722b295 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a69fa70c78405d805f8b70860f57bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:30.011283 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d9fd4745-25e6-4534-80fb-6ca67722b295 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 200 len: 1549 microversion: 2.1 time: 0.147825 Oct 11 07:21:30.011857 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1750/3499] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:29 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 1549 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:21:30.905660 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-18e0468f-8d68-450c-bda0-9f3fbacb9758 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:30.906259 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-18e0468f-8d68-450c-bda0-9f3fbacb9758 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: de68987b-f150-41fb-9df8-e056b5f2e140] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:30.908566 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:21:30.913929 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18e0468f-8d68-450c-bda0-9f3fbacb9758 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:30.914408 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18e0468f-8d68-450c-bda0-9f3fbacb9758 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:30.914865 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18e0468f-8d68-450c-bda0-9f3fbacb9758 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:30.915578 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18e0468f-8d68-450c-bda0-9f3fbacb9758 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:30.916025 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18e0468f-8d68-450c-bda0-9f3fbacb9758 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:30.916445 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-18e0468f-8d68-450c-bda0-9f3fbacb9758 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:31.047221 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-18e0468f-8d68-450c-bda0-9f3fbacb9758 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:31.054973 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-18e0468f-8d68-450c-bda0-9f3fbacb9758 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140" status: 200 len: 1265 microversion: 2.1 time: 0.153157 Oct 11 07:21:31.055561 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1750/3500] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:30 2022] GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:31.555777 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-81529141-1cad-47b1-8cf1-5d09848ee7ee tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b52ca7e7-48b7-4c4c-b166-bbbf3e3146e1"}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:21:31.558094 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-81529141-1cad-47b1-8cf1-5d09848ee7ee tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:31.564466 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81529141-1cad-47b1-8cf1-5d09848ee7ee tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:31.564947 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81529141-1cad-47b1-8cf1-5d09848ee7ee tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:31.565380 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81529141-1cad-47b1-8cf1-5d09848ee7ee tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:31.566062 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81529141-1cad-47b1-8cf1-5d09848ee7ee tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:31.566510 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81529141-1cad-47b1-8cf1-5d09848ee7ee tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:31.566925 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-81529141-1cad-47b1-8cf1-5d09848ee7ee tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:31.846667 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-81529141-1cad-47b1-8cf1-5d09848ee7ee tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "POST /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294215 Oct 11 07:21:31.847195 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1751/3501] 10.222.0.39 () {60 vars in 1323 bytes} [Tue Oct 11 07:21:31 2022] POST /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:21:32.078380 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-fac8abd4-4c02-4782-9fe9-fc2d7cdd3152 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:32.079178 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-fac8abd4-4c02-4782-9fe9-fc2d7cdd3152 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: de68987b-f150-41fb-9df8-e056b5f2e140] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:32.086112 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fac8abd4-4c02-4782-9fe9-fc2d7cdd3152 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:32.086582 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fac8abd4-4c02-4782-9fe9-fc2d7cdd3152 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:32.087005 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fac8abd4-4c02-4782-9fe9-fc2d7cdd3152 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:32.087702 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fac8abd4-4c02-4782-9fe9-fc2d7cdd3152 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:32.088146 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fac8abd4-4c02-4782-9fe9-fc2d7cdd3152 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:32.088559 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-fac8abd4-4c02-4782-9fe9-fc2d7cdd3152 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:32.214436 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-fac8abd4-4c02-4782-9fe9-fc2d7cdd3152 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:32.222536 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-fac8abd4-4c02-4782-9fe9-fc2d7cdd3152 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140" status: 200 len: 1265 microversion: 2.1 time: 0.148432 Oct 11 07:21:32.223088 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1751/3502] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:32 2022] GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:33.245885 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-3182f956-aeac-4655-8e7b-7bb7c777467d tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:33.246578 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-3182f956-aeac-4655-8e7b-7bb7c777467d tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: de68987b-f150-41fb-9df8-e056b5f2e140] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:33.249633 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:21:33.255057 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3182f956-aeac-4655-8e7b-7bb7c777467d tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:33.255564 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3182f956-aeac-4655-8e7b-7bb7c777467d tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:33.255996 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3182f956-aeac-4655-8e7b-7bb7c777467d tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:33.256689 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3182f956-aeac-4655-8e7b-7bb7c777467d tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:33.257141 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3182f956-aeac-4655-8e7b-7bb7c777467d tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:33.257557 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-3182f956-aeac-4655-8e7b-7bb7c777467d tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:33.387541 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-3182f956-aeac-4655-8e7b-7bb7c777467d tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:33.395284 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-3182f956-aeac-4655-8e7b-7bb7c777467d tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140" status: 200 len: 1265 microversion: 2.1 time: 0.153625 Oct 11 07:21:33.395872 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1752/3503] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:33 2022] GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:34.417779 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c1db6252-d3f9-461d-bad5-1af40e77e8bb tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:34.418361 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c1db6252-d3f9-461d-bad5-1af40e77e8bb tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: de68987b-f150-41fb-9df8-e056b5f2e140] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:34.424664 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c1db6252-d3f9-461d-bad5-1af40e77e8bb tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:34.425135 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c1db6252-d3f9-461d-bad5-1af40e77e8bb tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:34.425558 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c1db6252-d3f9-461d-bad5-1af40e77e8bb tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:34.426236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c1db6252-d3f9-461d-bad5-1af40e77e8bb tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:34.426676 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c1db6252-d3f9-461d-bad5-1af40e77e8bb tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:34.427089 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c1db6252-d3f9-461d-bad5-1af40e77e8bb tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:34.559511 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c1db6252-d3f9-461d-bad5-1af40e77e8bb tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:34.567561 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c1db6252-d3f9-461d-bad5-1af40e77e8bb tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140" status: 200 len: 1265 microversion: 2.1 time: 0.153593 Oct 11 07:21:34.568185 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1752/3504] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:34 2022] GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:35.591756 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d4aa04d9-f26b-49e4-a0d6-db586e66cab4 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:35.592364 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d4aa04d9-f26b-49e4-a0d6-db586e66cab4 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: de68987b-f150-41fb-9df8-e056b5f2e140] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:35.598749 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d4aa04d9-f26b-49e4-a0d6-db586e66cab4 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:35.599227 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d4aa04d9-f26b-49e4-a0d6-db586e66cab4 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:35.599693 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d4aa04d9-f26b-49e4-a0d6-db586e66cab4 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:35.600375 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d4aa04d9-f26b-49e4-a0d6-db586e66cab4 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:35.600822 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d4aa04d9-f26b-49e4-a0d6-db586e66cab4 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:35.601237 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d4aa04d9-f26b-49e4-a0d6-db586e66cab4 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:35.734511 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d4aa04d9-f26b-49e4-a0d6-db586e66cab4 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:35.742057 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d4aa04d9-f26b-49e4-a0d6-db586e66cab4 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140" status: 200 len: 1265 microversion: 2.1 time: 0.154776 Oct 11 07:21:35.742614 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1753/3505] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:35 2022] GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:36.436696 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-d8cbc242-1517-4e9f-8684-6ef3553dc7dc req-db8e3005-433e-4425-acd0-42eee6fbebb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de68987b-f150-41fb-9df8-e056b5f2e140", "name": "network-vif-plugged", "status": "completed", "tag": "62c41126-ec7e-4ed2-a83a-c9fddae2327b"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:21:36.446708 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-d8cbc242-1517-4e9f-8684-6ef3553dc7dc req-db8e3005-433e-4425-acd0-42eee6fbebb4 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:36.447160 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-d8cbc242-1517-4e9f-8684-6ef3553dc7dc req-db8e3005-433e-4425-acd0-42eee6fbebb4 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:36.447612 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-d8cbc242-1517-4e9f-8684-6ef3553dc7dc req-db8e3005-433e-4425-acd0-42eee6fbebb4 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:36.459150 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-d8cbc242-1517-4e9f-8684-6ef3553dc7dc req-db8e3005-433e-4425-acd0-42eee6fbebb4 service nova] Creating event network-vif-plugged:62c41126-ec7e-4ed2-a83a-c9fddae2327b for instance de68987b-f150-41fb-9df8-e056b5f2e140 on hv-cinder-85495 Oct 11 07:21:36.464115 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-d8cbc242-1517-4e9f-8684-6ef3553dc7dc req-db8e3005-433e-4425-acd0-42eee6fbebb4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031609 Oct 11 07:21:36.464747 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1753/3506] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:21:36.764836 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-26527d16-d695-4625-a0d3-c939c53e7962 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:36.765449 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-26527d16-d695-4625-a0d3-c939c53e7962 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: de68987b-f150-41fb-9df8-e056b5f2e140] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:36.771719 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26527d16-d695-4625-a0d3-c939c53e7962 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:36.772199 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26527d16-d695-4625-a0d3-c939c53e7962 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:36.772630 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26527d16-d695-4625-a0d3-c939c53e7962 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:36.773316 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26527d16-d695-4625-a0d3-c939c53e7962 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:36.773753 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26527d16-d695-4625-a0d3-c939c53e7962 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:36.774175 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-26527d16-d695-4625-a0d3-c939c53e7962 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:36.903347 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-26527d16-d695-4625-a0d3-c939c53e7962 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:36.912023 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-26527d16-d695-4625-a0d3-c939c53e7962 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140" status: 200 len: 1265 microversion: 2.1 time: 0.150879 Oct 11 07:21:36.912599 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1754/3507] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:36 2022] GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:37.936450 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-3e227a46-5322-43c5-9d88-92d03710a24c tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:37.937176 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-3e227a46-5322-43c5-9d88-92d03710a24c tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: de68987b-f150-41fb-9df8-e056b5f2e140] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:37.943843 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e227a46-5322-43c5-9d88-92d03710a24c tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:37.944321 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e227a46-5322-43c5-9d88-92d03710a24c tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:37.944755 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e227a46-5322-43c5-9d88-92d03710a24c tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:37.945441 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e227a46-5322-43c5-9d88-92d03710a24c tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:37.945885 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e227a46-5322-43c5-9d88-92d03710a24c tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:37.946311 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-3e227a46-5322-43c5-9d88-92d03710a24c tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:38.080059 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-3e227a46-5322-43c5-9d88-92d03710a24c tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:38.088050 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-3e227a46-5322-43c5-9d88-92d03710a24c tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140" status: 200 len: 1265 microversion: 2.1 time: 0.156527 Oct 11 07:21:38.088605 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1754/3508] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:37 2022] GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:39.110501 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-b35f1f78-2987-458a-af7c-217a94afa0c0 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:39.111108 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-b35f1f78-2987-458a-af7c-217a94afa0c0 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: de68987b-f150-41fb-9df8-e056b5f2e140] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:39.117619 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b35f1f78-2987-458a-af7c-217a94afa0c0 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:39.118102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b35f1f78-2987-458a-af7c-217a94afa0c0 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:39.118537 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b35f1f78-2987-458a-af7c-217a94afa0c0 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:39.119221 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b35f1f78-2987-458a-af7c-217a94afa0c0 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:39.119694 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b35f1f78-2987-458a-af7c-217a94afa0c0 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:39.120121 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-b35f1f78-2987-458a-af7c-217a94afa0c0 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:39.256506 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-b35f1f78-2987-458a-af7c-217a94afa0c0 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:39.264383 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-b35f1f78-2987-458a-af7c-217a94afa0c0 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140" status: 200 len: 1451 microversion: 2.1 time: 0.158037 Oct 11 07:21:39.264951 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1755/3509] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:39 2022] GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:39.287507 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bfb48b52-b1e4-48bf-9aa6-5cf87c520144 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:39.288657 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bfb48b52-b1e4-48bf-9aa6-5cf87c520144 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: de68987b-f150-41fb-9df8-e056b5f2e140] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:39.295227 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bfb48b52-b1e4-48bf-9aa6-5cf87c520144 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:39.295808 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bfb48b52-b1e4-48bf-9aa6-5cf87c520144 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:39.296322 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bfb48b52-b1e4-48bf-9aa6-5cf87c520144 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:39.297049 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bfb48b52-b1e4-48bf-9aa6-5cf87c520144 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:39.297492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bfb48b52-b1e4-48bf-9aa6-5cf87c520144 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:39.297910 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bfb48b52-b1e4-48bf-9aa6-5cf87c520144 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:39.442410 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-4899cc91-c213-4a1b-8442-1cbb78781be9 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:39.443002 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-4899cc91-c213-4a1b-8442-1cbb78781be9 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:39.444693 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-bfb48b52-b1e4-48bf-9aa6-5cf87c520144 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:39.448874 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4899cc91-c213-4a1b-8442-1cbb78781be9 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:39.449351 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4899cc91-c213-4a1b-8442-1cbb78781be9 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:39.449788 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4899cc91-c213-4a1b-8442-1cbb78781be9 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:39.450480 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4899cc91-c213-4a1b-8442-1cbb78781be9 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:39.450930 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4899cc91-c213-4a1b-8442-1cbb78781be9 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:39.451347 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-4899cc91-c213-4a1b-8442-1cbb78781be9 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:39.452276 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bfb48b52-b1e4-48bf-9aa6-5cf87c520144 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140" status: 200 len: 1451 microversion: 2.1 time: 0.169336 Oct 11 07:21:39.453353 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1755/3510] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:39 2022] GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140 => generated 1451 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:21:39.588856 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-4899cc91-c213-4a1b-8442-1cbb78781be9 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a69fa70c78405d805f8b70860f57bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:39.598099 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-4899cc91-c213-4a1b-8442-1cbb78781be9 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 200 len: 1595 microversion: 2.1 time: 0.159442 Oct 11 07:21:39.598990 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1756/3511] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:39 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 1595 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:21:41.060723 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-6d684e7d-80a3-4d01-97ab-251897ce85dc req-0b459bdf-890c-4477-bfc9-89540800bd59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de68987b-f150-41fb-9df8-e056b5f2e140", "tag": "62c41126-ec7e-4ed2-a83a-c9fddae2327b"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:21:41.070521 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-6d684e7d-80a3-4d01-97ab-251897ce85dc req-0b459bdf-890c-4477-bfc9-89540800bd59 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:41.071014 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-6d684e7d-80a3-4d01-97ab-251897ce85dc req-0b459bdf-890c-4477-bfc9-89540800bd59 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:41.071459 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-6d684e7d-80a3-4d01-97ab-251897ce85dc req-0b459bdf-890c-4477-bfc9-89540800bd59 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:41.083229 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-6d684e7d-80a3-4d01-97ab-251897ce85dc req-0b459bdf-890c-4477-bfc9-89540800bd59 service nova] Creating event network-changed:62c41126-ec7e-4ed2-a83a-c9fddae2327b for instance de68987b-f150-41fb-9df8-e056b5f2e140 on hv-cinder-85495 Oct 11 07:21:41.088452 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-6d684e7d-80a3-4d01-97ab-251897ce85dc req-0b459bdf-890c-4477-bfc9-89540800bd59 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031335 Oct 11 07:21:41.089126 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1756/3512] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:21:41.275105 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-100832a4-2f4d-4c76-a35e-bf9b29edff10 req-8cfa9c82-cec5-499e-804a-c990d4c2293e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efae89e3-9121-4a31-ba5b-040087bb8b3e", "tag": "7f80cdc8-459e-4ac3-a549-1418688400ff"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:21:41.287839 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell0:SELECT=2 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:21:41.292849 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-100832a4-2f4d-4c76-a35e-bf9b29edff10 req-8cfa9c82-cec5-499e-804a-c990d4c2293e service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:41.293623 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-100832a4-2f4d-4c76-a35e-bf9b29edff10 req-8cfa9c82-cec5-499e-804a-c990d4c2293e service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:41.294644 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-100832a4-2f4d-4c76-a35e-bf9b29edff10 req-8cfa9c82-cec5-499e-804a-c990d4c2293e service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:41.314294 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-100832a4-2f4d-4c76-a35e-bf9b29edff10 req-8cfa9c82-cec5-499e-804a-c990d4c2293e service nova] Creating event network-changed:7f80cdc8-459e-4ac3-a549-1418688400ff for instance efae89e3-9121-4a31-ba5b-040087bb8b3e on hv-cinder-85495 Oct 11 07:21:41.321080 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-100832a4-2f4d-4c76-a35e-bf9b29edff10 req-8cfa9c82-cec5-499e-804a-c990d4c2293e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049786 Oct 11 07:21:41.322329 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1757/3513] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:21:42.497127 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-2cfa5f33-2fb4-4d49-9e8d-1db30d791c73 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-371945836"}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:21:42.497877 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-2cfa5f33-2fb4-4d49-9e8d-1db30d791c73 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:42.505359 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2cfa5f33-2fb4-4d49-9e8d-1db30d791c73 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:42.506186 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2cfa5f33-2fb4-4d49-9e8d-1db30d791c73 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:42.506833 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2cfa5f33-2fb4-4d49-9e8d-1db30d791c73 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:42.507803 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2cfa5f33-2fb4-4d49-9e8d-1db30d791c73 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:42.508474 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2cfa5f33-2fb4-4d49-9e8d-1db30d791c73 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:42.509165 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-2cfa5f33-2fb4-4d49-9e8d-1db30d791c73 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:42.664277 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.network.security_group_api [None req-2cfa5f33-2fb4-4d49-9e8d-1db30d791c73 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Adding security group 311a77f7-dcba-4c83-91b3-5e02c6e11a99 to port 7f80cdc8-459e-4ac3-a549-1418688400ff Oct 11 07:21:42.987228 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-2cfa5f33-2fb4-4d49-9e8d-1db30d791c73 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "POST /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e/action" status: 202 len: 0 microversion: 2.1 time: 0.495855 Oct 11 07:21:42.987887 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1757/3514] 10.222.0.39 () {60 vars in 1278 bytes} [Tue Oct 11 07:21:42 2022] POST /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 07:21:42.997251 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-41bb6f1a-9968-4cf6-9993-cf33e57ae996 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:21:42.998509 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-41bb6f1a-9968-4cf6-9993-cf33e57ae996 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:21:43.004746 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41bb6f1a-9968-4cf6-9993-cf33e57ae996 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:43.005216 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41bb6f1a-9968-4cf6-9993-cf33e57ae996 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:43.005652 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41bb6f1a-9968-4cf6-9993-cf33e57ae996 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:43.006343 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41bb6f1a-9968-4cf6-9993-cf33e57ae996 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:43.006798 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41bb6f1a-9968-4cf6-9993-cf33e57ae996 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:43.007220 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-41bb6f1a-9968-4cf6-9993-cf33e57ae996 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:43.103773 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-fc3bf621-9492-4370-af88-79f13250ee65 req-61d574cc-a9bf-466a-8c26-3a3f9b96b02a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efae89e3-9121-4a31-ba5b-040087bb8b3e", "tag": "7f80cdc8-459e-4ac3-a549-1418688400ff"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:21:43.114611 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-fc3bf621-9492-4370-af88-79f13250ee65 req-61d574cc-a9bf-466a-8c26-3a3f9b96b02a service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:21:43.115036 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-fc3bf621-9492-4370-af88-79f13250ee65 req-61d574cc-a9bf-466a-8c26-3a3f9b96b02a service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:21:43.115590 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-fc3bf621-9492-4370-af88-79f13250ee65 req-61d574cc-a9bf-466a-8c26-3a3f9b96b02a service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:21:43.127214 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-fc3bf621-9492-4370-af88-79f13250ee65 req-61d574cc-a9bf-466a-8c26-3a3f9b96b02a service nova] Creating event network-changed:7f80cdc8-459e-4ac3-a549-1418688400ff for instance efae89e3-9121-4a31-ba5b-040087bb8b3e on hv-cinder-85495 Oct 11 07:21:43.132212 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-fc3bf621-9492-4370-af88-79f13250ee65 req-61d574cc-a9bf-466a-8c26-3a3f9b96b02a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032252 Oct 11 07:21:43.136025 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1758/3515] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:21:43.151718 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-41bb6f1a-9968-4cf6-9993-cf33e57ae996 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a69fa70c78405d805f8b70860f57bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:21:43.160544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-41bb6f1a-9968-4cf6-9993-cf33e57ae996 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 200 len: 1758 microversion: 2.1 time: 0.168098 Oct 11 07:21:43.161101 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1758/3516] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:21:42 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:22:05.673700 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=17 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:22:05.674658 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=59 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:22:05.679933 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-bfe0296c-bb1f-4433-8abe-93b5293dabbd tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:22:05.682216 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-bfe0296c-bb1f-4433-8abe-93b5293dabbd tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:22:05.689672 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bfe0296c-bb1f-4433-8abe-93b5293dabbd tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:05.690143 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bfe0296c-bb1f-4433-8abe-93b5293dabbd tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:05.690604 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bfe0296c-bb1f-4433-8abe-93b5293dabbd tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:05.691287 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bfe0296c-bb1f-4433-8abe-93b5293dabbd tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:05.691754 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bfe0296c-bb1f-4433-8abe-93b5293dabbd tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:05.692170 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-bfe0296c-bb1f-4433-8abe-93b5293dabbd tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:05.763889 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-bfe0296c-bb1f-4433-8abe-93b5293dabbd tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "POST /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e/action" status: 202 len: 0 microversion: 2.1 time: 0.091486 Oct 11 07:22:05.765014 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1759/3517] 10.222.0.39 () {60 vars in 1278 bytes} [Tue Oct 11 07:22:05 2022] POST /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 07:22:05.773032 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-62128ccc-c41c-47ea-9bd5-6a0a4c209ff7 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:22:05.773639 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-62128ccc-c41c-47ea-9bd5-6a0a4c209ff7 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:22:05.776272 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=13 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:22:05.777102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:22:05.783357 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62128ccc-c41c-47ea-9bd5-6a0a4c209ff7 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:05.783897 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62128ccc-c41c-47ea-9bd5-6a0a4c209ff7 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:05.784320 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62128ccc-c41c-47ea-9bd5-6a0a4c209ff7 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:05.785029 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62128ccc-c41c-47ea-9bd5-6a0a4c209ff7 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:05.785501 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62128ccc-c41c-47ea-9bd5-6a0a4c209ff7 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:05.785910 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-62128ccc-c41c-47ea-9bd5-6a0a4c209ff7 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:05.940271 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-62128ccc-c41c-47ea-9bd5-6a0a4c209ff7 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a69fa70c78405d805f8b70860f57bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:22:05.948968 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-62128ccc-c41c-47ea-9bd5-6a0a4c209ff7 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 200 len: 1750 microversion: 2.1 time: 0.179786 Oct 11 07:22:05.949616 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1759/3518] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:22:05 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 1750 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:22:06.973960 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6132d9ff-f156-4efc-84aa-c2012950b0c7 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:22:06.974643 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6132d9ff-f156-4efc-84aa-c2012950b0c7 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:22:06.980793 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6132d9ff-f156-4efc-84aa-c2012950b0c7 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:06.981269 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6132d9ff-f156-4efc-84aa-c2012950b0c7 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:06.981691 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6132d9ff-f156-4efc-84aa-c2012950b0c7 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:06.982363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6132d9ff-f156-4efc-84aa-c2012950b0c7 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:06.983069 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6132d9ff-f156-4efc-84aa-c2012950b0c7 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:06.983507 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6132d9ff-f156-4efc-84aa-c2012950b0c7 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:07.130129 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-6132d9ff-f156-4efc-84aa-c2012950b0c7 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a69fa70c78405d805f8b70860f57bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:22:07.138399 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6132d9ff-f156-4efc-84aa-c2012950b0c7 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 200 len: 1755 microversion: 2.1 time: 0.169120 Oct 11 07:22:07.138958 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1760/3519] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:22:06 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:22:08.162220 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7cf1845e-ea74-492f-ba16-704987d1ae00 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:22:08.162825 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7cf1845e-ea74-492f-ba16-704987d1ae00 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:22:08.170680 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7cf1845e-ea74-492f-ba16-704987d1ae00 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:08.171199 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7cf1845e-ea74-492f-ba16-704987d1ae00 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:08.171823 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7cf1845e-ea74-492f-ba16-704987d1ae00 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:08.172833 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7cf1845e-ea74-492f-ba16-704987d1ae00 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:08.173374 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7cf1845e-ea74-492f-ba16-704987d1ae00 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:08.173805 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7cf1845e-ea74-492f-ba16-704987d1ae00 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:08.317375 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-7cf1845e-ea74-492f-ba16-704987d1ae00 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a69fa70c78405d805f8b70860f57bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:22:08.325544 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7cf1845e-ea74-492f-ba16-704987d1ae00 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 200 len: 1755 microversion: 2.1 time: 0.167139 Oct 11 07:22:08.326048 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1760/3520] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:22:08 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:22:09.349701 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-f383b6b9-fc80-4004-9f3c-32bb4a24e86b tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:22:09.350340 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-f383b6b9-fc80-4004-9f3c-32bb4a24e86b tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:22:09.357080 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f383b6b9-fc80-4004-9f3c-32bb4a24e86b tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:09.358612 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f383b6b9-fc80-4004-9f3c-32bb4a24e86b tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:09.359050 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f383b6b9-fc80-4004-9f3c-32bb4a24e86b tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:09.359770 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f383b6b9-fc80-4004-9f3c-32bb4a24e86b tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:09.360221 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f383b6b9-fc80-4004-9f3c-32bb4a24e86b tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:09.360899 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-f383b6b9-fc80-4004-9f3c-32bb4a24e86b tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:09.504484 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-f383b6b9-fc80-4004-9f3c-32bb4a24e86b tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a69fa70c78405d805f8b70860f57bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:22:09.512734 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-f383b6b9-fc80-4004-9f3c-32bb4a24e86b tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 200 len: 1755 microversion: 2.1 time: 0.167238 Oct 11 07:22:09.513290 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1761/3521] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:22:09 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:22:10.537176 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-39369a2e-8ee1-4404-b923-cd32b258c0c8 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:22:10.537783 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-39369a2e-8ee1-4404-b923-cd32b258c0c8 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:22:10.544463 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-39369a2e-8ee1-4404-b923-cd32b258c0c8 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:10.544941 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-39369a2e-8ee1-4404-b923-cd32b258c0c8 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:10.545954 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-39369a2e-8ee1-4404-b923-cd32b258c0c8 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:10.546638 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-39369a2e-8ee1-4404-b923-cd32b258c0c8 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:10.547085 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-39369a2e-8ee1-4404-b923-cd32b258c0c8 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:10.547532 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-39369a2e-8ee1-4404-b923-cd32b258c0c8 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:10.687792 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-39369a2e-8ee1-4404-b923-cd32b258c0c8 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a69fa70c78405d805f8b70860f57bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:22:10.696393 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-39369a2e-8ee1-4404-b923-cd32b258c0c8 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 200 len: 1755 microversion: 2.1 time: 0.162848 Oct 11 07:22:10.696960 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1761/3522] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:22:10 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:22:11.719662 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-5f411d0a-79a9-4b20-80a0-a7c85b91d5f4 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:22:11.720185 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-5f411d0a-79a9-4b20-80a0-a7c85b91d5f4 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:22:11.727266 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5f411d0a-79a9-4b20-80a0-a7c85b91d5f4 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:11.727760 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5f411d0a-79a9-4b20-80a0-a7c85b91d5f4 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:11.728190 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5f411d0a-79a9-4b20-80a0-a7c85b91d5f4 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:11.728862 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5f411d0a-79a9-4b20-80a0-a7c85b91d5f4 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:11.729302 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5f411d0a-79a9-4b20-80a0-a7c85b91d5f4 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:11.729716 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-5f411d0a-79a9-4b20-80a0-a7c85b91d5f4 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:11.871368 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-5f411d0a-79a9-4b20-80a0-a7c85b91d5f4 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a69fa70c78405d805f8b70860f57bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:22:11.880017 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-5f411d0a-79a9-4b20-80a0-a7c85b91d5f4 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 200 len: 1755 microversion: 2.1 time: 0.164264 Oct 11 07:22:11.880565 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1762/3523] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:22:11 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:22:12.902976 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d2ae0c41-f657-4d0b-8490-27696669f104 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:22:12.903607 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d2ae0c41-f657-4d0b-8490-27696669f104 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:22:12.910549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d2ae0c41-f657-4d0b-8490-27696669f104 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:12.911018 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d2ae0c41-f657-4d0b-8490-27696669f104 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:12.911460 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d2ae0c41-f657-4d0b-8490-27696669f104 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:12.912140 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d2ae0c41-f657-4d0b-8490-27696669f104 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:12.912581 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d2ae0c41-f657-4d0b-8490-27696669f104 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:12.912993 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d2ae0c41-f657-4d0b-8490-27696669f104 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:13.051552 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d2ae0c41-f657-4d0b-8490-27696669f104 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a69fa70c78405d805f8b70860f57bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:22:13.059651 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d2ae0c41-f657-4d0b-8490-27696669f104 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 200 len: 1755 microversion: 2.1 time: 0.160477 Oct 11 07:22:13.060210 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1762/3524] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:22:12 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:22:14.083185 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-338a74b2-cde5-403c-afe4-ea477f4d2655 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:22:14.083959 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-338a74b2-cde5-403c-afe4-ea477f4d2655 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:22:14.090372 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-338a74b2-cde5-403c-afe4-ea477f4d2655 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:14.090848 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-338a74b2-cde5-403c-afe4-ea477f4d2655 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:14.091281 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-338a74b2-cde5-403c-afe4-ea477f4d2655 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:14.092005 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-338a74b2-cde5-403c-afe4-ea477f4d2655 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:14.092454 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-338a74b2-cde5-403c-afe4-ea477f4d2655 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:14.092875 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-338a74b2-cde5-403c-afe4-ea477f4d2655 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:14.231570 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-338a74b2-cde5-403c-afe4-ea477f4d2655 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a69fa70c78405d805f8b70860f57bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:22:14.240828 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-338a74b2-cde5-403c-afe4-ea477f4d2655 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 200 len: 1755 microversion: 2.1 time: 0.161461 Oct 11 07:22:14.241375 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1763/3525] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:22:14 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:22:15.265097 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-d7a0035a-104f-4943-91f6-f3dde8773518 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:22:15.265706 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-d7a0035a-104f-4943-91f6-f3dde8773518 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:22:15.272119 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d7a0035a-104f-4943-91f6-f3dde8773518 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:15.272593 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d7a0035a-104f-4943-91f6-f3dde8773518 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:15.273025 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d7a0035a-104f-4943-91f6-f3dde8773518 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:15.273704 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d7a0035a-104f-4943-91f6-f3dde8773518 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:15.274152 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d7a0035a-104f-4943-91f6-f3dde8773518 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:15.274570 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-d7a0035a-104f-4943-91f6-f3dde8773518 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:15.415693 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-d7a0035a-104f-4943-91f6-f3dde8773518 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a69fa70c78405d805f8b70860f57bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:22:15.424419 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-d7a0035a-104f-4943-91f6-f3dde8773518 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 200 len: 1755 microversion: 2.1 time: 0.163705 Oct 11 07:22:15.424976 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1763/3526] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:22:15 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:22:16.451547 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-e9bff9b9-0df0-41c0-8b62-6c7c46369f5a tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:22:16.452150 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-e9bff9b9-0df0-41c0-8b62-6c7c46369f5a tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:22:16.458614 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e9bff9b9-0df0-41c0-8b62-6c7c46369f5a tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:16.459080 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e9bff9b9-0df0-41c0-8b62-6c7c46369f5a tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:16.459535 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e9bff9b9-0df0-41c0-8b62-6c7c46369f5a tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:16.460208 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e9bff9b9-0df0-41c0-8b62-6c7c46369f5a tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:16.460648 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e9bff9b9-0df0-41c0-8b62-6c7c46369f5a tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:16.461068 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-e9bff9b9-0df0-41c0-8b62-6c7c46369f5a tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:16.602417 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-e9bff9b9-0df0-41c0-8b62-6c7c46369f5a tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a69fa70c78405d805f8b70860f57bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:22:16.610683 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-e9bff9b9-0df0-41c0-8b62-6c7c46369f5a tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 200 len: 1755 microversion: 2.1 time: 0.163620 Oct 11 07:22:16.611227 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1764/3527] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:22:16 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:22:17.634737 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bd7789cb-1157-4821-b6ef-5b4731e36221 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:22:17.635322 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bd7789cb-1157-4821-b6ef-5b4731e36221 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:22:17.642098 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bd7789cb-1157-4821-b6ef-5b4731e36221 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:17.642575 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bd7789cb-1157-4821-b6ef-5b4731e36221 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:17.643005 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bd7789cb-1157-4821-b6ef-5b4731e36221 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:17.643722 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bd7789cb-1157-4821-b6ef-5b4731e36221 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:17.644168 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bd7789cb-1157-4821-b6ef-5b4731e36221 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:17.644588 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bd7789cb-1157-4821-b6ef-5b4731e36221 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:17.785740 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-bd7789cb-1157-4821-b6ef-5b4731e36221 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a69fa70c78405d805f8b70860f57bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:22:17.793787 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bd7789cb-1157-4821-b6ef-5b4731e36221 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 200 len: 1758 microversion: 2.1 time: 0.163640 Oct 11 07:22:17.794348 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1764/3528] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:22:17 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:22:29.154309 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-df58c24b-2c55-453d-9e21-ae537bcaf594 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:22:29.154844 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-df58c24b-2c55-453d-9e21-ae537bcaf594 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:22:29.157007 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=12 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:22:29.157662 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:22:29.161257 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=12 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:22:29.164509 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-df58c24b-2c55-453d-9e21-ae537bcaf594 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:29.165113 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-df58c24b-2c55-453d-9e21-ae537bcaf594 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:29.165625 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-df58c24b-2c55-453d-9e21-ae537bcaf594 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:29.165769 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=36 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:22:29.166433 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-df58c24b-2c55-453d-9e21-ae537bcaf594 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:29.166974 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-df58c24b-2c55-453d-9e21-ae537bcaf594 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:29.168386 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-df58c24b-2c55-453d-9e21-ae537bcaf594 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:29.197355 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-df58c24b-2c55-453d-9e21-ae537bcaf594 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Going to try to terminate instance {{(pid=125266) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 07:22:29.216586 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-1b2b3f92-4f6f-4e37-aac1-31c16cc9829e req-18a21e33-f9f9-4289-afb8-fda35df7ec8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c70b9e3f-05fe-4127-a536-02801eb865a2", "tag": "112615ed-3ec4-49cb-aa0b-c8d23ae96ae5"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:22:29.226245 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-1b2b3f92-4f6f-4e37-aac1-31c16cc9829e req-18a21e33-f9f9-4289-afb8-fda35df7ec8e service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:29.226719 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-1b2b3f92-4f6f-4e37-aac1-31c16cc9829e req-18a21e33-f9f9-4289-afb8-fda35df7ec8e service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:29.227148 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-1b2b3f92-4f6f-4e37-aac1-31c16cc9829e req-18a21e33-f9f9-4289-afb8-fda35df7ec8e service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:29.239731 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-1b2b3f92-4f6f-4e37-aac1-31c16cc9829e req-18a21e33-f9f9-4289-afb8-fda35df7ec8e service nova] Creating event network-changed:112615ed-3ec4-49cb-aa0b-c8d23ae96ae5 for instance c70b9e3f-05fe-4127-a536-02801eb865a2 on hv-cinder-85495 Oct 11 07:22:29.244945 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-1b2b3f92-4f6f-4e37-aac1-31c16cc9829e req-18a21e33-f9f9-4289-afb8-fda35df7ec8e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092667 Oct 11 07:22:29.245821 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1765/3529] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:22:29.279812 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-df58c24b-2c55-453d-9e21-ae537bcaf594 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 204 len: 0 microversion: 2.1 time: 0.129961 Oct 11 07:22:29.280319 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1765/3530] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Oct 11 07:22:29 2022] DELETE /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 07:22:29.289074 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-351b8d00-6290-48c7-81a8-72e9acde4772 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:22:29.289892 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-351b8d00-6290-48c7-81a8-72e9acde4772 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:22:29.297622 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-351b8d00-6290-48c7-81a8-72e9acde4772 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:29.298892 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-351b8d00-6290-48c7-81a8-72e9acde4772 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:29.299406 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-351b8d00-6290-48c7-81a8-72e9acde4772 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:29.300351 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-351b8d00-6290-48c7-81a8-72e9acde4772 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:29.300897 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-351b8d00-6290-48c7-81a8-72e9acde4772 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:29.301356 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-351b8d00-6290-48c7-81a8-72e9acde4772 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:29.452264 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-351b8d00-6290-48c7-81a8-72e9acde4772 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:22:29.462415 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-351b8d00-6290-48c7-81a8-72e9acde4772 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1569 microversion: 2.1 time: 0.177567 Oct 11 07:22:29.462982 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1766/3531] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:22:29 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 07:22:30.486379 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-a4e06da1-6167-4b0b-867f-dbc056f93585 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:22:30.487071 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-a4e06da1-6167-4b0b-867f-dbc056f93585 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:22:30.493457 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a4e06da1-6167-4b0b-867f-dbc056f93585 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:30.493934 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a4e06da1-6167-4b0b-867f-dbc056f93585 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:30.494366 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a4e06da1-6167-4b0b-867f-dbc056f93585 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:30.495052 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a4e06da1-6167-4b0b-867f-dbc056f93585 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:30.495530 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a4e06da1-6167-4b0b-867f-dbc056f93585 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:30.495957 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-a4e06da1-6167-4b0b-867f-dbc056f93585 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:30.692713 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-a4e06da1-6167-4b0b-867f-dbc056f93585 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:22:30.701237 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-a4e06da1-6167-4b0b-867f-dbc056f93585 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1569 microversion: 2.1 time: 0.219316 Oct 11 07:22:30.701792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1766/3532] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:22:30 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1569 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:22:31.724912 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-24653192-2304-4468-a4fb-3d5e8f6b7c62 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:22:31.725603 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-24653192-2304-4468-a4fb-3d5e8f6b7c62 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:22:31.733594 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-24653192-2304-4468-a4fb-3d5e8f6b7c62 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:31.734236 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-24653192-2304-4468-a4fb-3d5e8f6b7c62 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:31.734736 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-24653192-2304-4468-a4fb-3d5e8f6b7c62 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:31.735810 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-24653192-2304-4468-a4fb-3d5e8f6b7c62 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:31.736398 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-24653192-2304-4468-a4fb-3d5e8f6b7c62 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:31.736823 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-24653192-2304-4468-a4fb-3d5e8f6b7c62 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:31.776717 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-521ecadf-fd36-4a05-b253-885e87f58175 req-62aeaa56-bbfa-45ba-91c0-d911918ff899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c70b9e3f-05fe-4127-a536-02801eb865a2", "name": "network-vif-deleted", "tag": "112615ed-3ec4-49cb-aa0b-c8d23ae96ae5"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:22:31.786831 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-521ecadf-fd36-4a05-b253-885e87f58175 req-62aeaa56-bbfa-45ba-91c0-d911918ff899 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:31.787485 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-521ecadf-fd36-4a05-b253-885e87f58175 req-62aeaa56-bbfa-45ba-91c0-d911918ff899 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:31.787916 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-521ecadf-fd36-4a05-b253-885e87f58175 req-62aeaa56-bbfa-45ba-91c0-d911918ff899 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:31.799907 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-521ecadf-fd36-4a05-b253-885e87f58175 req-62aeaa56-bbfa-45ba-91c0-d911918ff899 service nova] Creating event network-vif-deleted:112615ed-3ec4-49cb-aa0b-c8d23ae96ae5 for instance c70b9e3f-05fe-4127-a536-02801eb865a2 on hv-cinder-85495 Oct 11 07:22:31.804821 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-521ecadf-fd36-4a05-b253-885e87f58175 req-62aeaa56-bbfa-45ba-91c0-d911918ff899 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032054 Oct 11 07:22:31.805510 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-24653192-2304-4468-a4fb-3d5e8f6b7c62 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:22:31.808375 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1767/3533] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 07:22:31.815432 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-24653192-2304-4468-a4fb-3d5e8f6b7c62 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1382 microversion: 2.1 time: 0.094543 Oct 11 07:22:31.815998 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1767/3534] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:22:31 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1382 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:22:32.839084 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-40de6512-e0a2-454d-b512-fb9bdd491bc2 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:22:32.840042 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-40de6512-e0a2-454d-b512-fb9bdd491bc2 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:22:32.846411 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-40de6512-e0a2-454d-b512-fb9bdd491bc2 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:32.846808 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-40de6512-e0a2-454d-b512-fb9bdd491bc2 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:32.847438 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-40de6512-e0a2-454d-b512-fb9bdd491bc2 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:32.848145 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-40de6512-e0a2-454d-b512-fb9bdd491bc2 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:32.848598 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-40de6512-e0a2-454d-b512-fb9bdd491bc2 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:32.849014 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-40de6512-e0a2-454d-b512-fb9bdd491bc2 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:32.881334 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-40de6512-e0a2-454d-b512-fb9bdd491bc2 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:32.881805 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-40de6512-e0a2-454d-b512-fb9bdd491bc2 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:32.882234 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-40de6512-e0a2-454d-b512-fb9bdd491bc2 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:32.882671 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.objects.instance [None req-40de6512-e0a2-454d-b512-fb9bdd491bc2 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lazy-loading 'fault' on Instance uuid c70b9e3f-05fe-4127-a536-02801eb865a2 {{(pid=125266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 07:22:32.924455 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-40de6512-e0a2-454d-b512-fb9bdd491bc2 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211be7ccf81649db928d8efd0a91426f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa103dda8c34135af4c1a3913ccb564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:22:32.931460 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-40de6512-e0a2-454d-b512-fb9bdd491bc2 tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 200 len: 1178 microversion: 2.1 time: 0.097057 Oct 11 07:22:32.932050 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1768/3535] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:22:32 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 1178 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:22:33.954717 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-30843c76-ad23-434b-b28b-94f3b28c573b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:22:33.955347 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-30843c76-ad23-434b-b28b-94f3b28c573b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] [instance: c70b9e3f-05fe-4127-a536-02801eb865a2] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:22:33.962159 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30843c76-ad23-434b-b28b-94f3b28c573b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:33.962630 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30843c76-ad23-434b-b28b-94f3b28c573b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:33.963055 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30843c76-ad23-434b-b28b-94f3b28c573b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:33.963764 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30843c76-ad23-434b-b28b-94f3b28c573b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:33.964210 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30843c76-ad23-434b-b28b-94f3b28c573b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:33.964623 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-30843c76-ad23-434b-b28b-94f3b28c573b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:33.979143 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-30843c76-ad23-434b-b28b-94f3b28c573b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] HTTP exception thrown: Instance c70b9e3f-05fe-4127-a536-02801eb865a2 could not be found. Oct 11 07:22:33.980782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-30843c76-ad23-434b-b28b-94f3b28c573b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Request method failure captured: Oct 11 07:22:33.980782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: request: GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 HTTP/1.1 Oct 11 07:22:33.980782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept: application/json Oct 11 07:22:33.980782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Oct 11 07:22:33.980782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Connection: close Oct 11 07:22:33.980782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Length: 0 Oct 11 07:22:33.980782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Type: application/json Oct 11 07:22:33.980782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Host: 10.222.0.39 Oct 11 07:22:33.980782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Oct 11 07:22:33.980782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.12 Oct 11 07:22:33.980782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABjRRihijDArGnkMux9fFq4BvXsInQusycDjO-Wp4Deq8AIAsUzGN4o-sv6ZEg3d4Xnlt_BdVYbndyBWOliH1PsL0dfTdyQ71YtSDSZwuftdVHPP2uJTN9kFxUMV1jnDq7Zv5D01u9hc0KGPy2JApaoBF4eMj7TCMlpQY2pWq11FB5Zzzs Oct 11 07:22:33.980782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Oct 11 07:22:33.980782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Oct 11 07:22:33.980782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Oct 11 07:22:33.980782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Oct 11 07:22:33.980782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Oct 11 07:22:33.980782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Oct 11 07:22:33.980782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Id: 0fa103dda8c34135af4c1a3913ccb564 Oct 11 07:22:33.980782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-TestShelveInstance-663837493 Oct 11 07:22:33.980782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Role: reader,member Oct 11 07:22:33.980782 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Oct 11 07:22:33.982659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0fa103dda8c34135af4c1a3913ccb564"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0fa103dda8c34135af4c1a3913ccb564"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0fa103dda8c34135af4c1a3913ccb564"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0fa103dda8c34135af4c1a3913ccb564"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 07:22:33.982659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-TestShelveInstance-663837493 Oct 11 07:22:33.982659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 0fa103dda8c34135af4c1a3913ccb564 Oct 11 07:22:33.982659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-TestShelveInstance-663837493 Oct 11 07:22:33.982659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User: tempest-TestShelveInstance-663837493-project Oct 11 07:22:33.982659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Oct 11 07:22:33.982659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Oct 11 07:22:33.982659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Id: 211be7ccf81649db928d8efd0a91426f Oct 11 07:22:33.982659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-TestShelveInstance-663837493-project Oct 11 07:22:33.982659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: method: > Oct 11 07:22:33.982659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: exception: Instance c70b9e3f-05fe-4127-a536-02801eb865a2 could not be found. Oct 11 07:22:33.982659 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: action_args: {'id': 'c70b9e3f-05fe-4127-a536-02801eb865a2'} Oct 11 07:22:33.983606 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 07:22:33.983606 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:22:33.983606 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 07:22:33.983606 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 07:22:33.983606 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 07:22:33.983606 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 07:22:33.983606 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 07:22:33.983606 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 07:22:33.983606 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 07:22:33.983606 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 07:22:33.983606 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c70b9e3f-05fe-4127-a536-02801eb865a2 could not be found. Oct 11 07:22:33.983606 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:22:33.983606 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:22:33.983606 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:22:33.983606 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:22:33.983606 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:22:33.983606 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:22:33.983606 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 07:22:33.983606 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 07:22:33.983606 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 07:22:33.985106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 07:22:33.985106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 07:22:33.985106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 07:22:33.985106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 07:22:33.985106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 07:22:33.985106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 07:22:33.985106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 07:22:33.985106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c70b9e3f-05fe-4127-a536-02801eb865a2 could not be found. Oct 11 07:22:33.985106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:22:33.985106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:22:33.985106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:22:33.985106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:22:33.985106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:22:33.985106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:22:33.985106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 07:22:33.985106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 07:22:33.985106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c70b9e3f-05fe-4127-a536-02801eb865a2 could not be found. Oct 11 07:22:33.985106 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:22:33.986560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-30843c76-ad23-434b-b28b-94f3b28c573b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Returning 404 to user: Instance c70b9e3f-05fe-4127-a536-02801eb865a2 could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 07:22:33.986560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-30843c76-ad23-434b-b28b-94f3b28c573b tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2" status: 404 len: 111 microversion: 2.1 time: 0.032022 Oct 11 07:22:33.986560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1768/3536] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:22:33 2022] GET /compute/v2.1/servers/c70b9e3f-05fe-4127-a536-02801eb865a2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 07:22:34.139699 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-dec9028f-b6d2-459e-baae-2b3b1d6fbd3e tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] Calling method '.version_select at 0x7f8e2a42be50>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:22:34.158541 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-dec9028f-b6d2-459e-baae-2b3b1d6fbd3e tempest-TestShelveInstance-663837493 tempest-TestShelveInstance-663837493-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-865132752" status: 202 len: 0 microversion: 2.1 time: 0.023717 Oct 11 07:22:34.159046 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1769/3537] 10.222.0.39 () {58 vars in 1251 bytes} [Tue Oct 11 07:22:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-865132752 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 07:22:50.598793 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-0066bfa0-aef1-4648-bc1b-7c85e86aff38 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-371945836"}} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:22:50.599398 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-0066bfa0-aef1-4648-bc1b-7c85e86aff38 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:22:50.601436 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=8 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:22:50.602083 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=16 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:22:50.609392 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0066bfa0-aef1-4648-bc1b-7c85e86aff38 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:50.609869 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0066bfa0-aef1-4648-bc1b-7c85e86aff38 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:50.610301 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0066bfa0-aef1-4648-bc1b-7c85e86aff38 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:50.610988 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0066bfa0-aef1-4648-bc1b-7c85e86aff38 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:50.611452 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0066bfa0-aef1-4648-bc1b-7c85e86aff38 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:50.611876 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-0066bfa0-aef1-4648-bc1b-7c85e86aff38 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:50.741165 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.network.security_group_api [None req-0066bfa0-aef1-4648-bc1b-7c85e86aff38 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Removing security group 311a77f7-dcba-4c83-91b3-5e02c6e11a99 from port 7f80cdc8-459e-4ac3-a549-1418688400ff Oct 11 07:22:51.042918 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-0066bfa0-aef1-4648-bc1b-7c85e86aff38 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "POST /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e/action" status: 202 len: 0 microversion: 2.1 time: 0.448109 Oct 11 07:22:51.043540 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1769/3538] 10.222.0.39 () {60 vars in 1278 bytes} [Tue Oct 11 07:22:50 2022] POST /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 07:22:51.066755 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:22:51.068232 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:22:51.074685 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-eacf91fd-212b-4cb8-b84e-c2e5c01730aa req-98ac132b-f62e-4ff4-849d-a8a30600cd59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efae89e3-9121-4a31-ba5b-040087bb8b3e", "tag": "7f80cdc8-459e-4ac3-a549-1418688400ff"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:22:51.088709 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-eacf91fd-212b-4cb8-b84e-c2e5c01730aa req-98ac132b-f62e-4ff4-849d-a8a30600cd59 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:51.089325 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-eacf91fd-212b-4cb8-b84e-c2e5c01730aa req-98ac132b-f62e-4ff4-849d-a8a30600cd59 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:51.090009 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-eacf91fd-212b-4cb8-b84e-c2e5c01730aa req-98ac132b-f62e-4ff4-849d-a8a30600cd59 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:51.105812 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-eacf91fd-212b-4cb8-b84e-c2e5c01730aa req-98ac132b-f62e-4ff4-849d-a8a30600cd59 service nova] Creating event network-changed:7f80cdc8-459e-4ac3-a549-1418688400ff for instance efae89e3-9121-4a31-ba5b-040087bb8b3e on hv-cinder-85495 Oct 11 07:22:51.123252 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-eacf91fd-212b-4cb8-b84e-c2e5c01730aa req-98ac132b-f62e-4ff4-849d-a8a30600cd59 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058295 Oct 11 07:22:51.124254 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1770/3539] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:22:52.175980 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-53b47d0c-e249-4fca-abcb-5fbe2be80bd9 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:22:52.177020 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-53b47d0c-e249-4fca-abcb-5fbe2be80bd9 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:22:52.184255 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-53b47d0c-e249-4fca-abcb-5fbe2be80bd9 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:52.184747 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-53b47d0c-e249-4fca-abcb-5fbe2be80bd9 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:52.185185 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-53b47d0c-e249-4fca-abcb-5fbe2be80bd9 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:52.185920 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-53b47d0c-e249-4fca-abcb-5fbe2be80bd9 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:52.186375 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-53b47d0c-e249-4fca-abcb-5fbe2be80bd9 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:52.186798 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-53b47d0c-e249-4fca-abcb-5fbe2be80bd9 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:52.267280 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-53b47d0c-e249-4fca-abcb-5fbe2be80bd9 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lazy-loading 'services' on Instance uuid efae89e3-9121-4a31-ba5b-040087bb8b3e {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 07:22:52.339161 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-53b47d0c-e249-4fca-abcb-5fbe2be80bd9 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "DELETE /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e/os-volume_attachments/b52ca7e7-48b7-4c4c-b166-bbbf3e3146e1" status: 202 len: 0 microversion: 2.1 time: 0.167610 Oct 11 07:22:52.339781 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1770/3540] 10.222.0.39 () {58 vars in 1416 bytes} [Tue Oct 11 07:22:52 2022] DELETE /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e/os-volume_attachments/b52ca7e7-48b7-4c4c-b166-bbbf3e3146e1 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 07:22:52.348673 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-b4632edc-5b52-464e-a0d5-1cf6344ad4cd tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:22:52.351851 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-b4632edc-5b52-464e-a0d5-1cf6344ad4cd tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:22:52.360982 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b4632edc-5b52-464e-a0d5-1cf6344ad4cd tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:52.361977 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b4632edc-5b52-464e-a0d5-1cf6344ad4cd tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:52.362405 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b4632edc-5b52-464e-a0d5-1cf6344ad4cd tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:52.363099 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b4632edc-5b52-464e-a0d5-1cf6344ad4cd tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:52.363740 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b4632edc-5b52-464e-a0d5-1cf6344ad4cd tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:52.364156 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-b4632edc-5b52-464e-a0d5-1cf6344ad4cd tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:52.394294 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-b4632edc-5b52-464e-a0d5-1cf6344ad4cd tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049967 Oct 11 07:22:52.394847 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1771/3541] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 07:22:52 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:22:53.139532 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-f84abf11-e705-475e-803e-2a3202e633bf req-4227efe8-129b-498d-9c9e-4bb5e6b9c9ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efae89e3-9121-4a31-ba5b-040087bb8b3e", "tag": "7f80cdc8-459e-4ac3-a549-1418688400ff"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:22:53.148985 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-f84abf11-e705-475e-803e-2a3202e633bf req-4227efe8-129b-498d-9c9e-4bb5e6b9c9ed service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:53.149451 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-f84abf11-e705-475e-803e-2a3202e633bf req-4227efe8-129b-498d-9c9e-4bb5e6b9c9ed service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:53.149874 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-f84abf11-e705-475e-803e-2a3202e633bf req-4227efe8-129b-498d-9c9e-4bb5e6b9c9ed service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:53.160958 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-f84abf11-e705-475e-803e-2a3202e633bf req-4227efe8-129b-498d-9c9e-4bb5e6b9c9ed service nova] Creating event network-changed:7f80cdc8-459e-4ac3-a549-1418688400ff for instance efae89e3-9121-4a31-ba5b-040087bb8b3e on hv-cinder-85495 Oct 11 07:22:53.165655 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-f84abf11-e705-475e-803e-2a3202e633bf req-4227efe8-129b-498d-9c9e-4bb5e6b9c9ed service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030165 Oct 11 07:22:53.166250 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1771/3542] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:22:53.407160 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ebce9128-82e7-4f1e-8312-63d7871cff65 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:22:53.410186 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ebce9128-82e7-4f1e-8312-63d7871cff65 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:22:53.419143 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ebce9128-82e7-4f1e-8312-63d7871cff65 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:53.419661 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ebce9128-82e7-4f1e-8312-63d7871cff65 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:53.420103 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ebce9128-82e7-4f1e-8312-63d7871cff65 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:53.420803 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ebce9128-82e7-4f1e-8312-63d7871cff65 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:53.421253 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ebce9128-82e7-4f1e-8312-63d7871cff65 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:53.421676 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ebce9128-82e7-4f1e-8312-63d7871cff65 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:53.453160 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ebce9128-82e7-4f1e-8312-63d7871cff65 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050164 Oct 11 07:22:53.454049 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1772/3543] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Oct 11 07:22:53 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 11 07:22:53.465895 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2fe2056d-dbd6-41d9-92ff-acb8f7ba83bd tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:22:53.466470 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-2fe2056d-dbd6-41d9-92ff-acb8f7ba83bd tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:22:53.472579 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2fe2056d-dbd6-41d9-92ff-acb8f7ba83bd tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:53.473058 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2fe2056d-dbd6-41d9-92ff-acb8f7ba83bd tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:53.473491 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2fe2056d-dbd6-41d9-92ff-acb8f7ba83bd tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:53.474189 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2fe2056d-dbd6-41d9-92ff-acb8f7ba83bd tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:53.474635 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2fe2056d-dbd6-41d9-92ff-acb8f7ba83bd tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:53.475055 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-2fe2056d-dbd6-41d9-92ff-acb8f7ba83bd tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:53.550278 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-2fe2056d-dbd6-41d9-92ff-acb8f7ba83bd tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] HTTP exception thrown: Instance efae89e3-9121-4a31-ba5b-040087bb8b3e is not attached to volume b52ca7e7-48b7-4c4c-b166-bbbf3e3146e1 Oct 11 07:22:53.552668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2fe2056d-dbd6-41d9-92ff-acb8f7ba83bd tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Request method failure captured: Oct 11 07:22:53.552668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: request: DELETE /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e/os-volume_attachments/b52ca7e7-48b7-4c4c-b166-bbbf3e3146e1 HTTP/1.1 Oct 11 07:22:53.552668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept: application/json Oct 11 07:22:53.552668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Oct 11 07:22:53.552668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Connection: close Oct 11 07:22:53.552668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Length: 0 Oct 11 07:22:53.552668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Type: application/json Oct 11 07:22:53.552668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Host: 10.222.0.39 Oct 11 07:22:53.552668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Oct 11 07:22:53.552668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.12 Oct 11 07:22:53.552668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABjRRlV6Ang6pKPJOifQiASLYn65f-S1SJzTFtpM4obpFahzUNzP-v-rLfkfpet0NtGvHFrIZFJ3GCGzShTH1kG8VVRV7Krje1NO-oyhzTFCV80O82wjFJMABY9-OQVUGFqlfSD5Fr5qIlWoHn9hglcxVMCnRIeKqSs5wwpBXeRI358y7I Oct 11 07:22:53.552668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Oct 11 07:22:53.552668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Oct 11 07:22:53.552668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Oct 11 07:22:53.552668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Oct 11 07:22:53.552668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Oct 11 07:22:53.552668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Oct 11 07:22:53.552668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Id: 709d4e3bf4de4bd6857171f2d5d77885 Oct 11 07:22:53.552668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-TestMinimumBasicScenario-1025403994 Oct 11 07:22:53.552668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Role: reader,member Oct 11 07:22:53.552668 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Oct 11 07:22:53.554209 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_709d4e3bf4de4bd6857171f2d5d77885"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/709d4e3bf4de4bd6857171f2d5d77885"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/709d4e3bf4de4bd6857171f2d5d77885"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/709d4e3bf4de4bd6857171f2d5d77885"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 07:22:53.554209 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-TestMinimumBasicScenario-1025403994 Oct 11 07:22:53.554209 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 709d4e3bf4de4bd6857171f2d5d77885 Oct 11 07:22:53.554209 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1025403994 Oct 11 07:22:53.554209 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User: tempest-TestMinimumBasicScenario-1025403994-project Oct 11 07:22:53.554209 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Oct 11 07:22:53.554209 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Oct 11 07:22:53.554209 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Id: 96a69fa70c78405d805f8b70860f57bf Oct 11 07:22:53.554209 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-TestMinimumBasicScenario-1025403994-project Oct 11 07:22:53.554209 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: method: > Oct 11 07:22:53.554209 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: exception: Instance efae89e3-9121-4a31-ba5b-040087bb8b3e is not attached to volume b52ca7e7-48b7-4c4c-b166-bbbf3e3146e1 Oct 11 07:22:53.555102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: action_args: {'server_id': 'efae89e3-9121-4a31-ba5b-040087bb8b3e', 'id': 'b52ca7e7-48b7-4c4c-b166-bbbf3e3146e1'} Oct 11 07:22:53.555102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 07:22:53.555102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:22:53.555102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 11 07:22:53.555102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 11 07:22:53.555102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 07:22:53.555102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 07:22:53.555102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 11 07:22:53.555102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 11 07:22:53.555102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b52ca7e7-48b7-4c4c-b166-bbbf3e3146e1. Oct 11 07:22:53.555102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:22:53.555102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:22:53.555102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:22:53.555102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:22:53.555102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:22:53.555102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:22:53.555102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 07:22:53.555102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 07:22:53.555102 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 07:22:53.556848 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 07:22:53.556848 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 11 07:22:53.556848 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 07:22:53.556848 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efae89e3-9121-4a31-ba5b-040087bb8b3e is not attached to volume b52ca7e7-48b7-4c4c-b166-bbbf3e3146e1 Oct 11 07:22:53.556848 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:22:53.556848 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:22:53.556848 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:22:53.556848 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:22:53.556848 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:22:53.556848 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:22:53.556848 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 07:22:53.556848 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 07:22:53.556848 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efae89e3-9121-4a31-ba5b-040087bb8b3e is not attached to volume b52ca7e7-48b7-4c4c-b166-bbbf3e3146e1 Oct 11 07:22:53.556848 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:22:53.556848 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-2fe2056d-dbd6-41d9-92ff-acb8f7ba83bd tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Returning 404 to user: Instance efae89e3-9121-4a31-ba5b-040087bb8b3e is not attached to volume b52ca7e7-48b7-4c4c-b166-bbbf3e3146e1 {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 07:22:53.558054 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-2fe2056d-dbd6-41d9-92ff-acb8f7ba83bd tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "DELETE /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e/os-volume_attachments/b52ca7e7-48b7-4c4c-b166-bbbf3e3146e1" status: 404 len: 154 microversion: 2.1 time: 0.093661 Oct 11 07:22:53.558054 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1772/3544] 10.222.0.39 () {58 vars in 1416 bytes} [Tue Oct 11 07:22:53 2022] DELETE /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e/os-volume_attachments/b52ca7e7-48b7-4c4c-b166-bbbf3e3146e1 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 07:22:54.696378 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-24714622-d1fe-4a9f-b6aa-82efe64b450b tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:22:54.696878 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-24714622-d1fe-4a9f-b6aa-82efe64b450b tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:22:54.703167 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-24714622-d1fe-4a9f-b6aa-82efe64b450b tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:54.703681 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-24714622-d1fe-4a9f-b6aa-82efe64b450b tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:54.704117 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-24714622-d1fe-4a9f-b6aa-82efe64b450b tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:54.704805 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-24714622-d1fe-4a9f-b6aa-82efe64b450b tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:54.705255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-24714622-d1fe-4a9f-b6aa-82efe64b450b tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:54.705678 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-24714622-d1fe-4a9f-b6aa-82efe64b450b tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:54.730616 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-24714622-d1fe-4a9f-b6aa-82efe64b450b tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Going to try to terminate instance {{(pid=125266) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 07:22:54.804395 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-24714622-d1fe-4a9f-b6aa-82efe64b450b tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "DELETE /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 204 len: 0 microversion: 2.1 time: 0.111576 Oct 11 07:22:54.805058 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1773/3545] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Oct 11 07:22:54 2022] DELETE /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 07:22:54.813315 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-bfca2dc3-712e-4250-a221-8719e3753975 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:22:54.813964 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-bfca2dc3-712e-4250-a221-8719e3753975 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:22:54.820310 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bfca2dc3-712e-4250-a221-8719e3753975 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:54.820783 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bfca2dc3-712e-4250-a221-8719e3753975 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:54.821212 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bfca2dc3-712e-4250-a221-8719e3753975 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:54.821896 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bfca2dc3-712e-4250-a221-8719e3753975 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:54.822341 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bfca2dc3-712e-4250-a221-8719e3753975 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:54.822759 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-bfca2dc3-712e-4250-a221-8719e3753975 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:54.948434 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-bfca2dc3-712e-4250-a221-8719e3753975 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a69fa70c78405d805f8b70860f57bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:22:54.956070 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-bfca2dc3-712e-4250-a221-8719e3753975 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 200 len: 1555 microversion: 2.1 time: 0.146744 Oct 11 07:22:54.956624 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1773/3546] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:22:54 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 1555 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:22:55.980378 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c3023d72-8bd0-4911-a6d5-c19e7840bfc3 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:22:55.981101 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c3023d72-8bd0-4911-a6d5-c19e7840bfc3 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:22:55.987685 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c3023d72-8bd0-4911-a6d5-c19e7840bfc3 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:55.988159 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c3023d72-8bd0-4911-a6d5-c19e7840bfc3 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:55.988591 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c3023d72-8bd0-4911-a6d5-c19e7840bfc3 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:55.989271 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c3023d72-8bd0-4911-a6d5-c19e7840bfc3 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:55.989713 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c3023d72-8bd0-4911-a6d5-c19e7840bfc3 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:55.990133 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c3023d72-8bd0-4911-a6d5-c19e7840bfc3 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:56.115863 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-c3023d72-8bd0-4911-a6d5-c19e7840bfc3 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a69fa70c78405d805f8b70860f57bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:22:56.124097 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c3023d72-8bd0-4911-a6d5-c19e7840bfc3 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 200 len: 1555 microversion: 2.1 time: 0.148419 Oct 11 07:22:56.124651 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1774/3547] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:22:55 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:22:57.133011 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [req-fcb51c0e-013c-4f89-9083-9fe5fef17746 req-346c5ded-9db8-44fc-a53c-2b1af001e961 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efae89e3-9121-4a31-ba5b-040087bb8b3e", "name": "network-vif-deleted", "tag": "7f80cdc8-459e-4ac3-a549-1418688400ff"}]} {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:22:57.146812 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-fcb51c0e-013c-4f89-9083-9fe5fef17746 req-346c5ded-9db8-44fc-a53c-2b1af001e961 service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:57.147629 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-fcb51c0e-013c-4f89-9083-9fe5fef17746 req-346c5ded-9db8-44fc-a53c-2b1af001e961 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:57.148330 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [req-fcb51c0e-013c-4f89-9083-9fe5fef17746 req-346c5ded-9db8-44fc-a53c-2b1af001e961 service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:57.150083 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-4ed7b35f-9a49-42a9-a8fb-4be9ae1bcfb7 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:22:57.151127 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-4ed7b35f-9a49-42a9-a8fb-4be9ae1bcfb7 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:22:57.161262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ed7b35f-9a49-42a9-a8fb-4be9ae1bcfb7 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:57.162049 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ed7b35f-9a49-42a9-a8fb-4be9ae1bcfb7 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:57.162755 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ed7b35f-9a49-42a9-a8fb-4be9ae1bcfb7 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:57.163932 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ed7b35f-9a49-42a9-a8fb-4be9ae1bcfb7 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:57.164937 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ed7b35f-9a49-42a9-a8fb-4be9ae1bcfb7 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:57.165632 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-4ed7b35f-9a49-42a9-a8fb-4be9ae1bcfb7 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:57.167831 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.compute.server_external_events [req-fcb51c0e-013c-4f89-9083-9fe5fef17746 req-346c5ded-9db8-44fc-a53c-2b1af001e961 service nova] Creating event network-vif-deleted:7f80cdc8-459e-4ac3-a549-1418688400ff for instance efae89e3-9121-4a31-ba5b-040087bb8b3e on hv-cinder-85495 Oct 11 07:22:57.174903 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [req-fcb51c0e-013c-4f89-9083-9fe5fef17746 req-346c5ded-9db8-44fc-a53c-2b1af001e961 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045213 Oct 11 07:22:57.180658 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1774/3548] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:22:57.236174 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-4ed7b35f-9a49-42a9-a8fb-4be9ae1bcfb7 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a69fa70c78405d805f8b70860f57bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709d4e3bf4de4bd6857171f2d5d77885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:22:57.243985 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-4ed7b35f-9a49-42a9-a8fb-4be9ae1bcfb7 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 200 len: 1344 microversion: 2.1 time: 0.101417 Oct 11 07:22:57.244539 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1775/3549] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:22:57 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 1344 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:22:58.268643 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-13093ef2-65ee-444d-8fc2-aed46836cc59 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:22:58.269275 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-13093ef2-65ee-444d-8fc2-aed46836cc59 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] [instance: efae89e3-9121-4a31-ba5b-040087bb8b3e] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:22:58.275444 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13093ef2-65ee-444d-8fc2-aed46836cc59 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:58.275943 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13093ef2-65ee-444d-8fc2-aed46836cc59 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:58.276378 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13093ef2-65ee-444d-8fc2-aed46836cc59 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:58.277685 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13093ef2-65ee-444d-8fc2-aed46836cc59 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:22:58.278132 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13093ef2-65ee-444d-8fc2-aed46836cc59 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:22:58.278553 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-13093ef2-65ee-444d-8fc2-aed46836cc59 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:22:58.291588 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-13093ef2-65ee-444d-8fc2-aed46836cc59 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] HTTP exception thrown: Instance efae89e3-9121-4a31-ba5b-040087bb8b3e could not be found. Oct 11 07:22:58.293188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-13093ef2-65ee-444d-8fc2-aed46836cc59 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Request method failure captured: Oct 11 07:22:58.293188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: request: GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e HTTP/1.1 Oct 11 07:22:58.293188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept: application/json Oct 11 07:22:58.293188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Oct 11 07:22:58.293188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Connection: close Oct 11 07:22:58.293188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Length: 0 Oct 11 07:22:58.293188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Type: application/json Oct 11 07:22:58.293188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Host: 10.222.0.39 Oct 11 07:22:58.293188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Oct 11 07:22:58.293188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.12 Oct 11 07:22:58.293188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABjRRlV6Ang6pKPJOifQiASLYn65f-S1SJzTFtpM4obpFahzUNzP-v-rLfkfpet0NtGvHFrIZFJ3GCGzShTH1kG8VVRV7Krje1NO-oyhzTFCV80O82wjFJMABY9-OQVUGFqlfSD5Fr5qIlWoHn9hglcxVMCnRIeKqSs5wwpBXeRI358y7I Oct 11 07:22:58.293188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Oct 11 07:22:58.293188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Oct 11 07:22:58.293188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Oct 11 07:22:58.293188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Oct 11 07:22:58.293188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Oct 11 07:22:58.293188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Oct 11 07:22:58.293188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Id: 709d4e3bf4de4bd6857171f2d5d77885 Oct 11 07:22:58.293188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-TestMinimumBasicScenario-1025403994 Oct 11 07:22:58.293188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Role: reader,member Oct 11 07:22:58.293188 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Oct 11 07:22:58.294713 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_709d4e3bf4de4bd6857171f2d5d77885"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/709d4e3bf4de4bd6857171f2d5d77885"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/709d4e3bf4de4bd6857171f2d5d77885"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/709d4e3bf4de4bd6857171f2d5d77885"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 07:22:58.294713 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-TestMinimumBasicScenario-1025403994 Oct 11 07:22:58.294713 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 709d4e3bf4de4bd6857171f2d5d77885 Oct 11 07:22:58.294713 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1025403994 Oct 11 07:22:58.294713 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User: tempest-TestMinimumBasicScenario-1025403994-project Oct 11 07:22:58.294713 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Oct 11 07:22:58.294713 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Oct 11 07:22:58.294713 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Id: 96a69fa70c78405d805f8b70860f57bf Oct 11 07:22:58.294713 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-TestMinimumBasicScenario-1025403994-project Oct 11 07:22:58.294713 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: method: > Oct 11 07:22:58.294713 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: exception: Instance efae89e3-9121-4a31-ba5b-040087bb8b3e could not be found. Oct 11 07:22:58.294713 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: action_args: {'id': 'efae89e3-9121-4a31-ba5b-040087bb8b3e'} Oct 11 07:22:58.295610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 07:22:58.295610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:22:58.295610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 07:22:58.295610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 07:22:58.295610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 07:22:58.295610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 07:22:58.295610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 07:22:58.295610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 07:22:58.295610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 07:22:58.295610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 07:22:58.295610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efae89e3-9121-4a31-ba5b-040087bb8b3e could not be found. Oct 11 07:22:58.295610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:22:58.295610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:22:58.295610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:22:58.295610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:22:58.295610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:22:58.295610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:22:58.295610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 07:22:58.295610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 07:22:58.295610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 07:22:58.297026 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 07:22:58.297026 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 07:22:58.297026 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 07:22:58.297026 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 07:22:58.297026 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 07:22:58.297026 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 07:22:58.297026 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 07:22:58.297026 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efae89e3-9121-4a31-ba5b-040087bb8b3e could not be found. Oct 11 07:22:58.297026 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:22:58.297026 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:22:58.297026 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:22:58.297026 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:22:58.297026 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:22:58.297026 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:22:58.297026 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 07:22:58.297026 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 07:22:58.297026 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efae89e3-9121-4a31-ba5b-040087bb8b3e could not be found. Oct 11 07:22:58.297026 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:22:58.298298 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-13093ef2-65ee-444d-8fc2-aed46836cc59 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Returning 404 to user: Instance efae89e3-9121-4a31-ba5b-040087bb8b3e could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 07:22:58.298298 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-13093ef2-65ee-444d-8fc2-aed46836cc59 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e" status: 404 len: 111 microversion: 2.1 time: 0.030679 Oct 11 07:22:58.298298 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1775/3550] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:22:58 2022] GET /compute/v2.1/servers/efae89e3-9121-4a31-ba5b-040087bb8b3e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 07:22:58.303083 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-02ce639a-ddf3-4401-96c4-064342963039 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] Calling method '.version_select at 0x7f8e26f37700>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:22:58.321363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-02ce639a-ddf3-4401-96c4-064342963039 tempest-TestMinimumBasicScenario-1025403994 tempest-TestMinimumBasicScenario-1025403994-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1172763278" status: 202 len: 0 microversion: 2.1 time: 0.021967 Oct 11 07:22:58.321920 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1776/3551] 10.222.0.39 () {58 vars in 1272 bytes} [Tue Oct 11 07:22:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1172763278 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 07:23:22.583738 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:23:22.584483 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG dbcounter [-] [125266] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:23:22.589553 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-49c771db-0cdf-440e-a665-00a856cdc104 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:23:22.590050 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-49c771db-0cdf-440e-a665-00a856cdc104 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: de68987b-f150-41fb-9df8-e056b5f2e140] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:23:22.592385 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_api:SELECT=14 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:23:22.593068 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG dbcounter [-] [125267] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=125267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:23:22.596697 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-55b14fd9-5d95-41c9-a9f6-ec4cc2d0d718 req-be8e4160-4dc2-4ec5-8b8b-0ccd42aa33ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de68987b-f150-41fb-9df8-e056b5f2e140", "tag": "62c41126-ec7e-4ed2-a83a-c9fddae2327b"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:23:22.608978 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-55b14fd9-5d95-41c9-a9f6-ec4cc2d0d718 req-be8e4160-4dc2-4ec5-8b8b-0ccd42aa33ef service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:23:22.609687 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-55b14fd9-5d95-41c9-a9f6-ec4cc2d0d718 req-be8e4160-4dc2-4ec5-8b8b-0ccd42aa33ef service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:23:22.610300 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-55b14fd9-5d95-41c9-a9f6-ec4cc2d0d718 req-be8e4160-4dc2-4ec5-8b8b-0ccd42aa33ef service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:23:22.613176 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-49c771db-0cdf-440e-a665-00a856cdc104 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:23:22.613759 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-49c771db-0cdf-440e-a665-00a856cdc104 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:23:22.614203 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-49c771db-0cdf-440e-a665-00a856cdc104 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:23:22.614916 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-49c771db-0cdf-440e-a665-00a856cdc104 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:23:22.615364 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-49c771db-0cdf-440e-a665-00a856cdc104 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:23:22.615813 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-49c771db-0cdf-440e-a665-00a856cdc104 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:23:22.625262 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-55b14fd9-5d95-41c9-a9f6-ec4cc2d0d718 req-be8e4160-4dc2-4ec5-8b8b-0ccd42aa33ef service nova] Creating event network-changed:62c41126-ec7e-4ed2-a83a-c9fddae2327b for instance de68987b-f150-41fb-9df8-e056b5f2e140 on hv-cinder-85495 Oct 11 07:23:22.630792 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-55b14fd9-5d95-41c9-a9f6-ec4cc2d0d718 req-be8e4160-4dc2-4ec5-8b8b-0ccd42aa33ef service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048393 Oct 11 07:23:22.631386 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1777/3552] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:23:22.647896 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-49c771db-0cdf-440e-a665-00a856cdc104 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: de68987b-f150-41fb-9df8-e056b5f2e140] Going to try to terminate instance {{(pid=125267) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 07:23:22.731660 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-49c771db-0cdf-440e-a665-00a856cdc104 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "DELETE /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140" status: 204 len: 0 microversion: 2.1 time: 0.150156 Oct 11 07:23:22.736036 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1776/3553] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Oct 11 07:23:22 2022] DELETE /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 07:23:22.742250 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-ff20df86-fd25-4a8e-aca1-5139533cd395 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:23:22.742953 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-ff20df86-fd25-4a8e-aca1-5139533cd395 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: de68987b-f150-41fb-9df8-e056b5f2e140] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:23:22.750845 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff20df86-fd25-4a8e-aca1-5139533cd395 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:23:22.751326 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff20df86-fd25-4a8e-aca1-5139533cd395 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:23:22.751796 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff20df86-fd25-4a8e-aca1-5139533cd395 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:23:22.752481 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff20df86-fd25-4a8e-aca1-5139533cd395 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:23:22.752935 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff20df86-fd25-4a8e-aca1-5139533cd395 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:23:22.753354 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-ff20df86-fd25-4a8e-aca1-5139533cd395 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:23:23.122653 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-ff20df86-fd25-4a8e-aca1-5139533cd395 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:23:23.130390 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-ff20df86-fd25-4a8e-aca1-5139533cd395 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140" status: 200 len: 1576 microversion: 2.1 time: 0.392793 Oct 11 07:23:23.130952 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1778/3554] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:23:22 2022] GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140 => generated 1576 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:23:24.154678 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-23c1df9b-8956-4ec3-84e0-03429d962186 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:23:24.155478 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-23c1df9b-8956-4ec3-84e0-03429d962186 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: de68987b-f150-41fb-9df8-e056b5f2e140] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:23:24.161966 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23c1df9b-8956-4ec3-84e0-03429d962186 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:23:24.162448 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23c1df9b-8956-4ec3-84e0-03429d962186 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:23:24.163168 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23c1df9b-8956-4ec3-84e0-03429d962186 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:23:24.163918 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23c1df9b-8956-4ec3-84e0-03429d962186 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:23:24.164370 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23c1df9b-8956-4ec3-84e0-03429d962186 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:23:24.164794 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-23c1df9b-8956-4ec3-84e0-03429d962186 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:23:24.353483 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-23c1df9b-8956-4ec3-84e0-03429d962186 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:23:24.362200 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-23c1df9b-8956-4ec3-84e0-03429d962186 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140" status: 200 len: 1576 microversion: 2.1 time: 0.211744 Oct 11 07:23:24.362760 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1777/3555] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:23:24 2022] GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140 => generated 1576 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:23:24.935446 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-f49e01f9-fc26-46be-904d-688efcbbd8f4 req-8471933c-fc9a-472d-b37b-03894d2fb15c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de68987b-f150-41fb-9df8-e056b5f2e140", "name": "network-vif-deleted", "tag": "62c41126-ec7e-4ed2-a83a-c9fddae2327b"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:23:24.948696 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-f49e01f9-fc26-46be-904d-688efcbbd8f4 req-8471933c-fc9a-472d-b37b-03894d2fb15c service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:23:24.949093 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-f49e01f9-fc26-46be-904d-688efcbbd8f4 req-8471933c-fc9a-472d-b37b-03894d2fb15c service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:23:24.949554 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-f49e01f9-fc26-46be-904d-688efcbbd8f4 req-8471933c-fc9a-472d-b37b-03894d2fb15c service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:23:24.961778 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-f49e01f9-fc26-46be-904d-688efcbbd8f4 req-8471933c-fc9a-472d-b37b-03894d2fb15c service nova] Creating event network-vif-deleted:62c41126-ec7e-4ed2-a83a-c9fddae2327b for instance de68987b-f150-41fb-9df8-e056b5f2e140 on hv-cinder-85495 Oct 11 07:23:24.968810 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-f49e01f9-fc26-46be-904d-688efcbbd8f4 req-8471933c-fc9a-472d-b37b-03894d2fb15c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041142 Oct 11 07:23:24.969416 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1779/3556] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:23:25.386328 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-93920e38-247b-4d54-8fbd-580b7ec038c1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:23:25.387610 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-93920e38-247b-4d54-8fbd-580b7ec038c1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: de68987b-f150-41fb-9df8-e056b5f2e140] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:23:25.394057 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93920e38-247b-4d54-8fbd-580b7ec038c1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:23:25.394694 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93920e38-247b-4d54-8fbd-580b7ec038c1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:23:25.395189 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93920e38-247b-4d54-8fbd-580b7ec038c1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:23:25.395976 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93920e38-247b-4d54-8fbd-580b7ec038c1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:23:25.396496 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93920e38-247b-4d54-8fbd-580b7ec038c1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:23:25.396981 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93920e38-247b-4d54-8fbd-580b7ec038c1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:23:25.434309 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93920e38-247b-4d54-8fbd-580b7ec038c1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:23:25.434789 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93920e38-247b-4d54-8fbd-580b7ec038c1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:23:25.435222 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-93920e38-247b-4d54-8fbd-580b7ec038c1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:23:25.435695 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.objects.instance [None req-93920e38-247b-4d54-8fbd-580b7ec038c1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lazy-loading 'fault' on Instance uuid de68987b-f150-41fb-9df8-e056b5f2e140 {{(pid=125267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 07:23:25.475812 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-93920e38-247b-4d54-8fbd-580b7ec038c1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:23:25.483859 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-93920e38-247b-4d54-8fbd-580b7ec038c1 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140" status: 200 len: 1229 microversion: 2.1 time: 0.101675 Oct 11 07:23:25.484424 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1778/3557] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:23:25 2022] GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140 => generated 1229 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:23:26.507430 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6c3b2e1f-a8ed-4402-9173-2e1d24f66513 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:23:26.508236 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-6c3b2e1f-a8ed-4402-9173-2e1d24f66513 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: de68987b-f150-41fb-9df8-e056b5f2e140] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:23:26.515607 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6c3b2e1f-a8ed-4402-9173-2e1d24f66513 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:23:26.516091 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6c3b2e1f-a8ed-4402-9173-2e1d24f66513 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:23:26.516526 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6c3b2e1f-a8ed-4402-9173-2e1d24f66513 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:23:26.517221 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6c3b2e1f-a8ed-4402-9173-2e1d24f66513 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:23:26.517674 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6c3b2e1f-a8ed-4402-9173-2e1d24f66513 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:23:26.518101 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-6c3b2e1f-a8ed-4402-9173-2e1d24f66513 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:23:26.533407 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-6c3b2e1f-a8ed-4402-9173-2e1d24f66513 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] HTTP exception thrown: Instance de68987b-f150-41fb-9df8-e056b5f2e140 could not be found. Oct 11 07:23:26.535006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6c3b2e1f-a8ed-4402-9173-2e1d24f66513 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Request method failure captured: Oct 11 07:23:26.535006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: request: GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140 HTTP/1.1 Oct 11 07:23:26.535006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept: application/json Oct 11 07:23:26.535006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Oct 11 07:23:26.535006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Connection: close Oct 11 07:23:26.535006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Length: 0 Oct 11 07:23:26.535006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Type: application/json Oct 11 07:23:26.535006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Host: 10.222.0.39 Oct 11 07:23:26.535006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Oct 11 07:23:26.535006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.12 Oct 11 07:23:26.535006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABjRRhHnYNIMKyF2tfqS42y71aTWXn3HKRZaYma0JrclXbKW7PAmGIzZ8OFbOkRLVnBKVTy8aEhXHboOolvsN6gFpFtVyCquR07OqnN6zdAK8MUFvVOzQo_3n6CYhYB1dMg4F5xnmnEN_1Km08DDHcP04R5D7meiMXCaWr-mHX9cGVX_mc Oct 11 07:23:26.535006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Oct 11 07:23:26.535006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Oct 11 07:23:26.535006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Oct 11 07:23:26.535006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Oct 11 07:23:26.535006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Oct 11 07:23:26.535006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Oct 11 07:23:26.535006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Id: 60dd1d4ab8434282b5f57d6547f8d3e9 Oct 11 07:23:26.535006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-TestVolumeBootPattern-1740065613 Oct 11 07:23:26.535006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Role: reader,member Oct 11 07:23:26.535006 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Oct 11 07:23:26.536496 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_60dd1d4ab8434282b5f57d6547f8d3e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/60dd1d4ab8434282b5f57d6547f8d3e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/60dd1d4ab8434282b5f57d6547f8d3e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/60dd1d4ab8434282b5f57d6547f8d3e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 07:23:26.536496 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-TestVolumeBootPattern-1740065613 Oct 11 07:23:26.536496 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 60dd1d4ab8434282b5f57d6547f8d3e9 Oct 11 07:23:26.536496 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-TestVolumeBootPattern-1740065613 Oct 11 07:23:26.536496 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User: tempest-TestVolumeBootPattern-1740065613-project Oct 11 07:23:26.536496 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Oct 11 07:23:26.536496 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Oct 11 07:23:26.536496 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Id: 52173fbead6e4b499a99a6979c9a9898 Oct 11 07:23:26.536496 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-TestVolumeBootPattern-1740065613-project Oct 11 07:23:26.536496 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: method: > Oct 11 07:23:26.536496 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: exception: Instance de68987b-f150-41fb-9df8-e056b5f2e140 could not be found. Oct 11 07:23:26.536496 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: action_args: {'id': 'de68987b-f150-41fb-9df8-e056b5f2e140'} Oct 11 07:23:26.537363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 07:23:26.537363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:23:26.537363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 07:23:26.537363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 07:23:26.537363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 07:23:26.537363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 07:23:26.537363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 07:23:26.537363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 07:23:26.537363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 07:23:26.537363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 07:23:26.537363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de68987b-f150-41fb-9df8-e056b5f2e140 could not be found. Oct 11 07:23:26.537363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:23:26.537363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:23:26.537363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:23:26.537363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:23:26.537363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:23:26.537363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:23:26.537363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 07:23:26.537363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 07:23:26.537363 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 07:23:26.538733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 07:23:26.538733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 07:23:26.538733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 07:23:26.538733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 07:23:26.538733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 07:23:26.538733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 07:23:26.538733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 07:23:26.538733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de68987b-f150-41fb-9df8-e056b5f2e140 could not be found. Oct 11 07:23:26.538733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:23:26.538733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:23:26.538733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:23:26.538733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:23:26.538733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:23:26.538733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:23:26.538733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 07:23:26.538733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 07:23:26.538733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de68987b-f150-41fb-9df8-e056b5f2e140 could not be found. Oct 11 07:23:26.538733 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:23:26.539965 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-6c3b2e1f-a8ed-4402-9173-2e1d24f66513 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Returning 404 to user: Instance de68987b-f150-41fb-9df8-e056b5f2e140 could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 07:23:26.539965 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-6c3b2e1f-a8ed-4402-9173-2e1d24f66513 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140" status: 404 len: 111 microversion: 2.1 time: 0.033134 Oct 11 07:23:26.539965 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1780/3558] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:23:26 2022] GET /compute/v2.1/servers/de68987b-f150-41fb-9df8-e056b5f2e140 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 07:23:29.564542 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-7dbfb0a6-b4b5-456f-92f9-2465b29381ae tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:23:29.565151 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7dbfb0a6-b4b5-456f-92f9-2465b29381ae tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 5fde741d-e09c-4bfb-93de-7554e07ae0a5] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:23:29.567571 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-5fedf650-8f9c-432c-80bd-0e0ceecd1cd2 req-a25f084f-fada-4d9f-8099-6bc75c7db93a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fde741d-e09c-4bfb-93de-7554e07ae0a5", "tag": "71634763-1cc7-402d-b94e-dc4268009170"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:23:29.571963 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7dbfb0a6-b4b5-456f-92f9-2465b29381ae tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:23:29.572525 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7dbfb0a6-b4b5-456f-92f9-2465b29381ae tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:23:29.573069 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7dbfb0a6-b4b5-456f-92f9-2465b29381ae tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:23:29.573859 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7dbfb0a6-b4b5-456f-92f9-2465b29381ae tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:23:29.574926 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7dbfb0a6-b4b5-456f-92f9-2465b29381ae tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:23:29.575454 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-7dbfb0a6-b4b5-456f-92f9-2465b29381ae tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:23:29.578364 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-5fedf650-8f9c-432c-80bd-0e0ceecd1cd2 req-a25f084f-fada-4d9f-8099-6bc75c7db93a service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:23:29.579037 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-5fedf650-8f9c-432c-80bd-0e0ceecd1cd2 req-a25f084f-fada-4d9f-8099-6bc75c7db93a service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:23:29.579638 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-5fedf650-8f9c-432c-80bd-0e0ceecd1cd2 req-a25f084f-fada-4d9f-8099-6bc75c7db93a service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:23:29.597660 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-5fedf650-8f9c-432c-80bd-0e0ceecd1cd2 req-a25f084f-fada-4d9f-8099-6bc75c7db93a service nova] Creating event network-changed:71634763-1cc7-402d-b94e-dc4268009170 for instance 5fde741d-e09c-4bfb-93de-7554e07ae0a5 on hv-cinder-85495 Oct 11 07:23:29.602955 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-7dbfb0a6-b4b5-456f-92f9-2465b29381ae tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 5fde741d-e09c-4bfb-93de-7554e07ae0a5] Going to try to terminate instance {{(pid=125267) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 07:23:29.606757 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-5fedf650-8f9c-432c-80bd-0e0ceecd1cd2 req-a25f084f-fada-4d9f-8099-6bc75c7db93a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043511 Oct 11 07:23:29.607644 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1781/3559] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:23:29.684488 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-7dbfb0a6-b4b5-456f-92f9-2465b29381ae tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5" status: 204 len: 0 microversion: 2.1 time: 0.122672 Oct 11 07:23:29.687510 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1779/3560] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Oct 11 07:23:29 2022] DELETE /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 07:23:29.696526 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-1bae20d2-d6ba-4fe1-80ea-12dc07ee10c9 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:23:29.697228 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-1bae20d2-d6ba-4fe1-80ea-12dc07ee10c9 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 5fde741d-e09c-4bfb-93de-7554e07ae0a5] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:23:29.704082 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1bae20d2-d6ba-4fe1-80ea-12dc07ee10c9 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:23:29.704816 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1bae20d2-d6ba-4fe1-80ea-12dc07ee10c9 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:23:29.705243 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1bae20d2-d6ba-4fe1-80ea-12dc07ee10c9 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:23:29.705939 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1bae20d2-d6ba-4fe1-80ea-12dc07ee10c9 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:23:29.706555 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1bae20d2-d6ba-4fe1-80ea-12dc07ee10c9 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:23:29.706979 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-1bae20d2-d6ba-4fe1-80ea-12dc07ee10c9 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:23:29.838456 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.policy [None req-1bae20d2-d6ba-4fe1-80ea-12dc07ee10c9 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125266) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:23:29.846153 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-1bae20d2-d6ba-4fe1-80ea-12dc07ee10c9 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5" status: 200 len: 1577 microversion: 2.1 time: 0.155616 Oct 11 07:23:29.846910 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1782/3561] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:23:29 2022] GET /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:23:30.870129 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-cce94845-3e3c-4099-8abd-c3c19942adbc tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:23:30.871291 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-cce94845-3e3c-4099-8abd-c3c19942adbc tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 5fde741d-e09c-4bfb-93de-7554e07ae0a5] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:23:30.877551 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cce94845-3e3c-4099-8abd-c3c19942adbc tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:23:30.878019 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cce94845-3e3c-4099-8abd-c3c19942adbc tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:23:30.878444 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cce94845-3e3c-4099-8abd-c3c19942adbc tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:23:30.879118 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cce94845-3e3c-4099-8abd-c3c19942adbc tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:23:30.879592 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cce94845-3e3c-4099-8abd-c3c19942adbc tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:23:30.880005 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-cce94845-3e3c-4099-8abd-c3c19942adbc tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:23:31.008437 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-cce94845-3e3c-4099-8abd-c3c19942adbc tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:23:31.017061 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-cce94845-3e3c-4099-8abd-c3c19942adbc tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5" status: 200 len: 1577 microversion: 2.1 time: 0.151264 Oct 11 07:23:31.017619 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1780/3562] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:23:30 2022] GET /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:23:31.792033 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [req-c39ff1b7-3c66-4bfd-b8eb-57b1d6cbb9c7 req-eda9bd30-d4e0-4609-b04a-fc21a177788a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fde741d-e09c-4bfb-93de-7554e07ae0a5", "name": "network-vif-deleted", "tag": "71634763-1cc7-402d-b94e-dc4268009170"}]} {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 07:23:31.804210 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-c39ff1b7-3c66-4bfd-b8eb-57b1d6cbb9c7 req-eda9bd30-d4e0-4609-b04a-fc21a177788a service nova] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:23:31.804677 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-c39ff1b7-3c66-4bfd-b8eb-57b1d6cbb9c7 req-eda9bd30-d4e0-4609-b04a-fc21a177788a service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:23:31.805101 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [req-c39ff1b7-3c66-4bfd-b8eb-57b1d6cbb9c7 req-eda9bd30-d4e0-4609-b04a-fc21a177788a service nova] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:23:31.817406 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.compute.server_external_events [req-c39ff1b7-3c66-4bfd-b8eb-57b1d6cbb9c7 req-eda9bd30-d4e0-4609-b04a-fc21a177788a service nova] Creating event network-vif-deleted:71634763-1cc7-402d-b94e-dc4268009170 for instance 5fde741d-e09c-4bfb-93de-7554e07ae0a5 on hv-cinder-85495 Oct 11 07:23:31.823471 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [req-c39ff1b7-3c66-4bfd-b8eb-57b1d6cbb9c7 req-eda9bd30-d4e0-4609-b04a-fc21a177788a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035386 Oct 11 07:23:31.824576 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1783/3563] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Oct 11 07:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 07:23:32.039021 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-efdc4707-3982-4e61-a43e-faed8cd2ed5c tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:23:32.039592 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-efdc4707-3982-4e61-a43e-faed8cd2ed5c tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 5fde741d-e09c-4bfb-93de-7554e07ae0a5] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:23:32.046116 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-efdc4707-3982-4e61-a43e-faed8cd2ed5c tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:23:32.046592 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-efdc4707-3982-4e61-a43e-faed8cd2ed5c tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:23:32.047018 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-efdc4707-3982-4e61-a43e-faed8cd2ed5c tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:23:32.047730 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-efdc4707-3982-4e61-a43e-faed8cd2ed5c tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:23:32.048177 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-efdc4707-3982-4e61-a43e-faed8cd2ed5c tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:23:32.048589 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-efdc4707-3982-4e61-a43e-faed8cd2ed5c tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:23:32.120276 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.policy [None req-efdc4707-3982-4e61-a43e-faed8cd2ed5c tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173fbead6e4b499a99a6979c9a9898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dd1d4ab8434282b5f57d6547f8d3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125267) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 07:23:32.128514 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-efdc4707-3982-4e61-a43e-faed8cd2ed5c tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5" status: 200 len: 1224 microversion: 2.1 time: 0.093333 Oct 11 07:23:32.129178 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1781/3564] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:23:32 2022] GET /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 07:23:33.152990 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c934dca6-4e46-4ad1-bc92-1865fea38904 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:23:33.153687 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-c934dca6-4e46-4ad1-bc92-1865fea38904 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 5fde741d-e09c-4bfb-93de-7554e07ae0a5] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:23:33.160381 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c934dca6-4e46-4ad1-bc92-1865fea38904 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:23:33.160855 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c934dca6-4e46-4ad1-bc92-1865fea38904 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:23:33.161284 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c934dca6-4e46-4ad1-bc92-1865fea38904 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:23:33.161962 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c934dca6-4e46-4ad1-bc92-1865fea38904 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:23:33.162433 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c934dca6-4e46-4ad1-bc92-1865fea38904 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:23:33.162834 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-c934dca6-4e46-4ad1-bc92-1865fea38904 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:23:33.176660 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-c934dca6-4e46-4ad1-bc92-1865fea38904 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] HTTP exception thrown: Instance 5fde741d-e09c-4bfb-93de-7554e07ae0a5 could not be found. Oct 11 07:23:33.178255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c934dca6-4e46-4ad1-bc92-1865fea38904 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Request method failure captured: Oct 11 07:23:33.178255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: request: GET /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5 HTTP/1.1 Oct 11 07:23:33.178255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept: application/json Oct 11 07:23:33.178255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Oct 11 07:23:33.178255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Connection: close Oct 11 07:23:33.178255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Length: 0 Oct 11 07:23:33.178255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Type: application/json Oct 11 07:23:33.178255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Host: 10.222.0.39 Oct 11 07:23:33.178255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Oct 11 07:23:33.178255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.12 Oct 11 07:23:33.178255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABjRRhHnYNIMKyF2tfqS42y71aTWXn3HKRZaYma0JrclXbKW7PAmGIzZ8OFbOkRLVnBKVTy8aEhXHboOolvsN6gFpFtVyCquR07OqnN6zdAK8MUFvVOzQo_3n6CYhYB1dMg4F5xnmnEN_1Km08DDHcP04R5D7meiMXCaWr-mHX9cGVX_mc Oct 11 07:23:33.178255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Oct 11 07:23:33.178255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Oct 11 07:23:33.178255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Oct 11 07:23:33.178255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Oct 11 07:23:33.178255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Oct 11 07:23:33.178255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Oct 11 07:23:33.178255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Id: 60dd1d4ab8434282b5f57d6547f8d3e9 Oct 11 07:23:33.178255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-TestVolumeBootPattern-1740065613 Oct 11 07:23:33.178255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Role: reader,member Oct 11 07:23:33.178255 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Oct 11 07:23:33.179725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_60dd1d4ab8434282b5f57d6547f8d3e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/60dd1d4ab8434282b5f57d6547f8d3e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/60dd1d4ab8434282b5f57d6547f8d3e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/60dd1d4ab8434282b5f57d6547f8d3e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 07:23:33.179725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-TestVolumeBootPattern-1740065613 Oct 11 07:23:33.179725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 60dd1d4ab8434282b5f57d6547f8d3e9 Oct 11 07:23:33.179725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-TestVolumeBootPattern-1740065613 Oct 11 07:23:33.179725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User: tempest-TestVolumeBootPattern-1740065613-project Oct 11 07:23:33.179725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Oct 11 07:23:33.179725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Oct 11 07:23:33.179725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Id: 52173fbead6e4b499a99a6979c9a9898 Oct 11 07:23:33.179725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-TestVolumeBootPattern-1740065613-project Oct 11 07:23:33.179725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: method: > Oct 11 07:23:33.179725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: exception: Instance 5fde741d-e09c-4bfb-93de-7554e07ae0a5 could not be found. Oct 11 07:23:33.179725 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: action_args: {'id': '5fde741d-e09c-4bfb-93de-7554e07ae0a5'} Oct 11 07:23:33.180490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 07:23:33.180490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:23:33.180490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 07:23:33.180490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 07:23:33.180490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 07:23:33.180490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 07:23:33.180490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 07:23:33.180490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 07:23:33.180490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 07:23:33.180490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 07:23:33.180490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fde741d-e09c-4bfb-93de-7554e07ae0a5 could not be found. Oct 11 07:23:33.180490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:23:33.180490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:23:33.180490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:23:33.180490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:23:33.180490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:23:33.180490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:23:33.180490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 07:23:33.180490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 07:23:33.180490 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 07:23:33.182028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 07:23:33.182028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 07:23:33.182028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 07:23:33.182028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 07:23:33.182028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 07:23:33.182028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 07:23:33.182028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 07:23:33.182028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fde741d-e09c-4bfb-93de-7554e07ae0a5 could not be found. Oct 11 07:23:33.182028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:23:33.182028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:23:33.182028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:23:33.182028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:23:33.182028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:23:33.182028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:23:33.182028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 07:23:33.182028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 07:23:33.182028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fde741d-e09c-4bfb-93de-7554e07ae0a5 could not be found. Oct 11 07:23:33.182028 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:23:33.183407 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-c934dca6-4e46-4ad1-bc92-1865fea38904 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Returning 404 to user: Instance 5fde741d-e09c-4bfb-93de-7554e07ae0a5 could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 07:23:33.183407 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-c934dca6-4e46-4ad1-bc92-1865fea38904 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5" status: 404 len: 111 microversion: 2.1 time: 0.031328 Oct 11 07:23:33.183407 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1784/3565] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:23:33 2022] GET /compute/v2.1/servers/5fde741d-e09c-4bfb-93de-7554e07ae0a5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 07:23:33.608550 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-15579860-2087-4a61-b98c-ee9838fa4679 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:23:33.609061 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.compute.api [None req-15579860-2087-4a61-b98c-ee9838fa4679 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 0bb04c29-c281-4fe5-8196-947a769f6e41] Fetching instance by UUID {{(pid=125267) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:23:33.615527 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15579860-2087-4a61-b98c-ee9838fa4679 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:23:33.616002 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15579860-2087-4a61-b98c-ee9838fa4679 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:23:33.616432 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15579860-2087-4a61-b98c-ee9838fa4679 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:23:33.617114 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15579860-2087-4a61-b98c-ee9838fa4679 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:23:33.617560 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15579860-2087-4a61-b98c-ee9838fa4679 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:23:33.617980 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG oslo_concurrency.lockutils [None req-15579860-2087-4a61-b98c-ee9838fa4679 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:23:33.630877 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.wsgi [None req-15579860-2087-4a61-b98c-ee9838fa4679 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] HTTP exception thrown: Instance 0bb04c29-c281-4fe5-8196-947a769f6e41 could not be found. Oct 11 07:23:33.632549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-15579860-2087-4a61-b98c-ee9838fa4679 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Request method failure captured: Oct 11 07:23:33.632549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: request: DELETE /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41 HTTP/1.1 Oct 11 07:23:33.632549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept: application/json Oct 11 07:23:33.632549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Accept-Encoding: identity Oct 11 07:23:33.632549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Connection: close Oct 11 07:23:33.632549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Length: 0 Oct 11 07:23:33.632549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Content-Type: application/json Oct 11 07:23:33.632549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Host: 10.222.0.39 Oct 11 07:23:33.632549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: Openstack-System-Scope: None Oct 11 07:23:33.632549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: User-Agent: python-urllib3/1.26.12 Oct 11 07:23:33.632549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Auth-Token: gAAAAABjRRhHnYNIMKyF2tfqS42y71aTWXn3HKRZaYma0JrclXbKW7PAmGIzZ8OFbOkRLVnBKVTy8aEhXHboOolvsN6gFpFtVyCquR07OqnN6zdAK8MUFvVOzQo_3n6CYhYB1dMg4F5xnmnEN_1Km08DDHcP04R5D7meiMXCaWr-mHX9cGVX_mc Oct 11 07:23:33.632549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Id: None Oct 11 07:23:33.632549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Domain-Name: None Oct 11 07:23:33.632549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Identity-Status: Confirmed Oct 11 07:23:33.632549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Is-Admin-Project: True Oct 11 07:23:33.632549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Id: default Oct 11 07:23:33.632549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Domain-Name: Default Oct 11 07:23:33.632549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Id: 60dd1d4ab8434282b5f57d6547f8d3e9 Oct 11 07:23:33.632549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Project-Name: tempest-TestVolumeBootPattern-1740065613 Oct 11 07:23:33.632549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Role: reader,member Oct 11 07:23:33.632549 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Roles: reader,member Oct 11 07:23:33.634014 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_60dd1d4ab8434282b5f57d6547f8d3e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/60dd1d4ab8434282b5f57d6547f8d3e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/60dd1d4ab8434282b5f57d6547f8d3e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/60dd1d4ab8434282b5f57d6547f8d3e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 07:23:33.634014 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant: tempest-TestVolumeBootPattern-1740065613 Oct 11 07:23:33.634014 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Id: 60dd1d4ab8434282b5f57d6547f8d3e9 Oct 11 07:23:33.634014 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-Tenant-Name: tempest-TestVolumeBootPattern-1740065613 Oct 11 07:23:33.634014 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User: tempest-TestVolumeBootPattern-1740065613-project Oct 11 07:23:33.634014 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Id: default Oct 11 07:23:33.634014 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Domain-Name: Default Oct 11 07:23:33.634014 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Id: 52173fbead6e4b499a99a6979c9a9898 Oct 11 07:23:33.634014 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: X-User-Name: tempest-TestVolumeBootPattern-1740065613-project Oct 11 07:23:33.634014 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: method: > Oct 11 07:23:33.634014 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: exception: Instance 0bb04c29-c281-4fe5-8196-947a769f6e41 could not be found. Oct 11 07:23:33.634014 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: action_args: {'id': '0bb04c29-c281-4fe5-8196-947a769f6e41'} Oct 11 07:23:33.634866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 07:23:33.634866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:23:33.634866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 07:23:33.634866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 07:23:33.634866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 07:23:33.634866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 07:23:33.634866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 07:23:33.634866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 07:23:33.634866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 07:23:33.634866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 07:23:33.634866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bb04c29-c281-4fe5-8196-947a769f6e41 could not be found. Oct 11 07:23:33.634866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:23:33.634866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:23:33.634866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:23:33.634866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:23:33.634866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:23:33.634866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:23:33.634866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 07:23:33.634866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 07:23:33.634866 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 07:23:33.636894 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 07:23:33.636894 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 07:23:33.636894 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 07:23:33.636894 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 07:23:33.636894 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 07:23:33.636894 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 07:23:33.636894 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 07:23:33.636894 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 07:23:33.636894 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 07:23:33.636894 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bb04c29-c281-4fe5-8196-947a769f6e41 could not be found. Oct 11 07:23:33.636894 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:23:33.636894 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:23:33.636894 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:23:33.636894 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:23:33.636894 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:23:33.636894 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:23:33.636894 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 07:23:33.636894 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 07:23:33.636894 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bb04c29-c281-4fe5-8196-947a769f6e41 could not be found. Oct 11 07:23:33.636894 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR nova.api.openstack.wsgi Oct 11 07:23:33.638203 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-15579860-2087-4a61-b98c-ee9838fa4679 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Returning 404 to user: Instance 0bb04c29-c281-4fe5-8196-947a769f6e41 could not be found. {{(pid=125267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 07:23:33.638203 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-15579860-2087-4a61-b98c-ee9838fa4679 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41" status: 404 len: 111 microversion: 2.1 time: 0.029837 Oct 11 07:23:33.638203 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1782/3566] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Oct 11 07:23:33 2022] DELETE /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 07:23:33.644467 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-125ae1a6-b691-433c-92b1-01e62439a6f3 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '>' {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:23:33.645075 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.compute.api [None req-125ae1a6-b691-433c-92b1-01e62439a6f3 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [instance: 0bb04c29-c281-4fe5-8196-947a769f6e41] Fetching instance by UUID {{(pid=125266) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 07:23:33.650981 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-125ae1a6-b691-433c-92b1-01e62439a6f3 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:23:33.651474 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-125ae1a6-b691-433c-92b1-01e62439a6f3 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:23:33.652503 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-125ae1a6-b691-433c-92b1-01e62439a6f3 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:23:33.653182 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-125ae1a6-b691-433c-92b1-01e62439a6f3 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Acquiring lock "e62ab37f-4106-4036-9988-c6129f938802" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 07:23:33.653622 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-125ae1a6-b691-433c-92b1-01e62439a6f3 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 07:23:33.654034 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG oslo_concurrency.lockutils [None req-125ae1a6-b691-433c-92b1-01e62439a6f3 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Lock "e62ab37f-4106-4036-9988-c6129f938802" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 07:23:33.666924 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.wsgi [None req-125ae1a6-b691-433c-92b1-01e62439a6f3 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] HTTP exception thrown: Instance 0bb04c29-c281-4fe5-8196-947a769f6e41 could not be found. Oct 11 07:23:33.668492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-125ae1a6-b691-433c-92b1-01e62439a6f3 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Request method failure captured: Oct 11 07:23:33.668492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: request: GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41 HTTP/1.1 Oct 11 07:23:33.668492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept: application/json Oct 11 07:23:33.668492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Accept-Encoding: identity Oct 11 07:23:33.668492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Connection: close Oct 11 07:23:33.668492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Length: 0 Oct 11 07:23:33.668492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Content-Type: application/json Oct 11 07:23:33.668492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Host: 10.222.0.39 Oct 11 07:23:33.668492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: Openstack-System-Scope: None Oct 11 07:23:33.668492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: User-Agent: python-urllib3/1.26.12 Oct 11 07:23:33.668492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Auth-Token: gAAAAABjRRhHnYNIMKyF2tfqS42y71aTWXn3HKRZaYma0JrclXbKW7PAmGIzZ8OFbOkRLVnBKVTy8aEhXHboOolvsN6gFpFtVyCquR07OqnN6zdAK8MUFvVOzQo_3n6CYhYB1dMg4F5xnmnEN_1Km08DDHcP04R5D7meiMXCaWr-mHX9cGVX_mc Oct 11 07:23:33.668492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Id: None Oct 11 07:23:33.668492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Domain-Name: None Oct 11 07:23:33.668492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Identity-Status: Confirmed Oct 11 07:23:33.668492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Is-Admin-Project: True Oct 11 07:23:33.668492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Id: default Oct 11 07:23:33.668492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Domain-Name: Default Oct 11 07:23:33.668492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Id: 60dd1d4ab8434282b5f57d6547f8d3e9 Oct 11 07:23:33.668492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Project-Name: tempest-TestVolumeBootPattern-1740065613 Oct 11 07:23:33.668492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Role: reader,member Oct 11 07:23:33.668492 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Roles: reader,member Oct 11 07:23:33.669963 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_60dd1d4ab8434282b5f57d6547f8d3e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/60dd1d4ab8434282b5f57d6547f8d3e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/60dd1d4ab8434282b5f57d6547f8d3e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/60dd1d4ab8434282b5f57d6547f8d3e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 11 07:23:33.669963 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant: tempest-TestVolumeBootPattern-1740065613 Oct 11 07:23:33.669963 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Id: 60dd1d4ab8434282b5f57d6547f8d3e9 Oct 11 07:23:33.669963 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-Tenant-Name: tempest-TestVolumeBootPattern-1740065613 Oct 11 07:23:33.669963 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User: tempest-TestVolumeBootPattern-1740065613-project Oct 11 07:23:33.669963 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Id: default Oct 11 07:23:33.669963 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Domain-Name: Default Oct 11 07:23:33.669963 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Id: 52173fbead6e4b499a99a6979c9a9898 Oct 11 07:23:33.669963 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: X-User-Name: tempest-TestVolumeBootPattern-1740065613-project Oct 11 07:23:33.669963 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: method: > Oct 11 07:23:33.669963 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: exception: Instance 0bb04c29-c281-4fe5-8196-947a769f6e41 could not be found. Oct 11 07:23:33.669963 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: action_args: {'id': '0bb04c29-c281-4fe5-8196-947a769f6e41'} Oct 11 07:23:33.670756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: {{(pid=125266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 07:23:33.670756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:23:33.670756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 07:23:33.670756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 07:23:33.670756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 07:23:33.670756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 07:23:33.670756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 07:23:33.670756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 07:23:33.670756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 07:23:33.670756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 07:23:33.670756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bb04c29-c281-4fe5-8196-947a769f6e41 could not be found. Oct 11 07:23:33.670756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:23:33.670756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:23:33.670756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:23:33.670756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:23:33.670756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:23:33.670756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:23:33.670756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 07:23:33.670756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 07:23:33.670756 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 07:23:33.672144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 07:23:33.672144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 07:23:33.672144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 07:23:33.672144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 07:23:33.672144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 07:23:33.672144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 07:23:33.672144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 07:23:33.672144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bb04c29-c281-4fe5-8196-947a769f6e41 could not be found. Oct 11 07:23:33.672144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:23:33.672144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 07:23:33.672144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:23:33.672144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 07:23:33.672144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 07:23:33.672144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 07:23:33.672144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 07:23:33.672144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 07:23:33.672144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bb04c29-c281-4fe5-8196-947a769f6e41 could not be found. Oct 11 07:23:33.672144 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: ERROR nova.api.openstack.wsgi Oct 11 07:23:33.673375 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: DEBUG nova.api.openstack.wsgi [None req-125ae1a6-b691-433c-92b1-01e62439a6f3 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Returning 404 to user: Instance 0bb04c29-c281-4fe5-8196-947a769f6e41 could not be found. {{(pid=125266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 07:23:33.673375 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: INFO nova.api.openstack.requestlog [None req-125ae1a6-b691-433c-92b1-01e62439a6f3 tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41" status: 404 len: 111 microversion: 2.1 time: 0.030389 Oct 11 07:23:33.673375 dv-cinder-854954-3-iscsi devstack@n-api.service[125266]: [pid: 125266|app: 0|req: 1785/3567] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Oct 11 07:23:33 2022] GET /compute/v2.1/servers/0bb04c29-c281-4fe5-8196-947a769f6e41 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 07:23:34.959157 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: DEBUG nova.api.openstack.wsgi [None req-c92ead58-5ac9-4853-a7f7-b48284ea89fd tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] Calling method '.version_select at 0x7f8e2a54e430>' {{(pid=125267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 07:23:34.963631 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c92ead58-5ac9-4853-a7f7-b48284ea89fd tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [9118c09c-d25a-4df3-9abf-bc5a09ce8823] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 07:23:35.971462 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO oslo.messaging._drivers.impl_rabbit [None req-c92ead58-5ac9-4853-a7f7-b48284ea89fd tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] [9118c09c-d25a-4df3-9abf-bc5a09ce8823] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 53828. Oct 11 07:23:35.990141 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: INFO nova.api.openstack.requestlog [None req-c92ead58-5ac9-4853-a7f7-b48284ea89fd tempest-TestVolumeBootPattern-1740065613 tempest-TestVolumeBootPattern-1740065613-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-999822900" status: 202 len: 0 microversion: 2.1 time: 1.034728 Oct 11 07:23:35.990937 dv-cinder-854954-3-iscsi devstack@n-api.service[125267]: [pid: 125267|app: 0|req: 1783/3568] 10.222.0.39 () {58 vars in 1260 bytes} [Tue Oct 11 07:23:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-999822900 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)